Research intelligence for CS/AI papers — track what matters, who drives it, what to read first.
Stop skimming paper lists. ResearchScope scores, tags, and surfaces the papers that actually move your field.
ResearchScope is an open research intelligence dashboard for computer science and AI papers. A GitHub Actions pipeline runs daily, fetches papers from arXiv (all 19 cs.* categories) and 20+ major conferences (NeurIPS, ICML, ICLR, CVPR, ACL, KDD, AAAI, SIGIR, and more), enriches them with multi-signal scores, detects research gaps, and persists everything to a Supabase PostgreSQL database. The frontend is hosted on GitHub Pages and queries Supabase directly — no file-size caps, no rolling windows, no limits.
| Date | Highlight |
|---|---|
| May 2026 | 60,000+ Papers — Expanded conference coverage: ICML (2020–25), AISTATS, UAI, CVPR (2021–25), ICCV, ECCV, ICLR/NeurIPS (2022+), plus S2 bulk fetch for AAAI, IJCAI, KDD, WWW, SIGIR, WSDM, CHI, SIGMOD, ICSE. Conference JSON cap raised to 20,000; Supabase stores all. |
| May 2026 | Supabase Backend — All papers, authors, topics, gaps, and labs live in a Supabase PostgreSQL database. Every page queries Supabase directly — no file-size caps, no rolling windows. The full dataset is always browsable. |
| May 2026 | Full Dataset Access — The papers browser now shows all papers with server-side filtering and pagination. Search covers the entire database live. |
| Apr 2026 | CiteLens Integration — Every arXiv paper card now has an "🔍 Analyze citations" button that opens CiteLens with the paper pre-loaded to see who cited it and why it mattered. |
| Apr 2026 | Topic Network Graph — Interactive force-directed graph on the Topics page visualising relationships between 80+ research areas. |
| Apr 2026 | Institution & Author Prestige Scoring — Papers from top labs (OpenAI, DeepMind, Google Research, MIT, Stanford…) and renowned researchers get a scoring boost. |
| Apr 2026 | Conference Papers Database — Permanent store covering NeurIPS, ICML, ICLR, CVPR, ICCV, ECCV, ACL, EMNLP, NAACL and more. Conference papers never expire. |
| Mar 2026 | My Library — Save papers to a browser-local personal library (localStorage). No account required. |
| Mar 2026 | Conference Recommender — Paste a title and abstract to get ranked venue matches with deadlines and reviewer expectations. |
| Feature | Description |
|---|---|
| 📄 Paper intelligence | 60,000+ arXiv + conference papers scored by recency, venue rank, author prestige, and novelty |
| 🗄 Supabase backend | Full dataset stored in PostgreSQL — no caps, no rolling windows, server-side filtering and search |
| 🔍 Analyze citations | One-click handoff to CiteLens to see who cited any arXiv paper, ranked by impact |
| 👩🔬 Author & lab intelligence | Track 5,000+ prolific authors and their momentum scores; lab and university output profiles |
| 🗺 Topic network graph | Interactive graph of 80+ research areas with reading packs by difficulty |
| 🕳 Research gap explorer | Surface under-explored areas across 3 gap types: explicit, pattern-detected, and starter ideas |
| 🎯 Conference recommender | Paste title + abstract → ranked venue matches with acceptance context |
| 📚 My Library | Personal browser-local paper saves with FIFO ordering, persistent across reloads |
| ⚡ Live search | Global search queries Supabase directly — results from the full 60,000+ paper dataset |
ResearchScope and CiteLens are companion tools that cover the full research workflow:
ResearchScope ──── "Here's a paper worth reading today"
│
🔍 Analyze citations
│
▼
CiteLens ──────── "Here's who cited it and why it mattered"
│
🔭 Browse topic in ResearchScope
│
▼
ResearchScope ──── "Discover more papers on this topic"
- ResearchScope → CiteLens: click "🔍 Analyze citations" on any arXiv paper card
- CiteLens → ResearchScope: click "🔭 ResearchScope" on any citing paper result
Both tools share the same SEMANTIC_SCHOLAR_API_KEY secret — one key covers both projects.
| Source | Content | Update frequency |
|---|---|---|
| arXiv (OAI-PMH) | All cs.* preprints — 19 CoRR categories | Daily |
| ACL Anthology | ACL, EMNLP, NAACL, EACL, COLING, TACL (2020+) | Monthly |
| OpenReview | ICLR (2022–25), NeurIPS (2022–24), COLM (2024–25) | Monthly |
| PMLR | ICML (2020–25), AISTATS (2021–25), UAI (2021–24) | Monthly |
| CVF | CVPR (2021–25), ICCV (2021+23), ECCV (2020+22+24) | Monthly |
| Semantic Scholar | AAAI, IJCAI, KDD, WWW, SIGIR, WSDM, CHI, SIGMOD, ICSE (2021–24) + affiliation enrichment | Monthly |
┌─────────────────────────────────────────────────────────┐
│ GitHub Actions │
│ (daily weekdays + monthly conference sync) │
│ │
│ src/pipeline.py — 11 sequential stages │
│ ├── connectors/ arXiv · ACL · OpenReview · PMLR │
│ │ CVF · Semantic Scholar │
│ ├── dedup/ Jaccard title-similarity dedup │
│ ├── tagging/ 80+ topic tags + paper_type │
│ ├── difficulty/ L1–L4 reading level │
│ ├── scoring/ 4 scores + author momentum │
│ ├── content/ summaries, tweets, LinkedIn posts │
│ ├── clustering/ topic grouping │
│ ├── gaps/ 3-layer research gap extraction │
│ ├── aggregation/ author, lab, university profiles │
│ └── sitegen/ → data/*.json + Supabase upsert │
└───────────────┬──────────────────────┬──────────────────┘
│ commits + deploys │ upserts all data
▼ ▼
site/ (GitHub Pages) Supabase PostgreSQL
index.html papers (60,000+, no cap)
papers.html authors (5,000+)
topics.html topics (150+)
authors.html gaps (100+)
labs.html labs (unlimited)
gaps.html
conferences.html ▲
deadlines.html │ REST API (anon key)
digest.html │
library.html Frontend queries Supabase
search.html directly for all live data
conference-recommender.html
.github/workflows/
update.yml # daily pipeline + Pages deploy (weekdays)
conference-sync.yml # monthly full conference sync
backfill.yml # manual historical backfill
discord-potd.yml # daily Paper of the Day → Discord
src/
pipeline.py # 11-stage orchestrator
connectors/ # arXiv, ACL, OpenReview, PMLR, CVF, S2
dedup/ # Jaccard title deduplication
tagging/ # 80+ topic tags + paper_type
difficulty/ # L1–L4 difficulty assessor
scoring/ # 4 scores + author momentum scorer
content/ # rule-based content enrichment
clustering/ # topic clustering
gaps/ # 3-layer gap extractor
aggregation/ # author, lab, university builder
sitegen/ # JSON writer + conference recommender
storage/
supabase_store.py # upserts all data to Supabase after each run
supabase/
schema.sql # PostgreSQL schema (run once in Supabase dashboard)
scripts/
discord_potd.py # Paper of the Day → Discord webhook
migrate_to_supabase.py # one-time migration of existing JSON data
site/
index.html # homepage
papers.html # paper browser — queries Supabase (all papers)
topics.html # topic browser + interactive network graph
authors.html / labs.html / gaps.html / conferences.html
deadlines.html / digest.html / library.html / search.html
conference-recommender.html
assets/css/
assets/js/
app.js # shared utilities
supabase-client.js # Supabase query helpers (anon key, public)
library.js / library-page.js / topic-graph.js
config/
topics.yaml # topic taxonomy
weights.yaml # tuneable score weights
venues.yaml # conference registry with ranks
data/ # generated JSON (committed by CI, fast fallback)
tests/ # pytest suite (110+ tests)
# Clone and install
git clone https://github.com/kishormorol/ResearchScope.git
cd ResearchScope
python -m venv .venv
source .venv/bin/activate # Windows: .venv\Scripts\activate
pip install -r requirements.txt
# Run the pipeline locally (writes JSON to data/)
python src/pipeline.py
# Run tests
python -m pytest tests/ -v
# Serve the site locally
cd site && python -m http.server 8080| Variable | Required | Description |
|---|---|---|
SUPABASE_URL |
Yes | Your Supabase project URL (e.g. https://xxx.supabase.co). Add as a GitHub Actions secret. |
SUPABASE_SERVICE_ROLE_KEY |
Yes | Supabase service role key — grants write access for the pipeline. Add as a GitHub Actions secret. |
SUPABASE_ANON_KEY |
Frontend only | Public anon key used by the browser. Already embedded in supabase-client.js. |
SEMANTIC_SCHOLAR_API_KEY |
Optional | Raises S2 rate limit from 1 req/s to 10 req/s. Add as a GitHub Actions secret. |
OPENAI_API_KEY |
Optional | Enables AI-generated summaries and content fields. |
ANTHROPIC_API_KEY |
Optional | Alternative to OpenAI for content generation. |
DISCORD_WEBHOOK_URL |
Optional | Enables daily Paper of the Day posts to a Discord channel. |
- Create a free project at supabase.com.
- Go to SQL Editor and run the contents of
supabase/schema.sqlto create all tables. - Add
SUPABASE_URLandSUPABASE_SERVICE_ROLE_KEYas GitHub Actions secrets. - Run the one-time migration to populate existing data:
pip install supabase export SUPABASE_URL=https://xxx.supabase.co export SUPABASE_SERVICE_ROLE_KEY=eyJ... python scripts/migrate_to_supabase.py
The workflow in .github/workflows/update.yml:
- Runs the Python pipeline to fetch and process papers.
- Commits updated JSON files to
data/. - Uploads the
site/folder as a GitHub Pages artifact and deploys it.
To enable Pages for a fork: go to Settings → Pages and set the source to GitHub Actions.
| Tool | Free | Open source | Daily updates | Research gaps | Conference deadlines | No sign-up |
|---|---|---|---|---|---|---|
| ResearchScope | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| Arxiv Sanity | ✅ | ✅ | ✅ | ❌ | ❌ | ✅ |
| Papers With Code | ✅ | ❌ | ✅ | ❌ | ❌ | ✅ |
| Semantic Scholar | ✅ | ❌ | ✅ | ❌ | ❌ | ✅ |
| Elicit | Partial | ❌ | ❌ | ❌ | ❌ | ❌ |
| Consensus | Partial | ❌ | ❌ | ❌ | ❌ | ❌ |
ResearchScope is the only fully free, open-source dashboard that combines daily paper rankings, research gap detection, conference deadlines, and citation analysis in one place — backed by a real database with no paper caps.
See CONTRIBUTING.md for guidelines.
| Source | What we use | License |
|---|---|---|
| arXiv | Paper metadata via OAI-PMH | Metadata: CC0 (public domain) |
| ACL Anthology | NLP/CL paper metadata | 2016+: CC BY 4.0 |
| PMLR | ICML proceedings metadata | CC BY 4.0 |
| Semantic Scholar | Conference metadata + affiliations | S2 API License |
| OpenReview | ICLR, NeurIPS, COLM papers | Public API |
| CVF | CVPR, ICCV, ECCV papers | Public access |
ResearchScope stores only bibliographic metadata. No full text or PDFs are stored or redistributed.
| Contributor | GitHub | Role |
|---|---|---|
| Md Kishor Morol | @kishormorol | Project lead · architecture · pipeline |
| Shadril Hassan | @shadril238 | Topic network graph |
| Saad Chowdhury | @0Sa-ad0 | Contributor |
Want to contribute? See CONTRIBUTING.md.
MIT © 2026 Md Kishor Morol
