Commits

Branch selector

 main

User selector

All users

All time

Commit History

Commits on Feb 2, 2026

• Merge pull request #23 from commoncrawl/laurie/aws-removal

  Show description for 08dcfbe
  laurieburchell

  authored
  08dcfbe

  Copy full SHA for 08dcfbe

Commits on Jan 27, 2026

• docs: remove mention of S3 from title

  laurieburchell

  committed
  05a3ce7

  Copy full SHA for 05a3ce7

• feat: remove references to steps needing S3 authentication

  laurieburchell

  committed
  b1d1445

  Copy full SHA for b1d1445

Commits on Dec 31, 2025

• Merge pull request #21 from commoncrawl/gzip-advice

  Show description for aabebc0
  laurieburchell

  authored
  aabebc0

  Copy full SHA for aabebc0

• doc: explain the one weird trick of warc gzip

  

  Greg Lindahl

  committed
  bb4e3ca

  Copy full SHA for bb4e3ca

Commits on Nov 20, 2025

• Merge pull request #20 from commoncrawl/hande/add-ref-to-notebook

  Show description for de1d7c4
  handecelikkanat

  authored
  de1d7c4

  Copy full SHA for de1d7c4

Commits on Nov 17, 2025

• doc: Fix overloaded `extract`; polish CDXT examples (#18)

  damian0815

  authored
  561a702

  Copy full SHA for 561a702

Commits on Nov 10, 2025

• feat: add reference to whirlwind notebook repo

  handecelikkanat

  committed
  53d81b5

  Copy full SHA for 53d81b5

Commits on Oct 16, 2025

• Merge pull request #19 from commoncrawl/hande/fix-CI-py38

  Show description for b786c75
  handecelikkanat

  authored
  b786c75

  Copy full SHA for b786c75

Commits on Oct 15, 2025

• fix(CI): Drop EOL py3.8

  handecelikkanat

  committed
  090af88

  Copy full SHA for 090af88

Commits on Oct 10, 2025

• Fix: Update README to match Makefile command (#17)

  damian0815

  authored
  f8dc317

  Copy full SHA for f8dc317

Commits on Jul 29, 2025

• docs: Added some diagrams and an extra bonus exercise

  Show description for 2c99dab
  dalhuijsen

  authored
  2c99dab

  Copy full SHA for 2c99dab

Commits on Jun 30, 2025

• docs: extend section on web graphs (#15)

  laurieburchell

  authored
  f630817

  Copy full SHA for f630817

Commits on Jun 10, 2025

• docs: rewrite Whirlwind Tour README

  laurieburchell

  authored
  a1b9275

  Copy full SHA for a1b9275

Commits on Jun 7, 2025

• chore: fix CI: raise min versions, get windows working

  wumpus

  authored
  ed7037d

  Copy full SHA for ed7037d

• new ubuntu-latest does not have 3.14; turn on windows

  

  Greg Lindahl

  committed
  ef0e82d

  Copy full SHA for ef0e82d

Commits on Dec 26, 2024

• try macos/windows CI (#12)

  wumpus

  authored
  8cb59eb

  Copy full SHA for 8cb59eb

• have .editorconfig control .yaml editing

  

  Greg Lindahl

  committed
  96bf032

  Copy full SHA for 96bf032

• add CI action; refactor; error handling to make CI reliable

  wumpus

  authored
  6ca98e6

  Copy full SHA for 6ca98e6

Commits on Dec 25, 2024

• Expand the home directory path before searching for the warc.parquet files

  

  silentninja

  authored and

  wumpus

  committed
  1bb8b03

  Copy full SHA for 1bb8b03

Commits on Nov 12, 2024

• doc: improve readability of readme (#6)

  tawandamoyo

  authored
  da9c01e

  Copy full SHA for da9c01e

Commits on Oct 26, 2024

• doc: add wreck the warc output

  

  Greg Lindahl

  committed
  a7b2837

  Copy full SHA for a7b2837

• doc: update instructions, add example output to readme, etc

  

  Greg Lindahl

  committed
  c10f363

  Copy full SHA for c10f363

Commits on Jul 5, 2024

• bug: fixes and doc:stuff

  Show description for 29983d1
  

  3 peopleauthored
  29983d1

  Copy full SHA for 29983d1

• bug: missing requirement

  

  Greg Lindahl

  committed
  5e02863

  Copy full SHA for 5e02863

• ...

  

  Greg Lindahl

  committed
  b25fada

  Copy full SHA for b25fada

• do not trigger our hairtrigger fail2ban

  

  Greg Lindahl

  committed
  8cf8ed0

  Copy full SHA for 8cf8ed0

Commits on Jul 2, 2024

• Adds cdxj-indexer to requirements.txt

  jasonculverhouse

  committed
  cf4a156

  Copy full SHA for cf4a156

Commits on Jun 23, 2024

• Merge pull request #1 from commoncrawl/readme-cleanup

  Show description for e262b51
  wumpus

  authored
  e262b51

  Copy full SHA for e262b51

• fix: various typos and clarifications

  thunderpoot

  committed
  6dbc8dd

  Copy full SHA for 6dbc8dd

• feat: tour using python

  

  Greg Lindahl

  committed
  b950e74

  Copy full SHA for b950e74

• Initial commit

  wumpus

  authored
  ff0c7d2

  Copy full SHA for ff0c7d2