Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Jul 29, 2025

• fix!: Remove unused "stats" field from RequestQueueMetadata (#1331)

  Show description for 0a63bef
  vdusek

  authored
  0a63bef

  Copy full SHA for 0a63bef

Commits on Jul 25, 2025

• docs: Add `impit` to upgrade guide (#1323)

  Show description for 480312d
  Mantisus

  authored
  480312d

  Copy full SHA for 480312d

• refactor!: Replace `HttpxHttpClient` with `ImpitHttpClient` as default HTTP client (#1307)

  Show description for c803a97
  Mantisus

  authored
  c803a97

  Copy full SHA for c803a97

Commits on Jul 23, 2025

• docs: switch from pipx to uvx (#1319)

  vdusek

  authored
  7d928fd

  Copy full SHA for 7d928fd

Commits on Jul 21, 2025

• docs: Add guide about integrating Stagehand (#1290)

  Show description for 439d81e
  Mantisus

  authored
  439d81e

  Copy full SHA for 439d81e

Commits on Jul 18, 2025

• docs: Add architecture overview guide and more (#1306)

  Show description for c560850
  vdusek

  authored
  c560850

  Copy full SHA for c560850

Commits on Jul 11, 2025

• feat: Add basic `OpenTelemetry` instrumentation (#1255)

  Show description for a92d8b3
  

  Pijukatel

  and

  vdusek

  authored
  a92d8b3

  Copy full SHA for a92d8b3

Commits on Jul 10, 2025

• refactor!: Change method `HttpResponse.read` from sync to async (#1296)

  Show description for 83fa8a4
  Mantisus

  authored
  83fa8a4

  Copy full SHA for 83fa8a4

Commits on Jul 3, 2025

• docs: Add guide about creating and using WARC files with `Crawlee` (#1273)

  Show description for abe0f52
  

  3 peopleauthored
  abe0f52

  Copy full SHA for abe0f52

• refactor!: Split `BrowserType` literal into two different literals based on context (#1070)

  Show description for 72b5698
  Pijukatel

  authored
  72b5698

  Copy full SHA for 72b5698

Commits on Jul 2, 2025

• feat: add periodic status logging and `status_message_callback` parameter for customization (#1265)

  Show description for b992fb2
  Mantisus

  authored
  b992fb2

  Copy full SHA for b992fb2

• chore: Bump minimum Python version to 3.10 (#1281)

  Show description for e5d0fdf
  vdusek

  authored
  e5d0fdf

  Copy full SHA for e5d0fdf

Commits on Jul 1, 2025

• feat: add utility for load and parse Sitemap and `SitemapRequestLoader` (#1169)

  Show description for 66599f8
  Mantisus

  authored
  66599f8

  Copy full SHA for 66599f8

• refactor!: Introduce new storage client system (#1194)

  Show description for de1c03f
  vdusek

  authored
  de1c03f

  Copy full SHA for de1c03f

Commits on May 2, 2025

• feat: add `on_skipped_request` decorator, to process links skipped according to `robots.txt` rules (#1166)

  Show description for bd16f14
  

  4 peopleauthored
  bd16f14

  Copy full SHA for bd16f14

Commits on Apr 29, 2025

• docs: Add guide for running crawler in web server (#1174)

  Show description for ec2dd15
  Pijukatel

  authored
  ec2dd15

  Copy full SHA for ec2dd15

Commits on Apr 24, 2025

• feat: add `respect_robots_txt_file` option (#1162)

  Show description for c23f365
  

  4 peopleauthored
  c23f365

  Copy full SHA for c23f365

• docs: add guide about error handling (#1149)

  Show description for 65dc880
  

  Mantisus

  and

  vdusek

  authored
  65dc880

  Copy full SHA for 65dc880

• docs: add GCP Cloud Run deployment guide (#1167)

  Show description for 3121f44
  Mantisus

  authored
  3121f44

  Copy full SHA for 3121f44

Commits on Apr 10, 2025

• docs: Add to the documentation guide of login with `HttpCrawler` and `PlaywrightCrawler` (#1142)

  Show description for a01291e
  Mantisus

  authored
  a01291e

  Copy full SHA for a01291e

• docs: add example resume a crawl (#1143)

  Show description for 40edf70
  Mantisus

  authored
  40edf70

  Copy full SHA for 40edf70

Commits on Apr 7, 2025

• feat: Add `ErrorSnapshotter` to `ErrorTracker` (#1125)

  Show description for 9666092
  Pijukatel

  authored
  9666092

  Copy full SHA for 9666092

Commits on Apr 4, 2025

• docs: add deploy guide for google functions (#1078)

  Show description for f457792
  Mantisus

  authored
  f457792

  Copy full SHA for f457792

Commits on Apr 3, 2025

• feat: Add `requests` argument to `EnqueueLinksFunction` (#1024)

  Show description for fc8444c
  Pijukatel

  authored
  fc8444c

  Copy full SHA for fc8444c

• docs: Add "Run on Apify" button (#1127)

  Show description for e7ebda7
  vdusek

  authored
  e7ebda7

  Copy full SHA for e7ebda7

Commits on Mar 31, 2025

• feat: add Session binding capability via `session_id` in `Request` (#1086)

  Show description for cda7b31
  Mantisus

  authored
  cda7b31

  Copy full SHA for cda7b31

Commits on Mar 18, 2025

• feat: Add `statistics_log_format` parameter to `BasicCrawler` (#1061)

  Show description for 635ae4a
  Mantisus

  authored
  635ae4a

  Copy full SHA for 635ae4a

Commits on Mar 7, 2025

• feat: Use fingerprint generator in `PlaywrightCrawler` by default (#1060)

  Show description for 09cec53
  

  Pijukatel

  and

  vdusek

  authored
  09cec53

  Copy full SHA for 09cec53

Commits on Mar 3, 2025

• refactor!: move `cli` dependencies to optional dependencies (#1011)

  Show description for 4382959
  Mantisus

  authored
  4382959

  Copy full SHA for 4382959

• chore: upgrade to Ruff v0.9 (#1026)

  Show description for 55e287f
  vdusek

  authored
  55e287f

  Copy full SHA for 55e287f

Commits on Feb 28, 2025

• refactor!: update status code handling (#1028)

  Show description for 6b59471
  Mantisus

  authored
  6b59471

  Copy full SHA for 6b59471

Commits on Feb 25, 2025

• refactor!: Replace enum with literal for `EnqueueStrategy` (#1019)

  Show description for d2481ef
  vdusek

  authored
  d2481ef

  Copy full SHA for d2481ef

• refactor!: change `Session` cookies from `dict` to `SessionCookies` with `CookieJar` (#984)

  Show description for 6523b3a
  Mantisus

  authored
  6523b3a

  Copy full SHA for 6523b3a

• refactor!: сhange default `incognito context` to `persistent context` for `Playwright` (#985)

  Show description for f01520d
  Mantisus

  authored
  f01520d

  Copy full SHA for f01520d

Commits on Feb 19, 2025

• feat!: Enable additional status codes arguments to PlaywrightCrawler (#959)

  Show description for 87cf446
  Pijukatel

  authored
  87cf446

  Copy full SHA for 87cf446

Pagination

Previous

Next