Commits

Breadcrumbs

History for

ontemplate-src

User selector

All users

All time

Commit History

Commits on Mar 18, 2025

• feat: Add `statistics_log_format` parameter to `BasicCrawler` (#1061)

  Show description for 635ae4a
  Mantisus

  authored
  635ae4a

  Copy full SHA for 635ae4a

Commits on Mar 7, 2025

• feat: Use fingerprint generator in `PlaywrightCrawler` by default (#1060)

  Show description for 09cec53
  

  Pijukatel

  and

  vdusek

  authored
  09cec53

  Copy full SHA for 09cec53

Commits on Mar 3, 2025

• refactor!: move `cli` dependencies to optional dependencies (#1011)

  Show description for 4382959
  Mantisus

  authored
  4382959

  Copy full SHA for 4382959

• chore: upgrade to Ruff v0.9 (#1026)

  Show description for 55e287f
  vdusek

  authored
  55e287f

  Copy full SHA for 55e287f

Commits on Feb 28, 2025

• refactor!: update status code handling (#1028)

  Show description for 6b59471
  Mantisus

  authored
  6b59471

  Copy full SHA for 6b59471

Commits on Feb 25, 2025

• refactor!: Replace enum with literal for `EnqueueStrategy` (#1019)

  Show description for d2481ef
  vdusek

  authored
  d2481ef

  Copy full SHA for d2481ef

• refactor!: change `Session` cookies from `dict` to `SessionCookies` with `CookieJar` (#984)

  Show description for 6523b3a
  Mantisus

  authored
  6523b3a

  Copy full SHA for 6523b3a

• refactor!: сhange default `incognito context` to `persistent context` for `Playwright` (#985)

  Show description for f01520d
  Mantisus

  authored
  f01520d

  Copy full SHA for f01520d

Commits on Feb 19, 2025

• feat!: Enable additional status codes arguments to PlaywrightCrawler (#959)

  Show description for 87cf446
  Pijukatel

  authored
  87cf446

  Copy full SHA for 87cf446

Commits on Feb 18, 2025

• chore(deps): update curl-impersonate to 0.9 (#986)

  Show description for a3a2b4f
  Mantisus

  authored
  a3a2b4f

  Copy full SHA for a3a2b4f

• feat: Add adaptive context helpers (#964)

  Show description for e248f17
  

  Pijukatel

  and

  janbuchar

  authored
  e248f17

  Copy full SHA for e248f17

Commits on Feb 12, 2025

• refactor!: remove Base prefix from abstract class names (#980)

  Show description for 8ccb5d4
  vdusek

  authored
  8ccb5d4

  Copy full SHA for 8ccb5d4

• chore: rm Apify as optional dependecy (#982)

  vdusek

  authored
  39a26e2

  Copy full SHA for 39a26e2

• refactor!: remove unused config properties (#978)

  Show description for 4b7fe29
  vdusek

  authored
  4b7fe29

  Copy full SHA for 4b7fe29

• docs: Add anti-blocking guide (#961)

  Show description for 207c983
  Pijukatel

  authored
  207c983

  Copy full SHA for 207c983

Commits on Feb 11, 2025

• docs: Set line length to docs related code to 90 (#973)

  Show description for a2e8496
  Pijukatel

  authored
  a2e8496

  Copy full SHA for a2e8496

Commits on Feb 7, 2025

• feat: Add AdaptivePlaywrightCrawler (#872)

  Show description for 5ba70b6
  

  Pijukatel

  and

  janbuchar

  authored
  5ba70b6

  Copy full SHA for 5ba70b6

Commits on Feb 5, 2025

• feat: Integrate browserforge fingerprints (#829)

  Show description for 2b156b4
  

  3 peopleauthored
  2b156b4

  Copy full SHA for 2b156b4

Commits on Jan 30, 2025

• docs: update setting up and running in cloud (#936)

  Show description for 2f9dae4
  vdusek

  authored
  2f9dae4

  Copy full SHA for 2f9dae4

Commits on Jan 27, 2025

• feat: add `transform_request_function` for `enqueue_links` (#923)

  Show description for 6b15957
  

  3 peopleauthored
  6b15957

  Copy full SHA for 6b15957

Commits on Jan 23, 2025

• feat: add `block_requests` helper for `PlaywrightCrawler` (#919)

  Show description for 1030459
  

  Mantisus

  and

  vdusek

  authored
  1030459

  Copy full SHA for 1030459

Commits on Jan 22, 2025

• feat: Add keep_alive flag to `crawler.__init__` (#921)

  Show description for 7a82d0c
  Pijukatel

  authored
  7a82d0c

  Copy full SHA for 7a82d0c

Commits on Jan 20, 2025

• docs: fix typo (#920)

  Show description for 5a7158e
  Mantisus

  authored
  5a7158e

  Copy full SHA for 5a7158e

Commits on Jan 17, 2025

• docs: add guide for PlaywrightCrawler and BrowserPool (#916)

  Show description for cfd5dda
  

  Mantisus

  and

  vdusek

  authored
  cfd5dda

  Copy full SHA for cfd5dda

• docs: Fix Playwright + Camoufox code example (#915)

  Show description for 5fc027a
  vdusek

  authored
  5fc027a

  Copy full SHA for 5fc027a

Commits on Jan 16, 2025

• docs: Update API docs of public components (#914)

  Show description for 3886b73
  vdusek

  authored
  3886b73

  Copy full SHA for 3886b73

• docs: Fix code sample on home page (#913)

  Show description for 6940af4
  vdusek

  authored
  6940af4

  Copy full SHA for 6940af4

Commits on Jan 15, 2025

• docs: update request loaders & storages guide (#904)

  vdusek

  authored
  dea6ca3

  Copy full SHA for dea6ca3

Commits on Jan 10, 2025

• docs: Add Storages & Request loaders guides (#896)

  Show description for 5d689f6
  vdusek

  authored
  5d689f6

  Copy full SHA for 5d689f6

Commits on Jan 6, 2025

• docs: add session management guide (#795)

  Show description for beac9fa
  

  Mantisus

  and

  vdusek

  authored
  beac9fa

  Copy full SHA for beac9fa

Commits on Jan 2, 2025

• chore: Fix new dir structure-related issues (#854)

  vdusek

  authored
  9a0725b

  Copy full SHA for 9a0725b

Commits on Dec 20, 2024

• refactor!: Update the crawlers & storage clients structure (#828)

  Show description for 0ba04d1
  vdusek

  authored
  0ba04d1

  Copy full SHA for 0ba04d1

• refactor!: Rename PlaywrightCrawler kwargs: browser_options, page_options (#831)

  Show description for ffc6048
  

  Pijukatel

  and

  vdusek

  authored
  ffc6048

  Copy full SHA for ffc6048

Commits on Dec 19, 2024

• feat!: Implement `RequestManagerTandem`, remove `add_request` from `RequestList`, accept any iterable in `RequestList` constructor (#777)

  Show description for 4172652
  

  janbuchar

  and

  vdusek

  authored
  4172652

  Copy full SHA for 4172652

• refactor!: Rename PwPreNavContext to PwPreNavCrawlingContext (#827)

  Show description for 84b61a3
  vdusek

  authored
  84b61a3

  Copy full SHA for 84b61a3