Commits

Breadcrumbs

History for

onsimplify-request-queue

User selector

All users

All time

Commit History

Commits on Nov 14, 2024

• WIP update is_finished()

  janbuchar

  committed
  87e08b9

  Copy full SHA for 87e08b9

Commits on Nov 13, 2024

• Merge remote-tracking branch 'origin/master' into simplify-request-queue

  janbuchar

  committed
  66b3d8d

  Copy full SHA for 66b3d8d

Commits on Nov 11, 2024

• docs: Add `@docs_group` decorator (#655)

  Show description for 9ce6e14
  

  barjin

  and

  vdusek

  authored
  9ce6e14

  Copy full SHA for 9ce6e14

• fix: Fix BaseDatasetClient.iter_items type hints (#680)

  Show description for a968b1b
  Pijukatel

  authored
  a968b1b

  Copy full SHA for a968b1b

• docs: improve docs of the `Configuration` class (#671)

  Show description for f74a02e
  vdusek

  authored
  f74a02e

  Copy full SHA for f74a02e

• feat: Add BeautifulSoupParser type alias (#674)

  Show description for b2cf88f
  Pijukatel

  authored
  b2cf88f

  Copy full SHA for b2cf88f

• fix: Fix unhandled ValueError in request handler result processing (#666)

  Show description for 0a99d7f
  janbuchar

  authored
  0a99d7f

  Copy full SHA for 0a99d7f

• chore: delete comment about improving error handling in Dataset (#672)

  Show description for c1d8c0b
  Mantisus

  authored
  c1d8c0b

  Copy full SHA for c1d8c0b

Commits on Nov 7, 2024

• chore: make HTTP headers more user friendly (#667)

  Show description for 0690db2
  vdusek

  authored
  0690db2

  Copy full SHA for 0690db2

• fix: Add HttpHeaders to module exports (#664)

  Show description for f0c5ca7
  vdusek

  authored
  f0c5ca7

  Copy full SHA for f0c5ca7

• chore: update identifiers & API docs in `_types` module (#665)

  Show description for c7b1a33
  vdusek

  authored
  c7b1a33

  Copy full SHA for c7b1a33

• fix: Fix total_size usage in memory size monitoring (#661)

  Show description for c2a3239
  janbuchar

  authored
  c2a3239

  Copy full SHA for c2a3239

Commits on Nov 5, 2024

• Do that convoluted memory storage thingy

  janbuchar

  committed
  c2468d0

  Copy full SHA for c2468d0

• Simplify request queue

  janbuchar

  committed
  a2a3b33

  Copy full SHA for a2a3b33

Commits on Nov 4, 2024

• feat: Add `max_crawl_depth` option to `BasicCrawler` (#637)

  Show description for 77deaa9
  Prathamesh010

  authored
  77deaa9

  Copy full SHA for 77deaa9

Commits on Nov 1, 2024

• docs: fix docstring format of typed dicts (#641)

  vdusek

  authored
  b51b0aa

  Copy full SHA for b51b0aa

• chore!: Remove Request.query_params field (#639)

  Show description for 6ec0ec4
  vdusek

  authored
  6ec0ec4

  Copy full SHA for 6ec0ec4

Commits on Oct 31, 2024

• feat: Split and add extra configuration to export_data method (#580)

  Show description for 6751635
  

  6 peopleauthored
  6751635

  Copy full SHA for 6751635

• feat: Add `always_enqueue` option to bypass URL deduplication (#621)

  Show description for 4e59fa4
  

  3 peopleauthored
  4e59fa4

  Copy full SHA for 4e59fa4

Commits on Oct 30, 2024

• feat: Add `pre_navigation_hooks` to `PlaywrightCrawler` (#631)

  Show description for 5dd5b60
  Prathamesh010

  authored
  5dd5b60

  Copy full SHA for 5dd5b60

• docs: Update input arg docstrings of `BasicCrawler` and `EventManager` (#633)

  vdusek

  authored
  f9463e7

  Copy full SHA for f9463e7

Commits on Oct 29, 2024

• fix: Default ProxyInfo port if httpx.URL port is None (#619)

  Show description for 8107a6f
  

  steffansafey

  and

  vdusek

  authored
  8107a6f

  Copy full SHA for 8107a6f

• chore: change ValueError to warning in RQClient for ID mismatch (#623)

  vdusek

  authored
  0be6432

  Copy full SHA for 0be6432

• docs: improve API docs of all crawlers (#624)

  Show description for 8988fe4
  

  vdusek

  and

  janbuchar

  authored
  8988fe4

  Copy full SHA for 8988fe4

Commits on Oct 25, 2024

• chore: update dev deps (#620)

  Show description for 0b4cefa
  vdusek

  authored
  0b4cefa

  Copy full SHA for 0b4cefa

Commits on Oct 24, 2024

• docs: Use renderable docs format for data structures (#617)

  Show description for 4a07dcc
  vdusek

  authored
  4a07dcc

  Copy full SHA for 4a07dcc

• fix!: merge payload and data fields of Request (#542)

  Show description for d06fcef
  vdusek

  authored
  d06fcef

  Copy full SHA for d06fcef

Commits on Oct 23, 2024

• fix: use strip in headers normalization (#614)

  Show description for a15b21e
  vdusek

  authored
  a15b21e

  Copy full SHA for a15b21e

• feat!: Add headers in unique key computation (#609)

  Show description for 6c4746f
  

  Prathamesh010

  and

  vdusek

  authored
  6c4746f

  Copy full SHA for 6c4746f

Commits on Oct 22, 2024

• docs: improve autogenerated API docs (#606)

  Show description for 01f0746
  barjin

  authored
  01f0746

  Copy full SHA for 01f0746

• feat: Added get_public_url method to KeyValueStore (#572)

  Show description for 3a4ba8f
  

  4 peopleauthored
  3a4ba8f

  Copy full SHA for 3a4ba8f

Commits on Oct 14, 2024

• feat: Key-value store context helpers (#584)

  Show description for fc15622
  janbuchar

  authored
  fc15622

  Copy full SHA for fc15622

Commits on Oct 8, 2024

• fix: Workaround for JSON value typing problems (#581)

  Show description for 403496a
  janbuchar

  authored
  403496a

  Copy full SHA for 403496a

Commits on Oct 2, 2024

• fix: Add equality check to UserData model (#562)

  Show description for 899a25c
  janbuchar

  authored
  899a25c

  Copy full SHA for 899a25c

• feat: add new model for `HttpHeaders` (#544)

  Show description for 854f2c1
  vdusek

  authored
  854f2c1

  Copy full SHA for 854f2c1