Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit History

Commits on Mar 2, 2023

• feat: Expose Wikipedia `auto_suggest` argument to the ingest CLI (#336)

  Show description for f5af87a
  tomaarsen

  authored
  f5af87a

  Copy full SHA for f5af87a

• fix: ensure all text is maintained in html output (#335)

  Show description for a5da3de
  MthwRobinson

  authored
  a5da3de

  Copy full SHA for a5da3de

Commits on Mar 1, 2023

• fix: set through env to avoid interpretation as command (#329)

  Show description for ed074b5
  qued

  authored
  ed074b5

  Copy full SHA for ed074b5

• feat: improve caching mechanism for `download_dir` on ingest (#314)

  Show description for 707f92f
  alvarobartt

  authored
  707f92f

  Copy full SHA for 707f92f

• refactor: For S3 Ingest, write to file directly using `json.dump` (#312)

  Show description for 95109db
  tomaarsen

  authored
  95109db

  Copy full SHA for 95109db

• bump: release commit (#317)

  Show description for a6f8256
  cragwolfe

  authored
  a6f8256

  Copy full SHA for a6f8256

Commits on Feb 28, 2023

• fix: Remove JavaScript from HTML reader output (#313)

  Show description for 350c423
  tomaarsen

  authored
  350c423

  Copy full SHA for 350c423

• Fix: Resolve several issues with the require dependencies decorator (#315)

  Show description for 1ccbc05
  tomaarsen

  authored
  1ccbc05

  Copy full SHA for 1ccbc05

• fix: track narrative text and figure captions in HTML documents (#309)

  Show description for 6966178
  MthwRobinson

  authored
  6966178

  Copy full SHA for 6966178

• feat: add `requires_dependencies` decorator (#302)

  Show description for e52dd5c
  alvarobartt

  authored
  e52dd5c

  Copy full SHA for e52dd5c

• feat: Add Wikipedia ingest connector (#299)

  Show description for 54a6db1
  tomaarsen

  authored
  54a6db1

  Copy full SHA for 54a6db1

• fix: `process_document` behavior when exception is raised (#298)

  alvarobartt

  authored
  a74d389

  Copy full SHA for a74d389

• build(deps): make pip-compile (#307)

  Show description for c7eba16
  cragwolfe

  authored
  c7eba16

  Copy full SHA for c7eba16

• build: Release commit for version 0.4.16 (#305)

  cragwolfe

  authored
  5eaf449

  Copy full SHA for 5eaf449

Commits on Feb 27, 2023

• feat: Add GitHub data connector; add Markdown partitioner (#284)

  tomaarsen

  authored
  ded60af

  Copy full SHA for ded60af

• Resolve various style issues to improve overall code quality (#282)

  Show description for 5eb1466
  tomaarsen

  authored
  5eb1466

  Copy full SHA for 5eb1466

• feat: Add Reddit ingest connector (#293)

  Show description for 486c798
  tomaarsen

  authored
  486c798

  Copy full SHA for 486c798

Commits on Feb 26, 2023

• fix: Ingest main: actually initialize the connector (#285)

  cragwolfe

  authored
  0a51f28

  Copy full SHA for 0a51f28

Commits on Feb 25, 2023

• feat: add ubuntu setup script (#279)

  qued

  authored
  a79b365

  Copy full SHA for a79b365

• Resolve numerous typos (#280)

  Show description for 9062d25
  tomaarsen

  authored
  9062d25

  Copy full SHA for 9062d25

Commits on Feb 24, 2023

• feat: detect filetype with extension if libmagic is unavailable (#268)

  Show description for 956f04d
  

  firedragonironfist

  and

  MthwRobinson

  authored
  956f04d

  Copy full SHA for 956f04d

Commits on Feb 23, 2023

• fix: preserve all elements when serialized; feat: helper functions for serialization (#273)

  Show description for 0d229f0
  MthwRobinson

  authored
  0d229f0

  Copy full SHA for 0d229f0

• build(deps): automatically download `nltk` models when required (#246)

  Show description for 354eff1
  MthwRobinson

  authored
  354eff1

  Copy full SHA for 354eff1

• fix: Adds missing __init__.py (#259)

  cragwolfe

  authored
  83f0454

  Copy full SHA for 83f0454

• build: new release (#249)

  Show description for 80c0fab
  cragwolfe

  authored
  80c0fab

  Copy full SHA for 80c0fab

• feat: add allow custom parsers in partition_html (#251)

  Show description for 60abac2
  

  asai95

  and

  Viktor Zhemchuzhnikov

  authored
  60abac2

  Copy full SHA for 60abac2

Commits on Feb 22, 2023

• refactor: move processing logic to IngestDoc (#248)

  Show description for 1b8bf31
  cragwolfe

  authored
  1b8bf31

  Copy full SHA for 1b8bf31

Commits on Feb 21, 2023

• refactor: break up logic from one line to 2 (#247)

  Show description for 69acb08
  cragwolfe

  authored
  69acb08

  Copy full SHA for 69acb08

• feat: Ingest refactors, doc updates (#243)

  Show description for 87fd0d0
  cragwolfe

  authored
  87fd0d0

  Copy full SHA for 87fd0d0

Commits on Feb 17, 2023

• feat: add `partition_ppt` for older power point docs (#238)

  Show description for 601f250
  MthwRobinson

  authored
  601f250

  Copy full SHA for 601f250

• feat: add `partition_doc` for `.doc` files (#236)

  Show description for 6036af3
  MthwRobinson

  authored
  6036af3

  Copy full SHA for 6036af3

Commits on Feb 16, 2023

• fix: `ElementMetadata` serializes when the filename is a `Path` object (#233)

  MthwRobinson

  authored
  f5ff140

  Copy full SHA for f5ff140

• feat: Ingest CLI flags and test fixture updates (#227)

  Show description for 3c1b089
  cragwolfe

  authored
  3c1b089

  Copy full SHA for 3c1b089

Commits on Feb 15, 2023

• feat: add metadata tracking to document elements (#225)

  Show description for 74e6b84
  MthwRobinson

  authored
  74e6b84

  Copy full SHA for 74e6b84

• feat: ability to skip English language specific checks with env var (#224)

  Show description for 558ee63
  MthwRobinson

  authored
  558ee63

  Copy full SHA for 558ee63