https://gitdab.com/cobertos/base-data-manager Chomp through data exports (Facebook, Google, wtf ever). Very WIP, do not use Wed, 15 Apr 2026 22:41:18 +0000 https://gitdab.com/cobertos/base-data-manager/commit/ab0a22641423662d3ba0ebdbe0c76a2e2eca7ad7 <a href="https://gitdab.com/cobertos/base-data-manager/commit/ab0a22641423662d3ba0ebdbe0c76a2e2eca7ad7">ab0a22641423662d3ba0ebdbe0c76a2e2eca7ad7</a> Claude: Added instagram 2026 export ab0a22641423662d3ba0ebdbe0c76a2e2eca7ad7 Claude: Added instagram 2026 export]]> cobertos 179376: https://gitdab.com/cobertos/base-data-manager/commit/ab0a22641423662d3ba0ebdbe0c76a2e2eca7ad7 Sun, 15 Mar 2026 20:02:11 +0000 https://gitdab.com/cobertos/base-data-manager/commit/94cad8864e4733f8c91aceaf9b090ae2e5133fce <a href="https://gitdab.com/cobertos/base-data-manager/commit/94cad8864e4733f8c91aceaf9b090ae2e5133fce">94cad8864e4733f8c91aceaf9b090ae2e5133fce</a> Added instagram 2026 export 94cad8864e4733f8c91aceaf9b090ae2e5133fce Added instagram 2026 export]]> cobertos 179375: https://gitdab.com/cobertos/base-data-manager/commit/94cad8864e4733f8c91aceaf9b090ae2e5133fce Sun, 15 Mar 2026 20:02:02 +0000 /cobertos/base-data-manager/compare/e7bb41d8ab60d45081c013a2796ab169d6a41292...f8f8a38a00e473e729a30f21262ecea52fa35b79 <a href="https://gitdab.com/cobertos/base-data-manager/commit/f8f8a38a00e473e729a30f21262ecea52fa35b79">f8f8a38a00e473e729a30f21262ecea52fa35b79</a> Added instagram fixture <a href="https://gitdab.com/cobertos/base-data-manager/commit/3302d84815d2dec70af32350ca121f573f02d9e5">3302d84815d2dec70af32350ca121f573f02d9e5</a> Glob simpler f8f8a38a00e473e729a30f21262ecea52fa35b79 Added instagram fixture 3302d84815d2dec70af32350ca121f573f02d9e5 Glob simpler]]> cobertos 179374: /cobertos/base-data-manager/compare/e7bb41d8ab60d45081c013a2796ab169d6a41292...f8f8a38a00e473e729a30f21262ecea52fa35b79 Sun, 15 Mar 2026 19:38:06 +0000 https://gitdab.com/cobertos/base-data-manager/commit/e7bb41d8ab60d45081c013a2796ab169d6a41292 <a href="https://gitdab.com/cobertos/base-data-manager/commit/e7bb41d8ab60d45081c013a2796ab169d6a41292">e7bb41d8ab60d45081c013a2796ab169d6a41292</a> Claude: Output summary as csv with csv-stringify e7bb41d8ab60d45081c013a2796ab169d6a41292 Claude: Output summary as csv with csv-stringify]]> cobertos 179250: https://gitdab.com/cobertos/base-data-manager/commit/e7bb41d8ab60d45081c013a2796ab169d6a41292 Wed, 04 Mar 2026 13:54:27 +0000 https://gitdab.com/cobertos/base-data-manager/commit/f0df9bccf7aeb9d504e0980e5e7db2207ff82905 <a href="https://gitdab.com/cobertos/base-data-manager/commit/f0df9bccf7aeb9d504e0980e5e7db2207ff82905">f0df9bccf7aeb9d504e0980e5e7db2207ff82905</a> Claude: add summary.ts f0df9bccf7aeb9d504e0980e5e7db2207ff82905 Claude: add summary.ts]]> cobertos 179249: https://gitdab.com/cobertos/base-data-manager/commit/f0df9bccf7aeb9d504e0980e5e7db2207ff82905 Wed, 04 Mar 2026 12:20:16 +0000 https://gitdab.com/cobertos/base-data-manager/commit/bcc4b0cff4aabdd7443e55828c047084c7663e02 <a href="https://gitdab.com/cobertos/base-data-manager/commit/bcc4b0cff4aabdd7443e55828c047084c7663e02">bcc4b0cff4aabdd7443e55828c047084c7663e02</a> Claude: add summary.ts bcc4b0cff4aabdd7443e55828c047084c7663e02 Claude: add summary.ts]]> cobertos 179248: https://gitdab.com/cobertos/base-data-manager/commit/bcc4b0cff4aabdd7443e55828c047084c7663e02 Wed, 04 Mar 2026 11:51:10 +0000 /cobertos/base-data-manager/compare/257598a17c2a45203b1de342199347f6699f1ba5...28d00763c67c367f183d27c6e5b3ca3437f0842c <a href="https://gitdab.com/cobertos/base-data-manager/commit/28d00763c67c367f183d27c6e5b3ca3437f0842c">28d00763c67c367f183d27c6e5b3ca3437f0842c</a> Claude: add summary.ts <a href="https://gitdab.com/cobertos/base-data-manager/commit/312e499fac5866a3776eb09c06d6cb980b52ea6c">312e499fac5866a3776eb09c06d6cb980b52ea6c</a> Use custom snapshots instead of nodejs&#39;s to handle carriage returns and better diffing/flow of running tests 28d00763c67c367f183d27c6e5b3ca3437f0842c Claude: add summary.ts 312e499fac5866a3776eb09c06d6cb980b52ea6c Use custom snapshots instead of nodejs's to handle carriage returns and better diffing/flow of running tests]]> cobertos 179247: /cobertos/base-data-manager/compare/257598a17c2a45203b1de342199347f6699f1ba5...28d00763c67c367f183d27c6e5b3ca3437f0842c Wed, 04 Mar 2026 11:40:24 +0000 https://gitdab.com/cobertos/base-data-manager/commit/257598a17c2a45203b1de342199347f6699f1ba5 <a href="https://gitdab.com/cobertos/base-data-manager/commit/257598a17c2a45203b1de342199347f6699f1ba5">257598a17c2a45203b1de342199347f6699f1ba5</a> Claude: add summary.ts 257598a17c2a45203b1de342199347f6699f1ba5 Claude: add summary.ts]]> cobertos 179246: https://gitdab.com/cobertos/base-data-manager/commit/257598a17c2a45203b1de342199347f6699f1ba5 Wed, 04 Mar 2026 11:00:38 +0000 https://gitdab.com/cobertos/base-data-manager/commit/d14f1ec778f5631d4936860864da1c3874a8672d <a href="https://gitdab.com/cobertos/base-data-manager/commit/d14f1ec778f5631d4936860864da1c3874a8672d">d14f1ec778f5631d4936860864da1c3874a8672d</a> Claude: Add fitbit export, though tests are broken due to snapshot oddities d14f1ec778f5631d4936860864da1c3874a8672d Claude: Add fitbit export, though tests are broken due to snapshot oddities]]> cobertos 179237: https://gitdab.com/cobertos/base-data-manager/commit/d14f1ec778f5631d4936860864da1c3874a8672d Tue, 03 Mar 2026 07:39:54 +0000 https://gitdab.com/cobertos/base-data-manager/commit/c84d901dd515afc174dd9649b3a79d600d621737 <a href="https://gitdab.com/cobertos/base-data-manager/commit/c84d901dd515afc174dd9649b3a79d600d621737">c84d901dd515afc174dd9649b3a79d600d621737</a> Added fitbit test fixture c84d901dd515afc174dd9649b3a79d600d621737 Added fitbit test fixture]]> cobertos 179193: https://gitdab.com/cobertos/base-data-manager/commit/c84d901dd515afc174dd9649b3a79d600d621737 Mon, 02 Mar 2026 13:43:05 +0000 /cobertos/base-data-manager/compare/06d5dec7e798067bced0bfc600ffd07ade4ee428...a7683bba322bcff02cee3acc4b35ff816cba001c <a href="https://gitdab.com/cobertos/base-data-manager/commit/a7683bba322bcff02cee3acc4b35ff816cba001c">a7683bba322bcff02cee3acc4b35ff816cba001c</a> Added fitbit test fixture <a href="https://gitdab.com/cobertos/base-data-manager/commit/6fd859e057be2421f8792bab30b664f59b1b19b3">6fd859e057be2421f8792bab30b664f59b1b19b3</a> Scrub now handles CSVs (in Typescript), scrub now has tests (for both TS and jq scrubbing), scrub has many more cases <a href="https://gitdab.com/cobertos/base-data-manager/commit/16650695933b1fe963d8dcc44bba6437378b8b49">16650695933b1fe963d8dcc44bba6437378b8b49</a> Use Nodejs&#39;s native implementation of globSync(), colocate all zipFs weirdness in it&#39;s own file <a href="https://gitdab.com/cobertos/base-data-manager/commit/4a50ed5d74e93370a814f1fa753662a64d36ce74">4a50ed5d74e93370a814f1fa753662a64d36ce74</a> Consolidate all separate export tests into single file + single test strategy a7683bba322bcff02cee3acc4b35ff816cba001c Added fitbit test fixture 6fd859e057be2421f8792bab30b664f59b1b19b3 Scrub now handles CSVs (in Typescript), scrub now has tests (for both TS and jq scrubbing), scrub has many more cases 16650695933b1fe963d8dcc44bba6437378b8b49 Use Nodejs's native implementation of globSync(), colocate all zipFs weirdness in it's own file 4a50ed5d74e93370a814f1fa753662a64d36ce74 Consolidate all separate export tests into single file + single test strategy]]> cobertos 179183: /cobertos/base-data-manager/compare/06d5dec7e798067bced0bfc600ffd07ade4ee428...a7683bba322bcff02cee3acc4b35ff816cba001c Mon, 02 Mar 2026 06:55:23 +0000 https://gitdab.com/cobertos/base-data-manager/commit/06d5dec7e798067bced0bfc600ffd07ade4ee428 <a href="https://gitdab.com/cobertos/base-data-manager/commit/06d5dec7e798067bced0bfc600ffd07ade4ee428">06d5dec7e798067bced0bfc600ffd07ade4ee428</a> Claude: added 3 new exporters + tests 06d5dec7e798067bced0bfc600ffd07ade4ee428 Claude: added 3 new exporters + tests]]> cobertos 179159: https://gitdab.com/cobertos/base-data-manager/commit/06d5dec7e798067bced0bfc600ffd07ade4ee428 Sat, 28 Feb 2026 02:30:43 +0000 /cobertos/base-data-manager/compare/9c3bdaa10001072ed6475c99d72a80d66a43fe95...c093fbfceeeef52ec6ffcb52f4b2e71360a2b9cd <a href="https://gitdab.com/cobertos/base-data-manager/commit/c093fbfceeeef52ec6ffcb52f4b2e71360a2b9cd">c093fbfceeeef52ec6ffcb52f4b2e71360a2b9cd</a> Added 3 more scrubbed fixtures for new exports, scrub added boolean and numeric key scrubbing <a href="https://gitdab.com/cobertos/base-data-manager/commit/7d815833e611bb02357ffc25e16a6399f3208def">7d815833e611bb02357ffc25e16a6399f3208def</a> Rewrote timelinize.ts to work, and added new features for it. Added aggregateColumns for aggregated header, added metaIdValue to track which aggregate has metadata for another TaskTarget, added each() to allow a method of using cmd() with .id and other properties, added execPaths to make the initial definition of TaskTarget array to be a little more succinct <a href="https://gitdab.com/cobertos/base-data-manager/commit/a4fbe1618dbf73332e9fd1c2875e502cfa48625d">a4fbe1618dbf73332e9fd1c2875e502cfa48625d</a> Fixed FB dating messages, added metadata as output table, added aggregate message thread metadata from FB <a href="https://gitdab.com/cobertos/base-data-manager/commit/f6d0427a45dfa6fecd68f23b31b8fe7ca8d0e51a">f6d0427a45dfa6fecd68f23b31b8fe7ca8d0e51a</a> Converted TaskTargetPipelineHelper to more functional style, added aggregate() functionality to bring together multiple exports (no tests, but works) c093fbfceeeef52ec6ffcb52f4b2e71360a2b9cd Added 3 more scrubbed fixtures for new exports, scrub added boolean and numeric key scrubbing 7d815833e611bb02357ffc25e16a6399f3208def Rewrote timelinize.ts to work, and added new features for it. Added aggregateColumns for aggregated header, added metaIdValue to track which aggregate has metadata for another TaskTarget, added each() to allow a method of using cmd() with .id and other properties, added execPaths to make the initial definition of TaskTarget array to be a little more succinct a4fbe1618dbf73332e9fd1c2875e502cfa48625d Fixed FB dating messages, added metadata as output table, added aggregate message thread metadata from FB f6d0427a45dfa6fecd68f23b31b8fe7ca8d0e51a Converted TaskTargetPipelineHelper to more functional style, added aggregate() functionality to bring together multiple exports (no tests, but works)]]> cobertos 179157: /cobertos/base-data-manager/compare/9c3bdaa10001072ed6475c99d72a80d66a43fe95...c093fbfceeeef52ec6ffcb52f4b2e71360a2b9cd Fri, 27 Feb 2026 08:39:49 +0000 https://gitdab.com/cobertos/base-data-manager/commit/9c3bdaa10001072ed6475c99d72a80d66a43fe95 <a href="https://gitdab.com/cobertos/base-data-manager/commit/9c3bdaa10001072ed6475c99d72a80d66a43fe95">9c3bdaa10001072ed6475c99d72a80d66a43fe95</a> Broken AI code adding more columns 9c3bdaa10001072ed6475c99d72a80d66a43fe95 Broken AI code adding more columns]]> cobertos 179123: https://gitdab.com/cobertos/base-data-manager/commit/9c3bdaa10001072ed6475c99d72a80d66a43fe95 Tue, 24 Feb 2026 03:50:23 +0000 https://gitdab.com/cobertos/base-data-manager/commit/845ceb4c8485be9dcc859b2654bae26afae7d421 <a href="https://gitdab.com/cobertos/base-data-manager/commit/845ceb4c8485be9dcc859b2654bae26afae7d421">845ceb4c8485be9dcc859b2654bae26afae7d421</a> Change up main for timelinize output 845ceb4c8485be9dcc859b2654bae26afae7d421 Change up main for timelinize output]]> cobertos 179122: https://gitdab.com/cobertos/base-data-manager/commit/845ceb4c8485be9dcc859b2654bae26afae7d421 Sun, 22 Feb 2026 16:52:46 +0000 https://gitdab.com/cobertos/base-data-manager/commit/80be7de84481bd7ff338981910d9c65a635a5391 <a href="https://gitdab.com/cobertos/base-data-manager/commit/80be7de84481bd7ff338981910d9c65a635a5391">80be7de84481bd7ff338981910d9c65a635a5391</a> Claude: annotate all facebook tables with metadata and description preliminarily 80be7de84481bd7ff338981910d9c65a635a5391 Claude: annotate all facebook tables with metadata and description preliminarily]]> cobertos 179121: https://gitdab.com/cobertos/base-data-manager/commit/80be7de84481bd7ff338981910d9c65a635a5391 Sun, 22 Feb 2026 13:33:40 +0000 /cobertos/base-data-manager/compare/fa070985495ca570cf0a3c65b3ca663825578dd2...3e64969e05dc4b2a60eb999b19a8314f7f69f349 <a href="https://gitdab.com/cobertos/base-data-manager/commit/3e64969e05dc4b2a60eb999b19a8314f7f69f349">3e64969e05dc4b2a60eb999b19a8314f7f69f349</a> Clean up API, make columnMeta a bit more specific <a href="https://gitdab.com/cobertos/base-data-manager/commit/f6b0f02de745ea6b28c97e6b0a0b322d95c5a2b5">f6b0f02de745ea6b28c97e6b0a0b322d95c5a2b5</a> setId(), types(), csvSink() become assignMeta(), clean up unused task.ts stuff 3e64969e05dc4b2a60eb999b19a8314f7f69f349 Clean up API, make columnMeta a bit more specific f6b0f02de745ea6b28c97e6b0a0b322d95c5a2b5 setId(), types(), csvSink() become assignMeta(), clean up unused task.ts stuff]]> cobertos 179120: /cobertos/base-data-manager/compare/fa070985495ca570cf0a3c65b3ca663825578dd2...3e64969e05dc4b2a60eb999b19a8314f7f69f349 Sun, 22 Feb 2026 13:23:03 +0000 /cobertos/base-data-manager/compare/20a0a6b310e931bf323259b37bc65f0b71048946...fa070985495ca570cf0a3c65b3ca663825578dd2 <a href="https://gitdab.com/cobertos/base-data-manager/commit/fa070985495ca570cf0a3c65b3ca663825578dd2">fa070985495ca570cf0a3c65b3ca663825578dd2</a> Added zipped facebook export test <a href="https://gitdab.com/cobertos/base-data-manager/commit/29a7d43851cf57f2f4a8e059a21605ec93217379">29a7d43851cf57f2f4a8e059a21605ec93217379</a> Add facebook tests against fixtures (fixed a few bugs), add GNU parallel replacement using Typescript + AI <a href="https://gitdab.com/cobertos/base-data-manager/commit/4a20a02ef59efc5966b16489bcfcb44cf80af1f7">4a20a02ef59efc5966b16489bcfcb44cf80af1f7</a> Fix tests to be portable, fix claude&#39;s odd character choice, cleanup shEscape() after a bunch of research <a href="https://gitdab.com/cobertos/base-data-manager/commit/787e281049f4d87f68ed061706ccdcce0de31640">787e281049f4d87f68ed061706ccdcce0de31640</a> Claude: add tests, fix bugs fa070985495ca570cf0a3c65b3ca663825578dd2 Added zipped facebook export test 29a7d43851cf57f2f4a8e059a21605ec93217379 Add facebook tests against fixtures (fixed a few bugs), add GNU parallel replacement using Typescript + AI 4a20a02ef59efc5966b16489bcfcb44cf80af1f7 Fix tests to be portable, fix claude's odd character choice, cleanup shEscape() after a bunch of research 787e281049f4d87f68ed061706ccdcce0de31640 Claude: add tests, fix bugs]]> cobertos 179119: /cobertos/base-data-manager/compare/20a0a6b310e931bf323259b37bc65f0b71048946...fa070985495ca570cf0a3c65b3ca663825578dd2 Sat, 21 Feb 2026 11:16:38 +0000 /cobertos/base-data-manager/compare/787e281049f4d87f68ed061706ccdcce0de31640...fa070985495ca570cf0a3c65b3ca663825578dd2 <a href="https://gitdab.com/cobertos/base-data-manager/commit/fa070985495ca570cf0a3c65b3ca663825578dd2">fa070985495ca570cf0a3c65b3ca663825578dd2</a> Added zipped facebook export test <a href="https://gitdab.com/cobertos/base-data-manager/commit/29a7d43851cf57f2f4a8e059a21605ec93217379">29a7d43851cf57f2f4a8e059a21605ec93217379</a> Add facebook tests against fixtures (fixed a few bugs), add GNU parallel replacement using Typescript + AI <a href="https://gitdab.com/cobertos/base-data-manager/commit/4a20a02ef59efc5966b16489bcfcb44cf80af1f7">4a20a02ef59efc5966b16489bcfcb44cf80af1f7</a> Fix tests to be portable, fix claude&#39;s odd character choice, cleanup shEscape() after a bunch of research fa070985495ca570cf0a3c65b3ca663825578dd2 Added zipped facebook export test 29a7d43851cf57f2f4a8e059a21605ec93217379 Add facebook tests against fixtures (fixed a few bugs), add GNU parallel replacement using Typescript + AI 4a20a02ef59efc5966b16489bcfcb44cf80af1f7 Fix tests to be portable, fix claude's odd character choice, cleanup shEscape() after a bunch of research]]> cobertos 179118: /cobertos/base-data-manager/compare/787e281049f4d87f68ed061706ccdcce0de31640...fa070985495ca570cf0a3c65b3ca663825578dd2 Sat, 21 Feb 2026 11:16:27 +0000 https://gitdab.com/cobertos/base-data-manager/commit/787e281049f4d87f68ed061706ccdcce0de31640 <a href="https://gitdab.com/cobertos/base-data-manager/commit/787e281049f4d87f68ed061706ccdcce0de31640">787e281049f4d87f68ed061706ccdcce0de31640</a> Claude: add tests, fix bugs 787e281049f4d87f68ed061706ccdcce0de31640 Claude: add tests, fix bugs]]> cobertos 179112: https://gitdab.com/cobertos/base-data-manager/commit/787e281049f4d87f68ed061706ccdcce0de31640 Fri, 20 Feb 2026 20:56:24 +0000 https://gitdab.com/cobertos/base-data-manager/src/branch/ai-code cobertos 179111: https://gitdab.com/cobertos/base-data-manager/src/branch/ai-code Fri, 20 Feb 2026 20:49:17 +0000 https://gitdab.com/cobertos/base-data-manager/src/branch/ai-code cobertos 179110: https://gitdab.com/cobertos/base-data-manager/src/branch/ai-code Fri, 20 Feb 2026 20:49:17 +0000 https://gitdab.com/cobertos/base-data-manager/src/branch/owo cobertos 179106: https://gitdab.com/cobertos/base-data-manager/src/branch/owo Fri, 20 Feb 2026 11:09:29 +0000 /cobertos/base-data-manager/compare/089f1e6134ffaafb779b95c628fb62ec4717cd31...20a0a6b310e931bf323259b37bc65f0b71048946 <a href="https://gitdab.com/cobertos/base-data-manager/commit/20a0a6b310e931bf323259b37bc65f0b71048946">20a0a6b310e931bf323259b37bc65f0b71048946</a> Removed all prototyping stuff, simplified Task, removed unnecessary state now that I&#39;m not using streams <a href="https://gitdab.com/cobertos/base-data-manager/commit/4978a97f23a610fcb513410d964c1a8b648a8409">4978a97f23a610fcb513410d964c1a8b648a8409</a> Added scrub and scrubbed facebook exports, and stub test <a href="https://gitdab.com/cobertos/base-data-manager/commit/03a5fec65e8947f831be82c18a83fa659a2e499f">03a5fec65e8947f831be82c18a83fa659a2e499f</a> Make zip work for globbing (wasnt working before), added facebook v2 for newer 2025 format, write to :memory: sqlite db before writing to disk for speed <a href="https://gitdab.com/cobertos/base-data-manager/commit/b90a66bfe20a5d1eba143c0b90bd73611295d0ca">b90a66bfe20a5d1eba143c0b90bd73611295d0ca</a> Tighten up zip support, prune all non-existant files when searching for files to load <a href="https://gitdab.com/cobertos/base-data-manager/commit/0b1d63c314f2037e77304e9e57074339325aca06">0b1d63c314f2037e77304e9e57074339325aca06</a> Bundled the parallels and other stuff into the typescript program, use csv extension and virtual csv tables to load everything _really_ fast 20a0a6b310e931bf323259b37bc65f0b71048946 Removed all prototyping stuff, simplified Task, removed unnecessary state now that I'm not using streams 4978a97f23a610fcb513410d964c1a8b648a8409 Added scrub and scrubbed facebook exports, and stub test 03a5fec65e8947f831be82c18a83fa659a2e499f Make zip work for globbing (wasnt working before), added facebook v2 for newer 2025 format, write to :memory: sqlite db before writing to disk for speed b90a66bfe20a5d1eba143c0b90bd73611295d0ca Tighten up zip support, prune all non-existant files when searching for files to load 0b1d63c314f2037e77304e9e57074339325aca06 Bundled the parallels and other stuff into the typescript program, use csv extension and virtual csv tables to load everything _really_ fast]]> cobertos 179107: /cobertos/base-data-manager/compare/089f1e6134ffaafb779b95c628fb62ec4717cd31...20a0a6b310e931bf323259b37bc65f0b71048946 Fri, 20 Feb 2026 11:09:29 +0000 https://gitdab.com/cobertos/base-data-manager cobertos 179105: https://gitdab.com/cobertos/base-data-manager Fri, 20 Feb 2026 11:08:43 +0000