Skip to content

Add Weaviate import and export support#114

Open
suhail-ak-2 wants to merge 2 commits into
AI-Northstar-Tech:mainfrom
suhail-ak-2:bounty-74-weaviate-support
Open

Add Weaviate import and export support#114
suhail-ak-2 wants to merge 2 commits into
AI-Northstar-Tech:mainfrom
suhail-ak-2:bounty-74-weaviate-support

Conversation

@suhail-ak-2
Copy link
Copy Markdown

/claim #74

Summary

  • add shared Weaviate connection, schema, vector, and metadata helpers
  • complete Weaviate export for collections/classes with default and named vector support
  • add Weaviate import support with collection creation, property inference, batch upsert, and VDF id preservation
  • update the README support matrix and CLI examples to include Weaviate

Verification

  • python -m compileall -q src/vdf_io/weaviate_util.py src/vdf_io/export_vdf/weaviate_export.py src/vdf_io/import_vdf/weaviate_import.py
  • parser/helper smoke test for Weaviate CLI args, collection naming, vector normalization, property inference, and vector config creation
  • fake-client import smoke test covering VDF parquet import, collection creation, batch upsert, and vdf_id metadata preservation
  • fake-client export smoke test covering collection iteration, parquet output, vector metadata, and VDF_META.json generation

Notes

  • supports Weaviate Cloud URLs, custom endpoints, and local instances
  • falls back to WEAVIATE_API_KEY when --api_key is not provided

@algora-pbc algora-pbc Bot mentioned this pull request May 13, 2026
13 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant