Skip to content

feat(v2): add tensorflow embedding, audio, video#1098

Merged
anna-charlotte merged 91 commits into
feat-rewrite-v2from
feat-tf-embedding
Feb 9, 2023
Merged

feat(v2): add tensorflow embedding, audio, video#1098
anna-charlotte merged 91 commits into
feat-rewrite-v2from
feat-tf-embedding

Conversation

@anna-charlotte

@anna-charlotte anna-charlotte commented Feb 8, 2023 •
edited
Loading

Copy link
Copy Markdown
Contributor

Add further tensorflow support:

  • TensorFlowEmbedding
  • VideoTensorFlowTensor
  • AudioTensorFlowTensor
  • ImageTensorFlowTensor
  • Tests
  • check and update documentation, if required. See guide

anna-charlotte added 30 commits February 7, 2023 10:36
feat: add tensorflow tensor
ba1a4b6 
Signed-off-by: anna-charlotte <charlotte.gerhaher@jina.ai>
feat: wip add tf comp backend
978dfe4 
Signed-off-by: anna-charlotte <charlotte.gerhaher@jina.ai>
fix: comp backend working of TensorFlowTensor, not tf tensor
712c950 
Signed-off-by: anna-charlotte <charlotte.gerhaher@jina.ai>
test: remove redundant print statements
fd88185 
Signed-off-by: anna-charlotte <charlotte.gerhaher@jina.ai>
feat: add comp backend retrieval
17fe3d5 
Signed-off-by: anna-charlotte <charlotte.gerhaher@jina.ai>
fix: extract methods that overlap for np and tf backend
b0fd980 
Signed-off-by: anna-charlotte <charlotte.gerhaher@jina.ai>
fix: revert poetry lock change
c2e6ab0 
Signed-off-by: anna-charlotte <charlotte.gerhaher@jina.ai>
fix: introduce norm callables to transform tftensor
cf6a0ef 
Signed-off-by: anna-charlotte <charlotte.gerhaher@jina.ai>
docs: clean up
194ab9f 
Signed-off-by: anna-charlotte <charlotte.gerhaher@jina.ai>
fix: retrieval and add docstring
6a2ecf1 
Signed-off-by: anna-charlotte <charlotte.gerhaher@jina.ai>
fix: add cosine sim for tf backend matrics
056db70 
Signed-off-by: anna-charlotte <charlotte.gerhaher@jina.ai>
fix: euclidean dist
6c35902 
Signed-off-by: anna-charlotte <charlotte.gerhaher@jina.ai>
fix: add typevar to register proto
2abe113 
Signed-off-by: anna-charlotte <charlotte.gerhaher@jina.ai>
fix: clean up
beb340e 
Signed-off-by: anna-charlotte <charlotte.gerhaher@jina.ai>
fix: add tft to inits
1817c44 
Signed-off-by: anna-charlotte <charlotte.gerhaher@jina.ai>
test: add tests for tensorflow tensor
a74daac 
Signed-off-by: anna-charlotte <charlotte.gerhaher@jina.ai>
fix: mypy checks
ab7d153 
Signed-off-by: anna-charlotte <charlotte.gerhaher@jina.ai>
fix: docarray from native
72744ad 
Signed-off-by: anna-charlotte <charlotte.gerhaher@jina.ai>
docs: add documentatino and clean up
dfdff10 
Signed-off-by: anna-charlotte <charlotte.gerhaher@jina.ai>
fix: clean up
28a7291 
Signed-off-by: anna-charlotte <charlotte.gerhaher@jina.ai>
fix: clean up
418ee37 
Signed-off-by: anna-charlotte <charlotte.gerhaher@jina.ai>
fix: stacked array with tf tensor
217c870 
Signed-off-by: anna-charlotte <charlotte.gerhaher@jina.ai>
fix: stack with tftensor
fd7a8e5 
Signed-off-by: anna-charlotte <charlotte.gerhaher@jina.ai>
test: fix get item test
26150b6 
Signed-off-by: anna-charlotte <charlotte.gerhaher@jina.ai>
fix: access by slice for tftensor
567b56a 
Signed-off-by: anna-charlotte <charlotte.gerhaher@jina.ai>
fix: add proto for tf
665f408 
Signed-off-by: anna-charlotte <charlotte.gerhaher@jina.ai>
test: introduce pytest tensorflow marker
68bdd77 
Signed-off-by: anna-charlotte <charlotte.gerhaher@jina.ai>
fix: typo in ci.yml
fcd5b74 
Signed-off-by: anna-charlotte <charlotte.gerhaher@jina.ai>
fix: try tf import
1e8e240 
Signed-off-by: anna-charlotte <charlotte.gerhaher@jina.ai>
fix: mypy
a5988ab 
Signed-off-by: anna-charlotte <charlotte.gerhaher@jina.ai>
@github-actions

github-actions Bot commented Feb 8, 2023

Copy link
Copy Markdown

This PR exceeds the recommended size of 1000 lines. Please make sure you are NOT addressing multiple issues with one PR. Note this PR might be rejected due to its size.

chore: update lock file
6a92e22 
Signed-off-by: anna-charlotte <charlotte.gerhaher@jina.ai>
@github-actions

github-actions Bot commented Feb 8, 2023

Copy link
Copy Markdown

This PR exceeds the recommended size of 1000 lines. Please make sure you are NOT addressing multiple issues with one PR. Note this PR might be rejected due to its size.

test: add missing tensorflow pytest marker
4786dee 
Signed-off-by: anna-charlotte <charlotte.gerhaher@jina.ai>
@github-actions

github-actions Bot commented Feb 8, 2023

Copy link
Copy Markdown

This PR exceeds the recommended size of 1000 lines. Please make sure you are NOT addressing multiple issues with one PR. Note this PR might be rejected due to its size.

@anna-charlotte anna-charlotte changed the title feat(v2): Add tensorflow embedding, audio, video feat(v2): add tensorflow embedding, audio, video Feb 8, 2023
anna-charlotte added 2 commits February 8, 2023 16:13
test: fix tf test and clean up
37d9355 
Signed-off-by: anna-charlotte <charlotte.gerhaher@jina.ai>
test: fix video test tf
7ef37e4 
Signed-off-by: anna-charlotte <charlotte.gerhaher@jina.ai>
@github-actions

github-actions Bot commented Feb 8, 2023

Copy link
Copy Markdown

This PR exceeds the recommended size of 1000 lines. Please make sure you are NOT addressing multiple issues with one PR. Note this PR might be rejected due to its size.

1 similar comment
@github-actions

github-actions Bot commented Feb 8, 2023

Copy link
Copy Markdown

This PR exceeds the recommended size of 1000 lines. Please make sure you are NOT addressing multiple issues with one PR. Note this PR might be rejected due to its size.

fix: remove copy paste errors for torch available
328be68 
Signed-off-by: anna-charlotte <charlotte.gerhaher@jina.ai>
@github-actions

github-actions Bot commented Feb 8, 2023

Copy link
Copy Markdown

This PR exceeds the recommended size of 1000 lines. Please make sure you are NOT addressing multiple issues with one PR. Note this PR might be rejected due to its size.

@anna-charlotte anna-charlotte marked this pull request as ready for review February 8, 2023 16:15
@anna-charlotte anna-charlotte requested review from JohannesMessner and samsja and removed request for samsja February 8, 2023 16:30
@github-actions

github-actions Bot commented Feb 8, 2023

Copy link
Copy Markdown

This PR exceeds the recommended size of 1000 lines. Please make sure you are NOT addressing multiple issues with one PR. Note this PR might be rejected due to its size.

@anna-charlotte anna-charlotte linked an issue Feb 8, 2023 that may be closed by this pull request
v2: Add Tensforflow support #1057
Closed
3 tasks
Charlotte Gerhaher added 2 commits February 9, 2023 08:42
Merge branch 'feat-rewrite-v2' into feat-tf-embedding
ad0ea71
fix: merge poetry lock
c5a1d4f 
Signed-off-by: anna-charlotte <charlotte.gerhaher@jina.ai>
@github-actions

github-actions Bot commented Feb 9, 2023

Copy link
Copy Markdown

This PR exceeds the recommended size of 1000 lines. Please make sure you are NOT addressing multiple issues with one PR. Note this PR might be rejected due to its size.

@github-actions

github-actions Bot commented Feb 9, 2023

Copy link
Copy Markdown

📝 Docs are deployed on https://ft-feat-tf-embedding--jina-docs.netlify.app 🎉

@anna-charlotte anna-charlotte merged commit 8bd0443 into feat-rewrite-v2 Feb 9, 2023
@anna-charlotte anna-charlotte deleted the feat-tf-embedding branch February 9, 2023 09:00
@anna-charlotte anna-charlotte mentioned this pull request Feb 20, 2023
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@samsja samsja samsja approved these changes

@JohannesMessner JohannesMessner Awaiting requested review from JohannesMessner

Assignees

No one assigned

Labels

area/core area/testing area/typing component/array size/xl

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

v2: Add Tensforflow support

2 participants

@anna-charlotte @samsja