Skip to content

cleanup & update dependencies tree#347

Closed
hozan23 wants to merge 2 commits intoroapi:mainfrom
twintag:cleanup-deps
Closed

cleanup & update dependencies tree#347
hozan23 wants to merge 2 commits intoroapi:mainfrom
twintag:cleanup-deps

Conversation

@hozan23
Copy link
Contributor

@hozan23 hozan23 commented Oct 19, 2024

Hello,

This PR cleans up and updates the dependencies tree for the columnq crate.

There are still two conflicts:

  • ConnectorX is still using arrow version 52. This can be resolved by merging this PR.
  • DeltaLake is still using datafusion 41.0. This will be resolved once they find a fix for this issue. The likely solution would be upgrading to datafusion 42.1 or skipping that version and using datafusion 43

@houqp
Copy link
Member

houqp commented Oct 20, 2024

Thanks for the update @hozan23 , for deltalake, you we can also create a temporary fork at https://github.com/roapi/delta-rs to unblock the upgrade. Let me know if you need any help with it.

@hozan23
Copy link
Contributor Author

hozan23 commented Oct 20, 2024

Hello @houqp

I think they are currently working on releasing datafusion 42.1 and they will use it with deltalake. we can wait for a few days until they merge it.

@hozan23
Copy link
Contributor Author

hozan23 commented Nov 10, 2024

An update:

The DataFusion 43 version has been released; we can continue with this PR once DeltaLake starts using DataFusion 43

@houqp
Copy link
Member

houqp commented Dec 31, 2024

@hozan23 do you need any help pushing this over the finish line?

@houqp
Copy link
Member

houqp commented Jan 1, 2025

@hozan23 I don't have access to push to your branch, so started a new branch #365 based off yours to finish off the upgrade. Thanks again for the help!

@houqp houqp closed this Jan 1, 2025
@hozan23
Copy link
Contributor Author

hozan23 commented Jan 1, 2025

@houqp Thanks for completing the upgrade.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants