chore: update arrow (to 48.0) and datafusion (to 33.0)#1703
Closed
vrongmeal wants to merge 2 commits intolance-format:mainfrom
Closed
chore: update arrow (to 48.0) and datafusion (to 33.0)#1703vrongmeal wants to merge 2 commits intolance-format:mainfrom
48.0) and datafusion (to 33.0)#1703vrongmeal wants to merge 2 commits intolance-format:mainfrom
Conversation
Signed-off-by: Vaibhav <vrongmeal@gmail.com>
Contributor
|
ACTION NEEDED Lance follows the Conventional Commits specification for release automation. The PR title and description are used as the merge commit message. Please update your PR title and description to match the specification. For details on the error please inspect the "PR Title Check" action. |
48.0) and datafusion (to 33.0)48.0) and datafusion (to 33.0)
Contributor
|
@vrongmeal Unfortunately, we might not be able to upgrade until the next version of DataFusion. We added the FSL implementation in apache/datafusion/pull/8225, which should be available in DF 34. |
Author
That makes sense! Thanks! I'll close this PR for now. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Known test failure:
Due to a change in DF where statistics are pulled even when not requested in
IndentVisitor, the testdataset::scanner::test::test_secondary_index_scansfails since there's an error pulling statistics. The error corresponds to not being able to create a scalar fromFixedSizeList(which should not be expected since a corresponding scalar exists).The error:
Problematic DF Code:
https://github.com/apache/arrow-datafusion/blob/93b21bdcd3d465ed78b610b54edf1418a47fc497/datafusion/physical-plan/src/display.rs#L263-L266
Fixes: #1694