Skip to content

[SPARK-48564][PYTHON][CONNECT] Propagate cached schema in set operations#46915

Closed
zhengruifeng wants to merge 3 commits into
apache:masterfrom
zhengruifeng:set_op_schema
Closed

[SPARK-48564][PYTHON][CONNECT] Propagate cached schema in set operations#46915
zhengruifeng wants to merge 3 commits into
apache:masterfrom
zhengruifeng:set_op_schema

Conversation

@zhengruifeng
Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

Propagate cached schema in set operations

Why are the changes needed?

to avoid extra RPC to get the schema of result data frame

Does this PR introduce any user-facing change?

No

How was this patch tested?

added tests

Was this patch authored or co-authored using generative AI tooling?

No

Comment thread python/pyspark/sql/connect/dataframe.py Outdated
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

you can just remove this too

@HyukjinKwon
Copy link
Copy Markdown
Member

Merged to master.

@zhengruifeng zhengruifeng deleted the set_op_schema branch June 11, 2024 00:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants