Skip to content

[SPARK-47081][CONNECT][FOLLOW-UP] Respect spark.connect.progress.reportInterval over timeout#49474

Closed
HyukjinKwon wants to merge 1 commit into
apache:masterfrom
HyukjinKwon:SPARK-47081-followup3
Closed

[SPARK-47081][CONNECT][FOLLOW-UP] Respect spark.connect.progress.reportInterval over timeout#49474
HyukjinKwon wants to merge 1 commit into
apache:masterfrom
HyukjinKwon:SPARK-47081-followup3

Conversation

@HyukjinKwon
Copy link
Copy Markdown
Member

What changes were proposed in this pull request?

This PR is a followup that addresses #45150 (comment)

Why are the changes needed?

To respect spark.connect.progress.reportInterval

Does this PR introduce any user-facing change?

Virtually no. In corner case, it the progress upgrade might take longer than spark.connect.progress.reportInterval.

How was this patch tested?

Manually tested.

Was this patch authored or co-authored using generative AI tooling?

No.

@HyukjinKwon
Copy link
Copy Markdown
Member Author

Merged to master.

Copy link
Copy Markdown
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM.

HyukjinKwon added a commit that referenced this pull request Jan 14, 2025
…rtInterval over timeout

### What changes were proposed in this pull request?

This PR is a followup of #49474 that properly assigns the value to `timeout`.

### Why are the changes needed?

It was a mistake that did not assign the value back.

### Does this PR introduce _any_ user-facing change?

Yes, same as #49474

### How was this patch tested?

Manually.

### Was this patch authored or co-authored using generative AI tooling?

No

Closes #49484 from HyukjinKwon/SPARK-47081-followup4.

Authored-by: Hyukjin Kwon <gurwls223@apache.org>
Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants