Skip to content

[SPARK-49153] Increase Gradle JVM memory to 4g like Spark repo#36

Closed
dongjoon-hyun wants to merge 1 commit into
apache:mainfrom
dongjoon-hyun:SPARK-49153
Closed

[SPARK-49153] Increase Gradle JVM memory to 4g like Spark repo#36
dongjoon-hyun wants to merge 1 commit into
apache:mainfrom
dongjoon-hyun:SPARK-49153

Conversation

@dongjoon-hyun
Copy link
Copy Markdown
Member

@dongjoon-hyun dongjoon-hyun commented Aug 8, 2024

What changes were proposed in this pull request?

This PR aims to increase Gradle JVM memory to 4g like Spark repo.

Why are the changes needed?

Unlike CI, in the local build, Gradle Daemon is reused. The compilation is unstable like the following because the default Gradle JVM memory is 512MB.

> Task :spark-operator:compileTestJava
Note: /Users/dongjoon/APACHE/spark-kubernetes-operator/spark-operator/src/test/java/org/apache/spark/k8s/operator/metrics/healthcheck/SentinelManagerTest.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
OpenJDK 64-Bit Server VM warning: CodeCache is full. Compiler has been disabled.
[1.372s][warning][codecache] CodeCache is full. Compiler has been disabled.
OpenJDK 64-Bit Server VM warning: Try increasing the code cache size using -XX:ReservedCodeCacheSize=
[1.372s][warning][codecache] Try increasing the code cache size using -XX:ReservedCodeCacheSize=
CodeCache: size=2944Kb used=2943Kb max_used=2943Kb free=0Kb
 bounds [0x0000000105004000, 0x00000001052e4000, 0x00000001052e4000]
 total_blobs=1102 nmethods=464 adapters=554
 compilation: disabled (not enough contiguous free space left)
              stopped_count=1, restarted_count=0
 full_count=1 

Does this PR introduce any user-facing change?

No. This is a dev-only change.

How was this patch tested?

Check the JVM setting via jps locally.

Was this patch authored or co-authored using generative AI tooling?

No.

@dongjoon-hyun
Copy link
Copy Markdown
Member Author

cc @viirya and @jiangzho

@viirya
Copy link
Copy Markdown
Member

viirya commented Aug 8, 2024

Looks good to me.

@dongjoon-hyun
Copy link
Copy Markdown
Member Author

Thank you, @viirya !
Merged to main.

@dongjoon-hyun dongjoon-hyun deleted the SPARK-49153 branch August 8, 2024 04:49
@dongjoon-hyun dongjoon-hyun mentioned this pull request Aug 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants