Skip to content

Application should not fail when hadoop-binaries are missing #727

@kevinwallimann

Description

@kevinwallimann

Description

Currently, the application fails when hadoop-binaries are missing, even if scheduler.executors.enableHyperdriveExecutor is set to false, with this error:

	Caused by: java.lang.IllegalStateException: Failed to introspect Class [za.co.absa.hyperdrive.trigger.api.rest.services.HyperdriveOffsetComparisonServiceImpl] from ClassLoader [ParallelWebappClassLoader
  context: hyperdrive_trigger
  delegate: false
----------> Parent Classloader:
java.net.URLClassLoader@1a6c5a9e
]
		at org.springframework.util.ReflectionUtils.getDeclaredMethods(ReflectionUtils.java:485)
		at org.springframework.util.ReflectionUtils.doWithLocalMethods(ReflectionUtils.java:321)
		at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.determineCandidateConstructors(AutowiredAnnotationBeanPostProcessor.java:267)
		... 101 more
	Caused by: java.lang.NoClassDefFoundError: org/apache/hadoop/security/UserGroupInformation
		at java.lang.Class.getDeclaredMethods0(Native Method)
		at java.lang.Class.privateGetDeclaredMethods(Class.java:2701)
		at java.lang.Class.getDeclaredMethods(Class.java:1975)
		at org.springframework.util.ReflectionUtils.getDeclaredMethods(ReflectionUtils.java:467)
		... 103 more
	Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.security.UserGroupInformation
		at org.apache.catalina.loader.WebappClassLoaderBase.loadClass(WebappClassLoaderBase.java:1363)
		at org.apache.catalina.loader.WebappClassLoaderBase.loadClass(WebappClassLoaderBase.java:1186)
		... 107 more

Expected behaviour

If scheduler.executors.enableHyperdriveExecutor is set to false, the application should not fail, because in that case the hadoop-binaries are not needed.

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions