4.1.1 Environment

Back to Master

Runtime Information

NameValue
Java Home/usr/lib/jvm/java-21-openjdk-amd64
Java Version21.0.10 (Ubuntu)
Scala Versionversion 2.13.17

Spark Properties

NameValue
spark.jars/opt/spark/extra-jars/io.delta_delta-spark_4.1_2.13-4.1.0.jar,/opt/spark/extra-jars/io.delta_delta-storage-4.1.0.jar,/opt/spark/extra-jars/org.antlr_antlr4-runtime-4.13.1.jar,/opt/spark/extra-jars/org.apache.hadoop_hadoop-aws-3.4.1.jar,/opt/spark/extra-jars/org.wildfly.openssl_wildfly-openssl-1.1.3.Final.jar,/opt/spark/extra-jars/software.amazon.awssdk_bundle-2.24.6.jar,/opt/spark/extra-jars/com.microsoft.sqlserver_mssql-jdbc-13.4.0.jre11.jar,/opt/spark/extra-jars/com.sap.jconnect_jconn4-16.3.4.jar,/opt/spark/extra-jars/net.sourceforge.jtds_jtds-1.3.1.jar,/opt/spark/extra-jars/org.postgresql_postgresql-42.7.11.jar
spark.kubernetes.container.imagegitlab-registry.aegis-sentientai.com/aegis/aegis-de/spark:2026.04.29
spark.kubernetes.namespaceaegis-dev
spark.master.rest.enabledtrue
spark.master.rest.host0.0.0.0
spark.master.ui.titleAegis Data Engineering Spark Cluster
spark.scheduler.mode
spark.sql.catalog.spark_catalogorg.apache.spark.sql.delta.catalog.DeltaCatalog
spark.sql.extensionsio.delta.sql.DeltaSparkSessionExtension
spark.streaming.stopGracefullyOnShutdowntrue
spark.ui.reverseProxytrue
spark.ui.reverseProxyUrlhttps://aegis-de-spark-ui-dev.aegis-sentientai.com

Hadoop Properties

System Properties

Metrics Properties

Classpath Entries

Environment Variables