4.1.1 Aegis Data Engineering Spark Cluster

  • URL: spark://aegis-de-spark-cluster-master-0:7077
  • REST URL: spark://aegis-de-spark-cluster-master-0:6066 (cluster mode)
  • Workers: 1 Alive, 1 Dead, 0 Decommissioned, 0 Unknown
  • Cores in use: 4 Total, 0 Used
  • Memory in use: 7.0 GiB Total, 0.0 B Used
  • Resources in use:
  • Applications: 0 Running, 9 Completed
  • Drivers: 0 Running (0 Waiting), 0 Completed (0 Killed, 0 Failed, 0 Error, 0 Relaunching)
  • Status: ALIVE (Environment, Log)

Workers (2)

Worker IdAddressStateCoresMemory
worker-20260517203050-10.244.46.16-46525 10.244.46.16:46525 ALIVE 4 (0 Used) 7.0 GiB (0.0 B Used)
worker-20260517213545-10.244.46.15-42095 10.244.46.15:42095 DEAD 4 (0 Used) 7.0 GiB (0.0 B Used)

Running Applications (0)

Application IDNameCoresMemory per ExecutorResources Per ExecutorSubmitted TimeUserStateDuration

Completed Applications (9)

Application IDNameCoresMemory per ExecutorResources Per ExecutorSubmitted TimeUserStateDuration
app-20260517213530-0008 aegis-cluster-test 6 2.0 GiB 2026/05/17 21:35:30 aegis FINISHED 17 s
app-20260517211631-0007 aegis-cluster-test 3 2.0 GiB 2026/05/17 21:16:31 aegis FINISHED 17 s
app-20260517210042-0006 aegis-cluster-test 6 2.0 GiB 2026/05/17 21:00:42 aegis FINISHED 16 s
app-20260517205656-0005 aegis-cluster-test 6 2.0 GiB 2026/05/17 20:56:56 aegis FINISHED 19 s
app-20260517205528-0004 aegis-cluster-test 6 2.0 GiB 2026/05/17 20:55:28 aegis FINISHED 17 s
app-20260517205405-0003 aegis-cluster-test 6 2.0 GiB 2026/05/17 20:54:05 aegis FINISHED 11 s
app-20260517205207-0002 aegis-cluster-test 3 2.0 GiB 2026/05/17 20:52:07 aegis FINISHED 10 s
app-20260517203850-0001 aegis-cluster-test 3 2.0 GiB 2026/05/17 20:38:50 aegis FINISHED 10 s
app-20260517203133-0000 aegis-cluster-test 8 1024.0 MiB 2026/05/17 20:31:33 aegis KILLED 55 s