3.5.0
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
AdsHub Analysis Processor
application UI
Details for Stage 240 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.7 s
Locality Level Summary:
Process local: 1
Input Size / Records:
0.0 B / 1
Associated Job Ids:
80
DAG Visualization
digraph G { subgraph clusterstage_240 { label="Stage 240"; subgraph cluster153 { label="MicroBatchScan"; 123 [labelType="html" label="DataSourceRDD [123]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; 124 [labelType="html" label="MapPartitionsRDD [124]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; } subgraph cluster152 { label="Filter"; 125 [labelType="html" label="MapPartitionsRDD [125]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; } subgraph cluster151 { label="Project"; 126 [labelType="html" label="MapPartitionsRDD [126]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; } subgraph cluster148 { label="WholeStageCodegen (1)"; 127 [labelType="html" label="MapPartitionsRDD [127]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; } subgraph cluster147 { label="EventTimeWatermark"; 128 [labelType="html" label="MapPartitionsRDD [128]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; } subgraph cluster144 { label="WholeStageCodegen (2)"; 129 [labelType="html" label="MapPartitionsRDD [129]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; } subgraph cluster143 { label="HashAggregate"; 130 [labelType="html" label="MapPartitionsRDD [130]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; } subgraph cluster142 { label="Exchange"; 131 [labelType="html" label="MapPartitionsRDD [131]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; } } 123->124; 124->125; 125->126; 126->127; 127->128; 128->129; 129->130; 130->131; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time