3.5.0
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
AdsHub Analysis Processor
application UI
Details for Stage 241 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
7 s
Locality Level Summary:
Process local: 50
Associated Job Ids:
80
DAG Visualization
digraph G { subgraph clusterstage_241 { label="Stage 241"; subgraph cluster142 { label="Exchange"; 132 [labelType="html" label="ShuffledRowRDD [132] [Unordered]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; } subgraph cluster141 { label="HashAggregate"; 133 [labelType="html" label="MapPartitionsRDD [133] [Unordered]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; } subgraph cluster140 { label="StateStoreRestore"; 134 [labelType="html" label="ReadStateStoreRDD [134] [Unordered]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; } subgraph cluster139 { label="HashAggregate"; 135 [labelType="html" label="MapPartitionsRDD [135] [Unordered]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; } subgraph cluster138 { label="StateStoreSave"; 136 [labelType="html" label="StateStoreRDD [136] [Unordered]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; } subgraph cluster137 { label="HashAggregate"; 137 [labelType="html" label="MapPartitionsRDD [137] [Unordered]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; } subgraph cluster136 { label="Exchange"; 138 [labelType="html" label="MapPartitionsRDD [138] [Unordered]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; 139 [labelType="html" label="MapPartitionsRDD [139] [Unordered]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; } } 132->133; 133->134; 134->135; 135->136; 136->137; 137->138; 138->139; }
131,132
Event Timeline
Enable zooming
Tasks: 50. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time