3.5.0
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
AdsHub Analysis Processor
application UI
Details for Stage 145 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
9 s
Locality Level Summary:
Process local: 50
Shuffle Read Size / Records:
132.0 B / 1
Shuffle Write Size / Records:
113.0 B / 1
Associated Job Ids:
48
DAG Visualization
digraph G { subgraph clusterstage_145 { label="Stage 145"; subgraph cluster85 { label="Exchange"; 82 [labelType="html" label="ShuffledRowRDD [82] [Unordered]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; } subgraph cluster84 { label="ObjectHashAggregate"; 83 [labelType="html" label="MapPartitionsRDD [83] [Unordered]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; } subgraph cluster83 { label="StateStoreRestore"; 84 [labelType="html" label="ReadStateStoreRDD [84] [Unordered]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; } subgraph cluster82 { label="ObjectHashAggregate"; 85 [labelType="html" label="MapPartitionsRDD [85] [Unordered]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; } subgraph cluster81 { label="StateStoreSave"; 86 [labelType="html" label="StateStoreRDD [86] [Unordered]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; } subgraph cluster80 { label="ObjectHashAggregate"; 87 [labelType="html" label="MapPartitionsRDD [87] [Unordered]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; } subgraph cluster79 { label="Exchange"; 88 [labelType="html" label="MapPartitionsRDD [88] [Unordered]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; 89 [labelType="html" label="MapPartitionsRDD [89] [Unordered]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; } } 82->83; 83->84; 84->85; 85->86; 86->87; 87->88; 88->89; }
81,82
Event Timeline
Enable zooming
Tasks: 50. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time