3.5.0
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
AdsHub Analysis Processor
application UI
Details for Stage 4 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
20 s
Locality Level Summary:
Process local: 50
Associated Job Ids:
2
DAG Visualization
digraph G { subgraph clusterstage_4 { label="Stage 4"; subgraph cluster13 { label="Exchange"; 30 [labelType="html" label="ShuffledRowRDD [30] [Unordered]<br>start at <unknown>:0"]; } subgraph cluster11 { label="HashAggregate"; 34 [labelType="html" label="MapPartitionsRDD [34] [Unordered]<br>start at <unknown>:0"]; } subgraph cluster8 { label="StateStoreRestore"; 35 [labelType="html" label="ReadStateStoreRDD [35] [Unordered]<br>start at <unknown>:0"]; } subgraph cluster6 { label="HashAggregate"; 41 [labelType="html" label="MapPartitionsRDD [41] [Unordered]<br>start at <unknown>:0"]; } subgraph cluster5 { label="StateStoreSave"; 43 [labelType="html" label="StateStoreRDD [43] [Unordered]<br>start at <unknown>:0"]; } subgraph cluster3 { label="HashAggregate"; 49 [labelType="html" label="MapPartitionsRDD [49] [Unordered]<br>start at <unknown>:0"]; } subgraph cluster2 { label="Exchange"; 50 [labelType="html" label="MapPartitionsRDD [50] [Unordered]<br>start at <unknown>:0"]; 51 [labelType="html" label="MapPartitionsRDD [51] [Unordered]<br>start at <unknown>:0"]; } } 30->34; 34->35; 35->41; 41->43; 43->49; 49->50; 50->51; }
29,30
Event Timeline
Enable zooming
Tasks: 50. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time