3.5.0
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
AdsHub Analysis Processor
application UI
Details for Stage 4 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
17 s
Locality Level Summary:
Process local: 50
Associated Job Ids:
2
DAG Visualization
digraph G { subgraph clusterstage_4 { label="Stage 4"; subgraph cluster14 { label="Exchange"; 30 [labelType="html" label="ShuffledRowRDD [30] [Unordered]<br>start at <unknown>:0"]; } subgraph cluster13 { label="HashAggregate"; 31 [labelType="html" label="MapPartitionsRDD [31] [Unordered]<br>start at <unknown>:0"]; } subgraph cluster10 { label="StateStoreRestore"; 34 [labelType="html" label="ReadStateStoreRDD [34] [Unordered]<br>start at <unknown>:0"]; } subgraph cluster9 { label="HashAggregate"; 40 [labelType="html" label="MapPartitionsRDD [40] [Unordered]<br>start at <unknown>:0"]; } subgraph cluster7 { label="StateStoreSave"; 42 [labelType="html" label="StateStoreRDD [42] [Unordered]<br>start at <unknown>:0"]; } subgraph cluster5 { label="HashAggregate"; 49 [labelType="html" label="MapPartitionsRDD [49] [Unordered]<br>start at <unknown>:0"]; } subgraph cluster0 { label="Exchange"; 50 [labelType="html" label="MapPartitionsRDD [50] [Unordered]<br>start at <unknown>:0"]; 51 [labelType="html" label="MapPartitionsRDD [51] [Unordered]<br>start at <unknown>:0"]; } } 30->31; 31->34; 34->40; 40->42; 42->49; 49->50; 50->51; }
29,30
Event Timeline
Enable zooming
Tasks: 50. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time