3.5.0
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
AdsHub Analysis Processor
application UI
Details for Stage 481 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
8 s
Locality Level Summary:
Process local: 50
Associated Job Ids:
160
DAG Visualization
digraph G { subgraph clusterstage_481 { label="Stage 481"; subgraph cluster290 { label="Exchange"; 252 [labelType="html" label="ShuffledRowRDD [252] [Unordered]<br>run at <unknown>:0"]; } subgraph cluster287 { label="WholeStageCodegen (2)"; 253 [labelType="html" label="MapPartitionsRDD [253] [Unordered]<br>run at <unknown>:0"]; } subgraph cluster286 { label="SortAggregate"; 254 [labelType="html" label="MapPartitionsRDD [254] [Unordered]<br>run at <unknown>:0"]; } subgraph cluster285 { label="StateStoreRestore"; 255 [labelType="html" label="ReadStateStoreRDD [255] [Unordered]<br>run at <unknown>:0"]; } subgraph cluster282 { label="WholeStageCodegen (3)"; 256 [labelType="html" label="MapPartitionsRDD [256] [Unordered]<br>run at <unknown>:0"]; } subgraph cluster281 { label="SortAggregate"; 257 [labelType="html" label="MapPartitionsRDD [257] [Unordered]<br>run at <unknown>:0"]; } subgraph cluster280 { label="StateStoreSave"; 258 [labelType="html" label="StateStoreRDD [258] [Unordered]<br>run at <unknown>:0"]; } subgraph cluster277 { label="WholeStageCodegen (4)"; 259 [labelType="html" label="MapPartitionsRDD [259] [Unordered]<br>run at <unknown>:0"]; } subgraph cluster276 { label="SortAggregate"; 260 [labelType="html" label="MapPartitionsRDD [260] [Unordered]<br>run at <unknown>:0"]; } subgraph cluster273 { label="WholeStageCodegen (5)"; 261 [labelType="html" label="MapPartitionsRDD [261] [Unordered]<br>run at <unknown>:0"]; } subgraph cluster272 { label="Exchange"; 262 [labelType="html" label="MapPartitionsRDD [262] [Unordered]<br>run at <unknown>:0"]; 263 [labelType="html" label="MapPartitionsRDD [263] [Unordered]<br>run at <unknown>:0"]; } } 252->253; 253->254; 254->255; 255->256; 256->257; 257->258; 258->259; 259->260; 260->261; 261->262; 262->263; }
251,252
Event Timeline
Enable zooming
Tasks: 50. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time