3.5.0
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
AdsHub Analysis Processor
application UI
Details for Stage 1153 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
10 s
Locality Level Summary:
Process local: 50
Associated Job Ids:
384
DAG Visualization
digraph G { subgraph clusterstage_1153 { label="Stage 1153"; subgraph cluster622 { label="Exchange"; 580 [labelType="html" label="ShuffledRowRDD [580] [Unordered]<br>run at <unknown>:0"]; } subgraph cluster619 { label="WholeStageCodegen (3)"; 581 [labelType="html" label="MapPartitionsRDD [581] [Unordered]<br>run at <unknown>:0"]; } subgraph cluster618 { label="SortAggregate"; 582 [labelType="html" label="MapPartitionsRDD [582] [Unordered]<br>run at <unknown>:0"]; } subgraph cluster617 { label="StateStoreRestore"; 583 [labelType="html" label="ReadStateStoreRDD [583] [Unordered]<br>run at <unknown>:0"]; } subgraph cluster614 { label="WholeStageCodegen (4)"; 584 [labelType="html" label="MapPartitionsRDD [584] [Unordered]<br>run at <unknown>:0"]; } subgraph cluster613 { label="SortAggregate"; 585 [labelType="html" label="MapPartitionsRDD [585] [Unordered]<br>run at <unknown>:0"]; } subgraph cluster612 { label="StateStoreSave"; 586 [labelType="html" label="StateStoreRDD [586] [Unordered]<br>run at <unknown>:0"]; } subgraph cluster609 { label="WholeStageCodegen (5)"; 587 [labelType="html" label="MapPartitionsRDD [587] [Unordered]<br>run at <unknown>:0"]; } subgraph cluster608 { label="SortAggregate"; 588 [labelType="html" label="MapPartitionsRDD [588] [Unordered]<br>run at <unknown>:0"]; } subgraph cluster605 { label="WholeStageCodegen (6)"; 589 [labelType="html" label="MapPartitionsRDD [589] [Unordered]<br>run at <unknown>:0"]; } subgraph cluster604 { label="Exchange"; 590 [labelType="html" label="MapPartitionsRDD [590] [Unordered]<br>run at <unknown>:0"]; 591 [labelType="html" label="MapPartitionsRDD [591] [Unordered]<br>run at <unknown>:0"]; } } 580->581; 581->582; 582->583; 583->584; 584->585; 585->586; 586->587; 587->588; 588->589; 589->590; 590->591; }
579,580
Event Timeline
Enable zooming
Tasks: 50. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time