3.5.0
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
AdsHub Analysis Processor
application UI
Details for Stage 1060 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
9 s
Locality Level Summary:
Process local: 50
Associated Job Ids:
353
DAG Visualization
digraph G { subgraph clusterstage_1060 { label="Stage 1060"; subgraph cluster627 { label="Exchange"; 561 [labelType="html" label="ShuffledRowRDD [561] [Unordered]<br>run at <unknown>:0"]; } subgraph cluster624 { label="WholeStageCodegen (2)"; 562 [labelType="html" label="MapPartitionsRDD [562] [Unordered]<br>run at <unknown>:0"]; } subgraph cluster623 { label="SortAggregate"; 563 [labelType="html" label="MapPartitionsRDD [563] [Unordered]<br>run at <unknown>:0"]; } subgraph cluster622 { label="StateStoreRestore"; 564 [labelType="html" label="ReadStateStoreRDD [564] [Unordered]<br>run at <unknown>:0"]; } subgraph cluster619 { label="WholeStageCodegen (3)"; 569 [labelType="html" label="MapPartitionsRDD [569] [Unordered]<br>run at <unknown>:0"]; } subgraph cluster618 { label="SortAggregate"; 570 [labelType="html" label="MapPartitionsRDD [570] [Unordered]<br>run at <unknown>:0"]; } subgraph cluster617 { label="StateStoreSave"; 571 [labelType="html" label="StateStoreRDD [571] [Unordered]<br>run at <unknown>:0"]; } subgraph cluster614 { label="WholeStageCodegen (4)"; 572 [labelType="html" label="MapPartitionsRDD [572] [Unordered]<br>run at <unknown>:0"]; } subgraph cluster613 { label="SortAggregate"; 573 [labelType="html" label="MapPartitionsRDD [573] [Unordered]<br>run at <unknown>:0"]; } subgraph cluster610 { label="WholeStageCodegen (5)"; 574 [labelType="html" label="MapPartitionsRDD [574] [Unordered]<br>run at <unknown>:0"]; } subgraph cluster609 { label="Exchange"; 575 [labelType="html" label="MapPartitionsRDD [575] [Unordered]<br>run at <unknown>:0"]; 576 [labelType="html" label="MapPartitionsRDD [576] [Unordered]<br>run at <unknown>:0"]; } } 561->562; 562->563; 563->564; 564->569; 569->570; 570->571; 571->572; 572->573; 573->574; 574->575; 575->576; }
560,561
Event Timeline
Enable zooming
Tasks: 50. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time