3.5.0
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
AdsHub Analysis Processor
application UI
Details for Stage 1537 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
8 s
Locality Level Summary:
Process local: 50
Shuffle Read Size / Records:
307.0 B / 2
Shuffle Write Size / Records:
142.0 B / 1
Associated Job Ids:
512
DAG Visualization
digraph G { subgraph clusterstage_1537 { label="Stage 1537"; subgraph cluster820 { label="Exchange"; 773 [labelType="html" label="ShuffledRowRDD [773] [Unordered]<br>run at <unknown>:0"]; } subgraph cluster819 { label="ObjectHashAggregate"; 774 [labelType="html" label="MapPartitionsRDD [774] [Unordered]<br>run at <unknown>:0"]; } subgraph cluster818 { label="StateStoreRestore"; 775 [labelType="html" label="ReadStateStoreRDD [775] [Unordered]<br>run at <unknown>:0"]; } subgraph cluster817 { label="ObjectHashAggregate"; 776 [labelType="html" label="MapPartitionsRDD [776] [Unordered]<br>run at <unknown>:0"]; } subgraph cluster816 { label="StateStoreSave"; 777 [labelType="html" label="StateStoreRDD [777] [Unordered]<br>run at <unknown>:0"]; } subgraph cluster815 { label="ObjectHashAggregate"; 778 [labelType="html" label="MapPartitionsRDD [778] [Unordered]<br>run at <unknown>:0"]; } subgraph cluster814 { label="Exchange"; 779 [labelType="html" label="MapPartitionsRDD [779] [Unordered]<br>run at <unknown>:0"]; 780 [labelType="html" label="MapPartitionsRDD [780] [Unordered]<br>run at <unknown>:0"]; } } 773->774; 774->775; 775->776; 776->777; 777->778; 778->779; 779->780; }
772,773
Event Timeline
Enable zooming
Tasks: 50. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time