3.5.0
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
AdsHub Analysis Processor
application UI
Details for Stage 1536 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Process local: 2
Input Size / Records:
0.0 B / 2
Shuffle Write Size / Records:
307.0 B / 2
Associated Job Ids:
512
DAG Visualization
digraph G { subgraph clusterstage_1536 { label="Stage 1536"; subgraph cluster831 { label="MicroBatchScan"; 764 [labelType="html" label="DataSourceRDD [764]<br>run at <unknown>:0"]; 765 [labelType="html" label="MapPartitionsRDD [765]<br>run at <unknown>:0"]; } subgraph cluster830 { label="Filter"; 766 [labelType="html" label="MapPartitionsRDD [766]<br>run at <unknown>:0"]; } subgraph cluster829 { label="Project"; 767 [labelType="html" label="MapPartitionsRDD [767]<br>run at <unknown>:0"]; } subgraph cluster826 { label="WholeStageCodegen (1)"; 768 [labelType="html" label="MapPartitionsRDD [768]<br>run at <unknown>:0"]; } subgraph cluster825 { label="EventTimeWatermark"; 769 [labelType="html" label="MapPartitionsRDD [769]<br>run at <unknown>:0"]; } subgraph cluster822 { label="WholeStageCodegen (2)"; 770 [labelType="html" label="MapPartitionsRDD [770]<br>run at <unknown>:0"]; } subgraph cluster821 { label="ObjectHashAggregate"; 771 [labelType="html" label="MapPartitionsRDD [771]<br>run at <unknown>:0"]; } subgraph cluster820 { label="Exchange"; 772 [labelType="html" label="MapPartitionsRDD [772]<br>run at <unknown>:0"]; } } 764->765; 765->766; 766->767; 767->768; 768->769; 769->770; 770->771; 771->772; }
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time