3.5.0
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
AdsHub Analysis Processor
application UI
Details for Stage 2640 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Process local: 2
Input Size / Records:
0.0 B / 2
Shuffle Write Size / Records:
462.0 B / 2
Associated Job Ids:
880
DAG Visualization
digraph G { subgraph clusterstage_2640 { label="Stage 2640"; subgraph cluster1492 { label="MicroBatchScan"; 1325 [labelType="html" label="DataSourceRDD [1325]<br>run at <unknown>:0"]; 1326 [labelType="html" label="MapPartitionsRDD [1326]<br>run at <unknown>:0"]; } subgraph cluster1491 { label="Filter"; 1327 [labelType="html" label="MapPartitionsRDD [1327]<br>run at <unknown>:0"]; } subgraph cluster1490 { label="Project"; 1328 [labelType="html" label="MapPartitionsRDD [1328]<br>run at <unknown>:0"]; } subgraph cluster1487 { label="WholeStageCodegen (1)"; 1329 [labelType="html" label="MapPartitionsRDD [1329]<br>run at <unknown>:0"]; } subgraph cluster1486 { label="EventTimeWatermark"; 1330 [labelType="html" label="MapPartitionsRDD [1330]<br>run at <unknown>:0"]; } subgraph cluster1482 { label="WholeStageCodegen (2)"; 1331 [labelType="html" label="MapPartitionsRDD [1331]<br>run at <unknown>:0"]; } subgraph cluster1481 { label="SortAggregate"; 1332 [labelType="html" label="MapPartitionsRDD [1332]<br>run at <unknown>:0"]; } subgraph cluster1480 { label="Exchange"; 1333 [labelType="html" label="MapPartitionsRDD [1333]<br>run at <unknown>:0"]; } } 1325->1326; 1326->1327; 1327->1328; 1328->1329; 1329->1330; 1330->1331; 1331->1332; 1332->1333; }
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time