3.5.0
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
AdsHub Analysis Processor
application UI
Details for Stage 1104 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Process local: 6
Input Size / Records:
0.0 B / 6
Shuffle Write Size / Records:
920.0 B / 6
Associated Job Ids:
368
DAG Visualization
digraph G { subgraph clusterstage_1104 { label="Stage 1104"; subgraph cluster599 { label="MicroBatchScan"; 548 [labelType="html" label="DataSourceRDD [548]<br>run at <unknown>:0"]; 549 [labelType="html" label="MapPartitionsRDD [549]<br>run at <unknown>:0"]; } subgraph cluster598 { label="Filter"; 550 [labelType="html" label="MapPartitionsRDD [550]<br>run at <unknown>:0"]; } subgraph cluster597 { label="Project"; 551 [labelType="html" label="MapPartitionsRDD [551]<br>run at <unknown>:0"]; } subgraph cluster594 { label="WholeStageCodegen (1)"; 552 [labelType="html" label="MapPartitionsRDD [552]<br>run at <unknown>:0"]; } subgraph cluster593 { label="EventTimeWatermark"; 553 [labelType="html" label="MapPartitionsRDD [553]<br>run at <unknown>:0"]; } subgraph cluster590 { label="WholeStageCodegen (2)"; 554 [labelType="html" label="MapPartitionsRDD [554]<br>run at <unknown>:0"]; } subgraph cluster589 { label="ObjectHashAggregate"; 555 [labelType="html" label="MapPartitionsRDD [555]<br>run at <unknown>:0"]; } subgraph cluster588 { label="Exchange"; 556 [labelType="html" label="MapPartitionsRDD [556]<br>run at <unknown>:0"]; } } 548->549; 549->550; 550->551; 551->552; 552->553; 553->554; 554->555; 555->556; }
Event Timeline
Enable zooming
Tasks: 6. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time