3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-wrkload-determination
application UI
Details for Stage 120062 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
11 s
Locality Level Summary:
Process local: 10000
Associated Job Ids:
46907
DAG Visualization
digraph G { subgraph clusterstage_120062 { label="Stage 120062"; subgraph cluster565572 { label="repartition"; 203687 [labelType="html" label="ShuffledRDD [203687] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 203688 [labelType="html" label="CoalescedRDD [203688] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 203689 [labelType="html" label="MapPartitionsRDD [203689] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster565573 { label="mapPartitions"; 203690 [labelType="html" label="MapPartitionsRDD [203690] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster565577 { label="Scan"; 203691 [labelType="html" label="MapPartitionsRDD [203691] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster565576 { label="AppendColumnsWithObject"; 203692 [labelType="html" label="MapPartitionsRDD [203692] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster565575 { label="Exchange"; 203693 [labelType="html" label="MapPartitionsRDD [203693] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } } 203687->203688; 203688->203689; 203689->203690; 203690->203691; 203691->203692; 203692->203693; }
203686,203687
Event Timeline
Enable zooming
Tasks: 10000. 100 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time