3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-wrkload-determination
application UI
Details for Stage 115676 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
12 s
Locality Level Summary:
Process local: 10000
Associated Job Ids:
44867
DAG Visualization
digraph G { subgraph clusterstage_115676 { label="Stage 115676"; subgraph cluster541806 { label="repartition"; 193385 [labelType="html" label="ShuffledRDD [193385] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 193386 [labelType="html" label="CoalescedRDD [193386] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 193387 [labelType="html" label="MapPartitionsRDD [193387] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster541807 { label="mapPartitions"; 193388 [labelType="html" label="MapPartitionsRDD [193388] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster541811 { label="Scan"; 193389 [labelType="html" label="MapPartitionsRDD [193389] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster541810 { label="AppendColumnsWithObject"; 193390 [labelType="html" label="MapPartitionsRDD [193390] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster541809 { label="Exchange"; 193391 [labelType="html" label="MapPartitionsRDD [193391] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } } 193385->193386; 193386->193387; 193387->193388; 193388->193389; 193389->193390; 193390->193391; }
193384,193385
Event Timeline
Enable zooming
Tasks: 10000. 100 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time