3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-wrkload-determination
application UI
Details for Stage 121696 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
11 s
Locality Level Summary:
Process local: 10000
Associated Job Ids:
47667
DAG Visualization
digraph G { subgraph clusterstage_121696 { label="Stage 121696"; subgraph cluster574426 { label="repartition"; 207525 [labelType="html" label="ShuffledRDD [207525] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 207526 [labelType="html" label="CoalescedRDD [207526] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 207527 [labelType="html" label="MapPartitionsRDD [207527] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster574427 { label="mapPartitions"; 207528 [labelType="html" label="MapPartitionsRDD [207528] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster574431 { label="Scan"; 207529 [labelType="html" label="MapPartitionsRDD [207529] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster574430 { label="AppendColumnsWithObject"; 207530 [labelType="html" label="MapPartitionsRDD [207530] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster574429 { label="Exchange"; 207531 [labelType="html" label="MapPartitionsRDD [207531] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } } 207525->207526; 207526->207527; 207527->207528; 207528->207529; 207529->207530; 207530->207531; }
207524,207525
Event Timeline
Enable zooming
Tasks: 10000. 100 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time