3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-wrkload-determination
application UI
Details for Stage 121653 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
11 s
Locality Level Summary:
Process local: 10000
Associated Job Ids:
47647
DAG Visualization
digraph G { subgraph clusterstage_121653 { label="Stage 121653"; subgraph cluster574193 { label="repartition"; 207424 [labelType="html" label="ShuffledRDD [207424] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 207425 [labelType="html" label="CoalescedRDD [207425] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 207426 [labelType="html" label="MapPartitionsRDD [207426] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster574194 { label="mapPartitions"; 207427 [labelType="html" label="MapPartitionsRDD [207427] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster574198 { label="Scan"; 207428 [labelType="html" label="MapPartitionsRDD [207428] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster574197 { label="AppendColumnsWithObject"; 207429 [labelType="html" label="MapPartitionsRDD [207429] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster574196 { label="Exchange"; 207430 [labelType="html" label="MapPartitionsRDD [207430] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } } 207424->207425; 207425->207426; 207426->207427; 207427->207428; 207428->207429; 207429->207430; }
207423,207424
Event Timeline
Enable zooming
Tasks: 10000. 100 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time