3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-wrkload-determination
application UI
Details for Stage 121223 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
11 s
Locality Level Summary:
Process local: 10000
Associated Job Ids:
47447
DAG Visualization
digraph G { subgraph clusterstage_121223 { label="Stage 121223"; subgraph cluster571863 { label="repartition"; 206414 [labelType="html" label="ShuffledRDD [206414] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 206415 [labelType="html" label="CoalescedRDD [206415] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 206416 [labelType="html" label="MapPartitionsRDD [206416] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster571864 { label="mapPartitions"; 206417 [labelType="html" label="MapPartitionsRDD [206417] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster571868 { label="Scan"; 206418 [labelType="html" label="MapPartitionsRDD [206418] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster571867 { label="AppendColumnsWithObject"; 206419 [labelType="html" label="MapPartitionsRDD [206419] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster571866 { label="Exchange"; 206420 [labelType="html" label="MapPartitionsRDD [206420] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } } 206414->206415; 206415->206416; 206416->206417; 206417->206418; 206418->206419; 206419->206420; }
206413,206414
Event Timeline
Enable zooming
Tasks: 10000. 100 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time