3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-wrkload-determination
application UI
Details for Stage 117826 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
11 s
Locality Level Summary:
Process local: 10000
Associated Job Ids:
45867
DAG Visualization
digraph G { subgraph clusterstage_117826 { label="Stage 117826"; subgraph cluster553456 { label="repartition"; 198435 [labelType="html" label="ShuffledRDD [198435] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 198436 [labelType="html" label="CoalescedRDD [198436] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 198437 [labelType="html" label="MapPartitionsRDD [198437] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster553457 { label="mapPartitions"; 198438 [labelType="html" label="MapPartitionsRDD [198438] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster553461 { label="Scan"; 198439 [labelType="html" label="MapPartitionsRDD [198439] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster553460 { label="AppendColumnsWithObject"; 198440 [labelType="html" label="MapPartitionsRDD [198440] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster553459 { label="Exchange"; 198441 [labelType="html" label="MapPartitionsRDD [198441] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } } 198435->198436; 198436->198437; 198437->198438; 198438->198439; 198439->198440; 198440->198441; }
198434,198435
Event Timeline
Enable zooming
Tasks: 10000. 100 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time