3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-wrkload-determination
application UI
Details for Stage 118041 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
11 s
Locality Level Summary:
Process local: 10000
Associated Job Ids:
45967
DAG Visualization
digraph G { subgraph clusterstage_118041 { label="Stage 118041"; subgraph cluster554621 { label="repartition"; 198940 [labelType="html" label="ShuffledRDD [198940] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 198941 [labelType="html" label="CoalescedRDD [198941] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 198942 [labelType="html" label="MapPartitionsRDD [198942] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster554622 { label="mapPartitions"; 198943 [labelType="html" label="MapPartitionsRDD [198943] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster554626 { label="Scan"; 198944 [labelType="html" label="MapPartitionsRDD [198944] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster554625 { label="AppendColumnsWithObject"; 198945 [labelType="html" label="MapPartitionsRDD [198945] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster554624 { label="Exchange"; 198946 [labelType="html" label="MapPartitionsRDD [198946] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } } 198940->198941; 198941->198942; 198942->198943; 198943->198944; 198944->198945; 198945->198946; }
198939,198940
Event Timeline
Enable zooming
Tasks: 10000. 100 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time