3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-wrkload-determination
application UI
Details for Stage 120140 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0 ms
Locality Level Summary:
Process local: 50
Input Size / Records:
1050.0 B / 0
Associated Job Ids:
46943
DAG Visualization
digraph G { subgraph clusterstage_120140 { label="Stage 120140"; 47136 [labelType="html" label="SQLExecutionRDD [47136] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 47146 [labelType="html" label="SQLExecutionRDD [47146] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; subgraph cluster141548 { label="Exchange"; 47131 [labelType="html" label="ShuffledRowRDD [47131] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster141543 { label="WholeStageCodegen (3)"; 47132 [labelType="html" label="MapPartitionsRDD [47132] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster141542 { label="DeserializeToObject"; 47133 [labelType="html" label="MapPartitionsRDD [47133] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster141541 { label="MapPartitions"; 47134 [labelType="html" label="MapPartitionsRDD [47134] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster141538 { label="WholeStageCodegen (4)"; 47135 [labelType="html" label="MapPartitionsRDD [47135] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster141549 { label="map"; 47137 [labelType="html" label="Delta Table State #22 - hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-workload-determination-service/in/workload-dupl-lock-v2/_delta_log [47137] [Cached] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster141582 { label="WholeStageCodegen (1)"; 47144 [labelType="html" label="MapPartitionsRDD [47144] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster141581 { label="Project"; 47145 [labelType="html" label="MapPartitionsRDD [47145] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster141589 { label="map"; 47147 [labelType="html" label="Delta Table State with Stats #22 - hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-workload-determination-service/in/workload-dupl-lock-v2/_delta_log [47147] [Cached] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster566000 { label="WholeStageCodegen (1)"; 203878 [labelType="html" label="MapPartitionsRDD [203878] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster566004 { label="mapPartitionsInternal"; 203879 [labelType="html" label="MapPartitionsRDD [203879] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } } 47131->47132; 47132->47133; 47133->47134; 47134->47135; 47135->47136; 47136->47137; 47137->47144; 47144->47145; 47145->47146; 47146->47147; 47147->203878; 203878->203879; }
47130,47131
47137
47147
Event Timeline
Enable zooming
Tasks: 50. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time