3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-wrkload-determination
application UI
Details for Stage 120065 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.7 s
Locality Level Summary:
Process local: 200
Associated Job Ids:
46908
DAG Visualization
digraph G { subgraph clusterstage_120065 { label="Stage 120065"; subgraph cluster565586 { label="Exchange"; 203694 [labelType="html" label="ShuffledRowRDD [203694] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster565582 { label="WholeStageCodegen (1)"; 203695 [labelType="html" label="MapPartitionsRDD [203695] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster565581 { label="MapGroups"; 203696 [labelType="html" label="MapPartitionsRDD [203696] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster565578 { label="WholeStageCodegen (2)"; 203697 [labelType="html" label="MapPartitionsRDD [203697] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster565587 { label="mapPartitionsInternal"; 203698 [labelType="html" label="MapPartitionsRDD [203698] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster565588 { label="mapPartitionsInternal"; 203699 [labelType="html" label="AdaptiveSparkPlan isFinalPlan=false\n+- SerializeFromObject [staticinvoke(class org.apache.spark.unsafe.types.UTF8String, StringType, fromString, knownnotnull(assertnotnull(input[0, org.apache.spark.sql.delta.SerializableFileStatus, true])).path, true, false, true) AS path#3310803, knownnotnull(assertnotnull(input[0, org.apache.spark.sql.delta.SerializableFileStatus, true])).length AS length#3310804L, knownnotnull(assertnotnull(input[0, org.apache.spark.sql.delta.SerializableFileStatus, true])).isDir AS isDir#3310805, knownnotnull(assertnotnull(input[0, org.apache.spark.sql.delta.SerializableFileStatus, true])).modificationTime AS modificationTime#3310806L]\n +- MapGroups org.apache.spark.sql.KeyValueGroupedDataset$$Lambda$6934/0x0000000801d21280@2335511c, value#3310797.toString, newInstance(class org.apache.spark.sql.delta.SerializableFileStatus), [value#3310797], [path#3310787, length#3310788L, isDir#3310789, modificationTime#3310790L], obj#3310802: org.apache.spark.sql.delta.SerializableFileStatus\n ... [203699] [Cached] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } } 203694->203695; 203695->203696; 203696->203697; 203697->203698; 203698->203699; }
203693,203694
203699
Event Timeline
Enable zooming
Tasks: 200. 2 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time