3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-wrkload-determination
application UI
Details for Stage 120796 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.8 s
Locality Level Summary:
Process local: 200
Associated Job Ids:
47248
DAG Visualization
digraph G { subgraph clusterstage_120796 { label="Stage 120796"; subgraph cluster569547 { label="Exchange"; 205411 [labelType="html" label="ShuffledRowRDD [205411] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster569543 { label="WholeStageCodegen (1)"; 205412 [labelType="html" label="MapPartitionsRDD [205412] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster569542 { label="MapGroups"; 205413 [labelType="html" label="MapPartitionsRDD [205413] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster569539 { label="WholeStageCodegen (2)"; 205414 [labelType="html" label="MapPartitionsRDD [205414] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster569548 { label="mapPartitionsInternal"; 205415 [labelType="html" label="MapPartitionsRDD [205415] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster569549 { label="mapPartitionsInternal"; 205416 [labelType="html" label="AdaptiveSparkPlan isFinalPlan=false\n+- SerializeFromObject [staticinvoke(class org.apache.spark.unsafe.types.UTF8String, StringType, fromString, knownnotnull(assertnotnull(input[0, org.apache.spark.sql.delta.SerializableFileStatus, true])).path, true, false, true) AS path#3339499, knownnotnull(assertnotnull(input[0, org.apache.spark.sql.delta.SerializableFileStatus, true])).length AS length#3339500L, knownnotnull(assertnotnull(input[0, org.apache.spark.sql.delta.SerializableFileStatus, true])).isDir AS isDir#3339501, knownnotnull(assertnotnull(input[0, org.apache.spark.sql.delta.SerializableFileStatus, true])).modificationTime AS modificationTime#3339502L]\n +- MapGroups org.apache.spark.sql.KeyValueGroupedDataset$$Lambda$6934/0x0000000801d21280@6e0d3b1d, value#3339493.toString, newInstance(class org.apache.spark.sql.delta.SerializableFileStatus), [value#3339493], [path#3339483, length#3339484L, isDir#3339485, modificationTime#3339486L], obj#3339498: org.apache.spark.sql.delta.SerializableFileStatus\n ... [205416] [Cached] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } } 205411->205412; 205412->205413; 205413->205414; 205414->205415; 205415->205416; }
205410,205411
205416
Event Timeline
Enable zooming
Tasks: 200. 2 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time