3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-wrkload-determination
application UI
Details for Stage 118471 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
11 s
Locality Level Summary:
Process local: 10000
Associated Job Ids:
46167
DAG Visualization
digraph G { subgraph clusterstage_118471 { label="Stage 118471"; subgraph cluster556951 { label="repartition"; 199950 [labelType="html" label="ShuffledRDD [199950] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 199951 [labelType="html" label="CoalescedRDD [199951] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 199952 [labelType="html" label="MapPartitionsRDD [199952] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster556952 { label="mapPartitions"; 199953 [labelType="html" label="MapPartitionsRDD [199953] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster556956 { label="Scan"; 199954 [labelType="html" label="MapPartitionsRDD [199954] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster556955 { label="AppendColumnsWithObject"; 199955 [labelType="html" label="MapPartitionsRDD [199955] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster556954 { label="Exchange"; 199956 [labelType="html" label="MapPartitionsRDD [199956] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } } 199950->199951; 199951->199952; 199952->199953; 199953->199954; 199954->199955; 199955->199956; }
199949,199950
Event Timeline
Enable zooming
Tasks: 10000. 100 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time