3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-wrkload-determination
application UI
Details for Stage 119718 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
11 s
Locality Level Summary:
Process local: 10000
Associated Job Ids:
46747
DAG Visualization
digraph G { subgraph clusterstage_119718 { label="Stage 119718"; subgraph cluster563708 { label="repartition"; 202879 [labelType="html" label="ShuffledRDD [202879] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 202880 [labelType="html" label="CoalescedRDD [202880] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 202881 [labelType="html" label="MapPartitionsRDD [202881] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster563709 { label="mapPartitions"; 202882 [labelType="html" label="MapPartitionsRDD [202882] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster563713 { label="Scan"; 202883 [labelType="html" label="MapPartitionsRDD [202883] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster563712 { label="AppendColumnsWithObject"; 202884 [labelType="html" label="MapPartitionsRDD [202884] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster563711 { label="Exchange"; 202885 [labelType="html" label="MapPartitionsRDD [202885] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } } 202879->202880; 202880->202881; 202881->202882; 202882->202883; 202883->202884; 202884->202885; }
202878,202879
Event Timeline
Enable zooming
Tasks: 10000. 100 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time