RDD Storage Info for AdaptiveSparkPlan isFinalPlan=false +- Project [product#124891, plant#124890, validFrom#124965, CASE WHEN (validTo#124973 > cast(blockedForReplenishmentStartingFrom#124892 as timestamp)) THEN cast(blockedForReplenishmentStartingFrom#124892 as timestamp) ELSE validTo#124973 END AS validTo#125675, prodPlantListingValidFrom#124982, prodPlantListingValidTo#124983] +- Filter ((isnotnull(blockedForReplenishmentStartingFrom#124892) AND (validFrom#124965 < cast(blockedForReplenishmentStartingFrom#124892 as timestamp))) OR isnull(blockedForReplenishmentStartingFrom#124892)) +- InMemoryTableScan [blockedForReplenishmentStartingFrom#124892, plant#124890, prodPlantListingValidFrom#124982, prodPlantListingValidTo#124983, product#124891, validFrom#124965, validTo#124973], [((isnotnull(blockedForReplenishmentStartingFrom#124892) AND (validFrom#124965 < cast(blockedForReplenishmentStartingFrom#124892 as timestamp))) OR isnull(blockedForReplenishmentStartingFrom#124892))] +- InMemoryRelation [product#1...

  • Storage Level: Disk Memory Serialized 2x Replicated
  • Cached Partitions: 12
  • Total Partitions: 12
  • Memory Size: 647.5 KiB
  • Disk Size: 0.0 B

Data Distribution on 4 Executors

HostOn Heap Memory UsageOff Heap Memory UsageDisk Usage
10.96.33.53:7079 109.3 KiB (-2613100611.0 B Remaining) 0.0 B (0.0 B Remaining) 0.0 B
10.96.16.73:7079 138.5 KiB (-2886503624.0 B Remaining) 0.0 B (0.0 B Remaining) 0.0 B
10.96.20.124:7079 222.4 KiB (-2748206691.0 B Remaining) 0.0 B (0.0 B Remaining) 0.0 B
10.96.0.101:7079 177.3 KiB (-3057581651.0 B Remaining) 0.0 B (0.0 B Remaining) 0.0 B

12 Partitions

Page:
Block Name Storage Level Size in Memory Size on Disk Executors ▴
rdd_4455_11 Memory Serialized 2x Replicated 59.9 KiB 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_4455_2 Memory Serialized 2x Replicated 71.7 KiB 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_4455_6 Memory Serialized 2x Replicated 76.2 KiB 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_4455_0 Memory Serialized 2x Replicated 75.8 KiB 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_4455_10 Memory Serialized 2x Replicated 71.0 KiB 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4455_3 Memory Serialized 2x Replicated 72.7 KiB 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_4455_7 Memory Serialized 2x Replicated 72.6 KiB 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_4455_5 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_4455_9 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_4455_1 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.124:7079 10.96.33.53:7079
rdd_4455_4 Memory Serialized 2x Replicated 72.3 KiB 0.0 B 10.96.20.124:7079 10.96.33.53:7079
rdd_4455_8 Memory Serialized 2x Replicated 75.2 KiB 0.0 B 10.96.20.124:7079 10.96.33.53:7079
Page: