RDD Storage Info for AdaptiveSparkPlan isFinalPlan=false +- Project [product#53831, plant#53830, validFrom#53905, CASE WHEN (validTo#53913 > cast(blockedForReplenishmentStartingFrom#53832 as timestamp)) THEN cast(blockedForReplenishmentStartingFrom#53832 as timestamp) ELSE validTo#53913 END AS validTo#54345, prodPlantListingValidFrom#53922, prodPlantListingValidTo#53923] +- Filter ((isnotnull(blockedForReplenishmentStartingFrom#53832) AND (validFrom#53905 < cast(blockedForReplenishmentStartingFrom#53832 as timestamp))) OR isnull(blockedForReplenishmentStartingFrom#53832)) +- InMemoryTableScan [blockedForReplenishmentStartingFrom#53832, plant#53830, prodPlantListingValidFrom#53922, prodPlantListingValidTo#53923, product#53831, validFrom#53905, validTo#53913], [((isnotnull(blockedForReplenishmentStartingFrom#53832) AND (validFrom#53905 < cast(blockedForReplenishmentStartingFrom#53832 as timestamp))) OR isnull(blockedForReplenishmentStartingFrom#53832))] +- InMemoryRelation [product#53831, plant#53830, blocke...

  • Storage Level: Disk Memory Serialized 2x Replicated
  • Cached Partitions: 12
  • Total Partitions: 12
  • Memory Size: 6.3 MiB
  • Disk Size: 0.0 B

Data Distribution on 4 Executors

HostOn Heap Memory UsageOff Heap Memory UsageDisk Usage
10.96.33.53:7079 1758.2 KiB (-2613100611.0 B Remaining) 0.0 B (0.0 B Remaining) 0.0 B
10.96.16.73:7079 1391.9 KiB (-2886503624.0 B Remaining) 0.0 B (0.0 B Remaining) 0.0 B
10.96.20.124:7079 1484.4 KiB (-2748206691.0 B Remaining) 0.0 B (0.0 B Remaining) 0.0 B
10.96.0.101:7079 1848.0 KiB (-3057581651.0 B Remaining) 0.0 B (0.0 B Remaining) 0.0 B

12 Partitions

Page:
Block Name Storage Level Size in Memory ▴ Size on Disk Executors
rdd_1947_1 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_1947_5 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_1947_9 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_1947_11 Memory Serialized 2x Replicated 588.8 KiB 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_1947_7 Memory Serialized 2x Replicated 719.0 KiB 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_1947_2 Memory Serialized 2x Replicated 729.1 KiB 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_1947_8 Memory Serialized 2x Replicated 730.0 KiB 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_1947_3 Memory Serialized 2x Replicated 731.0 KiB 0.0 B 10.96.20.124:7079 10.96.33.53:7079
rdd_1947_4 Memory Serialized 2x Replicated 737.5 KiB 0.0 B 10.96.20.124:7079 10.96.33.53:7079
rdd_1947_10 Memory Serialized 2x Replicated 746.8 KiB 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_1947_0 Memory Serialized 2x Replicated 749.7 KiB 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_1947_6 Memory Serialized 2x Replicated 750.5 KiB 0.0 B 10.96.0.101:7079 10.96.20.124:7079
Page: