RDD Storage Info for AdaptiveSparkPlan isFinalPlan=false +- Project [product#672057, plant#672056, validFrom#672131, CASE WHEN (validTo#672139 > cast(blockedForReplenishmentStartingFrom#672058 as timestamp)) THEN cast(blockedForReplenishmentStartingFrom#672058 as timestamp) ELSE validTo#672139 END AS validTo#672841, prodPlantListingValidFrom#672148, prodPlantListingValidTo#672149] +- Filter ((isnotnull(blockedForReplenishmentStartingFrom#672058) AND (validFrom#672131 < cast(blockedForReplenishmentStartingFrom#672058 as timestamp))) OR isnull(blockedForReplenishmentStartingFrom#672058)) +- InMemoryTableScan [blockedForReplenishmentStartingFrom#672058, plant#672056, prodPlantListingValidFrom#672148, prodPlantListingValidTo#672149, product#672057, validFrom#672131, validTo#672139], [((isnotnull(blockedForReplenishmentStartingFrom#672058) AND (validFrom#672131 < cast(blockedForReplenishmentStartingFrom#672058 as timestamp))) OR isnull(blockedForReplenishmentStartingFrom#672058))] +- InMemoryRelation [product#6...

  • Storage Level: Disk Memory Serialized 2x Replicated
  • Cached Partitions: 12
  • Total Partitions: 12
  • Memory Size: 647.4 KiB
  • Disk Size: 0.0 B

Data Distribution on 4 Executors

HostOn Heap Memory UsageOff Heap Memory UsageDisk Usage
10.96.33.53:7079 37.5 KiB (-2613100611.0 B Remaining) 0.0 B (0.0 B Remaining) 0.0 B
10.96.16.73:7079 144.1 KiB (-2886503624.0 B Remaining) 0.0 B (0.0 B Remaining) 0.0 B
10.96.20.124:7079 250.6 KiB (-2748206691.0 B Remaining) 0.0 B (0.0 B Remaining) 0.0 B
10.96.0.101:7079 215.1 KiB (-3057581651.0 B Remaining) 0.0 B (0.0 B Remaining) 0.0 B

12 Partitions

Page:
Block Name Storage Level ▴ Size in Memory Size on Disk Executors
rdd_43083_1 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_43083_10 Memory Serialized 2x Replicated 71.2 KiB 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_43083_3 Memory Serialized 2x Replicated 73.1 KiB 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_43083_4 Memory Serialized 2x Replicated 73.1 KiB 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_43083_6 Memory Serialized 2x Replicated 71.9 KiB 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_43083_5 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_43083_9 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.124:7079 10.96.33.53:7079
rdd_43083_8 Memory Serialized 2x Replicated 70.8 KiB 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_43083_2 Memory Serialized 2x Replicated 70.8 KiB 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_43083_0 Memory Serialized 2x Replicated 75.8 KiB 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_43083_7 Memory Serialized 2x Replicated 74.9 KiB 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_43083_11 Memory Serialized 2x Replicated 65.6 KiB 0.0 B 10.96.0.101:7079 10.96.20.124:7079
Page: