RDD Storage Info for AdaptiveSparkPlan isFinalPlan=false +- Project [product#116635] +- SortMergeJoin [articlehierarchynode#107874], [articlehierarchynode#116626], Inner :- Project [articlehierarchynode#107874] : +- Filter (rank#116645 = 1) : +- Window [rank(stepCnt#107899) windowspecdefinition(articlehierarchynode#107874, stepCnt#107899 DESC NULLS LAST, specifiedwindowframe(RowFrame, unboundedpreceding$(), currentrow$())) AS rank#116645], [articlehierarchynode#107874], [stepCnt#107899 DESC NULLS LAST] : +- WindowGroupLimit [articlehierarchynode#107874], [stepCnt#107899 DESC NULLS LAST], rank(stepCnt#107899), 1, Final : +- Sort [articlehierarchynode#107874 ASC NULLS FIRST, stepCnt#107899 DESC NULLS LAST], false, 0 : +- Exchange hashpartitioning(articlehierarchynode#107874, 200), ENSURE_REQUIREMENTS, [plan_id=135141] : +- WindowGroupLimit [articlehierarchynode#107874], [stepCnt#107899 DESC NULLS LAST], rank(stepCnt#107899), 1, Partia...

  • Storage Level: Disk Memory Serialized 2x Replicated
  • Cached Partitions: 200
  • Total Partitions: 200
  • Memory Size: 15.9 KiB
  • Disk Size: 0.0 B

Data Distribution on 4 Executors

HostOn Heap Memory UsageOff Heap Memory UsageDisk Usage
10.96.33.53:7079 6.3 KiB (-2613100611.0 B Remaining) 0.0 B (0.0 B Remaining) 0.0 B
10.96.16.73:7079 1974.0 B (-2886503624.0 B Remaining) 0.0 B (0.0 B Remaining) 0.0 B
10.96.20.124:7079 1827.0 B (-2748206691.0 B Remaining) 0.0 B (0.0 B Remaining) 0.0 B
10.96.0.101:7079 6.0 KiB (-3057581651.0 B Remaining) 0.0 B (0.0 B Remaining) 0.0 B

200 Partitions

Page:
Block Name Storage Level Size in Memory Size on Disk Executors ▴
rdd_4391_5 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_4391_9 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_4391_13 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_4391_18 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_4391_27 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_4391_42 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_4391_45 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_4391_47 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_4391_56 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_4391_60 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_4391_61 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_4391_64 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_4391_76 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_4391_86 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_4391_87 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_4391_97 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_4391_102 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_4391_108 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_4391_114 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_4391_116 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_4391_118 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_4391_130 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_4391_133 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_4391_140 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_4391_152 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_4391_158 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_4391_161 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_4391_170 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_4391_171 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_4391_174 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_4391_183 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_4391_191 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_4391_197 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_4391_193 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_4391_194 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_4391_0 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_4391_8 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_4391_12 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_4391_23 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_4391_28 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_4391_31 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_4391_36 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_4391_38 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_4391_43 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_4391_44 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_4391_54 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_4391_58 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_4391_63 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_4391_80 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_4391_98 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_4391_110 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_4391_144 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_4391_165 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_4391_167 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_4391_168 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_4391_178 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_4391_184 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_4391_187 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_4391_188 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_4391_4 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_20 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_22 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_2 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_30 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_15 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_62 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_25 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_85 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_33 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_99 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_35 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_104 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_40 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_123 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_48 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_129 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_137 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_51 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_142 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_166 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_177 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_69 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_181 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_70 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_189 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_71 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_72 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_79 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_81 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_96 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_119 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_131 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_135 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_136 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_141 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_147 Memory Serialized 2x Replicated 7.8 KiB 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_149 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_151 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_156 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_4391_157 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
Page: