RDD Storage Info for AdaptiveSparkPlan isFinalPlan=false +- Project [product#44943] +- SortMergeJoin [articlehierarchynode#35895], [articlehierarchynode#44934], Inner :- Project [articlehierarchynode#35895] : +- Filter (rank#44953 = 1) : +- Window [rank(stepCnt#35920) windowspecdefinition(articlehierarchynode#35895, stepCnt#35920 DESC NULLS LAST, specifiedwindowframe(RowFrame, unboundedpreceding$(), currentrow$())) AS rank#44953], [articlehierarchynode#35895], [stepCnt#35920 DESC NULLS LAST] : +- WindowGroupLimit [articlehierarchynode#35895], [stepCnt#35920 DESC NULLS LAST], rank(stepCnt#35920), 1, Final : +- Sort [articlehierarchynode#35895 ASC NULLS FIRST, stepCnt#35920 DESC NULLS LAST], false, 0 : +- Exchange hashpartitioning(articlehierarchynode#35895, 200), ENSURE_REQUIREMENTS, [plan_id=58250] : +- WindowGroupLimit [articlehierarchynode#35895], [stepCnt#35920 DESC NULLS LAST], rank(stepCnt#35920), 1, Partial : ...

  • Storage Level: Disk Memory Serialized 2x Replicated
  • Cached Partitions: 200
  • Total Partitions: 200
  • Memory Size: 62.2 KiB
  • Disk Size: 0.0 B

Data Distribution on 4 Executors

HostOn Heap Memory UsageOff Heap Memory UsageDisk Usage
10.96.33.53:7079 29.6 KiB (-2613100611.0 B Remaining) 0.0 B (0.0 B Remaining) 0.0 B
10.96.16.73:7079 11.8 KiB (-2886503624.0 B Remaining) 0.0 B (0.0 B Remaining) 0.0 B
10.96.20.124:7079 14.6 KiB (-2748206691.0 B Remaining) 0.0 B (0.0 B Remaining) 0.0 B
10.96.0.101:7079 6.2 KiB (-3057581651.0 B Remaining) 0.0 B (0.0 B Remaining) 0.0 B

200 Partitions

Page:
Block Name ▾ Storage Level Size in Memory Size on Disk Executors
rdd_1889_99 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_1889_98 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_1889_97 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_1889_96 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_1889_95 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_1889_94 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_1889_93 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_1889_92 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_1889_91 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_1889_90 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_1889_9 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.124:7079 10.96.33.53:7079
rdd_1889_89 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_1889_88 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.124:7079 10.96.33.53:7079
rdd_1889_87 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_1889_86 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_1889_85 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_1889_84 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_1889_83 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.124:7079 10.96.33.53:7079
rdd_1889_82 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_1889_81 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_1889_80 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_1889_8 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_1889_79 Memory Serialized 2x Replicated 4.2 KiB 0.0 B 10.96.20.124:7079 10.96.33.53:7079
rdd_1889_78 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.124:7079 10.96.33.53:7079
rdd_1889_77 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_1889_76 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_1889_75 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_1889_74 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_1889_73 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_1889_72 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.124:7079 10.96.33.53:7079
rdd_1889_71 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_1889_70 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_1889_7 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.124:7079 10.96.33.53:7079
rdd_1889_69 Memory Serialized 2x Replicated 4.2 KiB 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_1889_68 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_1889_67 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.124:7079 10.96.33.53:7079
rdd_1889_66 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_1889_65 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_1889_64 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_1889_63 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_1889_62 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_1889_61 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_1889_60 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_1889_6 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.124:7079 10.96.33.53:7079
rdd_1889_59 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_1889_58 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_1889_57 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_1889_56 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_1889_55 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_1889_54 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_1889_53 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_1889_52 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_1889_51 Memory Serialized 2x Replicated 4.3 KiB 0.0 B 10.96.20.124:7079 10.96.33.53:7079
rdd_1889_50 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_1889_5 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_1889_49 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_1889_48 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_1889_47 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_1889_46 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_1889_45 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_1889_44 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_1889_43 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_1889_42 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_1889_41 Memory Serialized 2x Replicated 4.2 KiB 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_1889_40 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_1889_4 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_1889_39 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.124:7079 10.96.33.53:7079
rdd_1889_38 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_1889_37 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.124:7079 10.96.33.53:7079
rdd_1889_36 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.124:7079 10.96.33.53:7079
rdd_1889_35 Memory Serialized 2x Replicated 4.2 KiB 0.0 B 10.96.20.124:7079 10.96.33.53:7079
rdd_1889_34 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_1889_33 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.124:7079 10.96.33.53:7079
rdd_1889_32 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_1889_31 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_1889_30 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_1889_3 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_1889_29 Memory Serialized 2x Replicated 4.1 KiB 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_1889_28 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_1889_27 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_1889_26 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_1889_25 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.124:7079 10.96.33.53:7079
rdd_1889_24 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.124:7079 10.96.33.53:7079
rdd_1889_23 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_1889_22 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_1889_21 Memory Serialized 2x Replicated 5.4 KiB 0.0 B 10.96.20.124:7079 10.96.33.53:7079
rdd_1889_20 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_1889_2 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_1889_199 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_1889_198 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_1889_197 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_1889_196 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_1889_195 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.124:7079 10.96.33.53:7079
rdd_1889_194 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_1889_193 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_1889_192 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.124:7079 10.96.33.53:7079
rdd_1889_191 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_1889_190 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_1889_19 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_1889_189 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
Page: