RDD Storage Info for AdaptiveSparkPlan isFinalPlan=false +- Project [product#663429] +- SortMergeJoin [articlehierarchynode#654370], [articlehierarchynode#663420], Inner :- Project [articlehierarchynode#654370] : +- Filter (rank#663439 = 1) : +- Window [rank(stepCnt#654395) windowspecdefinition(articlehierarchynode#654370, stepCnt#654395 DESC NULLS LAST, specifiedwindowframe(RowFrame, unboundedpreceding$(), currentrow$())) AS rank#663439], [articlehierarchynode#654370], [stepCnt#654395 DESC NULLS LAST] : +- WindowGroupLimit [articlehierarchynode#654370], [stepCnt#654395 DESC NULLS LAST], rank(stepCnt#654395), 1, Final : +- Sort [articlehierarchynode#654370 ASC NULLS FIRST, stepCnt#654395 DESC NULLS LAST], false, 0 : +- Exchange hashpartitioning(articlehierarchynode#654370, 200), ENSURE_REQUIREMENTS, [plan_id=725537] : +- WindowGroupLimit [articlehierarchynode#654370], [stepCnt#654395 DESC NULLS LAST], rank(stepCnt#654395), 1, Partia...

  • Storage Level: Disk Memory Serialized 2x Replicated
  • Cached Partitions: 200
  • Total Partitions: 200
  • Memory Size: 15.9 KiB
  • Disk Size: 0.0 B

Data Distribution on 4 Executors

HostOn Heap Memory UsageOff Heap Memory UsageDisk Usage
10.96.33.53:7079 5.8 KiB (-2613100611.0 B Remaining) 0.0 B (0.0 B Remaining) 0.0 B
10.96.16.73:7079 6.2 KiB (-2886503624.0 B Remaining) 0.0 B (0.0 B Remaining) 0.0 B
10.96.20.124:7079 2.1 KiB (-2748206691.0 B Remaining) 0.0 B (0.0 B Remaining) 0.0 B
10.96.0.101:7079 1890.0 B (-3057581651.0 B Remaining) 0.0 B (0.0 B Remaining) 0.0 B

200 Partitions

Page:
Block Name Storage Level Size in Memory Size on Disk ▴ Executors
rdd_43015_2 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_43015_4 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_43015_0 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_43015_7 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_43015_10 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_43015_12 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_43015_13 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_43015_15 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_43015_14 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_43015_11 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_43015_5 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_43015_8 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_43015_1 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_43015_9 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.124:7079 10.96.33.53:7079
rdd_43015_6 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.124:7079 10.96.33.53:7079
rdd_43015_3 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_43015_18 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_43015_16 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_43015_19 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_43015_17 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_43015_21 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_43015_20 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_43015_22 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.124:7079 10.96.33.53:7079
rdd_43015_26 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_43015_25 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_43015_23 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_43015_24 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_43015_27 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_43015_29 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_43015_28 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_43015_30 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_43015_33 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_43015_35 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_43015_31 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_43015_36 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_43015_37 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_43015_32 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_43015_34 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_43015_39 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_43015_40 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_43015_38 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_43015_42 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_43015_41 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_43015_43 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.124:7079 10.96.33.53:7079
rdd_43015_44 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_43015_47 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_43015_45 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_43015_46 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_43015_49 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_43015_54 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_43015_48 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_43015_50 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_43015_56 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_43015_57 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_43015_60 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_43015_61 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_43015_58 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_43015_51 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_43015_52 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_43015_62 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_43015_63 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_43015_64 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_43015_65 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_43015_68 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_43015_53 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_43015_66 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_43015_75 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_43015_74 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.124:7079 10.96.33.53:7079
rdd_43015_59 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_43015_55 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_43015_80 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_43015_76 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_43015_78 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_43015_85 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_43015_83 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_43015_67 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_43015_86 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_43015_69 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_43015_87 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_43015_70 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_43015_90 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_43015_92 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_43015_91 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.124:7079 10.96.33.53:7079
rdd_43015_71 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_43015_72 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.33.53:7079
rdd_43015_93 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.124:7079 10.96.33.53:7079
rdd_43015_94 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_43015_97 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_43015_95 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.124:7079 10.96.33.53:7079
rdd_43015_98 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_43015_99 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_43015_77 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_43015_102 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_43015_103 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_43015_79 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_43015_104 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.33.53:7079
rdd_43015_81 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.16.73:7079
rdd_43015_105 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.101:7079 10.96.20.124:7079
rdd_43015_107 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.16.73:7079 10.96.20.124:7079
rdd_43015_108 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.124:7079 10.96.33.53:7079
Page: