== Physical Plan ==
TakeOrderedAndProject (51)
+- * Project (50)
   +- Window (49)
      +- * ColumnarToRow (48)
         +- CometSort (47)
            +- CometColumnarExchange (46)
               +- RowToColumnar (45)
                  +- * HashAggregate (44)
                     +- * ColumnarToRow (43)
                        +- CometColumnarExchange (42)
                           +- RowToColumnar (41)
                              +- * HashAggregate (40)
                                 +- * Expand (39)
                                    +- * Project (38)
                                       +- * BroadcastHashJoin Inner BuildRight (37)
                                          :- * ColumnarToRow (9)
                                          :  +- CometProject (8)
                                          :     +- CometBroadcastHashJoin (7)
                                          :        :- CometFilter (2)
                                          :        :  +- CometScan parquet spark_catalog.default.store_sales (1)
                                          :        +- CometBroadcastExchange (6)
                                          :           +- CometProject (5)
                                          :              +- CometFilter (4)
                                          :                 +- CometScan parquet spark_catalog.default.date_dim (3)
                                          +- BroadcastExchange (36)
                                             +- * BroadcastHashJoin LeftSemi BuildRight (35)
                                                :- * ColumnarToRow (12)
                                                :  +- CometFilter (11)
                                                :     +- CometScan parquet spark_catalog.default.store (10)
                                                +- BroadcastExchange (34)
                                                   +- * Project (33)
                                                      +- * Filter (32)
                                                         +- Window (31)
                                                            +- WindowGroupLimit (30)
                                                               +- * Sort (29)
                                                                  +- * HashAggregate (28)
                                                                     +- * ColumnarToRow (27)
                                                                        +- CometColumnarExchange (26)
                                                                           +- RowToColumnar (25)
                                                                              +- * HashAggregate (24)
                                                                                 +- * ColumnarToRow (23)
                                                                                    +- CometProject (22)
                                                                                       +- CometBroadcastHashJoin (21)
                                                                                          :- CometProject (19)
                                                                                          :  +- CometBroadcastHashJoin (18)
                                                                                          :     :- CometFilter (14)
                                                                                          :     :  +- CometScan parquet spark_catalog.default.store_sales (13)
                                                                                          :     +- CometBroadcastExchange (17)
                                                                                          :        +- CometFilter (16)
                                                                                          :           +- CometScan parquet spark_catalog.default.store (15)
                                                                                          +- ReusedExchange (20)


(1) Scan parquet spark_catalog.default.store_sales
Output [3]: [ss_store_sk#1, ss_net_profit#2, ss_sold_date_sk#3]
Batched: true
Location: InMemoryFileIndex []
PartitionFilters: [isnotnull(ss_sold_date_sk#3), dynamicpruningexpression(ss_sold_date_sk#3 IN dynamicpruning#4)]
PushedFilters: [IsNotNull(ss_store_sk)]
ReadSchema: struct<ss_store_sk:int,ss_net_profit:decimal(7,2)>

(2) CometFilter
Input [3]: [ss_store_sk#1, ss_net_profit#2, ss_sold_date_sk#3]
Condition : isnotnull(ss_store_sk#1)

(3) Scan parquet spark_catalog.default.date_dim
Output [2]: [d_date_sk#5, d_month_seq#6]
Batched: true
Location [not included in comparison]/{warehouse_dir}/date_dim]
PushedFilters: [IsNotNull(d_month_seq), GreaterThanOrEqual(d_month_seq,1200), LessThanOrEqual(d_month_seq,1211), IsNotNull(d_date_sk)]
ReadSchema: struct<d_date_sk:int,d_month_seq:int>

(4) CometFilter
Input [2]: [d_date_sk#5, d_month_seq#6]
Condition : (((isnotnull(d_month_seq#6) AND (d_month_seq#6 >= 1200)) AND (d_month_seq#6 <= 1211)) AND isnotnull(d_date_sk#5))

(5) CometProject
Input [2]: [d_date_sk#5, d_month_seq#6]
Arguments: [d_date_sk#5], [d_date_sk#5]

(6) CometBroadcastExchange
Input [1]: [d_date_sk#5]
Arguments: [d_date_sk#5]

(7) CometBroadcastHashJoin
Left output [3]: [ss_store_sk#1, ss_net_profit#2, ss_sold_date_sk#3]
Right output [1]: [d_date_sk#5]
Arguments: [ss_sold_date_sk#3], [d_date_sk#5], Inner, BuildRight

(8) CometProject
Input [4]: [ss_store_sk#1, ss_net_profit#2, ss_sold_date_sk#3, d_date_sk#5]
Arguments: [ss_store_sk#1, ss_net_profit#2], [ss_store_sk#1, ss_net_profit#2]

(9) ColumnarToRow [codegen id : 5]
Input [2]: [ss_store_sk#1, ss_net_profit#2]

(10) Scan parquet spark_catalog.default.store
Output [3]: [s_store_sk#7, s_county#8, s_state#9]
Batched: true
Location [not included in comparison]/{warehouse_dir}/store]
PushedFilters: [IsNotNull(s_store_sk)]
ReadSchema: struct<s_store_sk:int,s_county:string,s_state:string>

(11) CometFilter
Input [3]: [s_store_sk#7, s_county#8, s_state#9]
Condition : isnotnull(s_store_sk#7)

(12) ColumnarToRow [codegen id : 4]
Input [3]: [s_store_sk#7, s_county#8, s_state#9]

(13) Scan parquet spark_catalog.default.store_sales
Output [3]: [ss_store_sk#10, ss_net_profit#11, ss_sold_date_sk#12]
Batched: true
Location: InMemoryFileIndex []
PartitionFilters: [isnotnull(ss_sold_date_sk#12), dynamicpruningexpression(ss_sold_date_sk#12 IN dynamicpruning#13)]
PushedFilters: [IsNotNull(ss_store_sk)]
ReadSchema: struct<ss_store_sk:int,ss_net_profit:decimal(7,2)>

(14) CometFilter
Input [3]: [ss_store_sk#10, ss_net_profit#11, ss_sold_date_sk#12]
Condition : isnotnull(ss_store_sk#10)

(15) Scan parquet spark_catalog.default.store
Output [2]: [s_store_sk#14, s_state#15]
Batched: true
Location [not included in comparison]/{warehouse_dir}/store]
PushedFilters: [IsNotNull(s_store_sk)]
ReadSchema: struct<s_store_sk:int,s_state:string>

(16) CometFilter
Input [2]: [s_store_sk#14, s_state#15]
Condition : isnotnull(s_store_sk#14)

(17) CometBroadcastExchange
Input [2]: [s_store_sk#14, s_state#15]
Arguments: [s_store_sk#14, s_state#15]

(18) CometBroadcastHashJoin
Left output [3]: [ss_store_sk#10, ss_net_profit#11, ss_sold_date_sk#12]
Right output [2]: [s_store_sk#14, s_state#15]
Arguments: [ss_store_sk#10], [s_store_sk#14], Inner, BuildRight

(19) CometProject
Input [5]: [ss_store_sk#10, ss_net_profit#11, ss_sold_date_sk#12, s_store_sk#14, s_state#15]
Arguments: [ss_net_profit#11, ss_sold_date_sk#12, s_state#15], [ss_net_profit#11, ss_sold_date_sk#12, s_state#15]

(20) ReusedExchange [Reuses operator id: 6]
Output [1]: [d_date_sk#16]

(21) CometBroadcastHashJoin
Left output [3]: [ss_net_profit#11, ss_sold_date_sk#12, s_state#15]
Right output [1]: [d_date_sk#16]
Arguments: [ss_sold_date_sk#12], [d_date_sk#16], Inner, BuildRight

(22) CometProject
Input [4]: [ss_net_profit#11, ss_sold_date_sk#12, s_state#15, d_date_sk#16]
Arguments: [ss_net_profit#11, s_state#15], [ss_net_profit#11, s_state#15]

(23) ColumnarToRow [codegen id : 1]
Input [2]: [ss_net_profit#11, s_state#15]

(24) HashAggregate [codegen id : 1]
Input [2]: [ss_net_profit#11, s_state#15]
Keys [1]: [s_state#15]
Functions [1]: [partial_sum(UnscaledValue(ss_net_profit#11))]
Aggregate Attributes [1]: [sum#17]
Results [2]: [s_state#15, sum#18]

(25) RowToColumnar
Input [2]: [s_state#15, sum#18]

(26) CometColumnarExchange
Input [2]: [s_state#15, sum#18]
Arguments: hashpartitioning(s_state#15, 5), ENSURE_REQUIREMENTS, CometColumnarShuffle, [plan_id=1]

(27) ColumnarToRow [codegen id : 2]
Input [2]: [s_state#15, sum#18]

(28) HashAggregate [codegen id : 2]
Input [2]: [s_state#15, sum#18]
Keys [1]: [s_state#15]
Functions [1]: [sum(UnscaledValue(ss_net_profit#11))]
Aggregate Attributes [1]: [sum(UnscaledValue(ss_net_profit#11))#19]
Results [3]: [s_state#15, MakeDecimal(sum(UnscaledValue(ss_net_profit#11))#19,17,2) AS _w0#20, s_state#15]

(29) Sort [codegen id : 2]
Input [3]: [s_state#15, _w0#20, s_state#15]
Arguments: [s_state#15 ASC NULLS FIRST, _w0#20 DESC NULLS LAST], false, 0

(30) WindowGroupLimit
Input [3]: [s_state#15, _w0#20, s_state#15]
Arguments: [s_state#15], [_w0#20 DESC NULLS LAST], rank(_w0#20), 5, Final

(31) Window
Input [3]: [s_state#15, _w0#20, s_state#15]
Arguments: [rank(_w0#20) windowspecdefinition(s_state#15, _w0#20 DESC NULLS LAST, specifiedwindowframe(RowFrame, unboundedpreceding$(), currentrow$())) AS ranking#21], [s_state#15], [_w0#20 DESC NULLS LAST]

(32) Filter [codegen id : 3]
Input [4]: [s_state#15, _w0#20, s_state#15, ranking#21]
Condition : (ranking#21 <= 5)

(33) Project [codegen id : 3]
Output [1]: [s_state#15]
Input [4]: [s_state#15, _w0#20, s_state#15, ranking#21]

(34) BroadcastExchange
Input [1]: [s_state#15]
Arguments: HashedRelationBroadcastMode(List(input[0, string, true]),false), [plan_id=2]

(35) BroadcastHashJoin [codegen id : 4]
Left keys [1]: [s_state#9]
Right keys [1]: [s_state#15]
Join type: LeftSemi
Join condition: None

(36) BroadcastExchange
Input [3]: [s_store_sk#7, s_county#8, s_state#9]
Arguments: HashedRelationBroadcastMode(List(cast(input[0, int, false] as bigint)),false), [plan_id=3]

(37) BroadcastHashJoin [codegen id : 5]
Left keys [1]: [ss_store_sk#1]
Right keys [1]: [s_store_sk#7]
Join type: Inner
Join condition: None

(38) Project [codegen id : 5]
Output [3]: [ss_net_profit#2, s_state#9, s_county#8]
Input [5]: [ss_store_sk#1, ss_net_profit#2, s_store_sk#7, s_county#8, s_state#9]

(39) Expand [codegen id : 5]
Input [3]: [ss_net_profit#2, s_state#9, s_county#8]
Arguments: [[ss_net_profit#2, s_state#9, s_county#8, 0], [ss_net_profit#2, s_state#9, null, 1], [ss_net_profit#2, null, null, 3]], [ss_net_profit#2, s_state#22, s_county#23, spark_grouping_id#24]

(40) HashAggregate [codegen id : 5]
Input [4]: [ss_net_profit#2, s_state#22, s_county#23, spark_grouping_id#24]
Keys [3]: [s_state#22, s_county#23, spark_grouping_id#24]
Functions [1]: [partial_sum(UnscaledValue(ss_net_profit#2))]
Aggregate Attributes [1]: [sum#25]
Results [4]: [s_state#22, s_county#23, spark_grouping_id#24, sum#26]

(41) RowToColumnar
Input [4]: [s_state#22, s_county#23, spark_grouping_id#24, sum#26]

(42) CometColumnarExchange
Input [4]: [s_state#22, s_county#23, spark_grouping_id#24, sum#26]
Arguments: hashpartitioning(s_state#22, s_county#23, spark_grouping_id#24, 5), ENSURE_REQUIREMENTS, CometColumnarShuffle, [plan_id=4]

(43) ColumnarToRow [codegen id : 6]
Input [4]: [s_state#22, s_county#23, spark_grouping_id#24, sum#26]

(44) HashAggregate [codegen id : 6]
Input [4]: [s_state#22, s_county#23, spark_grouping_id#24, sum#26]
Keys [3]: [s_state#22, s_county#23, spark_grouping_id#24]
Functions [1]: [sum(UnscaledValue(ss_net_profit#2))]
Aggregate Attributes [1]: [sum(UnscaledValue(ss_net_profit#2))#27]
Results [7]: [MakeDecimal(sum(UnscaledValue(ss_net_profit#2))#27,17,2) AS total_sum#28, s_state#22, s_county#23, (cast((shiftright(spark_grouping_id#24, 1) & 1) as tinyint) + cast((shiftright(spark_grouping_id#24, 0) & 1) as tinyint)) AS lochierarchy#29, MakeDecimal(sum(UnscaledValue(ss_net_profit#2))#27,17,2) AS _w0#30, (cast((shiftright(spark_grouping_id#24, 1) & 1) as tinyint) + cast((shiftright(spark_grouping_id#24, 0) & 1) as tinyint)) AS _w1#31, CASE WHEN (cast((shiftright(spark_grouping_id#24, 0) & 1) as tinyint) = 0) THEN s_state#22 END AS _w2#32]

(45) RowToColumnar
Input [7]: [total_sum#28, s_state#22, s_county#23, lochierarchy#29, _w0#30, _w1#31, _w2#32]

(46) CometColumnarExchange
Input [7]: [total_sum#28, s_state#22, s_county#23, lochierarchy#29, _w0#30, _w1#31, _w2#32]
Arguments: hashpartitioning(_w1#31, _w2#32, 5), ENSURE_REQUIREMENTS, CometColumnarShuffle, [plan_id=5]

(47) CometSort
Input [7]: [total_sum#28, s_state#22, s_county#23, lochierarchy#29, _w0#30, _w1#31, _w2#32]
Arguments: [total_sum#28, s_state#22, s_county#23, lochierarchy#29, _w0#30, _w1#31, _w2#32], [_w1#31 ASC NULLS FIRST, _w2#32 ASC NULLS FIRST, _w0#30 DESC NULLS LAST]

(48) ColumnarToRow [codegen id : 7]
Input [7]: [total_sum#28, s_state#22, s_county#23, lochierarchy#29, _w0#30, _w1#31, _w2#32]

(49) Window
Input [7]: [total_sum#28, s_state#22, s_county#23, lochierarchy#29, _w0#30, _w1#31, _w2#32]
Arguments: [rank(_w0#30) windowspecdefinition(_w1#31, _w2#32, _w0#30 DESC NULLS LAST, specifiedwindowframe(RowFrame, unboundedpreceding$(), currentrow$())) AS rank_within_parent#33], [_w1#31, _w2#32], [_w0#30 DESC NULLS LAST]

(50) Project [codegen id : 8]
Output [5]: [total_sum#28, s_state#22, s_county#23, lochierarchy#29, rank_within_parent#33]
Input [8]: [total_sum#28, s_state#22, s_county#23, lochierarchy#29, _w0#30, _w1#31, _w2#32, rank_within_parent#33]

(51) TakeOrderedAndProject
Input [5]: [total_sum#28, s_state#22, s_county#23, lochierarchy#29, rank_within_parent#33]
Arguments: 100, [lochierarchy#29 DESC NULLS LAST, CASE WHEN (lochierarchy#29 = 0) THEN s_state#22 END ASC NULLS FIRST, rank_within_parent#33 ASC NULLS FIRST], [total_sum#28, s_state#22, s_county#23, lochierarchy#29, rank_within_parent#33]

===== Subqueries =====

Subquery:1 Hosting operator id = 1 Hosting Expression = ss_sold_date_sk#3 IN dynamicpruning#4
BroadcastExchange (56)
+- * ColumnarToRow (55)
   +- CometProject (54)
      +- CometFilter (53)
         +- CometScan parquet spark_catalog.default.date_dim (52)


(52) Scan parquet spark_catalog.default.date_dim
Output [2]: [d_date_sk#5, d_month_seq#6]
Batched: true
Location [not included in comparison]/{warehouse_dir}/date_dim]
PushedFilters: [IsNotNull(d_month_seq), GreaterThanOrEqual(d_month_seq,1200), LessThanOrEqual(d_month_seq,1211), IsNotNull(d_date_sk)]
ReadSchema: struct<d_date_sk:int,d_month_seq:int>

(53) CometFilter
Input [2]: [d_date_sk#5, d_month_seq#6]
Condition : (((isnotnull(d_month_seq#6) AND (d_month_seq#6 >= 1200)) AND (d_month_seq#6 <= 1211)) AND isnotnull(d_date_sk#5))

(54) CometProject
Input [2]: [d_date_sk#5, d_month_seq#6]
Arguments: [d_date_sk#5], [d_date_sk#5]

(55) ColumnarToRow [codegen id : 1]
Input [1]: [d_date_sk#5]

(56) BroadcastExchange
Input [1]: [d_date_sk#5]
Arguments: HashedRelationBroadcastMode(List(cast(input[0, int, true] as bigint)),false), [plan_id=6]

Subquery:2 Hosting operator id = 13 Hosting Expression = ss_sold_date_sk#12 IN dynamicpruning#4


