WeOLAP亚秒级实时数仓——BitBooster10倍查询优化实践

见贤思齐

--查询S1：CREATETABLEtest.bm_64(`ds`Date,`bm`AggregateFunction(groupBitmap,UInt64),`id`String)ENGINE=MergeTreePARTITIONBYdsORDERBYid;insertintotest.bm_64select'2022-06-10',groupBitmapState(rand64()),'rand'fromnumbers(10000000);X1insertintotest.bm_64select'2022-06-11',groupBitmapState(rand64()),'rand'fromnumbers(10000000);X1insertintotest.bm_64select'2022-06-12',groupBitmapState(rand64()),'rand'fromnumbers(10000000);X7optimizetabletest.bm_64;-----------------------------SELECTds,bitmapCardinality(bm)FROMtest.bm_64WHEREid='rand'ORDERBYdsASCSETTINGSforce_repartition_after_reading_from_merge_tree=1;┌─────────ds─┬─bitmapCardinality(bm)─┐│2022-06-10│10000000││2022-06-11│10000000││2022-06-12│10000000││2022-06-12│10000000││2022-06-12│10000000││2022-06-12│10000000││2022-06-12│10000000││2022-06-12│10000000││2022-06-12│10000000│└────────────┴───────────────────────┘9rowsinset.Elapsed:83.593sec.-----------------------------SELECTds,bitmapCardinality(bm)FROMtest.bm_64WHEREid='rand'ORDERBYdsASC┌─────────ds─┬─bitmapCardinality(bm)─┐│2022-06-10│10000000││2022-06-11│10000000││2022-06-12│10000000││2022-06-12│10000000││2022-06-12│10000000││2022-06-12│10000000││2022-06-12│10000000││2022-06-12│10000000││2022-06-12│10000000│└────────────┴───────────────────────┘9rowsinset.Elapsed:108.241sec.