Repository navigation

Draft distributed plan - #1

Open

mdianjun wants to merge 84 commits into

branch-v21.11.3.6-stablefrom

draft-distributed-plan

Commits on Dec 6, 2021
- Add distributed plan, distributed source operator, grpc communication.
  mdianjun
  committed
  6252748
- Optimize building stages and plan fragment.
  mdianjun
  committed
  0704d1d
Commits on Dec 9, 2021
- Support distributed ALTER UPDATE/DELETE statement.
  
  Allen Zhang
  authored and
  Pony Ma
  committed
  ea7d64b
- Add insert distributed for replicate merge tree
  
  godliness
  authored and
  Pony Ma
  committed
  20bb20e
Commits on Dec 13, 2021
- 1.Optimize the execution of plan fragment.
  mdianjun
  committed
  89468c4
Commits on Dec 17, 2021
- add cancel request support on new distributed plan
  
  caspian
  authored and
  Pony Ma
  committed
  147cc1e
- add kill on all support
  
  caspian
  authored and
  Pony Ma
  committed
  9bb71d7
- Add distributed sort and limit.
  mdianjun
  committed
  5e8773e
- Change stage to use multiple parent stages.
  mdianjun
  committed
  576de4a
- Fix quering system tables on single worker.
  mdianjun
  committed
  a3ef01e
- Fix GRPCClient log and exception message
  mdianjun
  committed
  c34c5ce
- Fix limit with offset
  mdianjun
  committed
  dfe2a48
- Refactor code
  mdianjun
  committed
  f261717
Commits on Dec 21, 2021
- Rollback distributed DDL
  
  Allen Zhang
  authored and
  Pony Ma
  committed
  9b3087f
Commits on Dec 24, 2021
- Support automatical execution on all servers of CREATE/DROP replicated database engine
  
  Allen Zhang
  authored and
  Pony Ma
  committed
  7bdc8e7
- Add distributed aggregate
  mdianjun
  committed
  9d4a896
- Add distributed broadcast join
  mdianjun
  committed
  705c8d5
- Add distributed union
  mdianjun
  committed
  20551ac
- Add exception processing when default database is not Replicated engine
  mdianjun
  committed
  e35e317
- Fix bug that doesn't set current database
  mdianjun
  committed
  decd825
- Add distributed insert for table engine mergetree
  
  godliness
  authored and
  Pony Ma
  committed
  c2e77fc
Commits on Dec 30, 2021
- Add distributed materialized view
  mdianjun
  committed
  e2d10bb
- Read data of external tables on initial node
  mdianjun
  committed
  05c69f2
Commits on Dec 31, 2021
- Skip distributed data which insert into system database
  
  godliness
  authored and
  Marble Ma
  committed
  989d1e9
Commits on Jan 4, 2022
- Fix to initialize ClustersWatcher before all servers start
  mdianjun
  committed
  de9962b
- Support input function in distributed mode
  mdianjun
  committed
  73290cb
Commits on Jan 5, 2022
- Only optimize_trivial_count on store workers
  mdianjun
  committed
  ab7b706
- Select one result from system.merge_tree_settings
  mdianjun
  committed
  fdb9c89
- Improve CREATE/DROP database executed distributedly
  
  Allen Zhang
  authored and
  Pony Ma
  committed
  13b449a
- Set database_replicated_always_detach_permanently default to true
  
  Allen Zhang
  authored and
  mdianjun
  committed
  ef74935
- Add settings for distributed query plan
  caspian
  committed
  6a3987c
- Reduce thread name
  caspian
  committed
  16d1740
Commits on Jan 6, 2022
- throw exception
  Allen Zhang
  committed
  9f202c5
- Sync databases metadata with meta-service, and remove local files for databases not exist in meta-service
  
  Allen Zhang
  authored and
  Pony Ma
  committed
  ec9ee6a
Commits on Jan 7, 2022
- Add persistent recursive watch
  
  caspian
  authored and
  Marble Ma
  committed
  c59241d
Commits on Jan 11, 2022
- Fix dangling pointer of query_info in GRPCServer
  
  Allen Zhang
  authored and
  mdianjun
  committed
  bb69892
- Fix log message in GRPCClient
  mdianjun
  committed
  e20f07f
- Support IN with subquery
  
  mdianjun
  authored and
  Pony Ma
  committed
  0c3cb98
Commits on Jan 12, 2022
- Add client support for recursive watch
  caspian
  committed
  a728ded
- Eliminate the last stage when it has only one source worker which is also a compute worker.
  
  mdianjun
  authored and
  Pony Ma
  committed
  026702e
- Fix bug about materialized view
  mdianjun
  committed
  d3d83bf
Commits on Jan 13, 2022
- Fix the checking of join on keys after join sql is rewritten
  mdianjun
  committed
  613d931
- Set prefer_global_in_and_join default to true
  mdianjun
  committed
  b8654a7
- Using grpc server exception code as client code
  
  Allen Zhang
  authored and
  mdianjun
  committed
  3d0a02f
- Ignore znode of database lock when loading metadata from meta-service
  
  Allen Zhang
  authored and
  mdianjun
  committed
  6ff37dc
Commits on Jan 14, 2022
- Fix watch bug
  
  caspian
  authored and
  Marble Ma
  committed
  5797de7
Commits on Jan 17, 2022
- Fix SELECT WITH TOTALS/ROLLUP/CUBE
  
  mdianjun
  authored and
  Pony Ma
  committed
  ace5f56
- Fix DistributedSource constructor, not set SourceWithProgress::auto_progress(default to true)
  
  Allen Zhang
  authored and
  mdianjun
  committed
  69e3d7c
- Cleanup QueryInfoWrapper until all consumers are done
  mdianjun
  committed
  431873c
- Use prewhere optimization on compute node even if no data
  mdianjun
  committed
  d49beaa
- Add share sessions
  
  godliness
  authored and
  Marble Ma
  committed
  a07ff61
- Transfer interpreter params in building plan fragment, and add interperter params when add ReadFromMergeTree step
  mdianjun
  committed
  de874bf
Commits on Jan 18, 2022
- Change empty_result_for_aggregation_by_empty_set to true
  godliness
  committed
  f23a8ec
- Fix intermediate stage read data multi times
  
  godliness
  authored and
  Pony Ma
  committed
  62ddd97
- Fix the tow use cases of StorageValues, one of them doesn't have view source
  
  mdianjun
  authored and
  Pony Ma
  committed
  f2009c8
Commits on Jan 19, 2022
- Execute "optimize table" on all nodes
  
  Allen Zhang
  authored and
  Pony Ma
  committed
  2afec23
Commits on Jan 22, 2022
- Revert empty_result_for_aggregation_by_empty_set to false
  godliness
  committed
  81452fd
- Improve subquery, including many bugs fixed.
  
  mdianjun
  authored and
  godliness
  committed
  709d153
- Fix friend class
  mdianjun
  committed
  9aad861
Commits on Jan 23, 2022
- Change private member functions of QueryPlan to public
  mdianjun
  committed
  5c01196
- Allow ATTACH/DROP PARTITION; disallow FETCH PARTITION; disallow any ALTER PART
  
  Allen Zhang
  authored and
  Pony Ma
  committed
  d897c07
Commits on Jan 24, 2022
- Fix hang when alter table where with materialized column
  godliness
  committed
  76a464a
- Fix create as select multi results and no table error
  
  godliness
  authored and
  Marble Ma
  committed
  03e0c20
- Add distributed SYSTEM DDL
  
  Allen Zhang
  authored and
  Pony Ma
  committed
  60f09f7
- Schedule intermediate stages on local compute node
  mdianjun
  committed
  7c7f46a
- Fix group by const error
  
  godliness
  authored and
  Marble Ma
  committed
  6589478
- Build same original query plan when trivial count is optimized, and skip executeWhere
  mdianjun
  committed
  556228e
- Clean grpc exception periodically thrown by producer; let consumer catch the root cause exception
  mdianjun
  committed
  75f22e6
Commits on Jan 25, 2022
- Support DISTINCT
  mdianjun
  committed
  e2e5697
- Add distributed read/write lock to control the access to database and table
  
  caspian
  authored and
  Pony Ma
  committed
  9fe470f
- Remove table system.processes from distributed query plan
  
  godliness
  authored and
  Pony Ma
  committed
  c1f3350
- Fix grpc client read buffer size limit from 4MB to unlimit
  
  Marble Ma
  authored and
  Pony Ma
  committed
  945ac87
- Clear garbage node
  
  Allen Zhang
  authored and
  Pony Ma
  committed
  e3dbde8
Commits on Jan 26, 2022
- Fix reading some storage(e.g. numbers, memory) from local instead of remote
  mdianjun
  committed
  3127542
- Eliminate unnecessary stages for sort and limit when shuffle has been created at aggregate
  mdianjun
  committed
  052d008
- Add default database name for SYSTEM
  
  Allen Zhang
  authored and
  mdianjun
  committed
  1b88b4d
- Fix ddl timeout when other ck should fail fast
  
  caspian
  authored and
  Pony Ma
  committed
  8b0fc4c
Commits on Jan 27, 2022
- Change parent stages order to sequential in order that iterating stages is from left branch to right branch
  mdianjun
  committed
  fdbae38
- Set current query id if empty
  mdianjun
  committed
  5ad6f43
Commits on Jan 28, 2022
- Fix RENAME query when using distributed lock
  
  caspian
  authored and
  Pony Ma
  committed
  e0ee52c
- Fix create or replace table to insert occur no table error
  Marble Ma
  committed
  0315aef
- Fix distributed subquery max_query_size limitation inconsistency
  
  Marble Ma
  authored and
  Marble Ma
  committed
  12c000d
- Fix JOIN and WITH TOTALS
  
  mdianjun
  authored and
  Pony Ma
  committed
  3d0871d
- Change stage building in right join and full join
  
  mdianjun
  authored and
  Pony Ma
  committed
  9af4f34

Commits

Commits on Dec 6, 2021

Commits on Dec 9, 2021

Commits on Dec 13, 2021

Commits on Dec 17, 2021

Commits on Dec 21, 2021

Commits on Dec 24, 2021

Commits on Dec 30, 2021

Commits on Dec 31, 2021

Commits on Jan 4, 2022

Commits on Jan 5, 2022

Commits on Jan 6, 2022

Commits on Jan 7, 2022

Commits on Jan 11, 2022

Commits on Jan 12, 2022

Commits on Jan 13, 2022

Commits on Jan 14, 2022

Commits on Jan 17, 2022

Commits on Jan 18, 2022

Commits on Jan 19, 2022

Commits on Jan 22, 2022

Commits on Jan 23, 2022

Commits on Jan 24, 2022

Commits on Jan 25, 2022

Commits on Jan 26, 2022

Commits on Jan 27, 2022

Commits on Jan 28, 2022