Replacing Atomic Table
Atomicity Replace
Doris supports atomic table replacement operations for two tables. This is only applicable to OLAP tables.
Applicable scenarios
- Atomic overwrite operations
- In certain cases, users may want to rewrite data in a table. However, the "delete and load" approach causes a data invisibility window. To solve that, Doris allows users to create a new table of the same schema using the CREATE TABLE LIKE statement, import the new data into this new table, and then atomically replace the old table with the new table. For atomic replacement at the partition level, please refer to the temporary partitiondocumentation.
Syntax
ALTER TABLE [db.]tbl1 REPLACE WITH TABLE tbl2
[PROPERTIES('swap' = 'true')];
Replace table tbl1 with table tbl2.
If swap
is true
, after the replacement, data in tbl1
will be replaced by that in tbl2
, while data in tbl2
will be replaced by that in tbl1
. In other words, the two tables will swap data.
If swap
is false
, after the replacement, data in tbl1
will be replaced by that in tbl2
and tbl2
will be deleted.
Implementation
In fact, table replacement is to combine the following operations into one atomic operation.
Assuming that table A is to be replaced with table B, and swap
is set to true
. The operations to be implemented are as follows:
- Rename table B to table A.
- Rename table A to table B.
If swap
is set to false
, the operations are as follows:
- Delete table A.
- Rename table B to table A.
Note
swap
defaults totrue
, meaning to swap the data between two tables.- If
swap
is set tofalse
, the table being replaced (table A) will be deleted and cannot be recovered. - The replacement operation can only be implemented between two OLAP tables and it does not check for table schema consistency.
- The replacement operation does not change the existing privilege settings because privilege checks are based on table names.