Doris命令速查
MySQL 协议连接、集群节点运维、库表与分区设计、Stream/Routine Load 导入、查询聚合、物化视图、监控与报错排查等 180 条命令
共 180 条命令 · 12 类场景 · 点击右侧图标可复制
| 命令 / SQL | 说明 | 复制 |
|---|---|---|
mysql -h 10.0.0.11 -P 9030 -uroot -p | Doris 兼容 MySQL 协议,直接用 mysql 客户端连接 FE 的 9030 端口 | |
mysql -h 10.0.0.11 -P 9030 -uroot -p -D db | 连接时直接指定库 | |
mysql -h 10.0.0.11 -P 9030 -uroot -p -e "SHOW FRONTENDS;" | 执行单条 SQL 后退出,脚本巡检常用 | |
mysql -h 10.0.0.11 -P 9030 -uroot -p db < init.sql | 执行 SQL 文件批量建库建表 | |
mysql --default-character-set=utf8mb4 -h fe -P 9030 -uapp -p | 避免中文乱码,务必指定 utf8mb4 | |
SHOW FRONTENDS; | 查看 FE 节点、是否 Master 与存活状态 | |
SHOW BACKENDS; | 查看 BE 节点、存活、磁盘与 tablet 数量 | |
SHOW BROKERS; | 查看 Broker 进程,Broker Load 与备份依赖它 | |
SELECT VERSION(); | 查看 Doris 版本,语法差异按版本确认 | |
SELECT DATABASE(), USER(), CURRENT_TIMESTAMP(); | 确认当前库、用户与时间 | |
SHOW VARIABLES LIKE "%mem_limit%"; | 查看会话级内存限制等变量 | |
访问 http://fe_host:8030 打开 FE Web UI | 查看集群概览、Query Profile 与导入任务 |
| 命令 / SQL | 说明 | 复制 |
|---|---|---|
ALTER SYSTEM ADD BACKEND "10.0.0.12:9050"; | 扩容 BE,9050 为 BE 心跳端口 | |
ALTER SYSTEM ADD FOLLOWER "10.0.0.13:9010"; | 增加 FE Follower(9010 为 edit_log 端口),提升元数据可用性 | |
ALTER SYSTEM ADD OBSERVER "10.0.0.14:9010"; | 增加只读 FE,分担查询与元数据读压力 | |
ALTER SYSTEM DECOMMISSION BACKEND "10.0.0.12:9050"; | 优雅下线 BE,先把数据迁移到其他节点 | |
ALTER SYSTEM DROP BACKEND "10.0.0.12:9050"; | 强制下线,可能丢失该节点副本(谨慎) | |
ALTER SYSTEM DROP FOLLOWER "10.0.0.13:9010"; | 移除 FE 节点 | |
SHOW PROC '/backends'; | BE 明细:磁盘使用率、tablet 数、是否 decommission | |
SHOW PROC '/frontends'; | FE 明细:角色、版本、存活与元数据同步情况 | |
ADMIN SHOW CONFIG LIKE "%max_running_txn%"; | 查看 FE 配置项当前值 | |
ADMIN SET FRONTEND CONFIG ("max_running_txn_num_per_db" = "2000"); | 动态修改 FE 参数,无需重启 | |
ADMIN SET ALL FRONTENDS CONFIG ("max_running_txn_num_per_db" = "2000"); | 在所有 FE 上统一设置(2.1+) | |
ADMIN REBALANCE DISK; | 触发 BE 磁盘间数据均衡 | |
ADMIN CANCEL REBALANCE DISK; | 取消磁盘均衡任务 | |
SHOW PROC '/statistic'; | 查看集群整体数据量与 tablet 统计 | |
SHOW PROC '/cluster_balance'; | 查看副本均衡与 tablet 调度任务进度 | |
SHOW PROC '/cluster_health/tablet_health'; | 查看 tablet 副本健康度,定位 unhealthy 副本 | |
ADMIN SHOW CONFIG LIKE "%stream_load%"; | 查看导入相关 FE 配置项 |
| 命令 / SQL | 说明 | 复制 |
|---|---|---|
CREATE DATABASE IF NOT EXISTS db PROPERTIES ("replication_num" = "3"); | 建库并指定默认副本数 | |
SHOW DATABASES; | 列出所有库 | |
USE db; | 切换当前库 | |
CREATE TABLE db.orders (id BIGINT, uid BIGINT, amount DECIMAL(18,2), ts DATETIME) UNIQUE KEY(id) DISTRIBUTED BY HASH(id) BUCKETS 16 PROPERTIES ("replication_num" = "3", "enable_unique_key_merge_on_write" = "true"); | Unique Key 明细表模板:分桶、3 副本、Merge-on-Write | |
CREATE TABLE db.logs (id BIGINT, msg VARCHAR(500), ts DATETIME) DUPLICATE KEY(id) DISTRIBUTED BY HASH(id) BUCKETS 8; | Duplicate Key 表,不聚合不去重,适合日志明细 | |
CREATE TABLE db.stats (k1 VARCHAR(32), v BIGINT SUM) AGGREGATE KEY(k1) DISTRIBUTED BY HASH(k1) BUCKETS 4; | Aggregate Key 表,导入时按 Key 预聚合 | |
SHOW TABLES FROM db; | 列出库内所有表 | |
SHOW CREATE TABLE db.orders; | 查看建表语句,迁移与比对必用 | |
DESC db.orders; | 查看字段、类型与聚合方式 | |
DESC db.orders ALL; | 连同物化视图一起展示 | |
ALTER TABLE db.orders ADD COLUMN channel VARCHAR(64) DEFAULT ""; | 加列,Light Schema Change 秒级生效 | |
ALTER TABLE db.orders MODIFY COLUMN channel VARCHAR(128); | 修改列类型或长度 | |
ALTER TABLE db.orders DROP COLUMN channel; | 删除列 | |
ALTER TABLE db.orders SET ('replication_num' = '2'); | 调整表级副本数 | |
ALTER TABLE db.orders RENAME orders_new; | 重命名表 | |
TRUNCATE TABLE db.orders; | 清空表数据,保留表结构 | |
DROP TABLE IF EXISTS db.orders; | 删除表(默认进入回收站,可恢复) | |
CREATE CATALOG hive PROPERTIES ('type' = 'hms', 'hive.metastore.uris' = 'thrift://10.0.0.20:9083'); | 接入 Hive Metastore,做数据湖联邦查询 | |
SHOW CATALOGS; | 查看已注册的 Catalog | |
SWITCH hive; | 切换 Catalog 后可直接查询外部表 | |
REFRESH CATALOG hive; | 刷新外部元数据缓存 |
| 命令 / SQL | 说明 | 复制 |
|---|---|---|
PARTITION BY RANGE(ts) (PARTITION p202601 VALUES [("2026-01-01"), ("2026-02-01"))) | 范围分区写法,配合 DISTRIBUTED BY HASH 使用 | |
PARTITION BY LIST(city) (PARTITION p_bj VALUES IN ("beijing"), PARTITION p_sh VALUES IN ("shanghai")) | 列表分区,适合按枚举维度切分 | |
"dynamic_partition.enable" = "true", "dynamic_partition.time_unit" = "MONTH", "dynamic_partition.start" = "-12", "dynamic_partition.end" = "3", "dynamic_partition.prefix" = "p" | 动态分区属性:自动建未来分区、删过期分区 | |
ALTER TABLE db.orders ADD PARTITION p202612 VALUES [("2026-12-01"), ("2027-01-01")); | 手动补建分区,导入前必须存在对应分区 | |
ALTER TABLE db.orders DROP PARTITION p202501; | 删除分区,比 DELETE 高效得多 | |
ALTER TABLE db.orders ADD TEMPORARY PARTITION tp1 VALUES [("2026-12-01"), ("2027-01-01")); | 临时分区做数据替换,校验后再正式替换 | |
ALTER TABLE db.orders REPLACE PARTITION p202512 WITH TEMPORARY PARTITION tp1; | 原子替换分区,实现无缝数据回补 | |
SHOW PARTITIONS FROM db.orders; | 查看分区列表、数据量与副本状态 | |
SHOW DATA FROM db.orders; | 查看表的数据量、副本数与占用空间 | |
SHOW DATA SKEW FROM db.orders; | 查看分桶数据倾斜,桶数设计不合理时最明显 | |
SHOW REPLICA DISTRIBUTION FROM db.orders; | 查看副本在各 BE 的分布 | |
SHOW TABLETS FROM db.orders; | 查看 tablet 明细与 compaction 状态 | |
SHOW TABLET 10001; | 查看单个 tablet 的版本、行数与副本 | |
分桶数建议为 BE 数量的整数倍,单桶数据控制在 1~10GB | 桶太少无法并行,桶太多增加元数据与 compaction 压力 |
| 命令 / SQL | 说明 | 复制 |
|---|---|---|
curl --location-trusted -u root: -H "label:orders_20261102_01" -H "column_separator:," -T orders.csv http://be_host:8040/api/db/orders/_stream_load | Stream Load 导入 CSV,直接发到 BE 的 8040 端口 | |
curl --location-trusted -u root: -H "format:json" -H "strip_outer_array:true" -T data.json http://be_host:8040/api/db/orders/_stream_load | 导入 JSON 数组,日志采集常用 | |
curl --location-trusted -u root: -H "format:json" -H "read_json_by_line:true" -T data.json http://be_host:8040/api/db/orders/_stream_load | 逐行 JSON 导入,Kafka 落地文件常用格式 | |
curl --location-trusted -u root: -H "label:merge_001" -H "merge_type: MERGE" -H "delete: uid" -T d.json http://be_host:8040/api/db/orders/_stream_load | 导入即删除/更新,配合 Unique Key 做 CDC 同步 | |
curl --location-trusted -u root: -H "strict_mode:true" -H "max_filter_ratio:0.01" -T d.csv http://be_host:8040/api/db/orders/_stream_load | 严格模式 + 允许 1% 脏数据,避免整批失败 | |
INSERT INTO db.orders VALUES (1, 1001, 99.50, "2026-11-02 10:00:00"); | INSERT 少量写入,仅适合调试与小批量 | |
INSERT INTO db.orders SELECT * FROM db.orders_stage WHERE ts >= "2026-11-01"; | 表间导入,内表之间效率最高 | |
LOAD LABEL db.label_001 (DATA INFILE("hdfs://ns/data/orders/*") INTO TABLE db.orders COLUMNS TERMINATED BY ",") WITH BROKER "hdfs_broker" PROPERTIES ("timeout" = "3600"); | Broker Load 从 HDFS/对象存储批量导入 | |
CREATE ROUTINE LOAD db.job_orders ON orders COLUMNS(id, uid, amount, ts) PROPERTIES ("desired_concurrent_number" = "3", "max_batch_interval" = "10") FROM KAFKA ("kafka_broker_list" = "10.0.0.30:9092", "kafka_topic" = "orders", "property.group.id" = "doris_orders"); | Routine Load 持续消费 Kafka,实时接入首选 | |
SHOW ROUTINE LOAD FOR db.job_orders; | 查看消费进度、延迟与错误 | |
PAUSE ROUTINE LOAD FOR db.job_orders; | 暂停消费,维护期使用 | |
RESUME ROUTINE LOAD FOR db.job_orders; | 恢复消费 | |
STOP ROUTINE LOAD FOR db.job_orders; | 停止并删除作业 | |
SHOW LOAD FROM db ORDER BY CreateTime DESC LIMIT 20; | 查看导入任务历史与失败原因 | |
SHOW LOAD WHERE LABEL = "orders_20261102_01"; | 按 label 精确定位导入任务 | |
CANCEL LOAD FROM db WHERE LABEL = "orders_20261102_01"; | 取消正在运行的导入 | |
SET enable_insert_strict = false; | 关闭严格插入,让部分脏数据被过滤而不是整批失败 |
| 命令 / SQL | 说明 | 复制 |
|---|---|---|
DELETE FROM db.orders WHERE id = 1; | 按条件删除(Unique/Aggregate 表有条件限制) | |
DELETE FROM db.orders WHERE ts < "2026-01-01"; | 按分区列删除历史数据,建议优先用 DROP PARTITION | |
UPDATE db.orders SET amount = 88.00 WHERE id = 1; | Unique Key Merge-on-Write 表支持 UPDATE | |
INSERT INTO db.orders VALUES (1, 1001, 88.00, "2026-11-02 10:00:00"); | Unique 表同 Key 覆盖写,是最高效的“更新”方式 | |
INSERT OVERWRITE TABLE db.orders PARTITION(p202611) SELECT * FROM db.orders_tmp; | 分区覆盖写,原子替换整块数据 | |
BEGIN; INSERT INTO db.orders VALUES (...); COMMIT; | 显式事务,保证多条写入原子性 | |
ROLLBACK; | 回滚当前显式事务 | |
SHOW TRANSACTION WHERE LABEL = "orders_20261102_01"; | 查看指定 label 的事务状态,导入异常时用 | |
SHOW PROC '/transactions'; | 查看正在运行的事务,堆积时排查长事务 | |
label 相同视为同一事务,天然幂等 | 重试导入时复用 label 可避免重复数据 |
| 命令 / SQL | 说明 | 复制 |
|---|---|---|
SELECT * FROM db.orders WHERE ts >= "2026-11-01" AND ts < "2026-11-02" LIMIT 100; | 分区列用常量区间,保证分区裁剪生效 | |
SELECT uid, COUNT(*) AS cnt, SUM(amount) AS total FROM db.orders GROUP BY uid ORDER BY total DESC LIMIT 10; | 常规分组聚合 | |
SELECT date_trunc(ts, "hour") AS h, COUNT(*) FROM db.orders GROUP BY h ORDER BY h; | 按小时聚合,做趋势看板 | |
SELECT uid, amount, ROW_NUMBER() OVER (PARTITION BY uid ORDER BY amount DESC) AS rn FROM db.orders; | 窗口函数取每组排名 | |
SELECT uid, SUM(amount) OVER (PARTITION BY uid ORDER BY ts) AS acc FROM db.orders; | 累计指标 | |
SELECT bitmap_union_count(to_bitmap(uid)) FROM db.orders; | Bitmap 精确去重,UV 统计首选 | |
SELECT hll_union_agg(hll_hash(uid)) FROM db.orders; | HLL 近似去重,亿级 UV 更快 | |
SELECT percentile_approx(amount, 0.95) FROM db.orders; | 近似分位数,延迟与耗时分析常用 | |
SELECT k1, group_concat(DISTINCT city) FROM db.orders GROUP BY k1; | 分组拼接字符串 | |
SELECT k1, collect_list(city) FROM db.orders GROUP BY k1; | 聚合为数组 | |
SELECT * FROM db.orders LATERAL VIEW explode_split(tags, ",") t AS tag; | 字符串拆分为多行,处理标签字段 | |
SELECT * FROM db.orders o LEFT JOIN db.users u ON o.uid = u.id; | 常规 Join,注意大表在小表右侧更利于优化 | |
WITH t AS (SELECT uid, SUM(amount) s FROM db.orders GROUP BY uid) SELECT * FROM t WHERE s > 1000; | CTE 拆分复杂查询,便于复用 | |
SELECT /*+ SET_VAR(exec_mem_limit=8589934592) */ COUNT(*) FROM db.orders; | Hint 方式对单条语句设置变量 |
| 命令 / SQL | 说明 | 复制 |
|---|---|---|
CREATE MATERIALIZED VIEW mv_daily AS SELECT date_trunc(ts, "day") d, uid, SUM(amount) s FROM db.orders GROUP BY d, uid; | 同步物化视图,单表聚合自动命中加速 | |
CREATE INDEX idx_city ON db.orders (city) USING INVERTED; | 倒排索引,加速等值与全文过滤 | |
CREATE INDEX idx_msg ON db.logs (msg) USING INVERTED PROPERTIES("parser" = "english"); | 英文分词倒排索引,日志检索更快 | |
CREATE INDEX idx_bloom ON db.orders (uid) USING BLOOM_FILTER; | BloomFilter 索引,提升高基数列过滤效率 | |
CREATE INDEX idx_ngram ON db.logs (msg) USING NGRAM_BF PROPERTIES("gram_size"="3","bf_size"="10240"); | Ngram 布隆索引,支持 LIKE 模糊匹配 | |
SHOW INDEX FROM db.orders; | 查看表上的索引 | |
BUILD INDEX idx_city ON db.orders; | 为历史数据构建索引 | |
SHOW BUILD INDEX WHERE TableName = "orders"; | 查看索引构建进度 | |
CANCEL BUILD INDEX ON db.orders; | 取消索引构建任务 | |
SHOW CREATE MATERIALIZED VIEW mv_daily ON db.orders; | 查看物化视图定义 | |
SHOW ALTER TABLE MATERIALIZED VIEW FROM db ORDER BY CreateTime DESC LIMIT 10; | 查看 MV 构建任务状态 | |
REFRESH MATERIALIZED VIEW mv_daily ON db.orders; | 手动刷新物化视图数据 | |
DROP MATERIALIZED VIEW IF EXISTS mv_daily ON db.orders; | 删除物化视图 | |
DROP INDEX idx_city ON db.orders; | 删除索引 |
| 命令 / SQL | 说明 | 复制 |
|---|---|---|
SHOW DATA; | 查看全库数据总量、副本数与占用空间 | |
SHOW PROC '/backends'; | 巡检 BE 磁盘使用率、tablet 数与 compaction 分数 | |
SHOW TABLETS FROM db.orders; | tablet 级巡检:版本数、行数与 compaction 状态 | |
SHOW PARTITIONS FROM db.orders; | 分区级数据量与副本健康状态 | |
SELECT * FROM information_schema.tables WHERE table_schema = "db"; | 以系统表方式查看表信息 | |
SELECT * FROM information_schema.tablets LIMIT 20; | tablet 明细系统表 | |
SHOW LOAD FROM db ORDER BY CreateTime DESC LIMIT 20; | 导入任务巡检,失败任务看 ErrorMsg | |
SHOW ROUTINE LOAD; | 查看所有例行导入作业状态 | |
ADMIN SHOW REPLICA STATUS FROM db.orders; | 副本健康巡检,异常副本可用 ADMIN REPAIR 修复 | |
SHOW QUERY PROFILE "/query_id"; | 按 query id 查看执行 Profile(需开启 profile) | |
SET enable_profile = true; | 为后续查询开启 profile 采集 | |
SHOW PROCESSLIST; | 查看当前连接与会话执行的语句 | |
KILL 12345; | 终止指定连接(SHOW PROCESSLIST 中的 Id) | |
访问 http://be_host:8040/metrics 获取 BE 监控指标 | 对接 Prometheus 的标准指标出口 |
| 命令 / SQL | 说明 | 复制 |
|---|---|---|
EXPLAIN SELECT * FROM db.orders WHERE uid = 1001; | 查看执行计划,确认分区裁剪与扫描方式 | |
EXPLAIN VERBOSE SELECT o.uid, u.city FROM db.orders o JOIN db.users u ON o.uid = u.id; | 详细计划,看 Join 顺序、分布方式与数据量估算 | |
SET exec_mem_limit = 8589934592; | 提高单查询内存上限(字节) | |
SET query_timeout = 300; | 延长查询超时,避免大查询被中断 | |
SET parallel_pipeline_task_num = 8; | 调整单查询并行度,匹配 BE 核数 | |
SET runtime_filter_type = "IN_OR_BLOOM_FILTER"; | 调整 Runtime Filter 类型,优化 Join 过滤 | |
SET enable_bucket_shuffle_join = true; | 开启桶级 Shuffle Join,减少数据网络传输 | |
SET enable_projection = true; | 开启投影优化,同类查询复用聚合结果 | |
SHOW DATA SKEW FROM db.orders; | 检查分桶倾斜,倾斜时查询会被最慢的桶拖住 | |
SHOW REPLICA DISTRIBUTION FROM db.orders; | 副本分布不均会导致单 BE 热点 | |
BE compaction 落后时降低导入频率或扩容 BE | tablet 版本数持续增长会直接导致查询变慢甚至 -235 错误 | |
分区列过滤 + 分桶列 Join | Doris 最优路径:分区裁剪 + Colocate/Bucket Shuffle Join | |
避免 SELECT *,只取必要列 | 列存下减少列读取可显著降低 IO 与内存 | |
ADMIN SET BACKEND CONFIG ("compaction_max_concurrent" = "10"); | 调整 BE compaction 并发(需按机型评估) |
| 命令 / SQL | 说明 | 复制 |
|---|---|---|
CREATE USER "app" IDENTIFIED BY "Str0ng!Pass"; | 创建用户,默认无任何权限 | |
CREATE USER "reader" IDENTIFIED BY "Pass1234" DEFAULT ROLE "analyst"; | 创建用户并绑定默认角色 | |
GRANT SELECT_PRIV ON db.* TO 'app'@'%'; | 授予库级只读权限 | |
GRANT SELECT_PRIV, LOAD_PRIV ON db.orders TO 'app'@'%'; | 按表授予查询与导入权限 | |
GRANT ALL ON db.* TO 'app'@'%'; | 授予库的全部权限 | |
REVOKE LOAD_PRIV ON db.orders FROM 'app'@'%'; | 回收导入权限 | |
SHOW GRANTS FOR 'app'@'%'; | 查看指定用户的授权 | |
SHOW GRANTS; | 查看当前用户权限 | |
CREATE ROLE analyst; | 创建角色,统一管理权限 | |
GRANT SELECT_PRIV ON db.* TO ROLE analyst; | 给角色授权 | |
GRANT analyst TO 'reader'@'%'; | 把角色授予用户 | |
SET ROLE analyst; | 切换当前会话角色 | |
DROP ROLE analyst; | 删除角色 | |
SET PASSWORD FOR "app" = PASSWORD("N3w!Pass"); | 修改用户密码 | |
DROP USER "app"; | 删除用户 | |
SHOW ROLES; | 查看所有角色 |
| 命令 / SQL | 说明 | 复制 |
|---|---|---|
errCode = 2, detailMessage = Label [xxx] has already been used | label 重复:换新 label,或视为同一事务实现幂等 | |
errCode = 2, detailMessage = Tablet version too large / -235 | tablet 版本过多:compaction 跟不上,降低导入频率或扩容 BE | |
errCode = 2, detailMessage = Failed to commit transaction | 副本写入失败:ADMIN SHOW REPLICA STATUS 查异常副本并修复 | |
Memory limit exceeded | 查询内存超限:调大 exec_mem_limit 或改小并行度、优化 Join | |
errCode = 2, detailMessage = Failed to find enough host with tag | 副本数大于可用 BE 数,减少 replication_num 或扩容 | |
current running txns on db exceed the limit | 事务数超限:调大 max_running_txn_num_per_db 或清理长事务 | |
no queryable replica / replica is not healthy | 副本不可用:ADMIN REPAIR TABLE,必要时 ADMIN SET REPLICA STATUS 标记坏副本 | |
ADMIN REPAIR TABLE db.orders; | 触发副本修复,优先恢复多数派 | |
BE 磁盘使用率超过 high water mark(85%) | 写入被拒绝:清理历史分区、扩盘或 ADMIN REBALANCE DISK | |
Stream Load 返回 307 Temporary Redirect | 请求发到了 FE:改为直接请求 BE 的 8040 端口 | |
Access denied for user | 账号密码或来源 IP 不符,检查 GRANT 与用户是否存在 | |
Unknown database / Unknown table | 库表名大小写、当前 Catalog 或库上下文不对 | |
导入报 partition does not exist | 目标分区未创建,补 ADD PARTITION 或开启动态分区 | |
FE 元数据不同步、SHOW FRONTENDS 中 Alive 为 false | 检查 9010 端口、时钟同步与 FE 日志 fe.log | |
SHOW BACKENDS 中节点 Alive=false | BE 进程或心跳异常,看 be.out 与 9050 端口连通性 | |
查询比预期慢很多 | 先 EXPLAIN 看是否全表扫描,再查 SHOW DATA SKEW 与 tablet 版本数 | |
SHOW PROC "/cluster_balance" 任务长期 pending | 副本均衡受限于带宽与磁盘,检查 BE 负载与 tablet 数量 |
运维常用组合
SHOW FRONTENDS → SHOW BACKENDS → SHOW PROC "/backends" 看磁盘 → ADMIN SHOW REPLICA STATUSCREATE DATABASE → CREATE TABLE(UNIQUE KEY + 分区 + 分桶) → SHOW CREATE TABLE → DESC ALLStream Load 到 BE:8040 → SHOW LOAD 看状态 → 失败看 ErrorURL → SELECT COUNT(*) 校验CREATE ROUTINE LOAD → SHOW ROUTINE LOAD 看延迟 → PAUSE/RESUME 维护 → STOP 下线SET enable_profile=true → 执行查询 → FE Web UI 看 Profile → EXPLAIN VERBOSE 调整分区分桶与 JoinADD TEMPORARY PARTITION → INSERT 到临时分区 → 校验行数 → REPLACE PARTITION 原子替换常见问题排查
1. 模型先选对
明细日志用 Duplicate,主键更新用 Unique(建议 Merge-on-Write),预聚合指标用 Aggregate,模型选错后续优化代价很大
2. 分区 + 分桶是性能地基
按时间 RANGE 分区、按高基数列 HASH 分桶;桶数取 BE 数量的整数倍,单桶 1~10GB 较合适
3. 导入别用 INSERT
批量导入走 Stream Load / Broker Load / Routine Load,INSERT 只适合调试,量大会拖垮事务与 compaction
4. label 就是幂等键
重试时复用同一个 label,Doris 会当作同一事务,避免重复写入
5. 副本异常先修多数派
ADMIN SHOW REPLICA STATUS 找出 bad 副本,ADMIN REPAIR TABLE 优先,最后才考虑标记坏副本
6. compaction 决定长期稳定
tablet 版本数持续上涨会让查询变慢甚至报 -235,控制导入频率并保证 BE 磁盘与 IO 余量
相关工具
Linux命令速查
文件、文本、权限、进程、网络、磁盘、systemd与防火墙等 Linux 常用命令速查手册
Docker命令速查
镜像、容器、网络、数据卷、Compose、Swarm、清理与排障等 Docker 常用命令速查手册
Nginx命令速查
服务管理、配置指令、反向代理、HTTPS、限流缓存、日志排查等 Nginx 常用命令速查手册
K8S命令速查
集群上下文、Pod调试、工作负载、Service与Ingress、存储、权限、排障等 kubectl 常用命令速查手册
Windows CMD命令速查
文件目录、网络诊断、进程服务、系统信息、用户权限、注册表、批处理等 Windows CMD 常用命令速查手册
systemctl服务管理速查
服务启停、开机自启、unit文件编写、日志查看、定时器、依赖分析与排障等 systemctl 命令速查手册
关于Doris命令速查
在线 Apache Doris 命令速查手册,按连接与客户端、集群节点与运维命令、库表 DDL 与 Catalog、数据模型与分区设计、数据导入、数据变更与事务、查询与聚合函数、物化视图与索引、系统表监控与巡检、性能优化与执行分析、用户权限与安全、常见报错与排查等 12 类场景整理 180+ 条常用命令与 SQL,每条附中文说明与可直接复制的写法,支持关键词搜索、分类折叠和一键复制,打开网页即可查阅。涵盖 mysql 客户端连接 FE 9030 与 -e/-D 参数、FE Web UI 8030 与 BE 8040 metrics、SHOW FRONTENDS/BACKENDS/BROKERS 与 ALTER SYSTEM ADD BACKEND/FOLLOWER/OBSERVER 与 DECOMMISSION/DROP、SHOW PROC 的 /backends /frontends /statistic /cluster_balance /cluster_health/tablet_health /transactions、ADMIN SHOW CONFIG 与 ADMIN SET FRONTEND CONFIG/ALL FRONTENDS CONFIG 与 ADMIN REBALANCE DISK 与 ADMIN SHOW REPLICA STATUS 与 ADMIN REPAIR TABLE 与 ADMIN SET BACKEND CONFIG、CREATE DATABASE 的 replication_num 与 CREATE TABLE 的 UNIQUE KEY/DUPLICATE KEY/AGGREGATE KEY 与 DISTRIBUTED BY HASH BUCKETS 与 PROPERTIES 的 enable_unique_key_merge_on_write、RANGE/LIST 分区与动态分区 dynamic_partition 与 ADD/DROP/TEMPORARY/REPLACE PARTITION、SHOW CREATE TABLE/DESC ALL/SHOW PARTITIONS/SHOW TABLETS/SHOW DATA/SHOW DATA SKEW/SHOW REPLICA DISTRIBUTION、CREATE CATALOG 接入 Hive Metastore 与 SWITCH CATALOG、Stream Load 的 label/column_separator/format:json/read_json_by_line/strict_mode/max_filter_ratio/merge_type 与 Broker Load 与 Routine Load 的 PAUSE/RESUME/STOP 与 SHOW LOAD/CANCEL LOAD、INSERT INTO/INSERT OVERWRITE 分区覆盖写与 DELETE/UPDATE/BEGIN-COMMIT-ROLLBACK 事务与 SHOW TRANSACTION、窗口函数与 bitmap_union_count/hll_union_agg/percentile_approx/group_concat/collect_list/LATERAL VIEW explode_split、CREATE MATERIALIZED VIEW 与 REFRESH/DROP MATERIALIZED VIEW 与 SHOW ALTER TABLE MATERIALIZED VIEW、INVERTED/BLOOM_FILTER/NGRAM_BF 索引与 BUILD INDEX、information_schema 系统表与 SHOW PROCESSLIST/KILL、EXPLAIN 与 EXPLAIN VERBOSE 与 SET exec_mem_limit/query_timeout/parallel_pipeline_task_num/runtime_filter_type/enable_bucket_shuffle_join/enable_projection、CREATE USER/ROLE 与 GRANT SELECT_PRIV/LOAD_PRIV/ALL 与 SET ROLE 与 SET PASSWORD、以及 Label has already been used、Tablet version too large(-235)、Failed to commit transaction、Memory limit exceeded、Failed to find enough host with tag、max_running_txn_num_per_db、no queryable replica、high water mark、Stream Load 307、partition does not exist 等报错排查。适用于 Apache Doris 集群日常运维、实时数仓与报表加速、明细与聚合模型设计、分区分桶规划、Stream/Routine Load 数据接入、物化视图与索引优化、慢查询定位与副本修复,以及大数据与 DBA 面试复习。
核心能力
- 涵盖 mysql 客户端连接 FE 9030 与 -e/-D 参数、FE Web UI 8030 与 BE 8040 metrics、SHOW FRONTENDS/BACKENDS/BROKERS 与 ALTER SYSTEM ADD BACKEND/FOLLOWER/OBSERVER 与 DECOMMISSION/DROP、SHOW PROC 的 /backends /frontends /statistic /cluster_balance /cluster_health/tablet_health /transactions、ADMIN SHOW CONFIG 与 ADMIN SET FRONTEND CONFIG/ALL FRONTENDS CONFIG 与 ADMIN REBALANCE DISK 与 ADMIN SHOW REPLICA STATUS 与 ADMIN REPAIR TABLE 与 ADMIN SET BACKEND CONFIG、CREATE DATABASE 的 replication_num 与 CREATE TABLE 的 UNIQUE KEY/DUPLICATE KEY/AGGREGATE KEY 与 DISTRIBUTED BY HASH BUCKETS 与 PROPERTIES 的 enable_unique_key_merge_on_write、RANGE/LIST 分区与动态分区 dynamic_partition 与 ADD/DROP/TEMPORARY/REPLACE PARTITION、SHOW CREATE TABLE/DESC ALL/SHOW PARTITIONS/SHOW TABLETS/SHOW DATA/SHOW DATA SKEW/SHOW REPLICA DISTRIBUTION、CREATE CATALOG 接入 Hive Metastore 与 SWITCH CATALOG、Stream Load 的 label/column_separator/format:json/read_json_by_line/strict_mode/max_filter_ratio/merge_type 与 Broker Load 与 Routine Load 的 PAUSE/RESUME/STOP 与 SHOW LOAD/CANCEL LOAD、INSERT INTO/INSERT OVERWRITE 分区覆盖写与 DELETE/UPDATE/BEGIN-COMMIT-ROLLBACK 事务与 SHOW TRANSACTION、窗口函数与 bitmap_union_count/hll_union_agg/percentile_approx/group_concat/collect_list/LATERAL VIEW explode_split、CREATE MATERIALIZED VIEW 与 REFRESH/DROP MATERIALIZED VIEW 与 SHOW ALTER TABLE MATERIALIZED VIEW、INVERTED/BLOOM_FILTER/NGRAM_BF 索引与 BUILD INDEX、information_schema 系统表与 SHOW PROCESSLIST/KILL、EXPLAIN 与 EXPLAIN VERBOSE 与 SET exec_mem_limit/query_timeout/parallel_pipeline_task_num/runtime_filter_type/enable_bucket_shuffle_join/enable_projection、CREATE USER/ROLE 与 GRANT SELECT_PRIV/LOAD_PRIV/ALL 与 SET ROLE 与 SET PASSWORD、以及 Label has already been used、Tablet version too large(-235)、Failed to commit transaction、Memory limit exceeded、Failed to find enough host with tag、max_running_txn_num_per_db、no queryable replica、high water mark、Stream Load 307、partition does not exist 等报错排查
适用场景
适用于 Apache Doris 集群日常运维、实时数仓与报表加速、明细与聚合模型设计、分区分桶规划、Stream/Routine Load 数据接入、物化视图与索引优化、慢查询定位与副本修复,以及大数据与 DBA 面试复习。Doris命令速查全程在浏览器中完成,无需安装插件,可放心用于日常办公与排障。
常见问题
- Doris命令速查是免费的吗?需要注册或安装吗?
- Doris命令速查完全免费,无需注册、无需下载安装任何软件,用浏览器打开网页即可直接使用,也不限制使用次数。
- Doris命令速查支持哪些功能?
- 涵盖 mysql 客户端连接 FE 9030 与 -e/-D 参数、FE Web UI 8030 与 BE 8040 metrics、SHOW FRONTENDS/BACKENDS/BROKERS 与 ALTER SYSTEM ADD BACKEND/FOLLOWER/OBSERVER 与 DECOMMISSION/DROP、SHOW PROC 的 /backends /frontends /statistic /cluster_balance /cluster_health/tablet_health /transactions、ADMIN SHOW CONFIG 与 ADMIN SET FRONTEND CONFIG/ALL FRONTENDS CONFIG 与 ADMIN REBALANCE DISK 与 ADMIN SHOW REPLICA STATUS 与 ADMIN REPAIR TABLE 与 ADMIN SET BACKEND CONFIG、CREATE DATABASE 的 replication_num 与 CREATE TABLE 的 UNIQUE KEY/DUPLICATE KEY/AGGREGATE KEY 与 DISTRIBUTED BY HASH BUCKETS 与 PROPERTIES 的 enable_unique_key_merge_on_write、RANGE/LIST 分区与动态分区 dynamic_partition 与 ADD/DROP/TEMPORARY/REPLACE PARTITION、SHOW CREATE TABLE/DESC ALL/SHOW PARTITIONS/SHOW TABLETS/SHOW DATA/SHOW DATA SKEW/SHOW REPLICA DISTRIBUTION、CREATE CATALOG 接入 Hive Metastore 与 SWITCH CATALOG、Stream Load 的 label/column_separator/format:json/read_json_by_line/strict_mode/max_filter_ratio/merge_type 与 Broker Load 与 Routine Load 的 PAUSE/RESUME/STOP 与 SHOW LOAD/CANCEL LOAD、INSERT INTO/INSERT OVERWRITE 分区覆盖写与 DELETE/UPDATE/BEGIN-COMMIT-ROLLBACK 事务与 SHOW TRANSACTION、窗口函数与 bitmap_union_count/hll_union_agg/percentile_approx/group_concat/collect_list/LATERAL VIEW explode_split、CREATE MATERIALIZED VIEW 与 REFRESH/DROP MATERIALIZED VIEW 与 SHOW ALTER TABLE MATERIALIZED VIEW、INVERTED/BLOOM_FILTER/NGRAM_BF 索引与 BUILD INDEX、information_schema 系统表与 SHOW PROCESSLIST/KILL、EXPLAIN 与 EXPLAIN VERBOSE 与 SET exec_mem_limit/query_timeout/parallel_pipeline_task_num/runtime_filter_type/enable_bucket_shuffle_join/enable_projection、CREATE USER/ROLE 与 GRANT SELECT_PRIV/LOAD_PRIV/ALL 与 SET ROLE 与 SET PASSWORD、以及 Label has already been used、Tablet version too large(-235)、Failed to commit transaction、Memory limit exceeded、Failed to find enough host with tag、max_running_txn_num_per_db、no queryable replica、high water mark、Stream Load 307、partition does not exist 等报错排查。
- Doris命令速查适合哪些场景使用?
- 适用于 Apache Doris 集群日常运维、实时数仓与报表加速、明细与聚合模型设计、分区分桶规划、Stream/Routine Load 数据接入、物化视图与索引优化、慢查询定位与副本修复,以及大数据与 DBA 面试复习。