ddsketch

实现DDSketch数据结构，实现在线的Quantile聚合

概览

扩展包名	版本	分类	许可证	语言
`ddsketch`	`1.0.1`	FUNC	PostgreSQL	C

ID	扩展名	Bin	Lib	Load	Create	Trust	Reloc	模式
4650	`ddsketch`	否	是	否	是	否	是	-

相关扩展	`tdigest` `count_distinct` `topn` `omnisketch` `datasketches` `hll` `quantile` `lower_quantile` `weighted_statistics`

版本

类型	仓库	版本	PG 大版本	包名	依赖
EXT	PIGSTY	`1.0.1`	1817161514	`ddsketch`	-
RPM	PIGSTY	`1.0.1`	1817161514	`ddsketch_$v`	-
DEB	PIGSTY	`1.0.1`	1817161514	`postgresql-$v-ddsketch`	-

OS / PG	PG18	PG17	PG16	PG15	PG14
el8.x86_64	PIGSTY 1.0.1 el8.x86_64.pg18 : ddsketch_18 ddsketch_18-1.0.1-1PIGSTY.el8.x86_64.rpm PIGSTY · 1.0.1 · 34.7KiB	PIGSTY 1.0.1 el8.x86_64.pg17 : ddsketch_17 ddsketch_17-1.0.1-1PIGSTY.el8.x86_64.rpm PIGSTY · 1.0.1 · 34.7KiB	PIGSTY 1.0.1 el8.x86_64.pg16 : ddsketch_16 ddsketch_16-1.0.1-1PIGSTY.el8.x86_64.rpm PIGSTY · 1.0.1 · 34.7KiB	PIGSTY 1.0.1 el8.x86_64.pg15 : ddsketch_15 ddsketch_15-1.0.1-1PIGSTY.el8.x86_64.rpm PIGSTY · 1.0.1 · 34.7KiB	PIGSTY 1.0.1 el8.x86_64.pg14 : ddsketch_14 ddsketch_14-1.0.1-1PIGSTY.el8.x86_64.rpm PIGSTY · 1.0.1 · 34.7KiB
el8.aarch64	PIGSTY 1.0.1 el8.aarch64.pg18 : ddsketch_18 ddsketch_18-1.0.1-1PIGSTY.el8.aarch64.rpm PIGSTY · 1.0.1 · 33.0KiB	PIGSTY 1.0.1 el8.aarch64.pg17 : ddsketch_17 ddsketch_17-1.0.1-1PIGSTY.el8.aarch64.rpm PIGSTY · 1.0.1 · 33.0KiB	PIGSTY 1.0.1 el8.aarch64.pg16 : ddsketch_16 ddsketch_16-1.0.1-1PIGSTY.el8.aarch64.rpm PIGSTY · 1.0.1 · 33.0KiB	PIGSTY 1.0.1 el8.aarch64.pg15 : ddsketch_15 ddsketch_15-1.0.1-1PIGSTY.el8.aarch64.rpm PIGSTY · 1.0.1 · 33.0KiB	PIGSTY 1.0.1 el8.aarch64.pg14 : ddsketch_14 ddsketch_14-1.0.1-1PIGSTY.el8.aarch64.rpm PIGSTY · 1.0.1 · 33.0KiB
el9.x86_64	PIGSTY 1.0.1 el9.x86_64.pg18 : ddsketch_18 ddsketch_18-1.0.1-1PIGSTY.el9.x86_64.rpm PIGSTY · 1.0.1 · 34.0KiB	PIGSTY 1.0.1 el9.x86_64.pg17 : ddsketch_17 ddsketch_17-1.0.1-1PIGSTY.el9.x86_64.rpm PIGSTY · 1.0.1 · 34.0KiB	PIGSTY 1.0.1 el9.x86_64.pg16 : ddsketch_16 ddsketch_16-1.0.1-1PIGSTY.el9.x86_64.rpm PIGSTY · 1.0.1 · 34.0KiB	PIGSTY 1.0.1 el9.x86_64.pg15 : ddsketch_15 ddsketch_15-1.0.1-1PIGSTY.el9.x86_64.rpm PIGSTY · 1.0.1 · 34.0KiB	PIGSTY 1.0.1 el9.x86_64.pg14 : ddsketch_14 ddsketch_14-1.0.1-1PIGSTY.el9.x86_64.rpm PIGSTY · 1.0.1 · 34.0KiB
el9.aarch64	PIGSTY 1.0.1 el9.aarch64.pg18 : ddsketch_18 ddsketch_18-1.0.1-1PIGSTY.el9.aarch64.rpm PIGSTY · 1.0.1 · 32.9KiB	PIGSTY 1.0.1 el9.aarch64.pg17 : ddsketch_17 ddsketch_17-1.0.1-1PIGSTY.el9.aarch64.rpm PIGSTY · 1.0.1 · 32.9KiB	PIGSTY 1.0.1 el9.aarch64.pg16 : ddsketch_16 ddsketch_16-1.0.1-1PIGSTY.el9.aarch64.rpm PIGSTY · 1.0.1 · 32.9KiB	PIGSTY 1.0.1 el9.aarch64.pg15 : ddsketch_15 ddsketch_15-1.0.1-1PIGSTY.el9.aarch64.rpm PIGSTY · 1.0.1 · 32.8KiB	PIGSTY 1.0.1 el9.aarch64.pg14 : ddsketch_14 ddsketch_14-1.0.1-1PIGSTY.el9.aarch64.rpm PIGSTY · 1.0.1 · 32.8KiB
el10.x86_64	PIGSTY 1.0.1 el10.x86_64.pg18 : ddsketch_18 ddsketch_18-1.0.1-1PIGSTY.el10.x86_64.rpm PIGSTY · 1.0.1 · 34.2KiB	PIGSTY 1.0.1 el10.x86_64.pg17 : ddsketch_17 ddsketch_17-1.0.1-1PIGSTY.el10.x86_64.rpm PIGSTY · 1.0.1 · 34.2KiB	PIGSTY 1.0.1 el10.x86_64.pg16 : ddsketch_16 ddsketch_16-1.0.1-1PIGSTY.el10.x86_64.rpm PIGSTY · 1.0.1 · 34.2KiB	PIGSTY 1.0.1 el10.x86_64.pg15 : ddsketch_15 ddsketch_15-1.0.1-1PIGSTY.el10.x86_64.rpm PIGSTY · 1.0.1 · 34.2KiB	PIGSTY 1.0.1 el10.x86_64.pg14 : ddsketch_14 ddsketch_14-1.0.1-1PIGSTY.el10.x86_64.rpm PIGSTY · 1.0.1 · 34.2KiB
el10.aarch64	PIGSTY 1.0.1 el10.aarch64.pg18 : ddsketch_18 ddsketch_18-1.0.1-1PIGSTY.el10.aarch64.rpm PIGSTY · 1.0.1 · 33.3KiB	PIGSTY 1.0.1 el10.aarch64.pg17 : ddsketch_17 ddsketch_17-1.0.1-1PIGSTY.el10.aarch64.rpm PIGSTY · 1.0.1 · 33.3KiB	PIGSTY 1.0.1 el10.aarch64.pg16 : ddsketch_16 ddsketch_16-1.0.1-1PIGSTY.el10.aarch64.rpm PIGSTY · 1.0.1 · 33.3KiB	PIGSTY 1.0.1 el10.aarch64.pg15 : ddsketch_15 ddsketch_15-1.0.1-1PIGSTY.el10.aarch64.rpm PIGSTY · 1.0.1 · 33.3KiB	PIGSTY 1.0.1 el10.aarch64.pg14 : ddsketch_14 ddsketch_14-1.0.1-1PIGSTY.el10.aarch64.rpm PIGSTY · 1.0.1 · 33.3KiB
d12.x86_64	PIGSTY 1.0.1 d12.x86_64.pg18 : postgresql-18-ddsketch postgresql-18-ddsketch_1.0.1-1PIGSTY~bookworm_amd64.deb PIGSTY · 1.0.1 · 60.7KiB	PIGSTY 1.0.1 d12.x86_64.pg17 : postgresql-17-ddsketch postgresql-17-ddsketch_1.0.1-1PIGSTY~bookworm_amd64.deb PIGSTY · 1.0.1 · 60.7KiB	PIGSTY 1.0.1 d12.x86_64.pg16 : postgresql-16-ddsketch postgresql-16-ddsketch_1.0.1-1PIGSTY~bookworm_amd64.deb PIGSTY · 1.0.1 · 60.7KiB	PIGSTY 1.0.1 d12.x86_64.pg15 : postgresql-15-ddsketch postgresql-15-ddsketch_1.0.1-1PIGSTY~bookworm_amd64.deb PIGSTY · 1.0.1 · 60.7KiB	PIGSTY 1.0.1 d12.x86_64.pg14 : postgresql-14-ddsketch postgresql-14-ddsketch_1.0.1-1PIGSTY~bookworm_amd64.deb PIGSTY · 1.0.1 · 60.6KiB
d12.aarch64	PIGSTY 1.0.1 d12.aarch64.pg18 : postgresql-18-ddsketch postgresql-18-ddsketch_1.0.1-1PIGSTY~bookworm_arm64.deb PIGSTY · 1.0.1 · 60.4KiB	PIGSTY 1.0.1 d12.aarch64.pg17 : postgresql-17-ddsketch postgresql-17-ddsketch_1.0.1-1PIGSTY~bookworm_arm64.deb PIGSTY · 1.0.1 · 60.4KiB	PIGSTY 1.0.1 d12.aarch64.pg16 : postgresql-16-ddsketch postgresql-16-ddsketch_1.0.1-1PIGSTY~bookworm_arm64.deb PIGSTY · 1.0.1 · 60.4KiB	PIGSTY 1.0.1 d12.aarch64.pg15 : postgresql-15-ddsketch postgresql-15-ddsketch_1.0.1-1PIGSTY~bookworm_arm64.deb PIGSTY · 1.0.1 · 60.4KiB	PIGSTY 1.0.1 d12.aarch64.pg14 : postgresql-14-ddsketch postgresql-14-ddsketch_1.0.1-1PIGSTY~bookworm_arm64.deb PIGSTY · 1.0.1 · 60.3KiB
d13.x86_64	PIGSTY 1.0.1 d13.x86_64.pg18 : postgresql-18-ddsketch postgresql-18-ddsketch_1.0.1-1PIGSTY~trixie_amd64.deb PIGSTY · 1.0.1 · 60.6KiB	PIGSTY 1.0.1 d13.x86_64.pg17 : postgresql-17-ddsketch postgresql-17-ddsketch_1.0.1-1PIGSTY~trixie_amd64.deb PIGSTY · 1.0.1 · 60.5KiB	PIGSTY 1.0.1 d13.x86_64.pg16 : postgresql-16-ddsketch postgresql-16-ddsketch_1.0.1-1PIGSTY~trixie_amd64.deb PIGSTY · 1.0.1 · 60.6KiB	PIGSTY 1.0.1 d13.x86_64.pg15 : postgresql-15-ddsketch postgresql-15-ddsketch_1.0.1-1PIGSTY~trixie_amd64.deb PIGSTY · 1.0.1 · 60.4KiB	PIGSTY 1.0.1 d13.x86_64.pg14 : postgresql-14-ddsketch postgresql-14-ddsketch_1.0.1-1PIGSTY~trixie_amd64.deb PIGSTY · 1.0.1 · 60.5KiB
d13.aarch64	PIGSTY 1.0.1 d13.aarch64.pg18 : postgresql-18-ddsketch postgresql-18-ddsketch_1.0.1-1PIGSTY~trixie_arm64.deb PIGSTY · 1.0.1 · 60.7KiB	PIGSTY 1.0.1 d13.aarch64.pg17 : postgresql-17-ddsketch postgresql-17-ddsketch_1.0.1-1PIGSTY~trixie_arm64.deb PIGSTY · 1.0.1 · 60.7KiB	PIGSTY 1.0.1 d13.aarch64.pg16 : postgresql-16-ddsketch postgresql-16-ddsketch_1.0.1-1PIGSTY~trixie_arm64.deb PIGSTY · 1.0.1 · 60.8KiB	PIGSTY 1.0.1 d13.aarch64.pg15 : postgresql-15-ddsketch postgresql-15-ddsketch_1.0.1-1PIGSTY~trixie_arm64.deb PIGSTY · 1.0.1 · 60.6KiB	PIGSTY 1.0.1 d13.aarch64.pg14 : postgresql-14-ddsketch postgresql-14-ddsketch_1.0.1-1PIGSTY~trixie_arm64.deb PIGSTY · 1.0.1 · 60.6KiB
u22.x86_64	PIGSTY 1.0.1 u22.x86_64.pg18 : postgresql-18-ddsketch postgresql-18-ddsketch_1.0.1-1PIGSTY~jammy_amd64.deb PIGSTY · 1.0.1 · 64.8KiB	PIGSTY 1.0.1 u22.x86_64.pg17 : postgresql-17-ddsketch postgresql-17-ddsketch_1.0.1-1PIGSTY~jammy_amd64.deb PIGSTY · 1.0.1 · 69.7KiB	PIGSTY 1.0.1 u22.x86_64.pg16 : postgresql-16-ddsketch postgresql-16-ddsketch_1.0.1-1PIGSTY~jammy_amd64.deb PIGSTY · 1.0.1 · 69.7KiB	PIGSTY 1.0.1 u22.x86_64.pg15 : postgresql-15-ddsketch postgresql-15-ddsketch_1.0.1-1PIGSTY~jammy_amd64.deb PIGSTY · 1.0.1 · 69.7KiB	PIGSTY 1.0.1 u22.x86_64.pg14 : postgresql-14-ddsketch postgresql-14-ddsketch_1.0.1-1PIGSTY~jammy_amd64.deb PIGSTY · 1.0.1 · 69.7KiB
u22.aarch64	PIGSTY 1.0.1 u22.aarch64.pg18 : postgresql-18-ddsketch postgresql-18-ddsketch_1.0.1-1PIGSTY~jammy_arm64.deb PIGSTY · 1.0.1 · 65.6KiB	PIGSTY 1.0.1 u22.aarch64.pg17 : postgresql-17-ddsketch postgresql-17-ddsketch_1.0.1-1PIGSTY~jammy_arm64.deb PIGSTY · 1.0.1 · 69.2KiB	PIGSTY 1.0.1 u22.aarch64.pg16 : postgresql-16-ddsketch postgresql-16-ddsketch_1.0.1-1PIGSTY~jammy_arm64.deb PIGSTY · 1.0.1 · 69.2KiB	PIGSTY 1.0.1 u22.aarch64.pg15 : postgresql-15-ddsketch postgresql-15-ddsketch_1.0.1-1PIGSTY~jammy_arm64.deb PIGSTY · 1.0.1 · 69.4KiB	PIGSTY 1.0.1 u22.aarch64.pg14 : postgresql-14-ddsketch postgresql-14-ddsketch_1.0.1-1PIGSTY~jammy_arm64.deb PIGSTY · 1.0.1 · 69.3KiB
u24.x86_64	PIGSTY 1.0.1 u24.x86_64.pg18 : postgresql-18-ddsketch postgresql-18-ddsketch_1.0.1-1PIGSTY~noble_amd64.deb PIGSTY · 1.0.1 · 63.5KiB	PIGSTY 1.0.1 u24.x86_64.pg17 : postgresql-17-ddsketch postgresql-17-ddsketch_1.0.1-1PIGSTY~noble_amd64.deb PIGSTY · 1.0.1 · 63.6KiB	PIGSTY 1.0.1 u24.x86_64.pg16 : postgresql-16-ddsketch postgresql-16-ddsketch_1.0.1-1PIGSTY~noble_amd64.deb PIGSTY · 1.0.1 · 63.6KiB	PIGSTY 1.0.1 u24.x86_64.pg15 : postgresql-15-ddsketch postgresql-15-ddsketch_1.0.1-1PIGSTY~noble_amd64.deb PIGSTY · 1.0.1 · 63.5KiB	PIGSTY 1.0.1 u24.x86_64.pg14 : postgresql-14-ddsketch postgresql-14-ddsketch_1.0.1-1PIGSTY~noble_amd64.deb PIGSTY · 1.0.1 · 63.5KiB
u24.aarch64	PIGSTY 1.0.1 u24.aarch64.pg18 : postgresql-18-ddsketch postgresql-18-ddsketch_1.0.1-1PIGSTY~noble_arm64.deb PIGSTY · 1.0.1 · 64.0KiB	PIGSTY 1.0.1 u24.aarch64.pg17 : postgresql-17-ddsketch postgresql-17-ddsketch_1.0.1-1PIGSTY~noble_arm64.deb PIGSTY · 1.0.1 · 64.0KiB	PIGSTY 1.0.1 u24.aarch64.pg16 : postgresql-16-ddsketch postgresql-16-ddsketch_1.0.1-1PIGSTY~noble_arm64.deb PIGSTY · 1.0.1 · 64.0KiB	PIGSTY 1.0.1 u24.aarch64.pg15 : postgresql-15-ddsketch postgresql-15-ddsketch_1.0.1-1PIGSTY~noble_arm64.deb PIGSTY · 1.0.1 · 64.0KiB	PIGSTY 1.0.1 u24.aarch64.pg14 : postgresql-14-ddsketch postgresql-14-ddsketch_1.0.1-1PIGSTY~noble_arm64.deb PIGSTY · 1.0.1 · 63.9KiB
u26.x86_64	PIGSTY 1.0.1 u26.x86_64.pg18 : postgresql-18-ddsketch postgresql-18-ddsketch_1.0.1-1PIGSTY~resolute_amd64.deb PIGSTY · 1.0.1 · 62.9KiB	PIGSTY 1.0.1 u26.x86_64.pg17 : postgresql-17-ddsketch postgresql-17-ddsketch_1.0.1-1PIGSTY~resolute_amd64.deb PIGSTY · 1.0.1 · 63.1KiB	PIGSTY 1.0.1 u26.x86_64.pg16 : postgresql-16-ddsketch postgresql-16-ddsketch_1.0.1-1PIGSTY~resolute_amd64.deb PIGSTY · 1.0.1 · 63.1KiB	PIGSTY 1.0.1 u26.x86_64.pg15 : postgresql-15-ddsketch postgresql-15-ddsketch_1.0.1-1PIGSTY~resolute_amd64.deb PIGSTY · 1.0.1 · 63.4KiB	PIGSTY 1.0.1 u26.x86_64.pg14 : postgresql-14-ddsketch postgresql-14-ddsketch_1.0.1-1PIGSTY~resolute_amd64.deb PIGSTY · 1.0.1 · 63.4KiB
u26.aarch64	PIGSTY 1.0.1 u26.aarch64.pg18 : postgresql-18-ddsketch postgresql-18-ddsketch_1.0.1-1PIGSTY~resolute_arm64.deb PIGSTY · 1.0.1 · 63.3KiB	PIGSTY 1.0.1 u26.aarch64.pg17 : postgresql-17-ddsketch postgresql-17-ddsketch_1.0.1-1PIGSTY~resolute_arm64.deb PIGSTY · 1.0.1 · 63.5KiB	PIGSTY 1.0.1 u26.aarch64.pg16 : postgresql-16-ddsketch postgresql-16-ddsketch_1.0.1-1PIGSTY~resolute_arm64.deb PIGSTY · 1.0.1 · 63.5KiB	PIGSTY 1.0.1 u26.aarch64.pg15 : postgresql-15-ddsketch postgresql-15-ddsketch_1.0.1-1PIGSTY~resolute_arm64.deb PIGSTY · 1.0.1 · 63.5KiB	PIGSTY 1.0.1 u26.aarch64.pg14 : postgresql-14-ddsketch postgresql-14-ddsketch_1.0.1-1PIGSTY~resolute_arm64.deb PIGSTY · 1.0.1 · 63.5KiB

构建

您可以使用 pig build 命令构建 ddsketch 扩展的 RPM / DEB 包：

BASH

pig build pkg ddsketch         # 构建 RPM / DEB 包

安装

您可以直接安装 ddsketch 扩展包的预置二进制包，首先确保 PGDG 和 PIGSTY 仓库已经添加并启用：

BASH

pig repo add pgsql -u          # 添加仓库并更新缓存

使用 pig 或者是 apt/yum/dnf 安装扩展：

安装

BASH

pig install ddsketch;          # 当前活跃 PG 版本安装

pig

BASH

pig ext install -y ddsketch -v 18  # PG 18
pig ext install -y ddsketch -v 17  # PG 17
pig ext install -y ddsketch -v 16  # PG 16
pig ext install -y ddsketch -v 15  # PG 15
pig ext install -y ddsketch -v 14  # PG 14

dnf

BASH

dnf install -y ddsketch_18       # PG 18
dnf install -y ddsketch_17       # PG 17
dnf install -y ddsketch_16       # PG 16
dnf install -y ddsketch_15       # PG 15
dnf install -y ddsketch_14       # PG 14

apt

BASH

apt install -y postgresql-18-ddsketch   # PG 18
apt install -y postgresql-17-ddsketch   # PG 17
apt install -y postgresql-16-ddsketch   # PG 16
apt install -y postgresql-15-ddsketch   # PG 15
apt install -y postgresql-14-ddsketch   # PG 14

创建扩展：

SQL

CREATE EXTENSION ddsketch;

用法

ddsketch: PostgreSQL 的 DDSketch 分位数估计

实现了 DDSketch，一种完全可合并的分位数草图，提供相对误差保证。比 percentile_cont 快得多，并支持并行处理。

SQL

CREATE EXTENSION ddsketch;

直接聚合函数

函数	描述
`ddsketch_percentile(value, alpha, nbuckets, quantile)`	估计单个百分位数
`ddsketch_percentile(value, alpha, nbuckets, quantiles[])`	估计多个百分位数
`ddsketch_percentile_of(value, alpha, nbuckets, value)`	估计某个值的百分位排名
`ddsketch_percentile_of(value, alpha, nbuckets, values[])`	估计多个值的百分位排名

预聚合函数

函数	描述
`ddsketch(value, alpha, nbuckets)`	从值构建 ddsketch
`ddsketch_percentile(sketch, quantile)`	从预构建的草图估计百分位数
`ddsketch_percentile(sketch, quantiles[])`	从预构建的草图估计多个百分位数

工具函数

函数	描述
`ddsketch_count(sketch)`	返回草图中的项目数量
`ddsketch_sum(sketch, low, high)`	指定值范围内的截断求和
`ddsketch_avg(sketch, low, high)`	指定值范围内的截断平均值

参数

alpha – 控制精度和草图大小（越小越精确，但体积越大）
nbuckets – 最大桶数（每个 8 字节）

示例

SQL

-- 替代：SELECT percentile_cont(0.95) WITHIN GROUP (ORDER BY a) FROM t;
SELECT ddsketch_percentile(a, 0.05, 1024, 0.95) FROM t;

-- 一次估计多个百分位数
SELECT ddsketch_percentile(a, 0.05, 1024, ARRAY[0.5, 0.95, 0.99]) FROM t;

-- 预聚合以加速重复查询
CREATE TABLE p AS SELECT a, b, ddsketch(c, 0.05, 1024) AS d FROM t GROUP BY a, b;

-- 查询预聚合数据（约 1.5ms vs 精确计算约 7s）
SELECT a, ddsketch_percentile(d, 0.95) FROM p GROUP BY a ORDER BY a;

意见反馈

这个页面对您有帮助吗？

感谢反馈！请告诉我们如何改进。

抱歉给您带来不便。请告诉我们如何改进。