- 快召唤伙伴们来围观吧
- 微博 QQ QQ空间 贴吧
- 视频嵌入链接 文档嵌入链接
- 复制
- 微信扫一扫分享
- 已成功复制到剪贴板
GPDB 6 server 新特性与新版本展望
GPDB 6 server 新特性与新版本展望
话题大纲:
- Greenplum 6 server 新特性
- 跨级群并行处理
- 资源管理精细化
- 安全认证算法增强
- Vacuum 效率提升
- Greenplum 7 server 新特性展望:
- 基于PG12,深度支持多重特性
- 资源管理全面升级
- AO/CO 功能扩展增强
展开查看详情
1 . VMware Greenplum 6 server 新特性与新版本 展望 Wen Wang Vmware GP Product Manager 12/09/2022 Confidential │© │ ©2022 2022VMware, VMware,Inc. Inc.
2 .Disclaimer • This presentation contains statements which are intended to outline the general direction of certain of VMware's offerings. • It is intended for information purposes only and may not be incorporated into any contract. • Any information regarding the pre-release of VMware offerings, future updates or other planned modifications is subject to ongoing evaluation by VMware and is subject to change. • All software releases are on an if and when available basis and are subject to change. • This information is provided without warranty or any kind, express or implied, and is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions regarding VMware offerings. • Any purchasing decisions should only be based on features currently available. • The development, release, and timing of any features or functionality described for VMware's offerings in this presentation remain at the sole discretion of VMware. Confidential │ © 2022 VMware, Inc. 2
3 .目录 Greenplum 6 Core Server new features • Greenplum to Greenplum Data Federation (GP2GP) • Resource management 资源管理改进 • SCRAM-SHA-256身份验证方法的支持 • AO 表上的vacuum 索引功能增强 Greenplum 7 Roadmap • PG12 support • Resource management 资源管理持续改进 • AO/CO enhancement: Primary Key/ Unique Indexes for AO/CO tables • Altering the storage type of the table is supported Confidential │ © 2022 VMware, Inc. 3
4 .Greenplum Database Version 6 The world's best and only OSS Multi-Platform Data Warehouse Greenplum Version 6 has achieved massive success in customer adoption running billions of diverse complex SQL daily with minimal support intervention Greenplum is the Massively Parallel Processing Powered by: Workhouse for big database analytics 1. PostgreSQL base code line 2. ORCA Optimizer Running Billions of SQL Daily Globally 3. Write Ahead Log High Availability on Exabytes Data 4. PXF, Spark and Streaming 5. Managed by Command Center Any Data | Any Size | Anywhere Confidential │ © 2020 VMware, Inc. 4
5 .Greenplum to Greenplum Data Federation (GP2GP) 1. GP2GP: 1. 帮助客户轻松快速地跨不同的Greenplum集群进行 查询 2. 实现高速数据联合和数据共享 3. 扩大了 Greenplum cluster的集群规模 Scale Efficiency Parallel Cursor 4. 为客户节省了资金 2. 特性: • 正确性: – 保证全局事务和MVCC • 兼容性: – 通过libpq协议控制和传输数据 • 效率: – 将数据 Pushdown , segment 之间直接相互传 输 FDW Transaction Safe Heterogenous Cluster Configuration 3. 组成: 1. Parallel retrieve Cursor 2. Greenplum Foreign Data Wrapper(FDW) Confidential │ © 2020 VMware, Inc. 5
6 .Resource management 资源管理改进 Resource Group Connection Management User-Based Resource Dynamic Query • Control over how many users Groups Prioritization can be connected. • Each user is assigned to a • CPU Levels per group • Provides pooling (to allow resource group that performs • Allows DBAs to control query large numbers) and caps (to 'admission control' of queries priorities in real-time, or restrict numbers if desired) into the database determine default priorities by • Intelligently frees and • Allows DBAs to control the resource group reacquires temporarily idle total number or total cost of session resources queries allowed in at any point in time • PGBouncer or Heimdahl • Memory allocations per group Confidential │ © 2020 VMware, Inc.
7 .Resource management 资源管理改进 管理范围 • CPU, Memory, Concurrency 新特性 • 精细化配置,资源得到更充分的利用 – 根据Coordinator和primary segments的内存配置, 分别计算每个query的最大内存分配额 • 高负载下改善性能, Hyper-Threading Best Practices – 更好的单个查询性能、 – 资源组(RG)之间的隔离 – 以及较低的运行与运行差异 • Debug信息细化 – 根据Vmem、系统、查询和资源组内存分配的当前状态输出不同的错误消息 Confidential │ © 2020 VMware, Inc. 7
8 .SCRAM-SHA-256 认证支持 GP6新安全密码功能 • 背景: – Md5:不再能满足高安全用户的需求 – Sha-256认证方式:网络发送密码格式为明文,必须与SSL一起工作 • SCRAM-SHA-256 – 密码哈希算法和客户端身份验证方法的支持 – 最安全 – Backport from PG10 Confidential │ © 2020 VMware, Inc. 8
9 .AO 表上的vacuum 索引功能增强 收益: • Vacuum index on AO 实现方法改进 • 提高运行效率,改善性能 分析: • AO 表特点,分片文件 • Vacuum on AO • Vacuum on AO index Confidential │ © 2020 VMware, Inc. 9
10 .GP 7 more features in coming Version 7.0 © 2022 VMware, Inc. 10
11 .Greenplum and PostgreSQL The only OSS PostgreSQL based Data Warehouse for Enterprise Greenplum 4 Greenplum 5 Greenplum 6 Greenplum 7 2010 2017 2019 2023 Postgres 8.2 Circa Postgres 8.3 Postgres 9.4 Postgres 12 2006 (-4) Circa 2008 (-9) Circa 2014 (-5) Circa 2019 (-4) Greenplum v8 based on Postgres 16 2 year trailing cadence Confidential │ © 2020 VMware, Inc. 11
12 . PG12 support Management Precision Security REINDEX CONCURRENTLY without blocking MCV statistics for query tuning Row level security control writes Scram SHA-256 Authentication Progress reporting statistics for CREATE INDEX, REINDEX, CLUSTER, VACUUM FULL, and pg_checksums ` Confidential │ © 2020 VMware, Inc.
13 .Performance JIT Upsert Partition table Brin index enhancement Support for the Vacuum SQL/JSON path enhancement language Automatic inlining of CTEs Windows functions support enhancement Optimizations to space utilization and read/write performance for B-tree indexes Confidential │ © 2020 VMware, Inc. 13
14 .Resource management 资源管理持续改进 • CGroup V2 support • Memory 控制 更易用,更灵活,高负载下更稳定 • CPU 控制改进 更稳定, 资源更充分调度 • 增强短query 的并发支持量 • 重构和抽象接口和流程,进程资源分配 © 2022 VMware, Inc. 14
15 .AO/CO enhancement: unique indexes on AO/CO tables • 压缩表上使用主键,支持唯一的索引 • Upsert for AO • 适用于更多的数据模型,业务更简洁 © 2022 VMware, Inc. 15
16 .Altering the storage type of the table is supported • 支持修改表的存储类型, – altering from heap to ao/co, ao to heap/co, co to heap/ao. • 增强数据兼容性 • 操作简单,易用性更强 • 高效运行 • 灵活方便 • 对新客户有很大吸引力 © 2022 VMware, Inc. 16
17 . Thank You Confidential │ © 2020 VMware, Inc.