Extreme Performance with the Oracle Exadata X3 and DB 12c

Presentation on theme: "Extreme Performance with the Oracle Exadata X3 and DB 12c"— Presentation transcript:

1

2 Extreme Performance with the Oracle Exadata X3 and DB 12c
娄恒 Exadata Solution Specialist

3 The following is intended to outline our general product direction
The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

4 传统数据库部署问题 传统数据库架构无法很好的扩展 投资成本 人员成本和技术复杂度 服务器与存储的分离、SAN存储和网络瓶颈
Servers 传统数据库架构无法很好的扩展 服务器与存储的分离、SAN存储和网络瓶颈 多核CPU对于数据处理能力10倍于SAN存储的数据吞吐能 力 投资成本 服务器、存储、SAN交换机、集成、存储软件、数据库软 件 人员成本和技术复杂度 部署复杂，需要每个系统调优、测试、维护 SAN Bottleneck Storage

5 Exadata 平台的设计理念 为最佳运行数据库平台而设计 对服务器、存储、网络的集成和优化
大规模服务器集群实现水平扩展 Flash优化、存储节省 通过对存储、Flash、网络特定的工程化软件设计，带 来数据库极限性能的提升 部署简单、维护简单 适用于各种数据库负载 OLTP、数据仓库、数据库云

6 超过1000+大客户部署 一半数据仓库、一半OLTP和数据库云 PB级数据仓库 互联网在线交易平台 电子商务网站 数百个数据库整合

7 Exadata for ERP, CRM, HR E-business Suite, Siebel, Peoplesoft, JDE, SAP

8 Exadata架构：水平扩展平台（Scale-Out）
运行数据库的完整平台– 服务器、存储、网络 水平扩展的数据库服务器 8台–每台2路服务器（16核）256 GB内存 或者2台– 每台8路服务器（80核）2 TB 内存 水平扩展的智能存储服务器 14台 – 2路存储服务器（12核） 168 磁盘– 500TB 56 Flash PCI – 22 TB Flash 高速网络 提供 40 Gb/sec的内部连接 10Gb 或 1Gb数据中心标准网卡连接 Fully Redundant

9 Exadata X3 | 内存数据库 X3 2012 2010 2009 数据仓库 在线交易和 超大数据库 竖向扩展 磁盘数据库 内存数据库
2008 大容量闪存 所有I/O都在闪存中 数据仓库 在线交易和 超大数据库 竖向扩展 磁盘数据库 内存数据库

10 从小配置起步，不断演进和扩展 可以跨代系扩展 八分之一机柜 四分之一机柜 二分之一机柜 满机柜

11 无缝的升级和扩展 升级例子 一台Exadata可以同时使用多个版本 的服务器 数据库和集群可以跨越不同版本的硬 件
新的软件可以运行旧的硬件上 X3-2 2012从1/2升到满配 X2-2 2011从1/4升级到1/2配 V2 2010最早买了个1/4配

12 不需其他设备情况下，可扩展到18个机柜 5900计算Core 9 PB非压缩数据存储

13 高度工程化和标准化 更低风险、更好的效果 避免工程师花大量的时间在集成和优化系统上 开箱即用、快速部署完成
Database, OS, drivers, firmware all optimized together 把I/T的精力转移到业务分析上 开箱即用、快速部署完成 Oracle提供从磁盘到数据库的端到端支持 可以运行目前所有的数据库负载任务 Ready- to-Run

14 Exadata白金服务 ORACLE 白金服务 对整个Oracle组件提供更好服务 对错误的主动式的远程监控 业界领先的服务响应时间:
提供高可靠保障. 没有附加成本. 对整个Oracle组件提供更好服务 包括对数据库软件的更好服务 对错误的主动式的远程监控 业界领先的服务响应时间: 5 分钟错误通知 15 分钟恢复或者升级到开发团队 30 分钟和开发团队联合调试 Oracle 工程师提供季度提供的季度更新补丁服务 对Exadata特定配置 有效 Oracle hardware and software are not only engineered to work together, they are engineered to be maintained, updated, and supported together. We are uniquely qualified to provide optimized performance at every level of the integrated stack, delivering the essential services and resources your business needs to maintain high availability, increase operational efficiency, and gain competitive advantage. Oracle Premier Support provides fully integrated system support with a single point of accountability… 24/7 support with access to Engineered Systems experts Updates, upgrades and support for the Oracle operating system, database and integrated server and storage hardware. 2 hour onsite response Access to My Oracle Support portal which contains a 1 million article database and many, many proactive tools to help you keep systems running at peak performance Oracle Automated Service Request – where your system phones home to Oracle to let us know if there is a problem with the hardware …and now, qualifying customers can also receive the enhanced coverage of Oracle Platinum Services for no additional cost. Oracle Platinum Services is a special entitlement under Oracle Premier Support, delivered at no additional cost. It’s exclusively available on Oracle Exadata, Exalogic and SPARC SuperCluster based on certified configurations. It provides 24/7 Oracle remote fault monitoring Backed by extremely fast response times: 5 Minute Fault Notification 15 Minute Restoration or Escalation to Development 30 Minute Joint Debugging with Development And, quarterly patching deployed by Oracle Oracle Platinum Services takes standard support to a whole new level with additional, no cost services targeted to delivering high availability. To learn more about Oracle Platinum Services go to:

15 Exadata关键创新 低成本下的极致性能
横向扩展的智能存储 通过InfiniBand 和服务器连接 Smart Scan 技术把查询负载下移 混合列式压缩 10x 数据仓库压缩率 15x 存档数据压缩率 + + + 未压缩 当扫描和存在flash时，数据保持压缩状态 压缩 智能PCI 闪存 磁盘的前端的透明缓存 30倍提高随机I/O 性能 4倍提高数据扫描速度 主数据库 在后续使用中保持空间节省 开发 备用数据库 测试 备份

16 100GB/sec Data Throughput
Exadata 智能存储网格 数据密集操作在Exadata存储网格中运行 从磁盘中过滤行和列 (168 Intel Cores) 举例: How much product X sold last quarter Exadata Storage Reads 10TB from disk Exadata Storage Filters rows by Product & Date Sends 100GB of matching data to DB Servers 大量存储服务器并行执行，消除IO瓶颈 100GB/sec Data Throughput

17 Exadata 智能存储 Exadata Intelligent Storage Grid Exadata存储服务器运行大量复杂的计算操作
Join filtering Incremental backup filtering I/O prioritization Storage Indexing Database level security Offloaded scans on encrypted data Data Mining Model Scoring 一般情况可以减少10倍以上的数据量，返回给DB服务器计算 Exadata Intelligent Storage Grid Statistic per Second physical read total bytes 19,924,306.57 cell physical IO bytes eligible for predicate offload 19,314,669.51 cell physical IO bytes saved by storage index 4,427,231.62 cell physical IO interconnect bytes returned by smart scan 37,133.44 smart scan efficiency =522：1 =cell physical IO bytes eligible for predicate offload/cell physical IO interconnect bytes returned by smart scan

18 Exadata 混合列压缩 Highest Capacity, Lowest Cost 数据按照列来组织和压缩
Speed Optimized Query Mode for Data Warehousing 10X compression typical Runs faster because of Exadata offload! Space Optimized Archival Mode for infrequently accessed data 15X to 50X compression typical Query Faster and Simpler Backup, DR, Caching, Reorg, Clone Benefits Multiply

19 Real-World数据压缩比 Compression Ratio varies by customer and table
Compression of largest table at 10 ultra large companies Average revenue > $60 BB Average Query Compression ratio was 13x On top of Oracle’s already highly efficient format Retail Financial Telecom

20 Turkcell: DW and DB Consolidation
Benefits Reduced Admin 20% Storage Savings 900 TB 1,000 TB to 100 TB Faster Reports 10X 27 min to 3 min (avg for 50k rpts) “In a word, Oracle Exadata is fantastic. Almost no report takes more than 10 minutes to run, versus hours before. It sounds unreal, but it’s real.” - Power User, Finance Department, Turkcell 80% Less Power 30 m2 Less Space Data Center Cost Savings Business Objectives Speed up BI Lean, green data center Prepare for big data growth Solution 2010: Replace 11 racks with 1 full-rack Exadata V2 for DW 2011: Add 2 full-rack Exadata X2-2s for DB consolidation Pre-Exadata Data Warehouse Exadata V2 Data Warehouse 2 Exadata X2-2 Prod Original V2 Prod/DR/Dev Hitachi USP-V 5 Racks EMC DMX-4 5 Racks 2010 2011 Backup Restore Turkcell is the largest mobile phone operator in Turkey, with twice as many subscribers as the nearest competitor. In 2010, Turkcell’s business intelligence agility was throttled by the performance of its data warehouse platform. Using a large Unix SMP system and 10 racks of high-end storage, the average report took almost 30 minutes to complete, and 50,000 reports were being run monthly. That’s when Turkcell invested in a full rack Exadata Database Machine and, applying Exadata’s hybrid columnar compression, converted a 250 TB data warehouse into a 25 TB compressed data warehouse on Exadata, enjoying a 10x speedup in the average report, which completed in less than 3 minutes. In 2011, Turkcell decided to consolidate more databases onto Exadata, and invested in two full rack Exadata X2-2 systems, holding 600 TB of raw data compressed to 60 TB. The original Exadata system now holds 400 TB of raw data compressed to 40 TB, for a total of 1 Petabyte of raw data on Exadata. In addition to the 10x performance improvement in their reporting, Turkcell freed up 900 TB of tier-1 storage for other uses, reduced overall IT admin costs by 20%, and shrunk the footprint of their data center, including power consumption, by 80%. 2011 250 TB Raw Data 25 TB Compressed 4 Prod, 2 Test Databases 400 TB Raw/ 40 TB Compressed 2 RAC Clusters 2 Prod Databases 600 TB Raw / 60 TB Compressed 16-node RAC Cluster

21 SK Telecom: Revenue Assurance DW
Benefits Storage Savings 900 TB 1,000 TB to 100 TB $ Millions Capture Lost Revenue Extreme Capacity 10 TB/day “Oracle Exadata Database Machine has overwhelmingly superior performance, with average data processing rates 8 to 20 times greater than other SK Telecom in-house systems.” - Jin-hyung Lee, Manager, Network Engineering Department, SK Telecom Exadata X2-2 Qtr Rack (2010) Spam Filtering Business Objectives Ensure billing accuracy Enhance customer service Predict data traffic trends Solution 2009: Create new DW on Exadata V1 half-rack 2010: Move to full-rack Exadata V2 2011: Add full-rack Exadata X2-2 2010 2011 Exadata V2+X2-2 Data Warehouse 1,000 TB Raw / 100 TB Compressed 16-node RAC Cluster Exadata V2 Data Warehouse Billing Analysis System Usage & Roaming Inquiries Exadata V1 Data Warehouse (2009) SK Telecom is Korea’s largest mobile service provider and a leader in driving new innovations in the industry. SK Telecom invested in the first generation of Exadata Database Machine in 2009 in order to more accurately track and account for customer usage and cross-network roaming, and thus more effectively bill for delivered services. The “revenue leakage” from SK Telecom’s numerous billing systems totaled millions of dollars annually, and Exadata quickly paid for itself by plugging these leaks. Soon thereafter, SK Telecom upgraded to the second (V2) generation of Exadata, as the amount of data collected and analyzed was increasing by 10 TB per day. In 2011 another full rack Exadata X2-2 system was added, and the database had grown to over 1 Petabyte of raw data, compressed 10x to 100 TB. The 16 total compute nodes were configured as one 16-node RAC cluster. Without Exadata’s superior performance, up to 20x faster than previous systems, SK Telecom would not have been able to keep pace with their billing data volumes and recoup the millions of dollars of unbilled revenue that easily validated the Exadata investment.

22 Exadata X3 Database In-Memory Machine
自动把所有活动数据从磁盘移动到内存 DRAM 内存扩展到2 TB 或者4 TB , 存放最热数据 压缩后可存储4 TB 到40 TB 用户数据 闪存扩展4倍，达到每个机柜22 TB 压缩后可存储40 TB to 200 TB 用户数据– 所有活动数据 在线交易系统： 每秒1.5 Million 的SQL 随机读 相当于15,000 磁盘，150磁盘柜 数据仓库和报表：每秒100 GB SQL 数据扫描 相当于1,000磁盘，10磁盘柜 2 or 4 TB DRAM 最热数据 22 TB PCI FLASH 活动数据 500 TB DISK 冷数据

23 Exadata Smart Flash Log
加速交易响应时间 Default (on left) - Choppy Response - High Outliers Transaction Response Times Smart Flash Log Enabled Smart Flash Log - 3x faster response - Much lower outliers Uses Flash for Database Logs in a clever way Flash is fast but has slow outliers - Erase cycles, wear leveling, etc. Smart Flash Log transparently uses Flash as a parallel write cache to disk controller cache Whichever write completes first wins (disk controller or flash) Faster log writes and more throughput, uses almost no flash space In Netezza and Teradata the application must encrypt and decrypt individual column values explicitly on every SQL statement Automatic and Transparent

24 Exadata X3 vs. 传统存储阵列 100 GB/sec Exadata . . . Smart Storage 52 GB/sec
True Scale-Out InfiniBand PCI Flash Achieved from SQL Not Counting Compression… 52 GB/sec With Flash Disks

25 Exadata 数据库云 HR EDW CRM ERP Data Mart
Supply Chain Exadata 具有同时独特的能力，可以在一个云环境中同时 运行多个不同负载类型的数据库 高端OLTP, 数据仓库，跑批，报表，备份等 同一时间运行 X3 database in-memory 为所有负载提供极致性能 同时避免一种负载把其他应用的性能拖垮 所有负载，所有应用 SAP, Siebel, PeopleSoft, JDE, E-business Suite, Fusion Applications

26 U.S. Customs and Border Protection
Benefits Faster Applications 10X speedup 32 billion queries/day Storage Savings 1 Petabyte Replaced $$ SAN Maximum Availability 99.95% Cost Savings 75% Cost Reduction “Oracle Exadata has changed our strategic IT focus from building systems to developing and supporting application services critical to the fulfillment of our national security mission.” - Ken Ritchhart, Deputy Assistant Commissioner Business Objectives Reduce cost and complexity Meet availability SLAs Extreme scalability Consolidation Solution 2010: Implement V2, X2-2 2011: Add X2-2, X2-8 2012: Add X2-8, Exalogic Exadata V2 Primary/Standby Exadata X2-2 Primary /Standby Exadata X2-8 Primary/Standby Data Guard Data Guard Data Guard The U.S. Customs and Border Protection Agency (CBP) is a division of Homeland Security, chartered with monitoring and protecting the movement of passengers and cargo across the US border. Every time a passenger’s passport is swiped upon entering the country, Exadata is performing that database lookup. The combined activity amounts to over 30 billion database queries per day across dozens of Exadata systems. CBP began their data center conversion to Engineered Systems in 2010, with the purchase of a number of Exadata V2 Database Machines. Their Exadata portfolio as of the Summer of 2012 included more than two dozen V2, X2-2 and X2-8 Database Machines, along with Exalogic systems for application deployment. All production systems are paired with a standby Exadata system using Oracle Data Guard, as CBP must have near 100% availability, due to the time-critical nature of their mission. If a production system is down, goods and passengers may be prohibited from entering or leaving the country. Since converting their main database platforms to Exadata, CBP has reduced their associated capex and opex costs by 75%! Application performance has improved up to 10x, and uptime has averaged close to 100%. Ken Ritchhart, who manages the CBP IT operations, credits Exadata for changing the strategic focus of IT from building systems to developing critical application services. 2010 Automated Targeting Systems Automated Export Systems Passenger Systems Enterprise Data Warehouse

27 Exadata I/O Resource Management
适用于混合负载和多数据库云环境 ERP CRM HR EDW Data Mart Supply Chain Ensure different databases are allocated correct resources Database A: 33% I/O resources Database B: 67% I/O resources Ensure different users and tasks within a database are allocated the correct resources Database B: Interactive: 60% of I/O resources Batch: % of I/O resources

28 Enterprise Manager 12c Exadata软硬件端到端的管理平台 Performance, availability, usage by databases, services, clusters Software and hardware alerts Topology view of DB systems/cluster Drill down from database issue to hardware root cause In Netezza and Teradata the application must encrypt and decrypt individual column values explicitly on every SQL statement

29 Best Platform for… Data Warehousing OLTP Database Cloud
Exadata 最佳的数据库运行平台 Best Platform for… Data Warehousing OLTP Database Cloud OLTP with Analytics and Parallelism of Warehousing Warehousing with Interactivity, Availability, and Security of OLTP

30 Oracle Database 12.1对Exadata OLTP优化
Database 12.1 enhancements for Exadata are focused on OLTP and Consolidation Exadata enhanced for 12.1 Multitenant databases Provides extreme performance and safest consolidation Online Compression Tiering and Storage Tiering Hybrid Columnar Compression OLTP Enhancements Smart scans on LOBs Enhanced Availability and Migration SQL Performance Enhancements

31 Database 12.1 多租户数据库架构 理想的Database as a Service
Single Multitenant Database Many Databases each in a OS & VM Sales PDB Assets PDB Billing PDB Parts PDB Sales DB Assets DB Billing DB VM O/S Parts DB Single Physical Container Database Single O/S, No VMs Needed 数据库架构转变，适应于数据库云整合 资源共享、应用数据库独立和隔离 动态供给和升级 完全应用透明，不需要应用修改 每个数据库更少的硬件资源占用

32 Exadata 网络资源管理 Network Resource Management maintains steady performance OLTP workloads can degrade when network intensive reports or jobs are run This is an especially serious issue on an unpredictable consolidated system Exadata Network Resource Management uniquely prioritizes critical database messages through the entire fabric Latency sensitive messages prioritized over batch, reporting, and backup messages Log file writes have highest priority to ensure low latency transactions

33 Compliance & Reporting
OLTP自动压缩分层 Frequent Reporting Compliance & Reporting OLTP Automatic Compression Tiering converts cooler partitions to columnar compressed format online Global indexes maintained HCC now has row level locking for better OLTP Get OLTP performance of row format, with compression and reporting benefits of columnar format 10x compressed 15x compressed This Year’s Data Last Year Prior Years Row Format is best for OLTP Column Format is best for reporting & archiving

34 存储分层和迁移 New command moves database files and tablespaces to a new location online Enables moving to a different ASM disk group Use cases: Move tables or partitions to different storage tier E.g. Historical tablespaces can move from high performance to high capacity disks Move to different mirroring E.g move from normal redundancy to high Move to newer hardware

35 LOB处理加强 Smart Scan 支持 LOB数据
Smart Scan offload for small CLOBs (< 4KB) Like expressions, e.g. like(html, ‘Exadata’) Pattern Matching, e.g. regexp_like() Smart Scan works for compressed and encrypted CLOBs Parallel DML 可以支持在non-partitioned LOB columns Parallel Insert as Select, Create Table as Select, Move Table or Partition Also now parallelizes within partitions

36 可靠性的加强 远程同步（Far Sync） 全球数据服务（Global Data Services）
支持远距离的0数据损失的Standby数据库 全球数据服务（Global Data Services） 跨数据中心进行无缝的负载均衡和故障切 换failover 应用连续性（Application Continuity） 屏蔽应用级错误，当数据库实例失败后， 通过自动化应用在其他实例重做 Primary Active Standby Active Standby GoldenGate

37 Exadata ASM可靠性加强 优先恢复关键文件 对Rebalance I/O操作卸载到Exadata存储服务器
Critical files like log files and control files are rebalanced first to reduce the chance of data loss due to double failures (e.g double disk failure) Prioritizing important files is a big advantage over generic storage mirroring 对Rebalance I/O操作卸载到Exadata存储服务器 Data sent directly from cell to cell rather than through database node 数据同步支持速度控制和断点续传 Also periodically checkpoints so that failed resyncs restart at last checkpoint

38 减少数据迁移的复杂性和停机时间 Restore Backup Backup
原数据库 (Big Endian) 目标数据库 – Little Endian Restore Backup Backup In > only Exadata target -> Reduce Transportable Tablespace Downtime using Cross Platform Incremental Backups Minimize read-only impact with multiple incremental backups Successive incrementals converted & applied to restored data files Final incremental while tablespace in read-only mode, with separate Data Pump metadata export and import To create the backup set containing data that must be transported to the destination database, use the BACKUP command on the source database. To indicate that you are creating a cross-platform backup, the BACKUP command must contain either the FOR TRANSPORT or TO PLATFORM clause. When you use FOR TRANSPORT, the backup set that is created can be transported to any destination database. If the destination database uses an endian format that is different from that of the source database, the endian format conversion is performed on the destination database. When you use TO PLATFORM, the endian format conversion is performed on the source database. If you specify a target platform by using TO PLATFORM, the platform must be a supported platform. In the source database, use the DATAPUMP clause of the BACKUP command to create the metadata required to plug tablespaces into the target database. The metadata is stored in a Data Pump export dump file as a separate backup set. This backup set can be used in conjunction with the tablespace backup set to plug the transported tablespaces into the target database. Cross Platform Backup and Restore optimizes migration to Exadata Endian conversion performed without staging migration files Minimize offline or read-only impact with multiple incremental backups

39 Road Map: OLTP消息处理的硬件优化
Exadata已经整体极大提升了存储和网络的吞吐能力 Exadata将更进一步加速OLTP数据库服务器间的消息处理机制 重点提升在RAC Cache Fusion的消息传递的延时和吞吐能力 数据库直接调用InfiniBand硬件，绕开网络软件的堆栈、中端和调度等 3X Speedup

40 总结 X3 第四代数据库云服务器 X3 Database in-memory Machine 所有活动数据存在内存中
Exadata 数据库云 新的1/8配入门级Exadata X3

41 选择Exadata平台的各种理由 更好的用户体验 低能耗 快速部署 运行速度 降低实施风险 线性扩展 更快、更强的执行力 降低成本和复杂性
**View this slide in SLIDE SHOW MODE to activate links to section of the deck that reviews that specific point *Prepare the 2-3 “reasons” in advance of customer presentation* Customer choose engineered systems for many reasons. <Read through the list quickly.> Which one(s) might be most important to your company? Why? <Click on a specific reason above and you will go directly to that section. Important: Click on the icon! Otherwise you will simply advance to the next slide in the deck which happens to be “Seize Market Opportunity”> <Hit “Back to Reasons” button at bottom right of slides to return to this “Reasons” slide, then select the next reason (click on the icon). Or you may click through the slides sequentially – your choice.> Are there any reasons important to you that may not be on this list? If so, which ones? Why important to you? <Encourage discussion, explain that usually more than one reason is important, try to get a feel for which ones are the most important and why they might think so. If mentioned that something important to them is missing from the list, ask about it. Most likely it can be incorporated in at least of the reasons above.> 线性扩展 更快、更强的执行力 降低成本和复杂性 维护简单

42

43