MPEG for the past, present and future of television MPEG 用于电视的过去、当前和未来

Presentation on theme: "MPEG for the past, present and future of television MPEG 用于电视的过去、当前和未来"— Presentation transcript:

1 MPEG for the past, present and future of television MPEG 用于电视的过去、当前和未来
Leonardo Chiariglione Keynote Speech at ATSC Annual Meeting Washington, DC – 2012/05/08 ，MPEG 召集人在 ATSC 年会的主题演说 徐孟侠翻译，黄铁军校对；

2 MPEG for the past of television MPEG 用于电视的过去
System 系统 Transport Stream 传送流 DSM-CC 数字存储媒体—命令与控制 Timed metadata 有定时的宏数据 Video 视频 MPEG-2 High Profile MPEG-2 高档次 Audio 音频 MPEG-1 Audio Layer II 音频第 2 层 MPEG-2 AAC MPEG-2 高级音频编码 MPEG for the past, present and future of TV 2012/05/02

3 An assessment 评价 MPEG has provided the means for the television business on air, cable and satellite to migrate from the analogue to the digital age MPEG 对地面、有线和卫星的电视服务从模拟过渡到数字时代，提供各种方法 It has been a collective efforts 它是集体努力的结果 Representatives from the entire spectrum of the broadcasting world provided their requirements 来自广播界的方方面面代表已提出各种需求 Packages of patent licences were created (outside of MPEG) 在 MPEG 之外，已创建成套的专利许可证 Today there is virtually no broadcasting system that is not based, at least partially, on MPEG standards 目前没有一个广播系统不是基于MPEG 标准（至少部分基于） MPEG for the past, present and future of TV 2012/05/08

4 MPEG for the present of television MPEG 用于电视的当前
Systems 系统 Carriage of MPEG-4 on MPEG-2 TS 用于在 MPEG-2 TS 上承载 MPEG-4 Dynamic Adaptive Streaming over HTTP (DASH) HTTP (DASH) 上的动态自适应流媒体 Video 视频 MPEG-4 Advanced Video Coding (AVC) MPEG-4 高级视频编码 3D extensions 各种 3D 扩展 Audio 音频 Various forms of Advanced Audio Coding (AAC) 高级音频编码的各种形式 Universal Speech and Audio (USAC) 通用的语音和音频编码 MPEG for the past, present and future of TV 2012/05/08

5 An assessment 评价 The deployment of 2nd generation digital broadcasting systems continues successfully 第二代数字广播系统的部署继续顺利进行 Use of the AVC on MPEG-2 TS allows packing twice as many programs as MPEG-2 Video in an analogue channel 在单个模拟电视频道中，采用 MPEG-2 TS 承载 AVC 视频，替代 MPEG-2 视频，可使节目数量翻一番 With IPTV the notion of broadcasting is expanding IPTV 正在拓展广播的概念 MPEG is helping the broadcasting industry MPEG 正在帮助广播工业界 To enrich the broadcasted user experience 丰富了广播用户的体验 Through standard technologies that serve multiple fields 通过标准技术服务于多个领域 MPEG for the past, present and future of TV 2012/05/08

6 MPEG for the future of television MPEG 用于电视之未来
Well, that’s what I am supposed to talk about… 好，下面是我今天准备讨论的… MPEG for the past, present and future of TV 2012/05/08

7 Broadcasting is a great business to be in… 广播业在未来…仍然将是一个巨大的事业
Broadcasting is a proven business with a constant revenue flow 广播业已被证实具有稳定的收益流 Many technologies appear that 很多技术表现出能够： Can help new competing businesses but 有助于具有竞争力的新服务 Can also be used to extend the broadcasting business 而且还可用于扩展广播服务 MPEG is a neutral body devoted to the development of standard technologies for user communities to exploit MPEG 是一个中立团体，致力于开发各类用户群体所需的标准化技术 MPEG for the past, present and future of TV 2012/05/08

8 MPEG-H: a video standard for future broadcasting MPEG-H:用于未来广播的视频标准
ISO/IEC High Efficiency Coding and Media Delivery in Heterogeneous Environments ISO/IEC 23008：高效编码和异构环境的媒体发送 A suite of standards for media coding and delivery 用于媒体编码和发送的一整套标准 Currently scheduled to appear in 3 parts 目前计划包括三部分： MPEG Media Transport MPEG 媒体传送 High Efficiency Video Coding 高效视频编码 3D Audio 3D 音频 Timeline 时间表 CD – 委员会草案 DIS – 国际标准草案 FDIS – 国际标准定稿草案 Part CD DIS FDIS MMT 12/07 13/01 13/07 HEVC 12/02 3D Audio 14/04 14/10 15/01 MPEG for the past, present and future of TV 2012/05/08

9 Service composition in MMT MMT（多媒体传送流）中的服务组装
MMT Package MMT 信息包 <subtitle> <标题> Composition information 组装信息 friendly with html5 与 HTML5 友好 Bird is flying… 鸟在飞… 通用发送的各种内容 3D Earth UD contents New points : Smart TV version composition information equivalent with Subtitle info in DTV case 3D 地球 Bird is flying… legacy broadcasting 传统广播 future broadcasting 未来广播 MPEG for the past, present and future of TV 2012/05/02

10 Smart delivery in Clouds 云计算中的智能发送
Video 视频 Web 互联网 File 文件 Service Component List 服务组件的清单 Component location 组件的位置 Composition relationship 组装的关系 QoE requirement 封装质量的需求 How to deliver 如何发送 How to consume 如何消费 pull 拉动 pull MMT Encapsulator MMT 封装器 MMT Frame MTT 数据帧 New points : Cloud based mash-up is possible Adaptive delivery in the heterogeneous environments(heterogeneous terminals, heterogeneous delivery channel…, until now, all broadcaster should prepare multiple content/service set for all terminals/all channels, but the number will be increased very fast…it is a big problem.) Configuration 配置 Adaptive delivery 自适应发送 Sync, Delay, Loss control 同步，延迟，丢包控制 2012/05/08

11 Mash-up service 混成服务 11 Audio Video1 Video2 Widget Web page
音频 Video1 视频 1 Video2 视频 2 Widget 小工具菜单 Web page 网页 MMT assets MMT 各种资产 Service 1 (MMT Package1) 服务 1 （MMT 信息包 1） Service 2 (MMT Package2) 服务 2（MMT 信息包2） New points : One source multi use each components can be used as “module” Each component will be non-timed, in addition to timed data(A, V) 11 MPEG for the past, present and future of TV 2012/05/08

12 Second screen management 第二屏幕的管理
MMT Package MMT 信息包 Composition information 组装信息 Issue <device 1>… <设备 1>… <device2>… <设备 2>… Video content on 2nd device 在第二设备上的视频内容 new points : 2nd screen management information from broadcaster Additional Information with Live Content (HTML) 实况内容的附加信息（HTML） MPEG for the past, present and future of TV 2012/05/08

13 MPEG-H part 2 High Efficiency Video Coding MPEG-H 第 2 部分 高效视频编码
Primary goal: ≥ 50% better compression than AVC 最初目标：压缩效率比 AVC 提高 ≥ 50 % For large displays(e.g. 4kx2k) 用于大屏幕 (例如 4kx2k) For mobile (e.g. WVGA) 用于移动服务 (例如，WVGA) Developed jointly with ITU-T by Joint Collaborative Team (JCT) on Video Coding 由 MPEG 与 ITU-T 联合成立的视频协作组制定 Technically in the same stream of past MPEG Video Coding standards (AVC and prior standards) 技术上使用与 MPEG 以前的视频编码标准 (AVC 及以前标准) 相同的传送流 Currently at Committee Draft level 目前处于委员会草案的阶段 MPEG for the past, present and future of TV 2012/05/08

14 HEVC vs AVC Subjective Performance Measurements HEVC 和 AVC 主观性能测试的对比
Preliminary subjective tests carried out for HEVC Committee Draft 对 HEVC 委员会草案已进行初步的 主观测试 Reasonably small and non-overlapping confidence intervals 合理较小的和不重叠的信任度间隔 Average rate savings at same (interpolated) MOS points 在相同的 (内插的) MOS (评分平均) 点，得出可节省的平均比特率 HEVC with 67% lower rate in class B (Full HD) 在 B 类 (全高清) 中 HEVC 的比特率要低 67 % HEVC with 49% lower rate in class C (WVGA) 在 C 类 (WVGA) 中 HEVC 的比特率要低 49 % HEVC with 58% lower rate overall HEVC 整体比特率要低 58 % MPEG for the past, present and future of TV 2012/05/08

15 A performance sample 一个性能样本
MPEG for the past, present and future of TV 2012/05/08

16 For those technology aware… 涉及的有关技术…
Block-based/Variable block sizes 基于块的/可变块尺寸 Block motion compensation 块的运动补偿 Fractional-pel motion vectors 分像素的运动矢量 Spatial intra prediction 空间域的帧内预测 Spatial transform of residual difference 残差值的空间域变换 Integer-based transform designs 基于整数的各种变换设计 Arithmetic or VLC-based entropy coding 基于算术的或变字长编码的熵编码 In-loop filtering to form final decoded picture 环内的滤波处理以形成最终的解码图像 MPEG for the past, present and future of TV 2012/05/08

17 Where we are (May 2012) 我们身处何处 (2012 年 5 月)
Activity: level of 1,000 documents per meeting crossed 活动：每次会议审议约 1,000 个文件 Very diverse participation from industry/academia 工业界和学术界的极广泛参加 Significant technical advance over prior standards 与过去的各种标准相比，已有显著的技术进步 Challenge: computational/implementation complexity 挑战：计算/实现的复杂度 Deliverables: 可发布的： Spec 技术规范 Reference software 参考软件 Conformance 符合性 Currently only one profile 目前只有一个档次 MPEG for the past, present and future of TV 2012/05/08

18 HEVC Scalability Extensions/1 HEVC 可伸缩性扩展/1
Serve the needs of heterogeneous environment of future digital TV distribution 服务于未来数字电视分发的异构环境之各种需求 Multiple devices: SHDTVs, set-top boxes, tablets, smart phones, PCs etc. 多类设备：超高清电视机，机顶盒，平板电脑，智能手机，个人电脑等 Wide range of processing powers, display sizes and power consumption needs 较宽范围的处理能力、显示器尺寸和功耗需求 Multiple networks: Cable, Satellite, Terrestrial, CDN, Cable Modem, xDSL, WiFi, 4G 多类网络：有线、卫星、地面、有线数字网络、有线调制解调器，xDSL，WiFi，4G Wide range of channel bandwidths and QoS 较宽范围的各种信道带宽和服务质量 Multiple protocols (多类协议): MPEG-2 TS, DASH, HLS, RTP, UDP Multiple services: Broadcasting, On demand, Streaming, Over The Top 多类服务：广播，点播，媒体流、三网融合 MPEG for the past, present and future of TV 2012/05/08

19 HEVC Scalability Extensions/2 HEVC 可伸缩性的扩展/2
Options for backward compatible migration paths 用于向后兼容的迁移途径之各种可选项 From 720p60 to 1080p60 从 720p60 到 1080p60 From1080p60 to 4kx2kp60 从 1080p60 到 4kx2kp60 From AVC to HEVC 从 AVC 到 HEVC Time Line 时间表 May 2012 Preliminary Call for Proposals (public) 2012 年 5 月，初次征求提案（公开） July 2012 Final Call for Proposals (public) 2012 年 7 月，最终征求提案（公开） October 年 10 月 Evaluation of proposals & start of collaborative design phase 评估各种提案，并开始合作设计阶段 Development of the time line associated with standardisation phases (WD, CD/PDAM, FDIS/FDAM, DIS/AMD) 按照标准化程序，设定执行时间表 MPEG for the past, present and future of TV 2012/05/08

20 Service Transitions 服务的过渡
1950s: Color TV 年代：彩色电视 Analog, backward compatible 模拟的，向后兼容 1990s: Digital TV 年代：数字电视 New infrastructure required 需要新的基础设施 Transitions from SD to HD 从标清过渡到高清 2010s: 3D 年代：三维电视 Mixed results from services introduction is 各种服务的导入所形成的各种混合结果 Not a single format across all services 已不再是各种服务使用的单一格式 MPEG for the past, present and future of TV 2012/05/08

21 Current Status of 3D Video 三维视频的现状
Increasing investments in 3D production and services 对 3D 制作和服务的投资日益增长 Increasingly capable 3D displays in the market (many competing and emerging technologies) 市场上的 3D 显示器日益增长 (大量竞争的和融合的技术) Market is primarily stereo (mix of different formats being deployed right now) 市场上主要是双目立体的 (不同格式的混合，目前正在部署中) Focus of current MPEG work: development of a new 3D format and associated compression techniques that could facilitate generation of multiview output 当前 MPEG 工作的重点：设定一个新的 3D 格式及相应的压缩技术，以支持多视输出的生成 MPEG for the past, present and future of TV 2012/05/08

22 Existing 3DV Coding Formats 现有三维视频编码的各种格式
Full-resolution coding of stereo and MV video as extension of AVC 双视和多视的视频之全分辨率编码是 AVC 的扩展 High coding efficiency achieved via inter-view prediction techniques 通过视间预测技术获得更高的编码效率 2D compatibility supported能够兼容二维 (2D) 电视 Adopted as format for 3D Blu-ray Disc 已采纳为 3D 蓝光盘的格式 Being considered for second phase of broadcast standards 正在考虑用于各广播标准的第 2 阶段 Left 左 Right 右 Pack pixels from left and right views into a single frame (loss of resolution) 把来自左视和右视的各像素，拼接进单个图像帧（分辨率下降） Leverage existing infrastructure and equipment, only require additional signaling to de-interleave frame 权衡现有的基础设施，并只需对图像帧增加 “去交织” 信令 Embraced by broadcasters for first phase of 3D broadcast services 在 3D 电视广播的第一阶段受到广播业者欢迎 左视 右视 视间的高效预测用于高压缩性能 MPEG for the past, present and future of TV 2012/05/08

23 Targets of Future 3DV Format 未来三维视频格式的各种目标
各种双目立体显示器 立体视基线可变 调节深度感知 左 右 数据格式 数据格式 受约束的比特率（基于分发） 受限的 摄像机输入 自动立体的 N 视显示器 宽视角 大量的各种输出视图 MPEG for the past, present and future of TV 2012/05/08

24 3DV Reference Framework 三维视频参考框架
Limited # Video Inputs (e.g., 2 or 3 views) 受限数量 # 的视频输入 (例如 2 或 3 个视角) 大于 # 的 输出视　 解码器和视图合成 Depth Estimation Video/Depth Encoder Decoder and View Synthesis Larger # Output Views 深度估计 视频/深度编码器 + Binary Representation & Reconstruction Process 二进制表达和重建过程 MPEG for the past, present and future of TV 2012/05/08

25 Overview of Call For Proposals 提案征集书的概述
Test Material & Conditions 测试素材及条件 8 test sequences (1920x1080 & 1024x768) 8 个测试序列 4 target bit rates per sequence 每个序列有 4 个目标比特率 2-view and 3-view test scenarios 2-视角和 3-视角的测试场景 AVC and HEVC compatible test categories 与 AVC 和 HEVC 兼容的各种测试类别 23 responses (12 AVC + 11 HEVC) 23 个响应 [提案] Evaluation in Nov 年 11 月的评估 Objective quality (PSNR of synthesized views) 客观质量（各种合成视的 PSNR） Subjective assessment (stereo and auto-stereo) 主观评分（双目立体和自动立体） MPEG for the past, present and future of TV 2012/05/08

26 3DV Testing Scenarios 三维视频的测试场景
2-view Configuration 2-视配置 左 右 输出至 立体显示器 深度估计 三维视频编码器 多视演奏 虚拟视 3-view Configuration 3-视配置 中 输出至 自动立体 N-视显示器 MPEG for the past, present and future of TV 2012/05/08

27 Tool Categories 工具的分类 Texture coding 纹理编码 Depth coding 深度编码
Independent of depth 不依赖于深度 E.g., inter-view prediction of color view, inter-view prediction of motion parameters and residual data 例如，彩色视的视间预测，运动参数和残差数据之间的视间预测 Using depth data 利用深度数据 E.g., view synthesis prediction, motion prediction 例如，视图合成的预测，运动预测 Depth coding 深度编码 Independent of texture 不依赖于纹理 E.g., depth modeling modes, weighted prediction, reduced resolution coding 例如，深度建模的各种模式，加权预测，降低分辨率编码 Using texture data 利用纹理数据 E.g., motion parameter inheritance, intra prediction 例如，运动参数的继承，帧内预测 MPEG for the past, present and future of TV 2012/05/08

28 3DV Current Status 三维视频的现状
Extensive subjective evaluation of 20+ proposals to the 3DV CfP 对 3DV 征集提案的 20 多个提案之广泛主观评估 Considered both AVC and HEVC compatible 考虑同 AVC 和 HEVC 的兼容性 Many new coding tools proposed for MV texture and depth coding 已提出多视纹理和深度的多种新编码工具 Substantial rate savings compared to capabilities of existing standards 与现存标准的各种可能性相比，可显著节省比特率 AVC and HEVC extensions standardisation under way AVC 和 HEVC 的扩展之标准化正在进行 Add support for depth 增加对深度的支持 New AVC-based coding tools 新的基于 AVC 的编码工具 MV extensions of HEVC HEVC 对多视的扩展 Hybrid architectures 混合结构 R1 建议的最佳性能 R3 的特例 MPEG for the past, present and future of TV 2012/05/08

29 Hybrid Architectures 各种混合结构
From a pure compression efficiency point of view, it is always best to use the most advanced codec 从纯压缩效率的观点来看，采用最先进的编码器总是最佳选择 However, when introducing new services, providers must also consider capabilities of existing receivers and transition plan 然而，在引进各种新服务时，服务提供者还必须考虑现存接收机和过渡计划的各种可能性 Use Case: 示例 Many terrestrial broadcast systems based on MPEG-2 很多地面广播系统基于 MPEG-2 US cable systems based on mix of MPEG-2 and AVC 美国有线系统基于 MPEG-2 和 AVC 的混合 May not be easy to simply switch codecs in near term 在近期简单切换编码器并不容易 MPEG for the past, present and future of TV 2012/05/08

30 Multiview Extensions of HEVC HEVC 的多视扩展
HEVC Stereo/MV extensions being considered 已考虑 HEVC 双目立体/多视的各种扩展 Extensions expected to be completed approximately 12 months after the base specification, i.e., Jan 2014 这些扩展预期在基本规范确定后约 12 个月完成，即 2014 年 1 月 Reportedly simple extensions of HEVC can achieve 30-40% bit rate reduction compared to HEVC simulcast 已有报告：对 HEVC 的简单扩展与 HEVC 同播相比，可使比特率下降 % Further gains expected if block-level changes to codec are considered 如果对编码器考虑图像块级的各种变更，预期可获得更多的增益 MPEG for the past, present and future of TV 2012/05/08

31 MPEG-H part 3: 3D Audio MPEG-H 第 3 部分：三维音频
Well, there is no Systems and Video without Audio… 好，没有不带音频的系统和视频… MPEG for the past, present and future of TV 2012/05/08

32 3D Audio requirements/1 对三维音频的需求/1
High quality: quality of decoded sound perceptually transparent 高质量：解码声的质量在感知上是透明的 Localization and Envelopment: Accurate sound localization and very high sense of sound envelopment within a targeted listening area (“sweet spot”) 定位和组装：在预定的监听区 (“欣赏地点”) 准确的声学定位和极高体验的声学组装 Flexible Loudspeaker Placement: the transmitted audio program to be mapped to a rendering setup in which loudspeakers are in alternate locations 灵活的扬声器摆放：传输的音频节目将映射到一套演奏装置，其中的扬声器可处在不同位置 Interactivity: Interactive modification of the sound scene rendered from the coded representation 交互性：从编码表示中演奏的声音场景，可进行交互式调节 MPEG for the past, present and future of TV 2012/05/08

33 3D Audio requirements/2 对三维音频的需求/2
Rendering on setups with fewer loudspeakers (including headphones): ability to derive a signal from the transmitted program material for reproduction with fewer loudspeakers 对较少扬声器 (包括耳机) 的配置也可演奏：扬声器较少时，仍然能够从传输的节目素材中导出一个信号来满足重现的需求 Audio/visual alignment & consistency: ability to adapt the rendered acoustic scene to be consistent with the visual 音频/视频的对准和一致性：能够调节演奏的声学场景，以便与视觉场景保持一致 Efficiency for decoding on different setups: ability to be rendered on all reproduction loudspeaker setups or headphone 在不同装置上进行解码的有效性：能够在所有重现的扬声器装置或耳机上进行演奏 MPEG for the past, present and future of TV 2012/05/08

34 3D Audio requirements/3 对三维音频的需求/3
Appropriate computational complexity and system latency for the target application (Broadcasting, Spatial two-(n-)way communication / telepresence ) 适当的计算复杂度和系统时延：以满足目标应用（如广播、空间的 2-(n-) 路通信 / 遥现） Transcoding for low bandwidth devices: A lower bandwidth signal can be extracted from the original program material 对窄带宽的设备之转码：可从源节目素材中提取窄带宽信号 Backward compatibility: (e.g. to 5.1 channel programs and decoders or transmission of HRTF encoded signals) 向后兼容性：例如，兼容 5.1 声道节目和解码器，或 HRTF 编码的信号 MPEG for the past, present and future of TV 2012/05/08

35 Envisioned Architecture 设想的结构
22.2 的多个扬声器 耳机上的空间感 家庭影院 22.2 声道音频节目 机框内置的通话器 3D Audio Decoder 音频对象 耳机上有空间感 三维音频 编码器 三维音频 解码器 平板电视 500 kb/s 比特流 音频情景 64 kb/s 比特流 智能手机，电视 Inputs 输入 Audio Channels 音频信道 “normal” content “常规的” 内容 Audio Objects 音频对象 “helicopter overflight” “直升机的飞过” Audio Scene 音频情景 Ambisonics 环境声效果 耳机上的空间感 转码器 Outputs 输出 Loudspeakers 扬声器 Headphones 耳机 Spatialized sound 有空间感的声音 In-frame loudspeakers 机框内置的扬声器 “Sound Bar” “声吧” Channel 信道 500 kb/s primary channel 500 kb/s 主信道 64 kb/s cellular channel 64 kb/s 蜂窝网信道 MPEG for the past, present and future of TV 2012/05/08

36 Audio, part of an Audio-visual Experience 音频，音视频体验的一部分
What is new in video? 视频中有哪些是新的？ Larger, high-resolution displays 更大的高分辨率显示器 Greater sense of envelopment 组装的更好感知 Possibly closer viewing distance 观看距离可能更靠近 More efficient compression 更高效的压缩 Wireless transmission to portable devices 无线传输至各种便携式设备 Immersive and enveloping audio experience 具有浸润性的和组装的音频体验 MPEG for the past, present and future of TV 2012/05/08

37 Use Case 1 Home Theatre 示例 1 家庭影院
Many loudspeakers 很多扬声器 10.1 [10 只扬声器加 1 只超低音扬声器] 22.2 “3D” Experience “三维” 体验 Height loudspeakers for greater envelopment 多个 “音柱” 用于更大的组装 Sense that audio objects are near or distant 音频对象为近的或远的情况时之感知 When near, they are consistent with video image 如果是近的，它们应该和视频图像保持一致性 MPEG for the past, present and future of TV 2012/05/08

38 22.2 multichannel sound system (NHK) 22.2 多声道声音系统 (日本广播协会)
顶层 9 个声道 中层 10 个声道 底层 3 个声道 低频效果 2 个声道 MPEG for the past, present and future of TV 2012/05/08

39 Home Theater – Issues 家庭影院—有关问题
Maintain compatibility with legacy systems: 5.1, stereo 维持同已有系统的兼容性：5.1, 立体声 Will content providers really step up to 22.2? 内容提供者真的会升级到 22.2？ Will consumers adopt 22.2?: 2 front high 消费者会接受 22.2？：2 个前置的 “音柱” How to compress 22.2 for transmission? 如何压缩 22.2 以便传输？ MPEG AAC 64 kb/s/channel: -> 1.5 Mb/s MPEG AAC 64 kb/s/声道：增至 1.5 Mb/s How to render for legacy setups? 对传统装置如何演奏? Relatively slow-growth market 增长相对较慢的市场 MPEG for the past, present and future of TV 2012/05/08

40 Use Case 2 Personal TV 示例 2 个人电视机
Small but high-resolution display 尺寸较小的、但高分辨率的显示器 “super-tablet” “超级平板” Local wireless communications 本地的无线通信 To cable or fiber home hub 连接到有线或光纤的家庭集线器 Possible audio presentation 可能的音频呈现方式 Headphones 耳机 Loudspeakers around perimeter of display 显示器周围的多个扬声器 Issue: To what extent can the user get an enveloping experience from only “front” loudspeakers? 问题：用户仅仅从 “前置的” 多个扬声器，究竟可获得多大程度的组装体验? MPEG for the past, present and future of TV 2012/05/08

41 Use Case 3 Mobile TV 示例 3 移动电视
Hand-held display: Smartphone 手持显示器：智能手机 Headphone listening: 耳机收听 Stereo, perhaps with binauralisation 立体声；也许有双耳效应化 Fastest growing market: Quick rollout and adoption of standard 增长最快的市场：迅速推进和采纳标准 What is new? 什么是新的？ USAC for stereo; MPEG Surround for binauralisation USAC 用于立体声；MPEG 环绕声用于双耳效应化 What is the “Wow” factor? “叫好” 因素是什么？ To spur adoption of new technology 鞭策采纳新技术 MPEG for the past, present and future of TV 2012/05/08

42 Spatialized on headphones
User Experience 用户体验 Spatialized on headphones 耳机上的空间感 Home Theatre 家庭影院 Tablet TV 平板电视 MPEG for the past, present and future of TV 2012/05/08

43 Flexible Rendering 灵活的演奏
Content providers create 22.2 program 内容提供者创建 22.2 节目 Consumed on stereo, 5.1, 10.1, 22.2 layouts 在立体声, 5.1, 10.1, 22.2 等配置上消费 Consumed on “wrong” layouts 在 “错误的” 配置上消费 Mis-positioned surrounds 错误放置环绕声 Missing surrounds 丢失环绕声 Non-standard layouts 非标准的配置 2 front high, 5.1 mid 2 个前置的 “音柱”，而 5.1 在中间 MPEG for the past, present and future of TV 2012/05/08

44 3D Audio Test Platform 三维音频测试平台
NHK “Loudspeaker Array Frame” (LAF) 日本广播协会的 “扬声器阵列机架” (LAF) Suggestions for 建议用于 Alternative platform for assessing “Home Theatre” use case 评估 “家庭影院” 示例的另一种平台 Model for assessing “Personal TV” use case 评估 “个人电视” 示例的模型 MPEG for the past, present and future of TV 2012/05/02

45 Summary 小 结 Provide compelling immersive audio experience for audio/visual programs 为各种音频/视频节目提供强烈浸润性的音频体验 Create content once, present on many different loudspeaker layouts or on headphones 音频内容仅进行一次制作，就可以在多种不同的扬声器配置上或耳机上呈现 Provide high compression and high-quality audio presentation 提供高压缩和高质量的音频呈现 Three goals entai significant constraints making this a potentially tough problem We need creative solutions! MPEG for the past, present and future of TV 2012/05/08

46 MPEG-V: Humans have more than two senses MPEG-V：人类的感知超过两种
用户 媒体 + 感知 控制 媒体 演奏设备 媒体 处理机器 听 觉 视 觉 嗅 觉 冷热感知 机械感知 信源 MPEG for the past, present and future of TV 2012/05/08

47 Augmented Reality Application Format (ARAF) 增强现实的应用格式 (ARAF)
远地传感器和作用器 本地传感器和作用器 Remote Real World Environment Local Real World Environment Remote Sensors & Actuators Local Sensors & Actuators 远地现实世界环境 本地现实世界环境 ARAF file or stream MARBle User 用户 ARAF 文件或媒体流 Media Servers Service Servers 媒体服务器 服务的服务器 MPEG for the past, present and future of TV 2012/05/08

48 Augmentation Region in ARAF ARAF 中的增强区域
AR service provider A AR 服务 提供者 A User A 用户 A Broadcaster 广播业者 User B 用户 B Augmentation Region 增强区域 AR 服务 提供者 B AR service provider B MPEG for the past, present and future of TV 2012/05/02

49 The past, the present and the future, again MPEG 的过去、当前和未来；再次
25 years ago MPEG selected the digital media way bringing innovation and interoperability …and thrived 25 年前，MPEG 选择了带来创新和互操作性的数字媒体之路 …而且已茁壮成长 This year the broadcasting industry has started a move in future broadcast services with interoperability at its core …and it is bound to thrive 今年广播工业界已开始转入未来广播服务，并以互操作性为其核心 …必将继续茁壮成长 MPEG looks forward to continuing a cooperation with the broadcasting industry providing the necessary standard technologies MPEG 将继续同广播工业界的合作，提供所需的标准技术 MPEG for the past, present and future of TV 2012/05/08

50 MPEG for the past, present and future of TV 2012/05/08