3D Visual Communications

A complete reference for end–to–end 3D visual experience  3D Visual Communications provides a comprehensive coverage of major theories and technologies involved in a lifecycle of the 3D video content delivery. The book showcases the technologies used in an end–to–end 3D video communication system, including the fundamentals of 3D visual representation, the latest 3D video coding techniques, relevant communication infrastructure and networks and 3D quality of experience. Specifically, this book covers the following four important areas:  3D video coding and communications 3D graphics/gaming and mobile communications end–to–end 3D ecosystem (including 3D display, 3D player, networking facility and 3D quality issues) future communications and networks advances for emerging 3D experience  It is essential reading for engineers involved in the research, design and development of 3D visual coding and 3D visual transmission systems and technologies, as well as academic and industrial researchers.

Preface ix About the Authors xiii 1 Introduction 1 1.1 Why 3D Communications? 1 1.2 End–to–End 3D Visual Ecosystem 3 1.3 3D Visual Communications 10 1.4 Challenges and Opportunities 11 References 15 2 3D Graphics and Rendering 17 2.1 3DTV Content Processing Procedure 19 2.2 3D Scene Representation with Explicit Geometry – Geometry Based Representation 22 2.3 3D Scene Representation without Geometry – Image–Based Representation 43 2.4 3D Scene Representation with Implicit Geometry – Depth–Image–Based Representation 51 References 57 3 3D Display Systems 63 3.1 Depth Cues and Applications to 3D Display 63 3.2 Stereoscopic Display 65 3.3 Autostereoscopic Display 71 3.4 Multi–View System 78 3.5 Recent Advances in Hologram System Study 83 References 84 4 3D Content Creation 85 4.1 3D Scene Modeling and Creation 85 4.2 3D Content Capturing 87 4.3 2D–to–3D Video Conversion 101 4.4 3D Multi–View Generation 125 References 126 5 3D Video Coding and Standards 129 5.1 Fundamentals of Video Coding 129 5.2 Two–View Stereo Video Coding 142 5.3 Frame–Compatible Stereo Coding 144 5.4 Video Plus Depth Coding 148 5.5 Multiple View Coding 156 5.6 Multi–View Video Plus Depth (MVD) Video 160 5.7 Layered Depth Video (LDV) 163 5.8 MPEG–4 BIFS and AFX 165 5.9 Free–View Point Video 166 References 167 6 Communication Networks 171 6.1 IP Networks 171 6.2 Wireless Communications 174 6.3 Wireless Networking 193 6.4 4G Standards and Systems 193 References 203 7 Quality of Experience 205 7.1 3D Artifacts 205 7.2 QoE Measurement 220 7.3 QoE Oriented System Design 247 References 250 8 3D Video over Networks 259 8.1 Transmission–Induced Error 259 8.2 Error Resilience 267 8.3 Error Concealment 270 8.4 Unequal Error Protection 275 8.5 Multiple Description Coding 279 8.6 Cross–Layer Design 282 References 286 9 3D Applications 289 9.1 Glass–Less Two–View Systems 289 9.2 3D Capture and Display Systems 291 9.3 Two–View Gaming Systems 294 9.4 3D Mobile 298 9.5 Augmented Reality 302 References 309 10 Advanced 3D Video Streaming Applications 313 10.1 Rate Control in Adaptive Streaming 313 10.2 Multi–View Video View Switching 321 10.3 Peer–to–Peer 3D Video Streaming 325 10.4 3D Video Broadcasting 328 10.5 3D Video over 4G Networks 329 References 331 Index 335