Emerging Technologies for 3D Video: Creation, Coding, Transmission and Rendering

With the expectation of greatly enhanced user experience, 3D video is widely perceived as the next major advancement in video technology. In order to fulfil the expectation of enhanced user experience, 3D video calls for new technologies addressing efficient content creation, representation/coding, transmission and display. Emerging Technologies for 3D Video will deal with all aspects involved in 3D video systems and services, including content acquisition and creation, data representation and coding, transmission, view synthesis, rendering, display technologies, human perception of depth and quality assessment. Key features: Offers an overview of key existing technologies for 3D video Provides a discussion of advanced research topics and future technologies Reviews relevant standardization efforts Addresses applications and implementation issues Includes contributions from leading researchers The book is a comprehensive guide to 3D video systems and services suitable for all those involved in this field, including engineers, practitioners, researchers as well as professors, graduate and undergraduate students, and managers making technological decisions about 3D video.

Preface xvii List of Contributors xxi Acknowledgements xxv PART I CONTENT CREATION 1 Consumer Depth Cameras and Applications 3 Seungkyu Lee 2 SFTI: Space–from–Time Imaging 17 Ahmed Kirmani, Andrea ColaSco, and Vivek K. Goyal 3 2D–to–3D Video Conversion: Overview and Perspectives 37 Carlos Vazquez, Liang Zhang, Filippo Speranza, Nils Plath, and Sebastian Knorr 4 Spatial Plasticity: Dual–Camera Configurations and Variable Interaxial 62 Ray Zone PART II REPRESENTATION, CODING AND TRANSMISSION 5 Disparity Estimation Techniques 81 Mounir Kaaniche, Raffaele Gaetano, Marco Cagnazzo, and Beatrice Pesquet–Popescu 6 3D Video Representation and Formats 102 Marco Cagnazzo, Beatrice Pesquet–Popescu, and Frederic Dufaux 7 Depth Video Coding Technologies 121 Elie Gabriel Mora, Giuseppe Valenzise, Jo€el Jung, B—eatrice Pesquet–Popescu, Marco Cagnazzo, and Frederic Dufaux 8 Depth–Based 3D Video Formats and Coding Technology 139 Anthony Vetro and Karsten M€uller 9 Coding for Interactive Navigation in High–Dimensional Media Data 162 Ngai–Man Cheung and Gene Cheung 10 Adaptive Streaming of Multiview Video Over P2P Networks 187 C. G€oktug G€urler and A. Murat Tekalp PART III RENDERING AND SYNTHESIS 11 Image Domain Warping for Stereoscopic 3D Applications 207 Oliver Wang, Manuel Lang, Nikolce Stefanoski, Alexander Sorkine–Hornung, Olga Sorkine–Hornung, Aljoscha Smolic, and Markus Gross 12 Image–Based Rendering and the Sampling of the Plenoptic Function 231 Christopher Gilliam, Mike Brookes, and Pier Luigi Dragotti 13 A Framework for Image–Based Stereoscopic View Synthesis from Asynchronous Multiview Data 249 Felix Klose, Christian Lipski, and Marcus Magnor PART IV DISPLAY TECHNOLOGIES 14 Signal Processing for 3D Displays 275 Janusz Konrad 15 3D Display Technologies 295 Thierry Borel and Didier Doyen 16 Integral Imaging 313 Jun Arai 17 3D Light–Field Display Technologies 336 Peter Tamas Kovacs and Tibor Balogh PART V HUMAN VISUAL SYSTEM AND QUALITY ASSESSMENT 18 3D Media and the Human Visual System 349 Simon J. Watt and Kevin J. MacKenzie 19 3D Video Quality Assessment 377 Philippe Hanhart, Francesca De Simone, Martin Rerabek, and Touradj Ebrahimi PART VI APPLICATIONS AND IMPLEMENTATION 20 Interactive Omnidirectional Indoor Tour 395 Jean–Charles Bazin, Olivier Saurer, Friedrich Fraundorfer, and Marc Pollefeys 21 View Selection 416 Fahad Daniyal and Andrea Cavallaro 22 3D Video on Mobile Devices 432 Arnaud Bourge and Alain Bellon 23 Graphics Composition for Multiview Displays 450 Jean Le Feuvre and Yves Mathieu 24 Real–Time Disparity Estimation Engine for High–Definition 3DTV Applications 468 Yu–Cheng Tseng and Tian–Sheuan Chang References 483 Index 487

Frédéric Dufaux , Télécom Paris Tech, CNRS, France Béatrice Pesquet–Popescu , Télécom Paris Tech, France Marco Cagnazzo , Télécom Paris Tech, France