Emerging Technologies for 3D Video Creation, Coding, Transmission and Rendering

With the expectation of greatly enhanced user experience, 3D video is widely perceived as the next major advancement in video technology. In order to fulfil the expectation of enhanced user experience, 3D video calls for new technologies addressing efficient content creation, representation/coding, transmission and display.

Emerging Technologies for 3D Video will deal with all aspects involved in 3D video systems and services, including content acquisition and creation, data representation and coding, transmission, view synthesis, rendering, display technologies, human perception of depth and quality assessment.

Key features:

• Offers an overview of key existing technologies for 3D video
• Provides a discussion of advanced research topics and future technologies
• Reviews relevant standardization efforts
• Addresses applications and implementation issues
• Includes contributions from leading researchers

The book is a comprehensive guide to 3D video systems and services suitable for all those involved in this field, including engineers, practitioners, researchers as well as professors, graduate and undergraduate students, and managers making technological decisions about 3D video.

Preface xvii

List of Contributors xxi

Acknowledgements xxv

PART I CONTENT CREATION

1 Consumer Depth Cameras and Applications 3
Seungkyu Lee

2 SFTI: Space-from-Time Imaging 17
Ahmed Kirmani, Andrea ColaSco, and Vivek K. Goyal

3 2D-to-3D Video Conversion: Overview and Perspectives 37
Carlos Vazquez, Liang Zhang, Filippo Speranza, Nils Plath, and Sebastian Knorr

4 Spatial Plasticity: Dual-Camera Configurations and Variable Interaxial 62
Ray Zone

PART II REPRESENTATION, CODING AND TRANSMISSION

5 Disparity Estimation Techniques 81
Mounir Kaaniche, Raffaele Gaetano, Marco Cagnazzo, and Beatrice Pesquet-Popescu

6 3D Video Representation and Formats 102
Marco Cagnazzo, Beatrice Pesquet-Popescu, and Frederic Dufaux

7 Depth Video Coding Technologies 121
Elie Gabriel Mora, Giuseppe Valenzise, Jo€el Jung, B_eatrice Pesquet-Popescu, Marco Cagnazzo, and Frederic Dufaux

8 Depth-Based 3D Video Formats and Coding Technology 139
Anthony Vetro and Karsten M€uller

9 Coding for Interactive Navigation in High-Dimensional Media Data 162
Ngai-Man Cheung and Gene Cheung

10 Adaptive Streaming of Multiview Video Over P2P Networks 187
C. G€oktug G€urler and A. Murat Tekalp

PART III RENDERING AND SYNTHESIS

11 Image Domain Warping for Stereoscopic 3D Applications 207
Oliver Wang, Manuel Lang, Nikolce Stefanoski, Alexander Sorkine-Hornung, Olga Sorkine-Hornung, Aljoscha Smolic, and Markus Gross

12 Image-Based Rendering and the Sampling of the Plenoptic Function 231
Christopher Gilliam, Mike Brookes, and Pier Luigi Dragotti

13 A Framework for Image-Based Stereoscopic View Synthesis from Asynchronous Multiview Data 249
Felix Klose, Christian Lipski, and Marcus Magnor

PART IV DISPLAY TECHNOLOGIES

14 Signal Processing for 3D Displays 275
Janusz Konrad

15 3D Display Technologies 295
Thierry Borel and Didier Doyen

16 Integral Imaging 313
Jun Arai

17 3D Light-Field Display Technologies 336
Peter Tamas Kovacs and Tibor Balogh

PART V HUMAN VISUAL SYSTEM AND QUALITY ASSESSMENT

18 3D Media and the Human Visual System 349
Simon J. Watt and Kevin J. MacKenzie

19 3D Video Quality Assessment 377
Philippe Hanhart, Francesca De Simone, Martin Rerabek, and Touradj Ebrahimi

PART VI APPLICATIONS AND IMPLEMENTATION

20 Interactive Omnidirectional Indoor Tour 395
Jean-Charles Bazin, Olivier Saurer, Friedrich Fraundorfer, and Marc Pollefeys

21 View Selection 416
Fahad Daniyal and Andrea Cavallaro

22 3D Video on Mobile Devices 432
Arnaud Bourge and Alain Bellon

23 Graphics Composition for Multiview Displays 450
Jean Le Feuvre and Yves Mathieu

24 Real-Time Disparity Estimation Engine for High-Definition 3DTV Applications 468
Yu-Cheng Tseng and Tian-Sheuan Chang

References 483

Index 487

Frédéric Dufaux, Télécom Paris Tech, CNRS, France

Béatrice Pesquet-Popescu, Télécom Paris Tech, France