LIFLET: Light Field Live with Thousands of Lenslets

Takeshi Naemura
The University of Tokyo

In this project, we have investigated and realized a system for real-time free-viewpoint image synthesis, which we call LIFLET. We focused on the combination of optical design of 3D photography and software algorithm of photo-realistic computer graphics. We started from an array of lenslets and clarified its characteristics in frequency domain. Then we proposed an algorithm for real-time pixel-by-pixel depth estimation method for higher quality of image synthesis, and employed a dual lens-array system for suppressing optical blurring effect. Finally, we can handle 3D scenes in motion for real-time free-viewpoint contents.

• Takeshi NAEMURA:
  ``Light Field Live with Thousands of Lenslets,''
  IEEE Workshop on Three-Dimensional Cinematography (3DCINE'06), Keynote Speech (Invited) (2006.6).
• Jonghyun Ha, Masaru Kojima, Keita Takahashi and Takeshi Naemura:
  ``All-in Focus Light Field Live with Thousands of Lenslets,''
  ACM SIGGRAPH2005, Posters, no. 68 (2005.8).
• Masaru Kojima, Takeshi Naemura:
  ``McLiflet: multiple cameras for light field live with thousands of lenslets,''
  Proceedings of SPIE Vol. 5664 Stereoscopic Displays and Virtual Reality Systems XII, pp. 495 -- 505 (2005.1).
  [abstract]
• Takeshi Naemura:
  ``3D Computer Graphics Based on Integral Photography,''
  The 11th International Display Workshops, 3D3-1 (Invited), pp. 1461 -- 1464 (2004.12).
• Tomoyuki Yamamoto, Masaru Kojima, and Takeshi Naemura:
  ``LIFLET: Light Field Live with Thousands of Lenslets,''
  ACM SIGGRAPH 2004 Emerging Technologies, etech_0130, Los Angeles (2004.8).
• Tomoyuki Yamamoto, Takeshi Naemura:
  ``Real-Time Capturing and Interactive Synthesis of 3D Scenes Using Integral Photography,''
  Proceedings of SPIE Vol. 5291 Stereoscopic Displays and Virtual Reality Systems XI, pp. 155 -- 166 (2004.1).
  [abstract]
• Satoshi Mitsuda, Tomoyuki Yamamoto, Keita Takahashi, Takeshi Naemura, Hiroshi Harashima:
  ``Interactive View Synthesis from Integral Photography Using Estimated Depth Information,''
  Proceedings of SPIE Vol. 5243 Three-Dimensional TV, Video, and Display II, pp. 116 -- 124 (2003.9).
  [abstract]
• Takeshi Naemura, Tatsuya Yoshida, Hiroshi Harashima:
  ``3-D computer graphics based on integral photography,''
  Opt. Express, 8, 4, pp. 255 - 262 (2001.2).

This project has been supported by Strategic Information and Communications R&D Promotion Programme (SCOPE).

E-mail: liflet (at) hc.ic.i.u-tokyo.ac.jp

© Copyright 2007 Harashima & Naemura Lab. / The University of Tokyo.