Volumetric Video: Canon’s 3D Experiences & Digitalization
Summary of Canon’s Volumetric Video Technology Progress
This text details Canon’s journey in developing volumetric video technology, moving from 2D images to immersive 3D experiences. Here’s a breakdown of the key points:
Initial Inspiration & Goal: The project began with a desire to allow viewers to experience footage from any viewpoint, going beyond conventional broadcast limitations.
Early Stages & Challenges: A dedicated team was formed,initially focusing on soccer and using a “shoot-and-process-later” approach due to real-time processing limitations. The 2019 Rugby World Cup was a key testing ground, but footage delivery was too slow (1 hour post-match) for broadcast use.
The “3-Second” target: The core goal became generating volumetric video within 3 seconds – the timeframe needed for live broadcast integration. This required improvements in algorithms, hardware, and software.The technical capability existed, but workflow and scene selection slowed down delivery.
Edge Processing & unique Hardware: Canon’s breakthrough lies in processing data at the edge – near the cameras – using specialized hardware and AI. This reduces reliance on cloud processing and enables high-speed generation of 3D models and volumetric video.
Current System: The system now generates 3D models at the edge and then creates volumetric video from that data.
Successful Applications & Expansion:
Sports: Used in the NBA (2021-2022 & 2022-2023 seasons) and demonstrated success at the Rugby World Cup.
Arts & Culture: Applied to Noh theater to capture actors’ movements in 3D.
New Use Cases: During the pandemic, it facilitated remote karate instruction with patterns distributed to dojos worldwide.
Dedicated Studio: Canon established a dedicated volumetric video studio in kawasaki, Japan, equipped with 159 cameras in an 8m x 8m space.
* Future Vision: Canon aims for “one source multi-use” – expanding applications beyond entertainment into areas like technology and tradition.
In essence, Canon has overcome significant technical hurdles to deliver broadcast-ready volumetric video, positioning themselves as leaders in this emerging technology. Their focus on edge processing and specialized hardware is a key differentiator.