Sony's proprietary 3DCG generation technology

Transform real spaces from still images into 3DCG, high speed, high quality

Utilizing Sony’s proprietary 3DCG generation technology*, high-quality 3DCG assets can be efficiently created from multiple still images. A custom-developed plugin also enables direct visualization of these assets within Unreal Engine.

*Using algorithm developed for XYN Spatial capture solution (prototype)^*1

Workflow: Background Asset Production for Virtual Production

Capturing raw images

Shoot about 100 still images with a mirrorless camera at the location you want to use as background 3DCG asset in the studio *. You can shoot efficiently in a short time by using Sony's unique mobile application that supports shooting.

*In case shooting backgrounds to be used in the virtual production studio at “KIYOSUMI-SHIRAKAWA BASE”




Generating Background

Background assets can be generated from captured images in just a few hours and reviewed on an LED display within one to two days. These high-resolution CG models, covering large-scale environments, are rendered in 4K or 8K+ resolution for LED wall display. All assets can be reviewed and managed within Unreal Engine.




Delivering to the virtual production studio

Background assets are delivered to virtual production studios using a custom-developed plugin for Unreal Engine.
Sony PCL provides operational services for use at Sony PCL's KIYOSUMI-SHIRAKAWA BASE and other virtual production studios*.

*The recommended system environment must be used.

*1：XYN Spatial capture solution is currently under development. Please wait for future updates on when the service will be available.