Sony's proprietary 3DCG generation technology

*This video is available in Japanese only. If you would like to watch it in other languages, please use the automatic translation feature of the video player.

Transform real spaces from still images into 3DCG, high speed, high quality

Utilizing Sony’s proprietary 3DCG generation technology*, high-quality 3DCG assets can be efficiently created from multiple still images. A custom-developed plugin also enables direct visualization of these assets within Unreal Engine.

*Using algorithm developed for XYN Spatial capture solution (prototype)^*1

Workflow: Background Asset Production for Virtual Production

Capturing raw images

Shoot about 100 still images with a mirrorless camera at the location you want to use as background 3DCG asset in the studio *. You can shoot efficiently in a short time by using Sony's unique mobile application that supports shooting.

*In case shooting backgrounds to be used in the virtual production studio at “KIYOSUMI-SHIRAKAWA BASE”




Generating Background

Background assets can be generated from captured images in just a few hours and reviewed on an LED display within one to two days. These high-resolution CG models, covering large-scale environments, are rendered in 4K or 8K+ resolution for LED wall display. All assets can be reviewed and managed within Unreal Engine.




Delivering to the virtual production studio

Background assets are delivered to virtual production studios using a custom-developed plugin for Unreal Engine.
Sony PCL provides operational services for use at Sony PCL's KIYOSUMI-SHIRAKAWA BASE and other virtual production studios*.

*The recommended system environment must be used.

*1：XYN Spatial capture solution is currently under development. Please wait for future updates on when the service will be available.