Spatial capture solution
Streamlines production workflow by creating high-quality 3DCG assets from real-world spaces and objects
What is a "Spatial capture solution?"
The solution creates high-quality 3DCG assets from real objects and spaces. It streamlines 3DCG production workflows for props in movies and games, as well as background assets for metaverse and virtual production.
The solution is currently offering features for virtual production (In-Camera VFX, greenbacks, etc.). It realizes efficient use of production-quality 3DCG assets.
Beta Version Overview
We are now accepting inquiries about using the beta version of XYN Spatial Capture Solution for virtual production (In-Camera VFX, Greenback, etc.).
The beta version includes XYN Spatial Scan Navi Beta, a smartphone application that supports spatial content capture, XYN Spatial Scan Beta, a web application that generates 3DCG assets from captured data, and XYN Spatial Renderer Plugin " for high-quality playback.
Image quality features of XYN Spatial Scan Beta
1. high resolution, low noise, high dynamic range 3DCG that can be used for LED walls in virtual production studios
(2) Generates 3DCG of reflective objects, transparent objects, complex shapes, and thin objects, which have been difficult to achieve in the past.
3. high quality playback, including HDR compatibility by providing Sony's proprietary renderer (to be supported soon)
photographing
Real-time visualization of shooting status reduces shooting errors.
Automatic setting and shooting functions that can be used even by those unfamiliar with shooting spatial content
XYN Spatial Scan Navi Beta
generation
Sony's proprietary algorithms enable studio-grade high-quality CG production.
Simple and easy-to-use interface that can be completed in a few simple steps
XYN Spatial Scan Beta
conjugation
Sony's original high-definition rendering
Media server support (coming soon)
XYN Spatial Renderer Plugin
*1 Please contact us for the models that have been tested for XYN Spatial Scan Navi Beta.
Workflow and Applications
We support the production workflow of 3DCG assets, from the shooting of spatial content to the generation and utilization of high-quality 3DCG assets.
Capture
XYN Spatial Scan Navi
Smartphone application to assist in capturing spatial content with a mirrorless SLR camera
Create
XYN Spatial Scan
Cloud application that turns real space into high-quality 3DCG assets
Utilize
XYN Spatial Renderer Plugin
Renderer plugin for stable display with high image quality
What is XYN Spatial Scan Navi Beta?
A smartphone application*1 that visualizes the shooting status of a mirrorless camera*1 in real time and enables efficient and high-quality 3D scanning*2,
It is a smartphone application*1 that visualizes the shooting status of a mirrorless camera*1 in real time and enables efficient and high-quality 3D scanning*1.
XYN Spatial Scan Beta Features
Photorealistic Generation Quality with Sony's Unique Algorithm
Innovative algorithms for generating studio-quality spatial content reproduce reflections and transparent materials in high-definition and photorealistic quality. The generation method can be customized according to the application, enabling high-quality content production that takes full advantage of the mirrorless camera's performance.
High-Quality 3DCG Assets Easily Generated by Cloud Generation
Using cloud generation, anyone can easily generate multiple high-quality 3DCG assets simultaneously*1 with just a few clicks in a simple web UI. Generated data can be previewed instantly on the web.
Speedy 3DCG asset generation and linkage with various production tools
The meta-information linkage between the mirrorless camera α and mobile applications that support photography enables speedy and high-quality generated 3DCG assets to be used for high-quality rendering on a wide range of devices, including LEDs, spatial reproduction displays, HMDs, PCs, and smartphones*2, The data format is easily handled by the DCC tools you normally use, maximizing flexibility and efficiency in production.
ソニー独自アルゴリズムによるフォトリアルな生成品質
スタジオ品質の空間コンテンツを生成する革新的なアルゴリズムにより、反射や透明な物質も高精細かつフォトリアルに再現。用途に応じた生成方法のカスタマイズが可能で、ミラーレスカメラの性能を最大限に活かした高品質なコンテンツ制作を実現します。
クラウド生成で高品質3DCGアセットを手軽に
普段使いのPCでOK!クラウド生成を活用し、シンプルなWeb UIで数クリックするだけで、誰でも簡単に高品質な3DCGアセットを複数同時に生成*1できます。生成したデータはWeb上で即座にプレビュー可能。
スピーディーな3DCGアセット生成と様々な制作ツールとの連携
ミラーレスカメラαと撮影を支援するモバイルアプリケーションのメタ情報連携により、スピーディーかつ高品質に生成された3DCGアセットを用いたLED、空間再現ディスプレイ、HMD、PC、スマホなど、幅広いデバイスでの高品質なレンダリングにも対応します*2。さらに、普段使いのDCCツールで簡単に扱えるデータ形式を採用し、制作の柔軟性と効率を最大化します。
*1 Generation may not be possible during cloud congestion.
*2 As of 11/20, only rendering to LED is supported.
Point 1
AR Navigation Makes High-Quality Photography Easy
Even beginners can easily take high-quality photos for 3DCG asset generation with the AR navigation display tailored to the subject. Automatic exposure settings and auto-shutter functions assist in taking pictures without mistakes or blurring, allowing photographers of any skill level to take pictures of consistent quality.
AR Navigation Makes High-Quality Photography Easy
Even beginners can easily take high-quality photos for 3DCG asset generation with the AR navigation display tailored to the subject. Automatic exposure settings and auto-shutter functions assist in taking pictures without mistakes or blurring, allowing photographers of any skill level to take pictures of consistent quality.
Full range of functions demanded by professionals in the field
From project management, which tends to be cumbersome, to a preview function that allows users to check captured photos and their positions in real time, the software covers all the functions necessary for the 3D scanning process. A wide variety of functions that respond to the needs of the field will help streamline the production process.
Smartphone Linkage Enables Speedy Processing
Smartphone meta information linkage simplifies the conventional data capture process and supports speedy and high-quality 3DCG asset creation*2. Photos taken can be uploaded to the XYN Spatial Scan Beta cloud directly from the application, and generation can begin immediately.
*2 Communication fees will be incurred if mobile data communication is used for uploading.
Point 3
Smartphone Linkage Enables Speedy Processing
Smartphone meta information linkage simplifies the conventional data capture process and supports speedy and high-quality 3DCG asset creation*2. Photos taken can be uploaded to the XYN Spatial Scan Beta cloud directly from the application, and generation can begin immediately.
*2 Communication fees will be incurred if mobile data communication is used for uploading.
*1 Windows only; please check the recommended PC specs.
*2 To connect 12 sensors in Professional Mode with XYN Motion Studio and mocopi PC application, two sets each of 'mocopi' and Sensor Data Receiver (QM-PR1) and 1 band (QM-PB1) are required. sets each of 'mocopi' and Sensor Data Receiver (QM-PR1) and 1 band (QM-PB1) are required.
*3 Requires the mocopi PC application or XYN Motion Studio .
*4 Requires Sensor Data Receiver for mocopi (QM-PR1)
Applications Supporting Spatial Capture Solutions
3D scan shooting with high accuracy and stability.
AR navigation display and automatic exposure setting functions support efficient shooting of background assets for virtual production.
Professional on-site needs in one package
From project management to real-time preview, all the functions necessary for 3D scanning are included. Realize more efficient production.
Smooth work time with application linkage
Upload photos directly from "XYN Spatial Scan Navi Beta" to "XYN Spatial Scan Beta" to the cloud*2 to start generating high-quality 3DCG assets immediately after shooting.
*2 Communication fees will be incurred if mobile data communication is used for uploading.
Generates studio-quality background assets
Sony's proprietary algorithms reproduce the transparency and reflections of glass and metal in a photo-realistic manner. High-quality background assets can be generated by taking advantage of the performance of mirrorless cameras*1.
Generation is performed in the cloud
Multiple high-quality 3DCG assets can be generated*3 in the cloud from a web application. No high-performance PC is required.
*3 Generation may take time or may not be possible due to cloud congestion.
Meta Information Linkage Streamlines Production
High-quality 3DCG assets can be generated quickly by linking meta information from "α™" mirrorless camera and "XYN Spatial Scan Navi Beta".
Features of XYN Spatial Scan Navi
A smartphone application that assists in shooting spatial content with mirrorless cameras
Assists in Shooting Spatial Content
By connecting to a mirrorless AlphaTM camera and a smartphone, it visualizes the required shooting position and angle using AR, guiding users to the optimal shooting position.
Features of XYN Spatial Scan
A cloud application that converts real-world spaces and objects into high-quality 3DCG assets
Generates high-quality 3DCG assets
Sony’s proprietary algorithms generate production-quality photorealistic 3DCG assets optimized for virtual production.
Features of XYN Spatial Renderer Plugin
A renderer plugin for high-quality, stable image display
Production-quality real-time rendering
A Sony-developed rendering plugin that enables production-quality playback of 3DCG assets generated with “XYN Spatial Scan.”
DetailsUse Cases
Film Production
Virtual Production
Bringing real-world into the studio
Creating real-world high-quality 3DCG assets to streamline workflows for virtual production and video production
Learn more
Sony PCL|「Anemoi」
Virtual Production Studio"KIYOSUMI-SHIRAKAWA BASE"
Sony PCL's Use of Background Assets in Music Video Production
Virtual Production Studio"KIYOSUMI-SHIRAKAWA BASE"
Partners
Motion capture system for easy, 3D, full body tracking anywhere
Dedicated receiver for direct connection between mocopi and PC
Sensor band exclusively for mocopi
Frequently Asked Questions
About XYN Spatial Capture Solution (Beta)
About XYN Spatial Scan Navi Beta
Plans and Rates
Basic
mocopi PC
Powered by XYN
Capture Function
- Motion Capture with mocopi
- Save motion data and save video
- Live stream of motion to Unity, Unreal Engine, Maya, Motion Builder
- Live stream of motion to other supported services
- mocopi Professional Mode
- Camera blending
- Saving in BVH and FBX formats
Pro
XYN Motion Studio
Capture Function
- All mocopi PC features
Editing Functions
- Timeline editing (trimming, merging)
- Automatic generation of intermediate motion (Tween)
Data Management Functions
- Motion upload to cloud
- Automatic motion tagging
- Use of Sony's motion library (tags and natural language search)
Premium
XYN Motion Studio
Motion capture system for easy, 3D, full body tracking anywhere
Dedicated receiver for direct connection between mocopi and PC
Sensor band exclusively for mocopi
Frequently Asked Questions
About XYN Spatial Capture Solution (Beta)
About XYN Spatial Scan Navi Beta
Point 1
Generate photo-realistic 3DCG assets
Upload images taken with a mirrorless camera to a cloud service (under development), andanyone can easily generate high-quality 3DCG assets.
Sony's Unique Algorithm
Sony's 3DCG generation technology reproduces real objects and spaces photo-realistically in the XR space, faithfully representing reflections and fine details.
Point 2
Smartphone application to support photography
Visualization of Shooting Status
Visualize the shooting status of Sony mirrorless cameras in real time to support efficient and high-quality shooting.
Point 3
Seamless workflow construction
Tool Linkage
XYN hardware and other various XR devices and 3DCG editing tools are linked to achieve workflow efficiency in a wide range of industries.
Streamlining workflows in a wide range of industries
We offer implementations suitable for a variety of workflows, including video production, virtual production shooting, game development, digital twin, metaverse, and digital archiving.
Product News
Plans and Rates
Basic
mocopi PC
Powered by XYN
Capture Function
- Motion Capture with mocopi
- Save motion data and save video
- Live stream of motion to Unity, Unreal Engine, Maya, Motion Builder
- Live stream of motion to other supported services
- mocopi Professional Mode
- Camera blending
- Saving in BVH and FBX formats
Pro
XYN Motion Studio
Capture Function
- All mocopi PC features
Editing Functions
- Timeline editing (trimming, merging)
- Automatic generation of intermediate motion (Tween)
Data Management Functions
- Motion upload to cloud
- Automatic motion tagging
- Use of Sony's motion library (tags and natural language search)