Sony OCELLUS: A Marker-Free Camera Tracking System for Virtual Production

Sony is set to revolutionize virtual production and augmented reality with the launch of OCELLUS (ASR-CT1), its first camera tracking system. Designed for broadcast and cinema applications, OCELLUS offers marker-free camera tracking using multiple sensors, making it easier to integrate AR and virtual production workflows. The system is compatible with both broadcast and cinema cameras, regardless of brand.

Advanced Tracking for Virtual Production
Ideal for In-Camera VFX and augmented reality applications, OCELLUS continuously transmits camera position and orientation data while filming. The system consists of a sensor unit, a processing box, and three lens encoders. It works seamlessly with Sony’s Cinema Line cameras, system cameras, and even third-party models.

Utilizing five image sensors and Sony’s Visual SLAM (Simultaneous Localization and Mapping) technology, OCELLUS generates a reference map, ensuring stable marker-free tracking in both indoor and outdoor environments.

Seamless Metadata Integration
For Sony cameras, the system retrieves real-time metadata on focus, iris, and zoom settings via SDI output, transmitting it over an Ethernet cable for external device integration. If a lens lacks built-in metadata capabilities, optional lens encoders can be attached to capture this data. The metadata is then leveraged for virtual production and AR, while also supporting tracking data, camera and lens metadata, timecode, and file names for post-production workflows.

A Complete Virtual Production Solution
Sony continues to expand its suite of virtual production tools, complementing OCELLUS with the Crystal LED VERONA display and software-based solutions like the Virtual Production Toolset.

Key Features of OCELLUS:

1. Compact and Lightweight Sensor Unit
● Equipped with five image sensors, four of which operate simultaneously for enhanced tracking and occlusion resistance.
● IR LEDs support tracking in low-light environments.
● Visible Light Cut Unit ensures stable tracking in changing lighting conditions.
● Dimensions: 86 mm × 60 mm × 43 mm (3.39″ × 2.36″ × 1.69″), weight: 250g.
● Easy installation with NATO rail mounting parts.
● Single USB Type-C connection to the processing box for power and data transfer.

2. Processing Box Features
● Real-time tracking data and camera/lens metadata transmission to CG rendering software (e.g., Unreal Engine) via Ethernet in free format.
● Genlock, Timecode, and SDI input/output terminals for seamless synchronization.
● Supports recording tracking data and metadata as FBX files on SDXC memory cards (UHS-II/UHS-I), synchronized with video files.
● OLED display for quick monitoring of tracking data, IP address, and lens metadata.

3. Lens Encoder Capabilities
Accurately detects lens focus, zoom, and iris position.
● Transmits data to the processing box via a LEMO 7-pin cable.
● Enables metadata capture for lenses and cameras without SDI output embedding.
● Comes with five types of gears for various lenses.

Availability
Sony will showcase OCELLUS (ASR-CT1) at the NAB Show 2025 in Las Vegas, starting April 6, 2025. The system is expected to be available in Singapore in Q4 2025.