Aximmetry Technical Whitepaper Analysis: Core Technical Logic and System Integration Solutions for Real-Time Virtual Production and Live Streaming

With the explosive growth in demand for Virtual Production, XR Extended Reality, and ultra-high-definition live streaming, the selection of a real-time graphics engine has become critical to project success. Aximmetry, as a real-time compositing and control platform optimized for broadcast-grade applications, has become the core production system for many of the world's top virtual studios, LED wall XR stages, and virtual idol live streaming projects after deep integration with Unreal Engine. This article provides an in-depth analysis of Aximmetry's technical logic from four dimensions: system architecture, core algorithms, integration solutions, and engineering implementation.

I. System Architecture Design: Dual-Engine Hybrid Drive Model

Aximmetry DE adopts a uniqueheterogeneous dual-engine architecture(Heterogeneous Dual-Engine Architecture):

• Unreal Engine as the front-end rendering engine: Responsible for real-time computation of all high-fidelity 3D content, including Nanite virtual geometry, Lumen dynamic global illumination, Chaos physics system, and Niagara particle effects.
• Aximmetry Core as the back-end control and compositing engine: Handles broadcast-grade tasks such as video signal acquisition, hardware I/O, precision chroma keying, camera tracking synchronization, node-based business logic orchestration, and multi-protocol output.

Communication between the two engines is achieved through Zero-Copy Shared Texture mechanism and custom Render Plugin , with end-to-end latency stably controlled within 2 frames (approximately 33ms at 60fps). This design effectively addresses the shortcomings of traditional UE projects in video engineering stability, color management precision, and multi-camera coordination.

The system supports Multi-GPU 和 Multi-Machine Clustering, enabling distributed rendering over 25G/100G networks, with a single system capable of driving up to 8 8K cameras simultaneously.

II. Core Algorithm Module Analysis

Advanced Layered Chroma Keyer Aximmetry's keying algorithm adopts aMulti-plane sampling + intelligent edge reconstructionmodel:

• Supports up to 16-point independent sampling (Multi-Point Sampling), allowing separate keying models to be established for different brightness and saturation areas of the foreground.
• Integrates Sub-Pixel Edge Reconstruction algorithm, effectively preserving details such as hair strands, transparent fabrics, and motion blur at 4K and higher resolutions.
• The unique Physically Based Shadow Catcher module can independently extract shadow information generated by real lighting and transfer it to the UE scene in Linear Space, achieving precise light and shadow matching.

Low-Latency Tracking Pipeline Supports mainstream protocols such as FreeD, SPUD, TrackMen, Mo-Sys, stYpe, Vicon, and OptiTrack. Internally uses Kalman Filter + Predictive Extrapolation algorithm to smooth tracking data, with measured latency as low as 8ms (excluding tracking device latency).

In XR projects, Aximmetry uses Real-Time Frustum Warping technology to clip and warp the UE rendered image in real-time based on the camera's 6DoF data, ensuring that the content displayed on the LED wall matches the real lens field of view 100%, avoiding ghosting and perspective errors.

Node-Based Visual Programming Engine Aximmetry's node system adopts aDataflow-Drivendesign, where all nodes execute asynchronously on GPU/CPU and support Hot-Reloading. Key features include:

• Custom Compound node encapsulation
• Event-Driven logic
• Powerful external protocol bridging (OSC, DMX512, MIDI, TCP/UDP, MQTT, HTTP, WebSocket, SQL)

III. Typical Project System Integration Solutions

Solution 1: High-End XR LED Virtual Stage

• Hardware Layer: 8K SDI cameras × 4 + stYpe Redspy tracking + ROE Visual LED wall
• Software Layer: Aximmetry DE master control + 4 UE Render Nodes (cluster mode)
• Key Configuration: Enable ICVFX Pipeline + Color Management (ACES 2065-1) + Genlock + PTP v2.1 time synchronization
• Output: 12G-SDI Program + NDI HX3 Preview + SRT backup stream

Solution 2: Medium-Sized VTuber Live Streaming Studio

• Hardware Layer: Sony FR7 PTZ camera + HTC Vive Tracker 3.0 + RTX 4090 single machine
• Software Layer: Aximmetry Broadcast + Unreal Engine 5.4
• Core Technical Points: Face Capture (via Live Link Face) + Full Body Tracking + Real-time Cloth Simulation + 8 virtual scene switches
• Output: RTMP/RTMPS direct push to Douyin, Bilibili, YouTube

Solution 3: TV Station 4K Virtual News Studio

• Key use of Aximmetry's Data Binding function to pull external data such as weather, stock market, and pandemic information in real-time to drive dynamic elements in the virtual scene.
• Through Playlist 和 Cue System , one-button program sequencing control for the director is achieved.

IV. Engineering Implementation Recommendations and Performance Benchmarks

Performance Benchmark Reference (Single RTX 4090 Configuration):

• 4K60 Project: Average GPU Load 62%, System End-to-End Latency 47ms
• 8K30 XR Project (4-machine cluster): Single Machine GPU Load 78%, Screen Sync Error < 1.2 Frames

Implementation Recommendations:

1. Strictly establish a color management system, recommending the adoption of ACEScg workflow.
2. All tracking devices must undergo regular Lens Calibration 和 Tracking Volume Mapping。
3. Establish standardized project templates (Template Project), including pre-tuned Keyer Presets, Tracking Presets, and Output Presets, significantly reducing project startup time.
4. A stress test of at least 2 hours must be conducted before live streaming, focusing on monitoring temperature, memory leaks, and network jitter.

Conclusion

Aximmetry's value lies in its perfect combination of cinematic real-time rendering capabilities, broadcast-grade signal stability, and engineer-friendly visual programming, creating a truly scalable real-time virtual content creation platform for mass production.

In today's pursuit of ultimate image quality, zero latency, and system reliability, Aximmetry has transcended the definition of a “tool” and become an indispensable technical infrastructure in the field of virtual production and live streaming. Whether it's a million-dollar XR stage or an independent studio focused on virtual idols, suitable solutions for their technical paths can be found within it.

In the future, with the further integration of real-time ray tracing, neural rendering, and AI-driven content generation, Aximmetry will continue to lead the development direction of real-time virtual production technology.