Environmental Volumetric Neural Shading of Clouds for Real-Time Rendering 59

We present a high-performance method for real-time relighting of high-fidelity volumetric clouds. Building on Relightable Neural Assets, we introduce key adaptations that enable neural shading of volumetric cloud phenomena within a rasterization-based pipeline. In particular, we incorporate a per-pixel thickness parameter to capture view-dependent opacity and replace the generalizing single light source with a sky illumination model, allowing the network to learn complex atmospheric scattering effects. To achieve real-time performance, we depart from density-field-based volumetric rendering and instead operate on mesh representations combined with a triplane feature encoding. This enables a fully rasterization-driven solution that reproduces volumetric appearance without requiring ray marching or volume integration. We further describe a complete pipeline for converting volumetric cloud assets into a neural representation trained from path-traced supervision. We evaluate our method through an ablation study analyzing both image quality and runtime performance. Our adaptations improve reconstruction quality from 18.13 dB to 22.32 dB while achieving rendering times as low as 3.7 ms per frame. These results demonstrate that our approach enables high-quality, relightable cloud rendering suitable for real-time and performance-critical applications.