Gaussian Splat and Mesh Ray Tracing with dynamic lighting, and shadows in Unity HDRP
Unity HDRP package for Gaussian Splat and mesh ray tracing with dynamic lighting, shadows, transmission and semantic cutaways
I've released an experimental open-source Unity HDRP package that renders 3D Gaussian splats and conventional triangle meshes together using hardware ray tracing.
This demo shows a Gaussian splat model interacting with dynamic lighting, shadows and transparent meshes. The aim is to make captured objects participate in a scene alongside conventional geometry.
Features include:
- Combined Gaussian and mesh rendering with ray-traced shadows.
- Directional, point and spot lights, plus mesh transmission.
- Gaussian PLY import and a basic example scene with synthetic splats.
- Optional semantic labels for isolating parts, fading selected classes and creating interactive cutaways. Labels can be imported or baked from aligned scene geometry.
It works with compatible Gaussian models of objects or environments. It renders existing splats; it doesn't train models or automatically segment them.
Current target: Unity 6000.3 / HDRP 17.3, Windows DX12 and a ray-tracing-capable GPU.
GitHub: Unity Gaussian Ray Tracing
Built on UnityGaussianSplatting, the multi-layer anatomy renderer, and NVIDIA Gaussian ray-tracing adaptations.
Demo model: "3D gaussian model of a bouquet of flowers" by Jean-Eudes Marvie, distributed through NVIDIA. NVIDIA's dataset page lists it under CC BY-SA 4.0. The model was imported into Unity and rendered with custom lighting, shadows and mesh interactions for this demonstration.
10 points · 2 comments
Mentions
Gaussian Splat and Mesh Ray Tracing with dynamic lighting, and shadows in Unity HDRP Unity HDRP package for Gaussian Splat and mesh ray tracing with dynamic lighting, shadows, transmission and semantic cutaways I've released an experimental open-source Unity HDRP package that renders 3D Gaussian splats and conventional triangle meshes together using hardware ray tracing. This demo shows a Gaussian splat model interacting with dynamic lighting, shadows and transparent meshes. The aim is to make captured objects participate in a scene alongside conventional geometry. Features include: - Combined Gaussian and mesh rendering with ray-traced shadows. - Directional, point and spot lights, plus mesh transmission. - Gaussian PLY import and a basic example scene with synthetic splats. - Optional semantic labels for isolating parts, fading selected classes and creating interactive cutaways. Labels can be imported or baked from aligned scene geometry. It works with compatible Gaussian models of objects or environments. It renders existing splats; it doesn't train models or automatically segment them. Current target: Unity 6000.3 / HDRP 17.3, Windows DX12 and a ray-tracing-capable GPU. GitHub: Unity Gaussian Ray Tracing Built on UnityGaussianSplatting, the multi-layer anatomy renderer, and NVIDIA Gaussian ray-tracing adaptations. Demo model: "3D gaussian model of a bouquet of flowers" by Jean-Eudes Marvie, distributed through NVIDIA. NVIDIA's dataset page lists it under CC BY-SA 4.0. The model was imported into Unity and rendered with custom lighting, shadows and mesh interactions for this demonstration.