Our project integrates advanced fluid dynamics simulations with real-time hand tracking technology to revolutionize VR. The project utilizes the optimized CPU computational technique known as Smoothed Particle Hydrodynamics (SPH) to simulate fluid dynamics in conjunction with a hand tracking system in VR. Consequently, we first did research on the SPH technique and its application in fluid flow simulation. Additionally, we also investigated how the hand tracking system functions in a VR environment for object interaction.

We started with generating the particles with crucial physical properties. These particles were contained within a customized box container. We used Unity's visualization tools to monitor and debug the simulation.

After the particles we needed were generated, we implemented the SPH algorithm to simulate the physical movement of the particles.

For faster and better rendering, we did optimization for our simulated fluid system.

In this phase, we documented how we integrated the Meta XR All-in-One SDK v64 to create the VR development environment we used for integrating hand tracking within Unity.

To create realistic interactions between hands and fluid in our VR environment, we've incorporated sphere colliders into each joint of the fingers, wrists, and palms, totaling 118 colliders for both hands. These colliders ensure complete coverage and direct contact with the fluid. .

Our project was conducted on a high-performance laptop, ensuring smooth execution of the Unity-based application. We adjusted the interaction space to 0.7 x 0.4 x 0.25 to fit the scale of hand-fluid interactions. With SPH fluid parameters optimized for a smoothing radius of 0.01, density of 500, pressure of 0.2, and viscosity of 0.8, we maintained frame rates above 100 FPS with 50,000 particles. See video demo by clicking the button below.