Virtual Reality Racing with Smart Green Screen Integration

Project Overview

In this UE4 project, my goal is to revolutionize the VR racing experience by seamlessly merging the real world with a virtual game environment. A key innovation lies in the use of a single front camera to capture the player’s surroundings, particularly the interior of a simulated car. By strategically implementing green screens on the virtual car’s windows, I wanted to create an immersive space where the player can see both their physical body and the virtual car simultaneously.

Key Features:

Immersive VR Environment: Designing a realistic virtual racing game environment, complete with dynamic elements like changing weather conditions and varying time of day.

Virtual Car Integration: Crafting a virtual representation of a racing car that mirrors the physical dimensions, providing an authentic in-game vehicle for the player.

Real-world Car Interior Simulation: Simulating the interior of a car within the VR environment to enhance the sense of being inside a vehicle, complete with a dashboard and steering wheel.

Single Front Camera Setup: Using a single front camera to capture the real-world environment, with a focus on the interior of the simulated car where the player is seated.

Green Screen Implementation: Strategically placing green screens on the windows of the virtual car to act as portals, allowing the player to see the real-time feed from the front camera.

Smart Green Screen Removal: Developing advanced algorithms for dynamic green screen removal, ensuring a seamless blend of the virtual and real-world elements in real-time.

User Interaction: Enabling user interaction within the VR environment, allowing players to control the virtual car using VR controllers or other input devices.

Real-time Processing: Implementing real-time image processing techniques to minimize latency and provide a smooth user experience.

Future Enhancements:

• Neural Network-Powered Green Screen Classification for Lag-Free Experiences
• Integration with additional sensors for more accurate body tracking.
• Expansion of game scenarios and environments for a diverse racing experience.
• Collaboration with VR hardware manufacturers to optimize compatibility.

This project marks a significant stride in redefining the boundaries of VR gaming, offering a unique and immersive racing experience that seamlessly integrates the physical and virtual worlds.