Automotive Mixed-Reality Gaming System Using Sensor Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing entertainment systems in vehicles lack the capability to provide immersive mixed-reality gaming experiences that integrate vehicle data and environmental data from sensors, limiting the engagement and interactivity of passengers during travel.
Innovation Solution
An automotive mixed-reality gaming system that utilizes vehicle sensors to collect movement and position data, and detection sensors to gather environmental data, which is then processed to generate an interactive gameplay application with a mixed-reality environment and virtual avatar, transmitted to mobile devices for user input and control.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If existing entertainment systems are used in vehicles, then passengers can listen to audio and watch video, but the systems lack immersive mixed-reality gaming capabilities that integrate vehicle and environmental sensor data
Solution Approach 1:
The entertainment system is enhanced to perform multiple functions: traditional audio/video playback, mixed-reality gaming, and integration with vehicle sensors (accelerometers, gyroscopes) and environmental detection sensors (cameras, LIDAR). This multi-functionality allows the system to adapt from conventional entertainment to immersive gaming without requiring completely separate systems.
Solution Approach 2:
The patent combines existing vehicle sensor data (movement, position) with environmental sensor data (external environment detection) and integrates them into a unified mixed-reality gaming system. By merging these data streams with the entertainment system, the invention creates immersive gaming experiences without adding completely new hardware subsystems.
2Adaptability or versatility
If sensors are added to collect vehicle and environmental data for gaming, then immersive mixed-reality experiences are enabled, but the device complexity increases
Solution Approach 1:
Existing vehicle sensors (accelerometers, gyroscopes used for navigation and stability control) and environmental sensors (cameras, LIDAR used for driver assistance) are repurposed for gaming applications. This multi-functionality approach allows the system to use already-deployed sensors for dual purposes: vehicle operation/safety and immersive gaming, thereby avoiding the need to add dedicated gaming sensors.
Solution Approach 2:
The system leverages data already being collected by the vehicle's existing sensor suite for other primary functions (navigation, driver assistance, safety systems). By having these sensors serve multiple masters simultaneously, the system avoids the overhead of dedicated gaming sensors while still achieving the desired mixed-reality gaming capability.
3Productivity
If environmental data is converted to game-centric coordinate system and processed in real-time, then interactive gameplay is generated, but processing requirements and energy consumption increase
Solution Approach 1:
The system pre-converts environmental sensor data into game-centric coordinate systems and pre-processes this data into game-relevant formats before actual gameplay begins. By performing coordinate transformations and data processing in advance rather than in real-time during gameplay, the system reduces the computational burden and energy consumption during active gaming sessions.
Solution Approach 2:
The system processes only the portion of environmental data that is relevant to the specific gaming application being executed. Rather than processing all sensor data at full resolution and detail, the system selectively processes only the necessary data subsets required for the current game, thereby reducing overall processing requirements and energy consumption while maintaining game quality.
Data Source
AI summary
An automotive mixed-reality gaming system for a vehicle includes vehicle sensors that collect vehicle data associated with movements and a position of the vehicle along a roadway, detection sensors that collect environmental data associated with an external environment of the vehicle, and a processing unit including a processor and a memory. The processing unit receives data from the vehicle sensors and the detection sensors, converts the environmental data to a game-centric coordinate system stored in the memory, and generates an interactive gameplay application including a mixed-reality environment and a virtual avatar based on the game-centric coordinate system. Further, the processing unit transmits the application to mobile devices, receives user input from the mobile devices, and controls the activity of the avatar and settings of the gameplay based on the vehicle data and user input. The avatar traverses the mixed-reality environment at a rate proportional to the vehicle.