Augmented Reality Vehicle Control via Image Pattern Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Passengers in the back seat of a vehicle find it difficult to operate in-vehicle devices like air conditioners, audio systems, or navigation systems, as the control buttons are typically located in the center fascia, and reaching them can be hazardous due to sudden vehicle movements.
Innovation Solution
A system and method using augmented reality on a mobile device to remotely control in-vehicle devices, where the mobile device captures images of the vehicle's object units, compares stored pattern information with the captured images, and transmits control commands to the vehicle's control unit, allowing users to interact with in-vehicle devices through a touch interface.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If operation buttons are positioned at the center fascia, then the driver can easily control in-vehicle devices, but passengers in the back seat cannot reach the buttons and may be endangered by sudden vehicle movements
Solution Approach 1:
The patent introduces a mobile device as an intermediary between the passenger and the in-vehicle device. The mobile device captures images of the center fascia, identifies operation buttons through pattern recognition, and transmits control commands wirelessly to the vehicle's control unit, eliminating the need for physical contact with the center fascia
Solution Approach 2:
The patent replaces the mechanical interaction (physical contact with buttons) with an optical and wireless communication system. The camera captures images, the control unit processes them through pattern recognition, and wireless communication transmits commands, substituting the mechanical button-pressing action with an automated image-based control system
2Device complexity
If operation buttons are positioned at the center fascia, then the control system remains simple, but passengers must lean forward which creates safety hazards
Solution Approach 1:
The system uses the mobile device's existing camera and processing capabilities to perform the identification and control functions. The vehicle's control unit automatically recognizes the captured image patterns and executes the appropriate control commands without requiring additional complex hardware or manual intervention
Solution Approach 2:
The mobile device serves as an intermediary that bridges the gap between the passenger and the vehicle's control system, using image capture and wireless communication to transmit control commands without requiring the passenger to physically reach the center fascia
Data Source
AI summary
Provided are a system and method of controlling an in-vehicle device using augmented reality. A system for controlling an in-vehicle device using augmented reality includes a mobile device configured to identify a vehicle object unit as an image and receive a vehicle control command through implementation of the augmented reality of the image, and a driving control unit configured to transmit a vehicle type information to the mobile device and, upon receiving a command signal from the mobile device, to control the in-vehicle device that corresponds to the command signal. Accordingly, by remotely controlling an in-vehicle device by using augmented reality of a mobile device, user convenience may be improved.