In-Vehicle Sign Language Recognition for Connected Service Access
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Hearing-impaired vehicle occupants face challenges in accessing vehicle connected services, as these services often rely on voice-activated commands and audio notifications, which they may not be able to hear or activate effectively.
Innovation Solution
A system and method that utilize in-vehicle sensors and cloud computing to recognize and convert sign language into text and audio messages, enabling communication between hearing-impaired occupants and remote systems, while also optimizing data transmission based on available bandwidth and quality of service metrics.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If comprehensive scene data including audio and video is transmitted to remote system, then communication quality is improved, but network bandwidth consumption increases
Solution Approach 1:
The patent extracts and transmits only the essential data elements required for sign language recognition and service operation. Instead of transmitting complete audio-video streams, the system processes video data locally to extract key gesture information and transmits only the necessary command parameters and minimal contextual data to the remote system, thereby reducing bandwidth consumption while maintaining communication effectiveness
Solution Approach 2:
The patent segments the data transmission into priority levels, transmitting critical service-related information (such as emergency alerts and essential commands) with higher priority and compressing or deferring less critical data. This segmented approach ensures reliable delivery of important communications while optimizing network bandwidth utilization
Data Source
AI summary
A method for enabling vehicle connected services for a hearing-impaired vehicle occupant includes receiving sensor data from a plurality of sensors of a vehicle. The sensor data includes scene data indicative of a scene inside the vehicle and outside the vehicle. The method further includes determining that the hearing-impaired vehicle occupant is articulating sign language using the sensor data. Also, the method includes determining a vehicle-occupant message corresponding to the sign language articulated by the hearing-impaired vehicle occupant to generate vehicle occupant-message data in response to determining that the hearing-impaired vehicle occupant is articulating sign language. The method further includes transmitting the vehicle occupant-message data and the scene data to a remote system in response to generating the vehicle occupant-message data. Further, the method includes receiving a vehicle connected service from the remote system.