Cockpit Display Personalization Using Camera and Speech Inputs
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The increasing homogeneity of content displayed on vehicle cockpit displays leads to reduced personalization and visual fatigue for users, affecting their driving experience.
Innovation Solution
A control method and apparatus that utilizes sensor data from cameras and microphones to generate personalized images for display, incorporating features like speech recognition and style transfer to create dynamic and user-specific content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If homogeneous content is displayed on cockpit displays, then device complexity is reduced, but user personalization and visual perception deteriorate
Solution Approach 1:
The display system dynamically adapts content based on detected user characteristics. The system transitions from static homogeneous display to dynamic personalized display by detecting user presence, identifying user characteristics through sensors, and automatically adjusting display content accordingly. This resolves the contradiction by making the system adaptable without requiring complex manual configuration.
Solution Approach 2:
The system automatically performs user identification and content personalization without requiring user intervention. Sensors detect user presence and characteristics, the system automatically selects appropriate content, and adjusts display parameters. This self-service approach provides personalization while keeping the system relatively simple, as users don't need to manually configure preferences.
2Use of energy by moving object
If single homogeneous images are displayed continuously, then energy consumption is reduced, but user visual fatigue increases
Solution Approach 1:
The system periodically changes display content based on detected user characteristics and usage patterns. Instead of displaying the same image continuously, the system refreshes and varies content periodically while adapting to user preferences. This periodic variation reduces visual fatigue while maintaining reasonable energy consumption by being selective about when and how content changes.
Solution Approach 2:
The system changes display parameters such as brightness, contrast, color temperature, and content selection based on detected user characteristics (e.g., time of day, user preference, environmental conditions). These parameter adjustments reduce visual fatigue without requiring complete system redesign or excessive energy consumption, as changes are optimized based on user needs.
3Adaptability or versatility
If multiple sensors and processing units are added for personalized content generation, then content personalization is improved, but device complexity increases
Solution Approach 1:
The system uses multi-functional components that serve both traditional display functions and personalized content generation. Existing sensors in the cockpit are repurposed for user detection, and the processing system handles both standard display control and advanced personalization tasks. This universal approach provides personalization capabilities without proportionally increasing system complexity.
Solution Approach 2:
The system introduces an intermediary processing layer that mediates between simple sensor inputs and complex display outputs. This intermediary layer handles user characteristic analysis, content selection, and parameter adjustment, allowing the system to achieve high personalization with relatively simple sensor components and display hardware. The intermediary processing distributes complexity across software algorithms rather than requiring complex hardware.
Data Source
AI summary
Embodiments of this application provide a control method and apparatus, and a transportation means. The method may be applied to the field of intelligent cockpits. The method includes: obtaining sensor data when an input from a user in a cockpit for indicating to generate an image is detected, where the sensor data includes a first image acquired by a camera of the transportation means or a speech signal acquired by a microphone of the transportation means; and controlling, based on the sensor data, a display area in the transportation means to display a second image. Embodiments of this application may be applied to an intelligent vehicle or an electric vehicle, to help improve a degree of personalization of content displayed in the cockpit, so as to help improve use experience of the user.