Vehicle Display Control via Occupant Direction-of-View

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current in-vehicle systems fail to provide an effective way for occupants to engage with shopping opportunities outside the vehicle, such as roadside shops or advertisements, due to limitations in user interaction and the need for manual device operation, leading to missed buying and selling opportunities.

Innovation Solution

A media display system that uses augmented and virtual reality techniques, equipped with image sensors to determine the occupant's direction of view and capture surrounding content, allowing for interactive display and real-time video feeds of objects-of-interest, enabling occupants to select and purchase products while driving.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If occupants use hand-held electronic devices to search for objects of interest, then they can gain understanding of products, but they face challenges in operating devices from within the vehicle and lose buying opportunities due to time constraints

Engineering Contradiction:
Improveproduct information accessVSAvoiddevice operation convenience
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The system automatically detects objects of interest using sensors and cameras, retrieves product information without user initiation, and presents it on the windshield display. This self-service approach eliminates the need for occupants to manually operate devices while searching for product information.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system performs preliminary actions by continuously monitoring the environment for objects of interest, pre-fetching product information before the occupant even requests it, and having it ready for immediate display on the windshield, thus eliminating time constraints.

Inventive Principle:
Principle #10Preliminary action

2Loss of information

If occupants physically visit stores to view objects, then they can examine products in detail, but they lose time and miss buying opportunities while moving

Engineering Contradiction:
Improveproduct viewing capabilityVSAvoidtime to visit physical locations
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The system creates virtual copies of physical store environments and product displays, presenting them on the windshield display. This allows occupants to view products in detail without physically visiting stores, saving time while maintaining product examination capability.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system transitions the shopping experience from the physical dimension (visiting stores) to the digital dimension (windshield display), allowing product viewing to occur in a different spatial and temporal context that eliminates travel time.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Loss of information

If the system displays all surrounding objects, then complete information is provided, but the display becomes overwhelming and difficult to navigate

Engineering Contradiction:
Improvecompleteness of product informationVSAvoiddisplay navigation complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The system applies local quality by providing detailed product information specifically at the location where the occupant's attention is focused (the detected object of interest), rather than uniformly displaying all information. This concentrates relevant information where needed, reducing overall display complexity.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system uses feedback from sensors detecting the occupant's gaze and attention to dynamically adjust what information is displayed. This feedback mechanism ensures that only relevant product information is shown, preventing information overload while maintaining completeness of necessary details.

Inventive Principle:
Principle #23Feedback

4Measurement precision

If the system uses multiple sensors and cameras to detect direction of view, then accurate object detection is achieved, but the system complexity increases

Engineering Contradiction:
Improvedirection of view detection accuracyVSAvoidsensor system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system merges multiple sensors and cameras into a unified object detection and direction-of-view tracking system. By combining these components into an integrated system, the patent achieves accurate measurement while managing complexity through unified processing and coordinated operation.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS11221741B2Display control of interactive content based on direction-of-view of occupant in vehicle
Publication Date: 2022.01.11 SONY GROUP CORP
  • US11221741B2 patent drawing
  • US11221741B2 patent drawing
  • US11221741B2 patent drawing

AI summary

A media display system for a vehicle that includes a first image sensor, a second image sensor, and an electronic device. The first image sensor is inside the vehicle and the second image sensor is outside the vehicle. The electronic apparatus determines a direction-of-view of an occupant of the vehicle based on user information of the occupant. The electronic apparatus further controls the second image sensor to capture a portion of view surrounding the vehicle in the determined direction-of-view of the occupant. The portion of view comprises an object-of-interest of the occupant. The electronic apparatus further control display of an interactive content on a display medium based on a user input on the object-of-interest, wherein the interactive content comprises items related to the object-of-interest. The electronic apparatus further controls navigation through the object-of-interest and remote selection of the items in the interactive content.