In-Cabin Pointing Control for Vehicle Output Devices

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing vehicle interaction methods are cumbersome and inefficient, particularly for rear occupants, due to limited and complicated operation devices, and existing IoV applications do not effectively facilitate interaction with individual output devices in dynamic scenarios like vehicles.

Innovation Solution

A method using ultra-wideband positioning and attitude sensing to determine the position and orientation of a user terminal device within a vehicle, enabling intuitive interaction with specific output devices through simple operations such as tapping, gestures, or movement, allowing data communication between the device and the vehicle to facilitate seamless interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple output devices are provided for each occupant, then entertainment and comfort are improved, but device complexity and operation difficulty increase

Engineering Contradiction:
Improveoccupant interaction capabilityVSAvoidoperation device complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent introduces a user terminal device (smartphone, tablet, or wearable device) as an intermediary between the occupant and the vehicle's output devices. The terminal device runs an application that communicates with the vehicle's head unit, enabling the occupant to control multiple output devices through a single, familiar interface rather than directly interacting with each device. This mediator approach resolves the contradiction by maintaining high adaptability while reducing operational complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The application on the user terminal device provides universal control capabilities for multiple types of output devices (displays, speakers, ambient lighting) through a single interface. Rather than requiring separate control mechanisms for each output device, the application offers multi-functional control that adapts to different device types and occupant positions, thereby improving versatility without increasing device complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Device complexity

If operation devices are concentrated and limited in number, then device simplicity is maintained, but interaction effectiveness for rear occupants deteriorates

Engineering Contradiction:
Improveoperation device quantityVSAvoidrear occupant interaction ease
Core Design Contradiction:
Device complexityVSEase of operation

Solution Approach 1:

The patent leverages the three-dimensional spatial environment within the vehicle by using the user terminal device's position and orientation data to determine which output device the occupant intends to control. Instead of requiring multiple physical control devices distributed throughout the vehicle, the system adds a spatial dimension to the interaction model, allowing rear occupants to easily select and control output devices based on their terminal device's pointing direction, thereby improving ease of operation without increasing device quantity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Adaptability or versatility

If IoV applications provide bidirectional control between smartphone and vehicle, then connectivity is improved, but operation complexity increases

Engineering Contradiction:
Improvebidirectional control capabilityVSAvoidapplication operation simplicity
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The application implements self-service functionality by automatically determining the occupant's intended output device based on the terminal device's position and orientation, and by automatically establishing communication with the vehicle's head unit. Rather than requiring the user to manually configure connections or navigate complex settings, the system performs these tasks autonomously, thereby maintaining bidirectional control capability while improving operational simplicity.

Inventive Principle:
Principle #25Self-service

4Adaptability or versatility

If control interfaces are comprehensive and functional, then device control capability is improved, but user interaction smoothness deteriorates

Engineering Contradiction:
Improveoutput device control capabilityVSAvoidinteraction smoothness
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system performs preliminary actions by pre-establishing communication channels between the user terminal device and the vehicle's head unit, and by pre-determining the mapping between terminal device orientation and target output devices. This preparation work is done automatically before the user needs to interact with specific output devices, allowing for smooth, intuitive control without requiring users to navigate complex interfaces or perform setup procedures, thereby maintaining comprehensive control capability while improving interaction smoothness.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP4304161B1Method for interacting between user terminal device and vehicle, vehicle and interactive system
Publication Date: 2025.09.10 BAYERISCHE MOTOREN WERKE AG
  • EP4304161B1 patent drawingFigure 1~2
  • EP4304161B1 patent drawingFigure 3~4
  • EP4304161B1 patent drawingFigure 5~7

AI summary

The present invention relates to a method for interacting between a user terminal device and a vehicle, wherein said vehicle is provided with a plurality of output devices, said method comprising: acquiring a position and attitude of the user terminal device in an interior space of the vehicle; determining an output device pointed by the user terminal device based on the acquired position and the attitude; performing data communication between the user terminal device and the vehicle to enable interaction between the user terminal device and the pointed output device in response to an operation of the user terminal device. The present invention also relates to a computer readable medium, a user terminal device, a vehicle and an interaction system. The present invention provides a more intuitive, smooth, convenient and comfortable interaction for the vehicle occupants, enabling them to utilize the output devices of the vehicle conveniently and efficiently.