Rotatable Display Camera Tracking User Position by Sound Azimuth

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional display apparatuses with integrated cameras have limited viewing angles, making it difficult to capture images of users who move outside the fixed camera range, leading to poor user experience in video chats and fitness applications where the camera cannot adjust its angle to follow the user's position.

Innovation Solution

A display apparatus with a rotatable camera and microphone array that adjusts its shooting angle based on sound source identification, using time difference analysis to determine the user's position and rotate the camera to ensure the user remains in the frame.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the camera is fixed in position, then the device structure is simple, but the camera cannot capture users who move outside the fixed viewing angle

Engineering Contradiction:
Improvecamera viewing angle adaptabilityVSAvoidcamera rotation mechanism complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The camera is transformed from a fixed static structure to a dynamic rotatable structure that can adjust its viewing angle based on user position. The rotation mechanism allows the camera to dynamically change its orientation to track users within a predetermined angle range, resolving the contradiction between fixed structure simplicity and viewing angle adaptability.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system uses audio signal feedback from the microphone array to determine user position and azimuth, then feeds this information back to control the camera rotation. This closed-loop feedback mechanism enables the camera to automatically adjust its viewing angle to track the user, achieving adaptability without requiring complex manual control systems.

Inventive Principle:
Principle #23Feedback

2Reliability

If the camera rotates to follow the user, then the user capture capability is improved, but the device complexity increases due to rotation mechanism

Engineering Contradiction:
Improveuser capture reliabilityVSAvoidcamera and microphone system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent combines the camera rotation function with the existing microphone array into an integrated audio-visual tracking system. The microphone array and camera work together synergistically, where the audio signals guide the camera rotation, reducing the need for separate complex tracking mechanisms and improving overall system reliability through multi-sensor fusion.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The controller serves as an intermediary that processes audio signals from the microphone array, determines user azimuth, and generates rotation instructions for the camera. This intermediary control layer simplifies the system architecture by centralizing the decision-making logic, rather than requiring direct complex connections between sensors and actuators.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If multiple sensors are integrated for accurate user positioning, then the positioning precision is improved, but the device complexity increases

Engineering Contradiction:
Improveuser position detection precisionVSAvoidsensor array and processing system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The microphone array is designed to serve multiple functions: it not only captures audio signals for voice communication but also enables user position detection and azimuth determination. This multi-functionality allows the same sensor array to support both audio processing and spatial tracking, reducing the need for separate positioning sensors and thereby controlling system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent replaces complex mechanical positioning systems with an acoustic field-based positioning approach. By using the microphone array to detect sound source direction and calculate user azimuth through signal processing, the system achieves precise positioning without requiring mechanical encoders, optical sensors, or other complex positioning hardware.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution allows for continuous image capture of the user even when they move, enhancing the user experience in video calls and fitness applications by maintaining a stable and accurate view of the user's portrait within the camera's frame.

Implementation Method 1

determining a target azimuth corresponding to the user, wherein the target azimuth is calculated according to a time difference of the test audio signal by obtaining at least two test audio signals collected by at least two microphones among the microphone array

Methodology Applied
Scientific EffectTime difference of arrival (TDOA):

Data Source

PatentUS12028617B2Display apparatus and processing method for display apparatus with camera
Publication Date: 2024.07.02 HISENSE VISUAL TECH CO LTD
  • US12028617B2 patent drawing
  • US12028617B2 patent drawing
  • US12028617B2 patent drawing

AI summary

Disclosed are a display apparatus and a processing method for the display apparatus with a camera. The display apparatus includes a camera, a sound collector and controller. The controller is configured for: starting shooting at least one image through the camera; in response to the at least one image not including a portrait of a user, starting obtaining a first test audio signal input from the user through the sound collector; in response to the first test audio signal, determining a target azimuth corresponding to the user; generating a rotation instruction for the camera according to the target azimuth of the user; sending the rotation instruction to the camera to adjust a shooting direction of the camera to the target azimuth.