Synchronized Dynamic Vision Sensor LED AI Tracking System and Method

DVS systems with IMUs and machine learning algorithms address the limitations of infrared cameras and accelerometers in VR and AR by providing precise and efficient game controller tracking with reduced data processing and hardware costs.

JP7833566B2Active Publication Date: 2026-03-19SONY INTERACTIVE ENTERTAINMENT LLC
View PDF 5 Cites 0 Cited by

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2023-04-12
Publication Date
2026-03-19

AI Technical Summary

Technical Problem

Existing VR and AR implementations face challenges in accurately and efficiently tracking game controllers due to the limitations of frame rate and setup requirements of infrared cameras and accelerometers, which are unsuitable for modern head-mounted displays and require expensive hardware for processing large amounts of data.

Method used

The use of Dynamic Vision Sensors (DVS) with high update rates to detect changes in light intensity, combined with inertial measurement units (IMUs) and machine learning algorithms, to track game controllers with reduced data output and improved motion detection.

Benefits of technology

DVS systems provide precise and efficient tracking of game controllers with reduced data processing requirements, enabling smooth motion feedback and reduced hardware costs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007833566000001
    Figure 0007833566000001
  • Figure 0007833566000002
    Figure 0007833566000002
  • Figure 0007833566000003
    Figure 0007833566000003
Patent Text Reader

Abstract

The tracking system and method include a processor and a controller operably coupled to the processor. Two or more light sources are mounted in a configuration known with respect to each other and with respect to the controller body, and the two or more light sources are configured to blink in a predetermined time sequence. The dynamic vision sensor is configured to output signals corresponding to two or more events at two or more corresponding photosensitive elements in the array in response to changes in the light output from the two or more light sources, as well as signals corresponding to the time of the two or more events and the position of the events at the photosensitive elements in the array. The processor determines the position and orientation of the controller from the time and position of the two or more events and the known information.
Need to check novelty before this filing date? Find Prior Art

Citation Information

Patent Citations

  • Device and method for displaying composite sense of reality, recording medium and computer program

    JP2003256876A

  • Simulation system, program and controller

    JP2018126340A

  • Position detection device, position detection system, and position detection method

    US20160328089A1

  • Tracking of position and orientation of objects in virtual reality systems

    US20180314346A1

  • Systems and methods for detecting objects within the boundary of a defined space while in artificial reality

    US20210319220A1