A universal virtual reality controller

IN595625BActive Publication Date: 2026-07-16SENSE3D TECHNOLOGIES PVT LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
IN202511007157
Authority / Receiving Office
IN · IN
Patent Type
Patents
Current Assignee / Owner
Filing Date
2025-01-29
Publication Date
2026-07-16
Estimated Expiration
2045-01-29

AI Technical Summary

Technical Problem

Current VR controllers face challenges with accuracy in varying lighting conditions, drift issues over time, and environmental interference, while also being costly and complex due to reliance on external cameras and headsets.

Method used

A universal VR controller system utilizing dynamically adjustable heating pads and a thermal camera for thermal marker tracking, eliminating the need for external lighting and reducing hardware complexity, with a cost-effective design compatible with conventional displays.

Benefits of technology

Ensures accurate real-time 3D positional tracking independent of lighting, reduces drift, and simplifies setup, making it versatile and affordable for a wide range of applications including gaming and drone control.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

The invention discloses a universal VR controller system designed to provide precise 3D positional and orientational tracking, overcoming the limitations of traditional VR controllers. The system comprises a Hand Node (200) and a camera node (100). The HN (200), equipped with heating pads (203,204), joystick (201), buttons (205), and an inertial measurement unit (IMU), acts as the user interface, while the CN, featuring a thermal camera (103) and Bluetooth communication, detects the position of the HN (200) based on its thermal markers. The HN (200) dynamically adjusts the heating pads (203,204) temperatures relative to ambient conditions, enabling reliable detection irrespective of lighting conditions. Positional and input data from the HN (200) are transmitted via a gamepad protocol for seamless interaction with 3D applications. The system is compatible with various platforms, including laptops, mobiles, and LCD screens, and can interface with both software and hardware applications, such as drones and robotic systems. The invention eliminates the need for complex headsets, offering a cost-effective and versatile solution for immersive 3D interaction. This combination of simplicity, accuracy, and adaptability makes the invention a significant advancement in VR technology.
Need to check novelty before this filing date? Find Prior Art

Description

FIELD OF THE INVENTIONThe present invention relates to the field of electronics, specifically virtual reality (VR)systems. It pertains to a novel VR controller that enhances 3D positional accuracy throughthermal markers, enabling seamless interaction with 3D applications displayed onconventional screens like laptops, mobiles, or LCDs, without requiring complex headsets.BACKGROUND FOR THE INVENTION:Virtual Reality (VR) technology has transformed how users interact with 3D environments,offering immersive experiences across various fields such as gaming, simulation, education,and remote operations. At the heart of VR systems is the controller, a device that captures usermovements and converts them into actions in the virtual world.Most current VR controllers are based on optical systems, including RGB or depth cameras,which can track their position and orientation in 3D space. For example, systems mentionedin patents like US10982648B2 use depth sensors for motion tracking. Although efficient, thesesystems rely heavily on external lighting and lose accuracy when the environment is poorlylit or too bright. Their reliance on external cameras also increases the complexity and cost ofthe setup, which limits their accessibility to more everyday users.Another popular method, described in patent US20200185615A1, is the use of inertial sensorsinside the controller to track motion. This approach eliminates the need for external camerasbut introduces the problem of drift, which leads to inaccuracies over time during extended use.Over the above limitations, thermal-based tracking systems have been developed. Forinstance, the patent US20170256904A1 discloses a technique of using IR markers to trackmotion. However, the interference of these systems from other heat-emitting objects in theenvironment may sometimes lead to false tracking data.There is, therefore a significant need for an accurate yet inexpensive VR controller systemthat will not be adversely affected by light or thermal interference while determining its 3Dposition and orientation.To meet this need, the Universal VR Controller of the present invention has been devisedusing thermal markers and a new method of operation. The system conquers environmentalchallenges and ensures reliable tracking by incorporating dynamically adjustable heating pads(203,204) and a thermal camera (103). Contrary to the earlier solutions, using two heatingpads (203,204) allows the controller to stand out from other heat sources, as explained in theoperational method. This design does not only make the tracking accurate but also simpler inhardware.In addition, this invention removes the need for expensive VR headsets, thus enablinginteraction with 3D applications on a simple laptop or LCD screen. The system combinessimplicity, affordability, and high performance to mark a major leap in VR technology.TableOBJECTS OF THE INVENTIONSome of the objects of the present disclosure, which at least one embodiment herein satisfies,are as follows.The primary object of the invention is to provide a universal VR controller system that ensuresaccurate 3D positional and orientational tracking of the controller in real time, regardless ofenvironmental lighting conditions.Another object of the invention is to overcome the limitations of existing VR controllers byemploying thermal markers instead of RGB or depth cameras, thereby reducing reliance onexternal lighting conditions.Another object of the invention is to design a cost-effective and simple solution that eliminatesthe need for sophisticated VR headsets, enabling interaction with 3D applications onconventional displays like laptops, mobile screens, or LCDs.Another object of the invention is to provide a versatile interface compatible with any 3Dsoftware or hardware applications, including but not limited to drones, robotic systems, andRC vehicles.Another object of the invention is to enhance user interaction with 3D environments byintegrating intuitive input devices such as joystick (201) and buttons (205), and seamlesslytransmitting data using standardized gamepad protocols.Yet Another object of the invention is to improve ease of use and portability by offering astandalone, battery-powered controller system with Bluetooth connectivity.These objects collectively address the limitations of existing VR controllers and pave the wayfor broader adoption of VR technologies in a range of applications.SUMMARY OF THE INVENTIONThe invention is a universal VR controller system that consists of two hardware components:a HN (200) and a Camera node (CN) (100). The HN (200) is the primary user interface, whichis equipped with heating pads (203,204), a joystick (201), buttons (205), a digital thermometer(202), and a microcontroller and Bluetooth 5.0 connectivity. The CN (100) consists of athermal camera (103), a microcontroller, and Bluetooth 5.0 (BT5) connectivity. Together,these parts allow the system to determine accurately the position and orientation of the HN(200) in 3D space relative to the CN (100).The main features of the invention are:- Thermal markers can be used to overcome environmental lighting constraints.- A universal interface compatible with any 3D application.- Cost-effective design that allows interaction with 3D applications on conventionaldisplays without the need for expensive VR headsets.BRIEF DESCRIPTION OF DRAWINGSReference will be made to embodiments of the invention, examples of which may beillustrated in accompanying figures. These figures are intended to be illustrative, not limiting.Although the invention is generally described in the context of these embodiments, it shouldbe understood that it is not intended to limit the scope of the invention to these particularembodiments.DETAILED DESCRIPTION OF DRAWINGSWhile the present invention is described herein by way of example using embodiments andillustrative drawings, those skilled in the art will recognize that the invention is not limited tothe embodiments of drawing or drawings described and are not intended to represent the scaleof the various components. Further, some components that may form a part of the inventionmay not be illustrated in certain figures, for ease of illustration, and such omissions do notlimit the embodiments outlined in any way. It should be understood that the drawings and thedetailed description thereto are not intended to limit the invention to the particular formdisclosed, but on the contrary, the invention is to cover all modifications, equivalents, andalternatives falling within the scope of the present invention as defined by the appended claim.As used throughout this description, the word "may" is used in a permissive sense (i.e.meaning having the potential to), rather than the mandatory sense, (i.e. meaning must).Further, the words "a" or "an" mean "at least one" and the word "plurality" means "one ormore" unless otherwise mentioned. Furthermore, the terminology and phraseology usedherein are solely used for descriptive purposes and should not be construed as limiting inscope. Language such as "including," "comprising," "having," "containing," or "involving,"and variations thereof, is intended to be broad and encompass the subject matter listedthereafter, equivalents, and additional subject matter not recited, and is not intended to excludeother additives, components, integers, or steps. Likewise, the term "comprising" is consideredsynonymous with the terms "including" or "containing" for applicable legal purposes. Anydiscussion of documents, acts, materials, devices, articles, and the like are included in thespecification solely for the purpose of providing a context for the present invention. It is notsuggested or represented that any or all these matters form part of the prior art base or arecommon general knowledge in the field relevant to the present invention.In this disclosure, whenever a composition or an element or a group of elements is precededwith the transitional phrase "comprising", it is understood that we also contemplate the samecomposition, element, or group of elements with transitional phrases "consisting of","consisting", "selected from the group of consisting of, "including", or "is" preceding therecitation of the composition, element or group of elements and vice versa.The present invention is described hereinafter by various embodiments with reference to theaccompanying drawing, wherein reference numerals used in the accompanying drawingcorrespond to the like elements throughout the description. This invention may, however, beembodied in many different forms and should not be construed as limited to the embodimentset forth herein. Rather, the embodiment is provided so that this disclosure will be thoroughand complete and will fully convey the scope of the invention to those skilled in the art. In thefollowing detailed description, numeric values and ranges are provided for various aspects ofthe implementations described. These values and ranges are to be treated as examples onlyand are not intended to limit the scope of the claims. In addition, several materials areidentified as suitable for various facets of the implementations. These materials are to betreated as exemplary and are not intended to limit the scope of the invention.The invention operates through the coordinated functioning of the Hand Node (200) andCamera node (100).In one embodiment, the invention comprises the operation of the Hand Node (200), a user-handled device equipped with advanced subsystems for precise control and communication.The HN (200) activates upon pressing a power button and initiates Bluetooth pairing with aCamera node CN (100) and a host device, such as a computer or gaming console. The HN(200) includes a digital thermometer (202) that measures the ambient temperature (AT) andutilizes this value to control two onboard heating pads (203,204).A first heating pad (203) to operate at an ambient temperature plus dynamically computedpredefined limit 1 and shared the same with CN and a second heating pad (204) to operate atan ambient temperature plus dynamically computed predefined limit 2 and shared the samewith CN for tracking of HN. Once the heating pads (203,204) reach their target temperatures,the HN (200) sends a message to the CN (100), sharing the AT value plus pre-define limit 1and AT +pre-define limit 2 and requesting positional data. Simultaneously, the HN (200)retrieves its orientation data, comprising Orientational X, Y, and Z coordinates, using anonboard inertial measurement unit (IMU). Additionally, the HN (200) collects input from itsonboard buttons (205) and joystick (201). This data is encoded according to a gamepadprotocol, where positional and orientational values are mapped to joystick (201). The HN(200) transmits this encoded gamepad data to the host device, enabling real-time interactionand feedback.Another embodiment of the invention focuses on the operation of the Camera node (CN)(100), which processes thermal image frames to derive positional data. Upon being connectedto a host device via USB, the CN (100) powers its onboard components and establishes aBluetooth connection with the HN (200). After receiving a data transfer request and theambient temperature (AT) + pre-define limit 1 and AT + Pre-define limit 2 value from the HN(200), the CN (100) utilizes its thermal camera (103) to capture temperature-based imageframes. These frames are processed through a thresholding algorithm, which sets pixel valuesto zero if the temperature is below AT + pre-define limit 1 or above the AT + Pre-define limit2, and to one for all other temperatures. The CN (100) scans the resulting black-and-whiteimage to detect two connected components (CCs) corresponding to the heating pads (203,204)on the HN (200). If exactly two CCs are not detected, the frame is discarded as noisy. Forvalid frames, the centroids of the CCs are calculated. Positional X and Y coordinates aredetermined as the average row and column values of these centroids, while Positional Z isinferred from the distance between the centroids. A smaller distance indicates that the HN(200) is farther from the CN (100), whereas a larger distance signifies closer proximity. TheCN (100) transmits the calculated positional data (Positional X, Y, Z) to the HN (200).In another embodiment, the invention combines the functionality of the HN (200) and theCamera node (100) to create a system capable of real-time positional and orientationaltracking for interactive applications. The HN (200) operates as a user-controlled input device,providing precise positional and orientational data along with feedback through its heatingpads (203,204). The CN (100) functions as an processing unit, using thermal imaging to trackthe HN's (200) position in three-dimensional space. The interaction between these nodes isfacilitated via Bluetooth communication, with the HN (200) requesting positional data and theCN (100) providing it in real time. The host device receives gamepad-compatible data fromthe HN (200), enabling seamless integration into gaming systems, virtual reality platforms, orother interactive environments. This integrated system ensures robustness againstenvironmental noise and provides enhanced accuracy and responsiveness, making it suitablefor a wide range of applications.The basic Advantages of the Invention are its accuracy as the system's reliance on thermalmarkers ensures accurate position tracking regardless of lighting conditions. Another benefitof the invention is its simplicity as it eliminates the need for complex headsets or additionalexternal hardware. Another benefit is its versatility as it is compatible with any 3D applicationand hardware systems like drones, robotic arms, and RC cars.

Claims

1. A system for universal virtual reality controller for real-time positional and orientational tracking, comprising: - a Hand Node (HN) (200) configured to: initiate Bluetooth pairing with a Camera node (CN) (100) and a host device upon activation, measure ambient temperature using an onboard digital thermometer (202), control a first heating pad (203) to operate at an ambient temperature plus dynamically computed predefined limit 1 and shared the same with CN and a second heating pad (204) to operate at an ambient temperature plus dynamically computed predefined limit 2 and shared the same with CN for tracking of HN retrieve positional data, including Positional X, Positional Y, and Positional Z coordinates, from the CN (100), retrieve orientation data, including Orientational X, Orientational Y, and Orientational Z coordinates, from a microcontroller and Bluetooth 5.0 connectivity, encode positional, orientational, and input data from onboard buttons (205) and joystick (201) into a gamepad protocol, and transmit encoded gamepad data to the host device; - a Camera node (CN) (100) configured to: activate components when connected to a host device via USB, establish Bluetooth communication with the HN (200), receive an ambient temperature (AT) + pre-define limit 1 and ambient temperature (AT) + Pre-define limit 2 data and data transfer requests from the HN (200), process thermal image frames to detect connected components corresponding to the HN (200)'s heating pads (203,204), calculate Positional X and Positional Y coordinates from the centroid of the connected components, determine Positional Z based on the distance between the connected components, and transmit Positional X, Positional Y, and Positional Z coordinates to the HN (200).

2. The system as claimed in Claim 1, wherein the HN (200) is further configured to regulate heating pad temperatures dynamically based on ambient temperature fluctuations and environmental conditions and sharing the same with CN(100).

3. The system as claimed in Claim 1, wherein the CN (100) is configured to perform image thresholding on thermal image frames, wherein: - pixel values are set to zero if the temperature is less than ambient temperature plus predefined limit 1, - pixel values are set to zero if the temperature is greater than ambient temperature plus predefined limit 2, and - pixel values are set to one for all other temperature values.

4. The system as claimed in Claim 1, wherein the HN (200) encodes gamepad data including - Positional X and Positional Y are mapped to a first joystick (201), - Orientational X and Orientational Y are mapped to a second joystick (201), - Positional Z and Orientational Z are mapped to a third joystick (201), - onboard joystick (201) input is mapped to a fourth joystick (201), and - onboard button states are mapped to gamepad button values.

5. The system as claimed in Claim 1, wherein the CN (100) is further configured to discard thermal image frames as noise if the number of detected connected components does not equal two.

6. The system as claimed in Claim 1, wherein the distance between the centroids of the connected components in the thermal image frames determines Positional Z, such that: a smaller centroid distance corresponds to a greater distance between the HN (200) and CN (100), and a larger centroid distance corresponds to closer proximity between the HN (200) and CN (100).

7. A method for real-time positional and orientational tracking, comprising: - powering on a Hand Node (200) and establishing Bluetooth communication with a Camera node (100) and a host device, - measuring ambient temperature at the HN (200) and configuring two heating pads (203,204) to operate at dynamically computed AT + pre-define limit 1 and AT + Pre-define limit 2 based on the ambient temperature and environmental conditions. - transmitting an ambient temperature (AT) + pre-define limit 1 and ambient temperature (AT) + Pre-define limit 2 and a data transfer request from the HN (200) to the CN (100), - processing thermal image frames at the CN (100) to calculate Positional X, Positional Y, and Positional Z coordinates, - transmitting the calculated positional data from the CN (100) to the HN (200), - retrieving orientation data at the HN (200) from an inertial measurement unit (IMU), - encoding positional, orientational, joystick (201), and button data at the HN (200) into a gamepad protocol, and - transmitting the encoded gamepad data from the HN (200) to the host device.

8. The method of Claim 7, wherein the processing of thermal image frames at the CN (100) includes thresholding pixel values based on predefined temperature limits and identifying connected components corresponding to heating pads (203,204) on the HN (200).