VR handle, VR glasses, pose information determination method and device
By setting up multi-band infrared and polarized light sources on the VR controllers and using the image sensors of the VR glasses to detect and adjust the light, the interference problem when VR devices recognize the controllers is solved, achieving higher recognition accuracy.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- VIVO MOBILE COMM CO LTD
- Filing Date
- 2022-12-23
- Publication Date
- 2026-05-01
AI Technical Summary
When VR devices recognize controllers, the controllers use a fixed band of infrared light, which is easily interfered with by infrared light of the same band emitted by other devices in the same environment, resulting in poor recognition accuracy.
N sets of first light sources are set on the VR controller to emit infrared light of different wavelengths and M second light sources to emit polarized light of different directions. Image sensors are set on the VR glasses to detect these lights and instruct the controller to adjust the light according to the light adjustment information to match the wavelength and polarization direction and prevent interference.
It improves the accuracy of VR controller pose information recognition, prevents light interference from other devices in the same environment, and enhances recognition precision.
Smart Images

Figure CN115944906B_ABST
Abstract
Description
VR controllers, VR glasses, pose information determination methods and devices Technical Field
[0001] This application belongs to the field of electronic technology, specifically relating to a VR controller, VR glasses, a method and device for determining pose information. Background Technology
[0002] Typically, in scenarios where users engage with virtual reality (VR) devices, they can interact with the VR device using a controller. Specifically, if a user needs to trigger the VR device to perform a certain operation, the user can first initiate a connection between the VR device and the controller, and then move the controller as input. This allows the VR device to obtain the relative position information of the controller based on the infrared light emitted by the controller's LED light source, and then perform the operation based on that position information.
[0003] However, since the controllers all use LED light sources that emit infrared light of a fixed wavelength, when the VR device is recognizing the controller, if other identical or similar devices in the same environment are emitting infrared light of the same wavelength, it will interfere with the VR device's recognition. Therefore, the VR device cannot accurately recognize the relative pose information of the controller. Summary of the Invention
[0004] The purpose of this application is to provide an electronic device, a method, apparatus, and medium for determining pose information, which can solve the problem of poor accuracy in the use of VR devices.
[0005] In a first aspect, embodiments of this application provide a VR controller, which includes: N sets of first light sources disposed on the VR controller, the N sets of first light sources being used to emit infrared light of different wavelengths, where N is a positive integer; and M second light sources disposed on the VR controller, the M second light sources being used to emit polarized light of different directions, where M is a positive integer; wherein, when the first set of first light sources in the N sets of first light sources emits infrared light, the other light sources in the N sets of first light sources, excluding the first set of first light sources, stop emitting infrared light; and when the third light source in the M second light sources emits polarized light, the other light sources in the M second light sources, excluding the third light source, stop emitting polarized light.
[0006] Secondly, embodiments of this application provide a VR headset, which includes: an image sensor disposed on the VR headset, the image sensor including N groups of first photosensitive pixels and M second photosensitive pixels; each group of first photosensitive pixels is used to sense infrared light of one wavelength, and each second photosensitive pixel is used to sense polarized light of one direction, where N and M are both positive integers; the VR headset is used to detect the infrared light and polarized light emitted by the VR controller to determine the pose information of the VR controller.
[0007] Thirdly, embodiments of this application provide a pose information determination method applied to VR glasses. The method includes: receiving a first infrared light and a first polarized light emitted by a VR controller; upon receiving the first light, transmitting light adjustment information to the VR controller, the light adjustment information being used to instruct the VR controller to adjust the first light to a second light; upon receiving the second light emitted by the VR controller, determining the pose information of the VR controller based on the second light; wherein, when the first light includes a second infrared light, the wavelengths of the second infrared light and the first infrared light are matched; and when the first light includes a second polarized light, the polarization directions of the second polarized light and the first polarized light are matched.
[0008] Fourthly, embodiments of this application provide a pose information determination device, which includes: a receiving module, a transmitting module, and a determining module; the receiving module is used to receive a first infrared light and a first polarized light emitted by a VR controller; the transmitting module is used to transmit light adjustment information to the VR controller when the first light is received, the light adjustment information being used to instruct the VR controller to adjust the first light to a second light; the determining module is used to determine the pose information of the VR controller based on the second light when the second light emitted by the VR controller is received; wherein, when the first light includes a second infrared light, the wavelengths of the second infrared light and the first infrared light are matched; and when the first light includes a second polarized light, the polarization directions of the second polarized light and the first polarized light are matched.
[0009] Fifthly, embodiments of this application provide an electronic device including a processor and a memory, the memory storing a program or instructions executable on the processor, the program or instructions, when executed by the processor, implementing the steps of the method as described in the first aspect.
[0010] In a sixth aspect, embodiments of this application provide a readable storage medium on which a program or instructions are stored, which, when executed by a processor, implement the steps of the method as described in the first aspect.
[0011] In a seventh aspect, embodiments of this application provide a chip, which includes a processor and a communication interface, the communication interface and the processor being coupled together, the processor being used to run programs or instructions to implement the method as described in the first aspect.
[0012] Eighthly, embodiments of this application provide a computer program product stored in a storage medium, which is executed by at least one processor to implement the method as described in the first aspect.
[0013] In this embodiment, N sets of first light sources and M second light sources are provided on the VR controller. The N sets of first light sources emit infrared light of different wavelengths, where N is a positive integer. The M second light sources emit polarized light of different directions, where M is a positive integer. When the first set of first light sources emits infrared light, the other light sources in the N sets stop emitting infrared light. Similarly, when the third light source in the M second light sources emits polarized light, the other light sources in the M second light sources stop emitting polarized light. Because the VR controller has multiple sets of first light sources and multiple second light sources, when the VR glasses detect that the light emitted by other electronic devices matches the light currently emitted by the VR controller during the detection of the VR controller's pose information, the light source on the VR controller can be switched to prevent interference from other electronic devices emitting the same light, thereby improving the accuracy of recognizing the relative pose information of the VR controller. Attached Figure Description
[0014] Figure 1 is a schematic diagram of the structure of the camera provided in an embodiment of this application;
[0015] Figure 2 is a schematic diagram of the handle provided in an embodiment of this application;
[0016] Figure 3 is a schematic diagram of the structure of the VR controller provided in an embodiment of this application;
[0017] Figure 4 is a schematic diagram of the structure of the light emitted by the VR controller provided in the embodiment of this application;
[0018] Figure 5 is a schematic diagram of the structure of the image sensor in the VR glasses provided in the embodiment of this application;
[0019] Figure 6 is a flowchart of a pose information determination method provided in an embodiment of this application;
[0020] Figure 7 is a schematic diagram of the pose information determination device provided in an embodiment of this application;
[0021] Figure 8 is a schematic diagram of the structure of an electronic device provided in an embodiment of this application;
[0022] Figure 9 is a hardware schematic diagram of an electronic device provided in an embodiment of this application. Detailed Implementation
[0023] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.
[0024] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.
[0025] The following will explain the terminology used in the embodiments of this application.
[0026] 1. Virtual Reality Technology
[0027] Virtual Reality (VR) is a novel and practical technology that emerged in the 20th century. It encompasses computer science, electronic information, and simulation technology. Its basic implementation involves using computers to simulate a virtual environment, creating a sense of immersion. VR refers to creating a virtual space through external devices; people can then enjoy applications such as watching movies and playing games within this virtual space. Typically, a VR device is a head-mounted glasses system equipped with multiple cameras.
[0028] The VR device includes a VR headset and two controllers (the aforementioned external devices). The VR headset has four cameras, primarily used for environmental see-through detection and six degrees of freedom (6DoF) detection. Alternatively, some VR headsets use separate camera configurations for see-through and 6DoF detection (see-through typically detects visible light signals, while 6DoF detects both visible and infrared signals). In this case, two additional dedicated see-through cameras are usually required (i.e., four 6DoF cameras + two see-through cameras). The infrared signal is mainly used for controller position detection. Since adding more cameras increases the overall size, power consumption, and cost of the camera module, the four 6DoF cameras can be reused for image acquisition to achieve the see-through function.
[0029] VR glasses typically establish a wireless connection with the controllers using 6DoF recognition. The controllers are equipped with a specific infrared light source (e.g., 850nm infrared band) to allow the camera on the VR glasses to capture the controllers' pose information. The camera module used in VR glasses usually employs a fixed-focal-length camera, as shown in Figure 1. The camera includes: a lens 21, an infrared reflection (IR) filter 22, a CMOS image sensor (CIS) chip 23, wire bonding wires 24, a flexible printed circuit (FPC) 25, and a reinforcing steel sheet 26. The lens 21, located at the front of the camera, consists of one glass lens and five plastic lenses. The IR filter 22 is used to filter light of a specific wavelength. The CIS chip 23, also known as the camera's photosensitive chip, is typically used in VR glasses as a global exposure chip. The wire bonding wires 24 are gold wires used to connect the photosensitive chip to external electrical components. The flexible printed circuit board (FPC25), also known as a "flexible board," is a printed circuit made of a flexible insulating substrate and is used to connect the photosensitive chip to external electrical components. The reinforcing steel sheet (26) is used to reinforce the back of the camera module.
[0030] Typically, as shown in Figure 2, a VR controller is equipped with multiple infrared light-emitting diodes (LEDs) 31. These multiple infrared LEDs 31 are generally arranged in a ring, and each of them emits infrared light of the same wavelength. The VR glasses' camera determines the controller's pose information by capturing the position and orientation of the infrared light emitted by the infrared LEDs on the controller.
[0031] The electronic device, pose information determination method, apparatus, and medium provided in this application will be described in detail below with reference to the accompanying drawings and through specific embodiments and application scenarios.
[0032] Figure 3 shows a possible structural schematic diagram of a VR controller provided in an embodiment of this application. As shown in Figure 4, the first electronic device includes: N sets of first light sources 41, disposed on the VR controller, the N sets of first light sources being used to emit infrared light of different wavelengths, where N is a positive integer; and M second light sources 42, disposed on the VR controller, the M second light sources being used to emit polarized light of different directions, where M is a positive integer. Specifically, when the first set of first light sources in the N sets emits infrared light, the other light sources in the N sets of first light sources, excluding the first set of first light sources, stop emitting infrared light; when the third light source in the M second light sources emits polarized light, the other light sources in the M second light sources, excluding the third light source, stop emitting polarized light.
[0033] For example, each of the N groups of first light sources emits infrared light in a different wavelength band.
[0034] Specifically, each of the above-mentioned first light sources may include at least one LED light source capable of emitting infrared light in the same wavelength band.
[0035] For example, each of the M second light sources emits polarized light rays in a different direction.
[0036] Specifically, the aforementioned M second light sources may include polarized light sources capable of emitting polarized light in two directions.
[0037] Optionally, in this embodiment, the first light source emits infrared light to make the VR glasses sensitive to infrared light; the third light source emits polarized light to make the VR glasses sensitive to polarized light.
[0038] For example, VR glasses can sense infrared light emitted by the VR controller through a first set of first light sources, or they can sense polarized light emitted by the VR controller through a third light source.
[0039] For example, as shown in Figure 3, taking a VR controller as an example, the aforementioned N groups of first light sources may include three groups of first light sources 41. Specifically, the first group of first light sources 43 emits infrared light in the 850nm band, the second group of first light sources 44 emits infrared light in the 900nm band, and the third group of first light sources 45 emits infrared light in the 950nm band. Referring to Figure 3, the aforementioned M groups of second light sources 42 may include two second light sources, namely a third light source 46 and a fourth light source 47. Specifically, as shown in Figure 4(a), the third light source emits polarized light in a first direction, and as shown in Figure 4(b), the fourth light source emits polarized light in a second direction. The polarized light in the first direction is perpendicular to the polarized light in the second direction.
[0040] The VR controller provided in this application embodiment has N sets of first light sources and M second light sources. The N sets of first light sources emit infrared light of different wavelengths, where N is a positive integer. The M second light sources emit polarized light of different directions, where M is a positive integer. When the first set of first light sources emits infrared light, the other light sources in the N sets stop emitting infrared light. Similarly, when the third light source in the M second light sources emits polarized light, the other light sources in the M second light sources stop emitting polarized light. Because the VR controller has multiple sets of first light sources and multiple second light sources, when the VR glasses detect the pose information of the VR controller and detect that the light emitted by other electronic devices matches the light currently emitted by the VR controller, they can switch the light sources on the VR controller to prevent interference from other electronic devices emitting the same light, thereby improving the accuracy of recognizing the relative pose information of the VR controller.
[0041] Optionally, in this embodiment of the application, a VR glasses is provided, which includes: an image sensor disposed on the VR glasses, as shown in FIG5. The image sensor includes N groups of first photosensitive pixels 61 and M second photosensitive pixels 62; each group of first photosensitive pixels is used to sense infrared light of one wavelength, and each second photosensitive pixel is used to sense polarized light of one direction, where N and M are both positive integers; the VR glasses are used to detect the infrared light and polarized light emitted by the VR controller to determine the pose information of the VR controller.
[0042] Specifically, as shown in Figure 5, the pixel arrangement of the image sensor satisfies at least one of the following: N groups of first photosensitive pixels 61 are distributed around M second photosensitive pixels 62; N groups of first photosensitive pixels and M second photosensitive pixels are arranged alternately.
[0043] For example, the image sensor described above can be at least one camera chip. Specifically, the image sensor described above can be a global exposure camera chip.
[0044] For example, the aforementioned N groups of first photosensitive pixels can be at least one group of first photosensitive pixels. Specifically, the aforementioned N groups of first photosensitive pixels can include at least one of the following: a first infrared photosensitive pixel (R1), a second infrared photosensitive pixel (R2), and a third infrared photosensitive pixel (R3), etc.
[0045] For example, the aforementioned M first photosensitive pixels can be at least one second photosensitive pixel. Specifically, the aforementioned M second photosensitive pixels can include at least one of the following: a first polarization photosensitive pixel (P1) and a second polarization photosensitive pixel (P2).
[0046] Optionally, in this embodiment of the application, the first group of photosensitive pixels in the above N groups of first photosensitive pixels is used to detect infrared light emitted by the first group of first light sources on the VR controller; the third photosensitive pixel in the M second photosensitive pixels is used to detect polarized light emitted by the third light source on the VR controller.
[0047] For example, VR glasses can detect infrared light emitted by a first light source on a VR controller through a first set of photosensitive pixels, and detect polarized light emitted by a third light source on a VR controller through a third set of photosensitive pixels.
[0048] The VR glasses provided in this application embodiment are equipped with an image sensor including various types of photosensitive pixels. This allows the VR glasses to accurately detect the light emitted by the VR controller during the process of detecting the VR controller's pose information, preventing interference from other electronic devices emitting the same light, thereby improving the accuracy of the VR glasses in detecting the VR controller's pose information.
[0049] The pose information determination method provided in this application is applied to scenarios where users use VR devices. The specific application scenario can be determined according to the usage requirements, and this application does not limit it.
[0050] For example, consider a scenario where VR glasses detect the pose information of the controllers.
[0051] In related technologies, 6DoF recognition for VR glasses is typically combined with controller pose information detection, as shown in Figure 2. LEDs with specific infrared wavelengths, such as 850nm, are installed on the controllers to facilitate the VR glasses' camera capturing the controllers' pose information. However, the camera modules used in VR glasses are usually fixed-focus cameras. When other devices emitting the same or similar infrared light wavelengths are present in the same environment, the camera's ability to recognize the controllers' pose information will be interfered with, making accurate identification of the controllers' pose information impossible.
[0052] In this embodiment, the VR glasses receive a first infrared light and a first polarized light emitted by the VR controller. If the first light is detected by the image sensor, and the VR glasses receive the first light, they transmit light adjustment information to the VR controller. Then, upon receiving a second light emitted by the VR controller, the VR glasses determine the VR controller's pose information based on the second light. The light adjustment information instructs the VR controller to adjust the first light to the second light. If the first light includes a second infrared light, the wavelengths of the second and first infrared lights match; if the first light includes a second polarized light, the polarization directions of the second and first polarized lights match. Because the VR glasses can instruct the VR controller to adjust the first light to the second light upon receiving the first light, and determine the VR controller's pose information based on the second light, the VR glasses can prevent interference from light emitted by other electronic devices in the same environment, thereby improving the accuracy of the VR glasses in detecting the VR controller's pose information.
[0053] This application provides a pose information determination method for VR glasses, as shown in Figure 6. The pose information determination method may include the following steps 201 to 203:
[0054] Step 201: The VR glasses receive the first infrared light and the first polarized light emitted by the VR controller.
[0055] For example, the first infrared light can be infrared light of the same wavelength emitted by any one of the N sets of first light sources of the VR controller.
[0056] For example, the first polarized light can be polarized light emitted in the same direction from any one of the M second light sources of the VR controller.
[0057] Step 202: Upon receiving the first light, the VR glasses transmit light adjustment information to the VR controller.
[0058] The aforementioned light adjustment information is used to instruct the VR controller to adjust the first light source to the second light source.
[0059] For example, the first ray can be light emitted by an electronic device other than the VR controller.
[0060] It should be noted that, upon detecting that a first ray emitted by another electronic device matches at least one ray emitted by the VR controller, the VR glasses can transmit light adjustment information to the VR controller, causing the VR controller to adjust the light. The aforementioned "matching" indicates that the infrared light in the first ray has the same wavelength as the first infrared light, or that the polarized light in the first ray has the same direction as the first polarized light.
[0061] Step 203: When the VR glasses receive the second light emitted by the VR controller, they determine the pose information of the VR controller based on the second light.
[0062] Wherein, when the first ray includes a second infrared ray, the wavelengths of the second infrared ray and the first infrared ray are matched; and when the first ray includes a second polarized ray, the polarization directions of the second polarized ray and the first polarized ray are matched.
[0063] For example, the pose information described above is used to indicate the relative position and posture information of the VR controller.
[0064] In this embodiment, when the VR glasses receive the first light source, they can instruct the VR controller to adjust the first light source to a second light source, and determine the VR controller's pose information based on the second light source. This prevents interference from light emitted by other electronic devices in the same environment, thereby improving the accuracy of the VR glasses in detecting the VR controller's pose information.
[0065] Optionally, in this embodiment, the second light ray includes a third infrared light ray and a third polarized light ray. Specifically, before step 201 above, the pose information determination method provided in this embodiment may further include step 301 below; before step 203 above, the pose information determination method provided in this embodiment may further include step 401 below:
[0066] Step 301: Once the VR glasses and VR controllers are connected, the VR glasses send instruction information to the VR controllers.
[0067] The aforementioned instruction information is used to instruct the VR controller to turn on the first group of first and third light sources.
[0068] For example, the above link can be a wired connection or a wireless connection.
[0069] For example, the wireless connection described above can be at least one of the following: Bluetooth connection, WiFi connection, and wireless LAN connection.
[0070] For example, the first group of first light sources can be any one of the N groups of first light sources.
[0071] For example, the third light source can be any one of the M second light sources.
[0072] Specifically, the first light source can be an infrared LED light source, and the second light source can be a polarized light source.
[0073] It should be noted that VR glasses can receive the first infrared light emitted by the first light source and the first polarized light emitted by the third light source through the image sensor.
[0074] Step 401: The VR glasses receive the second light emitted by the target light source through the image sensor.
[0075] The light adjustment information is used to instruct the VR controller to turn on the target light source, which includes at least one of the following: the second group of first light sources in N groups of first light sources and the fourth light source in M groups of second light sources; the infrared light emitted by the first group of first light sources and the second group of first light sources has different wavelengths; the polarized light emitted by the third light source and the fourth light source has different directions.
[0076] It should be noted that if the VR glasses detect a first light emitted by another electronic device that matches at least one of the first infrared light and the first polarized light emitted by the VR controller, the VR glasses can instruct the VR controller to turn on the target light source.
[0077] Thus, since VR glasses can instruct VR controllers to switch light sources, they can prevent interference from other electronic devices emitting the same light emitted by the VR controllers during the detection of the VR controllers' pose information, thereby improving the accuracy of VR glasses in detecting the VR controllers' pose information.
[0078] Optionally, in this embodiment, the second light ray includes a third infrared light ray and a third polarized light ray. Specifically, step 203 can be implemented by the following step 203a:
[0079] Step 203a: If the VR glasses meet the preset conditions between the third infrared light and the third polarized light, determine the pose information of the VR controller based on the second light.
[0080] For example, the above-mentioned preset conditions may be at least one of the following: whether the relative positional relationship between the third infrared ray and the third polarized ray matches the preset positional relationship, whether the relative motion relationship between the third infrared ray and the third polarized ray matches the preset motion relationship, etc.
[0081] For example, the aforementioned preset conditions can be set in advance according to user needs, or they can be stored in the electronic device in advance.
[0082] Optionally, in the embodiments of this application, step 203a above can be implemented by at least one of the following steps 203a1 and 203a2:
[0083] Step 203a1: When the relative positional relationship between the third infrared ray and the third polarized ray matches the preset positional relationship, the VR glasses determine the pose information of the VR controller based on the third infrared ray and the third polarized ray.
[0084] For example, the above relative positional relationship is used to indicate the relative positional relationship between the first light source corresponding to the emission of the third infrared light and the second light source corresponding to the emission of the third polarized light.
[0085] For example, the aforementioned preset positional relationship is used to indicate the fixed positional relationship between the first light source emitting the third infrared light and the second light source emitting the third polarized light on the VR controller.
[0086] For example, the above matches can be identical or similar.
[0087] It should be noted that VR glasses can determine the pose information of the VR controllers by checking whether the relative positional relationship between the first light source emitting the third infrared light and the second light source emitting the third polarized light is the same as the fixed positional relationship. If they are the same, it means they are matched, and the pose information of the VR controllers can be determined based on the third infrared light and the third polarized light. If they are different, it means they are not matched, and it is necessary to continue sending light adjustment information to the VR controllers to determine their pose information based on the adjusted light from the VR controllers.
[0088] Step 203a2: When the relative motion relationship between the third infrared light and the third polarized light of the VR glasses matches the preset motion relationship, the pose information of the VR controller is determined based on the third infrared light and the third polarized light.
[0089] For example, the above relative motion relationship is used to indicate the relative motion direction between the third infrared ray and the third polarized ray.
[0090] For example, the aforementioned preset motion relationship can be a pre-stored preset motion direction.
[0091] For example, the above matches can be identical or similar.
[0092] It should be noted that VR glasses can determine the VR controller's pose information based on whether the relative motion direction between the third infrared light and the third polarized light is the same as the preset motion direction. If they are the same, it means they are matched, and the VR controller's pose information can be determined based on the third infrared light and the third polarized light. If they are different, it means they are not matched, and it is necessary to continue sending light adjustment information to the VR controller to determine its pose information based on the adjusted light.
[0093] Thus, it can be seen that, since VR glasses can determine the pose information of the VR controller based on the relative position or relative motion relationship between the third infrared light and the third polarized light under preset conditions, this can prevent the VR glasses from being interfered with by the same light emitted by other electronic devices, thereby improving the accuracy of the VR glasses in detecting pose information.
[0094] The pose information determination method provided in this application can be executed by a pose information determination device. This application uses the example of a pose information determination device executing the pose information determination method to illustrate the pose information determination device provided in this application.
[0095] This application provides a pose information determination device, as shown in FIG7. The pose information determination device 400 includes: a receiving module 401, a transmitting module 402, and a determining module 403, wherein: the receiving module is used to receive a first infrared light and a first polarized light emitted by a VR controller; the transmitting module is used to transmit light adjustment information to the VR controller when the first light is received, the light adjustment information being used to instruct the VR controller to adjust the first light to a second light; the determining module is used to determine the pose information of the VR controller based on the second light emitted by the VR controller when the second light is received; wherein, when the first light includes a second infrared light, the wavelengths of the second infrared light and the first infrared light are matched; when the first light includes a second polarized light, the polarization directions of the second polarized light and the first polarized light are matched.
[0096] Optionally, in this embodiment, the second light ray includes a third infrared light ray and a third polarized light ray. The transmitting module is further configured to transmit instruction information to the VR controller when a connection is established between the VR glasses and the VR controller. The instruction information is used to instruct the VR controller to turn on the first group of first light sources and the third light source. The receiving module is further configured to receive the second light ray emitted by the target light source through an image sensor. The light adjustment information is used to instruct the VR controller to turn on the target light source, which includes at least one of the following: a second group of first light sources from N groups of first light sources and a fourth light source from M groups of second light sources; the infrared light emitted by the first group of first light sources and the second group of first light sources has different wavelengths; the polarized light emitted by the third light source and the fourth light source has different directions.
[0097] Optionally, in this embodiment, the second ray includes a third infrared ray and a third polarized ray. The determining module is specifically configured to determine the pose information of the VR controller based on the second ray, provided that preset conditions are met between the third infrared ray and the third polarized ray.
[0098] Optionally, in this embodiment of the application, the aforementioned determining module is specifically used to determine the pose information of the VR controller based on the third infrared light and the third polarized light when the relative positional relationship between the third infrared light and the third polarized light matches the preset positional relationship; or, when the relative motion relationship between the third infrared light and the third polarized light matches the preset motion relationship, to determine the pose information of the VR controller based on the third infrared light and the third polarized light.
[0099] In the pose information determination device provided in this application embodiment, when the pose information determination device receives a first light source, it can instruct the VR controller to adjust the first light source to a second light source, and determine the pose information of the VR controller based on the second light source. This pose information determination device can prevent interference from light emitted by other electronic devices in the same environment, thereby improving the accuracy of the VR glasses in detecting the pose information of the VR controller.
[0100] The pose information determination device in this application embodiment can be an electronic device or a component within an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices besides a terminal. For example, the electronic device can be a mobile phone, tablet computer, laptop computer, PDA, in-vehicle electronic device, mobile internet device (MID), augmented reality (AR) / virtual reality (VR) device, robot, wearable device, ultra-mobile personal compute (UMPC), netbook, or personal digital assistant (PDA), etc. It can also be a server, network attached storage (NAS), personal computer (PC), television (TV), ATM, or self-service machine, etc. This application embodiment does not specifically limit the device.
[0101] The pose information determination device in this application embodiment can be a device with an operating system. This operating system can be Android, iOS, or other possible operating systems; this application embodiment does not specifically limit it.
[0102] The pose information determination device provided in this application embodiment can implement the various processes implemented in the method embodiment of FIG6. To avoid repetition, it will not be described again here.
[0103] Optionally, as shown in FIG8, this application embodiment also provides an electronic device 600, including a processor 601 and a memory 602. The memory 602 stores a program or instructions that can be executed on the processor 601. When the program or instructions are executed by the processor 601, they implement the various steps of the above-described pose information determination method embodiment and can achieve the same technical effect. To avoid repetition, they will not be described again here.
[0104] It should be noted that the electronic devices in the embodiments of this application include the aforementioned mobile electronic devices and non-mobile electronic devices.
[0105] Figure 9 is a schematic diagram of the hardware structure of an electronic device that implements an embodiment of this application.
[0106] The electronic device 100 includes, but is not limited to, components such as: radio frequency unit 101, network module 102, audio output unit 103, input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, and processor 110.
[0107] Those skilled in the art will understand that the electronic device 100 may also include a power supply (such as a battery) for powering various components. The power supply can be logically connected to the processor 110 through a power management system, thereby enabling functions such as managing charging, discharging, and power consumption through the power management system. The electronic device structure shown in Figure 9 does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.
[0108] The processor 110 is configured to receive a first infrared light and a first polarized light emitted by the VR controller; upon receiving the first light, it transmits light adjustment information to the VR controller, the light adjustment information instructing the VR controller to adjust the first light to a second light; upon receiving the second light emitted by the VR controller, it determines the pose information of the VR controller based on the second light; wherein, when the first light includes the second infrared light, the wavelengths of the second infrared light and the first infrared light are matched; and when the first light includes the second polarized light, the polarization directions of the second polarized light and the first polarized light are matched.
[0109] Optionally, in this embodiment, the second light source includes a third infrared light source and a third polarized light source. The processor 110 is further configured to transmit instruction information to the VR controller when a connection is established between the VR glasses and the VR controller. The instruction information is used to instruct the VR controller to activate the first group of first light sources and the third light source. Specifically, the processor 110 is configured to receive the second light source emitted by the target light source via an image sensor; wherein the light adjustment information is used to instruct the VR controller to activate the target light source, and the target light source includes at least one of the following: a second group of first light sources from N groups of first light sources and a fourth light source from M groups of second light sources; the infrared light emitted by the first group of first light sources and the second group of first light sources has different wavelengths; the polarized light emitted by the third light source and the fourth light source has different directions.
[0110] Optionally, in this embodiment, the second light ray includes a third infrared light ray and a third polarized light ray. Specifically, the processor 110 is used to determine the pose information of the VR controller based on the second light ray when a preset condition is met between the third infrared light ray and the third polarized light ray.
[0111] Optionally, in this embodiment of the application, the processor 110 is specifically used to determine the pose information of the VR controller based on the third infrared light and the third polarized light when the relative positional relationship between the third infrared light and the third polarized light matches the preset positional relationship; or, when the relative motion relationship between the third infrared light and the third polarized light matches the preset motion relationship, to determine the pose information of the VR controller based on the third infrared light and the third polarized light.
[0112] In the electronic device provided in this application embodiment, when the VR glasses receive a first light source, they can instruct the VR controller to adjust the first light source to a second light source, and determine the VR controller's pose information based on the second light source. This prevents interference from light emitted by other electronic devices in the same environment, thereby improving the accuracy of the VR glasses in detecting the VR controller's pose information.
[0113] It should be understood that, in this embodiment, the input unit 104 may include a graphics processing unit (GPU) 1041 and a microphone 1042. The GPU 1041 processes image data of still images or videos obtained by an image capture device (such as a camera) in video capture mode or image capture mode. The display unit 106 may include a display panel 1061, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, or the like. The user input unit 107 includes at least one of a touch panel 1071 and other input devices 1072. The touch panel 1071 is also called a touch screen. The touch panel 1071 may include a touch detection device and a touch controller. Other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (such as volume control buttons, power buttons, etc.), a trackball, a mouse, and a joystick, which will not be described in detail here.
[0114] The memory 109 can be used to store software programs and various data. The memory 109 may primarily include a first storage area for storing programs or instructions and a second storage area for storing data. The first storage area may store the operating system, application programs or instructions required for at least one function (such as sound playback, image playback, etc.). Furthermore, the memory 109 may include volatile memory or non-volatile memory, or both. The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus RAM (DRRAM). The memory 109 in the embodiments of this application includes, but is not limited to, these and any other suitable types of memory.
[0115] Processor 110 may include one or more processing units; optionally, processor 110 integrates an application processor and a modem processor, wherein the application processor mainly handles operations involving the operating system, user interface, and applications, and the modem processor mainly handles wireless communication signals, such as a baseband processor. It is understood that the aforementioned modem processor may also not be integrated into processor 110.
[0116] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the above-described pose information determination method embodiments and achieve the same technical effect. To avoid repetition, they will not be described again here.
[0117] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.
[0118] This application embodiment also provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run programs or instructions to implement the various processes of the above-described pose information determination method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be described again here.
[0119] It should be understood that the chip mentioned in the embodiments of this application may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.
[0120] This application provides a computer program product, which is stored in a storage medium and executed by at least one processor to implement the various processes of the pose information determination method embodiment described above, and can achieve the same technical effect. To avoid repetition, it will not be described again here.
[0121] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.
[0122] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.
[0123] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.
Claims
1. A virtual reality (VR) controller, characterized in that, The VR controller includes: N groups of first light sources, disposed on the VR controller, wherein the N groups of first light sources are used to emit infrared light of different wavelengths, and N is a positive integer; and M second light sources, disposed on the VR controller, wherein the M second light sources are used to emit polarized light of different directions, and M is a positive integer; wherein, when the first group of first light sources in the N groups emits infrared light, the other light sources in the N groups of first light sources, excluding the first group of first light sources, stop emitting infrared light; each group of first light sources emits infrared light of the same wavelength; when the third light source in the M second light sources emits polarized light, the other light sources in the M second light sources, excluding the third light source, stop emitting polarized light; wherein, when one group of first light sources in the N groups emits first infrared light, and the M second light sources emit infrared light of different wavelengths, the other light sources in the M groups of second light sources stop emitting polarized light; After one of the second light sources emits a first polarized ray, it receives light adjustment information emitted by the VR glasses and emits a second ray according to the light adjustment information. The light adjustment information is used to instruct the VR controller to emit the second ray, and the light adjustment information is emitted by the VR glasses after receiving the first ray. If the first ray includes a second infrared ray, the second ray includes a third infrared ray, wherein the wavelengths of the second infrared ray and the first infrared ray are matched, and the wavelengths of the third infrared ray and the second infrared ray are different. If the first ray includes a second polarized ray, the second ray includes a third polarized ray, wherein the polarization directions of the second polarized ray and the first polarized ray are matched, and the directions of the third polarized ray and the second polarized ray are different.
2. The VR controller according to claim 1, characterized in that, The first light source in the first group emits infrared light so that the VR glasses can be sensitive to the infrared light; the third light source emits polarized light so that the VR glasses can be sensitive to the polarized light.
3. A VR headset, characterized in that, include: An image sensor is mounted on the VR glasses. The image sensor includes N groups of first photosensitive pixels and M second photosensitive pixels. The N groups of first photosensitive pixels are used to sense N different wavelengths of infrared light, with each group of first photosensitive pixels specifically used to sense one wavelength of infrared light. The M second photosensitive pixels are used to sense polarized light in different directions, with each second photosensitive pixel specifically used to sense one polarized light direction. N and M are both positive integers. The VR glasses receive the first infrared light and the first polarized light emitted by the VR controller to determine the pose information of the VR controller. Upon receiving the first light, the VR glasses transmit light adjustment information to the VR controller, the light adjustment information being used to... The VR controller emits a second light beam; and, upon receiving the second light beam emitted by the VR controller, the VR glasses determine the pose information of the VR controller based on the second light beam; if the first light beam includes a second infrared light beam, the second light beam includes a third infrared light beam, wherein the wavelengths of the second infrared light beam and the first infrared light beam are matched, and the wavelengths of the third infrared light beam and the second infrared light beam are different; if the first light beam includes a second polarized light beam, the second light beam includes a third polarized light beam, wherein the polarization directions of the second polarized light beam and the first polarized light beam are matched, and the directions of the third polarized light beam and the second polarized light beam are different.
4. The VR glasses according to claim 3, characterized in that, The first group of photosensitive pixels in the N groups of the first photosensitive pixels is used to detect infrared light emitted by the first light source in the first group on the VR controller; the third photosensitive pixel in the M groups of the second photosensitive pixels is used to detect polarized light emitted by the third light source on the VR controller.
5. A method for determining pose information, applied to VR glasses as described in claim 3 or 4, characterized in that, The method includes: receiving a first infrared light and a first polarized light emitted by a VR controller; upon receiving the first light, transmitting light adjustment information to the VR controller, the light adjustment information being used to instruct the VR controller to emit a second light; upon receiving the second light emitted by the VR controller, determining the pose information of the VR controller based on the second light; where the first light includes a second infrared light, the second light includes a third infrared light, wherein the wavelengths of the second infrared light and the first infrared light are matched, and the wavelengths of the third infrared light and the second infrared light are different; where the first light includes a second polarized light, the second light includes a third polarized light, wherein the polarization directions of the second polarized light and the first polarized light are matched, and the directions of the third polarized light and the second polarized light are different.
6. The method according to claim 5, characterized in that, The second light ray includes the third infrared light ray and the third polarized light ray; before receiving the first infrared light ray and the first polarized light ray emitted by the VR controller, the method further includes: when the VR glasses and the VR controller are connected, transmitting indication information to the VR controller, the indication information being used to instruct the VR controller to turn on the first group of first light sources and the third light source; before determining the pose information of the VR controller based on the second light ray, the method further includes: receiving the second light ray emitted by the target light source through the image sensor; wherein, the light adjustment information is used to instruct the VR controller to turn on the target light source, the target light source including at least one of the following: a second group of first light sources in N groups of first light sources and a fourth light source in M groups of second light sources; the infrared light emitted by the first group of first light sources and the second group of first light sources has different wavelengths; the polarized light emitted by the third light source and the fourth light source has different directions.
7. The method according to claim 5, characterized in that, The second ray includes the third infrared ray and the third polarized ray; the step of determining the pose information of the VR controller based on the second ray when the second ray emitted by the VR controller is received includes: determining the pose information of the VR controller based on the second ray when a preset condition is met between the third infrared ray and the third polarized ray.
8. The method according to claim 7, characterized in that, When a preset condition is met between the third infrared ray and the third polarized ray, determining the pose information of the VR controller based on the second ray includes at least one of the following: when the relative positional relationship between the third infrared ray and the third polarized ray matches a preset positional relationship, determining the pose information of the VR controller based on the third infrared ray and the third polarized ray; when the relative motion relationship between the third infrared ray and the third polarized ray matches a preset motion relationship, determining the pose information of the VR controller based on the third infrared ray and the third polarized ray.
9. A pose information determination device, characterized in that, The device includes: a receiving module, a transmitting module, and a determining module; the receiving module is used to receive a first infrared light and a first polarized light emitted by a VR controller; the transmitting module is used to transmit light adjustment information to the VR controller upon receiving the first light, the light adjustment information being used to instruct the VR controller to emit a second light; the determining module is used to determine the pose information of the VR controller based on the second light upon receiving the second light emitted by the VR controller; wherein, when the first light includes a second infrared light, the second light includes a third infrared light, wherein the wavelengths of the second infrared light and the first infrared light are matched, and the wavelengths of the third infrared light and the second infrared light are different; when the first light includes a second polarized light, the second light includes a third polarized light, wherein the polarization directions of the second polarized light and the first polarized light are matched, and the directions of the third polarized light and the second polarized light are different.
10. An electronic device, characterized in that, It includes a processor and a memory, the memory storing a program or instructions that can run on the processor, the program or instructions being executed by the processor to implement the steps of the pose information determination method as described in any one of claims 5-8.
Citation Information
Patent Citations
Image-capture device, method for controlling same, image-capture system, and method for controlling same
CN105917638A
Method and system for tracking position of matched gamepad of VR (virtual reality) head-mounted device
CN106768361A
Polarizer, polarizer array, polarization control method and device and electronic equipment
CN114077102A
Transparent remote controller
CN115410360A