Pairing method, head-mounted display device, server and display system
The communication module of the head-mounted display device and the server sends identification information to generate pairing information, which solves the problem of returning to the factory in the existing technology, realizes the fast and convenient pairing of the device and the handle, and improves user experience and security.
Patent Information
- Application Number
- CN202211318601.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-10-26
- Publication Date
- 2025-07-08
- Estimated Expiration
- 2042-10-26
AI Technical Summary
The matching relationship between the existing head-mounted display device and the handle is fixed when leaving the factory. When the user replaces the handle, he needs to return to the factory to re-pair, which is inconvenient to use and affects the user experience.
The first communication module of the head-mounted display device establishes a communication connection with the server, sends identification information to generate pairing information, and compares it with the scanned handle identification information to realize automatic pairing of the device and the handle.
It realizes rapid pairing of head-mounted display devices and handles, improves convenience of use, and improves security, and does not require the manufacturer's pairing algorithm to be disclosed.
Smart Images

Figure CN115766825B_ABST
Abstract
Description
Technical Field
[0001] Embodiments of the present disclosure relate to the field of virtual reality technology. More specifically, embodiments of the present disclosure relate to a pairing method, a head-mounted display device, a server, and a display system. Background Art
[0002] Currently, a head-mounted display device is usually paired with a handle for use. However, the pairing relationship between the head-mounted display device and the handle is set at the factory, and the head-mounted display device cannot establish a pairing relationship with other handles. In this regard, when a user needs to replace the handle, the head-mounted display device needs to be returned to the factory for re-pairing settings, which is inconvenient to use and affects the user experience.
[0003] Therefore, it is necessary to provide a new pairing method to solve the problem that the existing head-mounted display device needs to be returned to the factory for pairing. Summary of the Invention
[0004] The purpose of embodiments of the present disclosure is to provide a pairing method, a head-mounted display device, a server, and a display system.
[0005] According to a first aspect of the present disclosure, a pairing method is provided, which is applied to a head-mounted display device. The head-mounted display device includes a first communication module. The method includes:
[0006] Sending a first message including first identification information of the head-mounted display device to a server through the first communication module, so that when no pairing relationship is established between the head-mounted display device and a first handle, the server generates and sends pairing information to the head-mounted display device according to the first identification information and second identification information of the first handle, where the pairing information includes the first identification information and the second identification information;
[0007] Receiving the identification information of the scanned handle and the pairing information sent by the server;
[0008] When there is target identification information in the identification information of the scanned handle that matches the second identification information in the pairing information, establishing a pairing relationship between the head-mounted display device and the handle corresponding to the target identification information.
[0009] Optionally, the first message further includes first positioning information of the head-mounted display device. The method further includes:
[0010] When the head-mounted display device turns on the anti-loss mode, sending the first message to the server through the first communication module, so that other devices obtain the first positioning information from the server to search for the head-mounted display device according to the first positioning information.
[0011] Optionally, before sending the first message to the server through the first communication module when the anti-loss mode of the head-mounted display device is enabled, the method further includes:
[0012] Receiving a first input from the user;
[0013] In response to the first input, enabling the anti-loss mode.
[0014] Optionally, sending the first message including the first identification information of the head-mounted display device through the first communication module includes:
[0015] When a preset event is detected, the first communication module enters a wake-up mode to send a first message including the first identification information of the head-mounted display device to the server through the first communication module;
[0016] Wherein, the preset event includes at least one of the following:
[0017] A first magnetic member of an external device is within the magnetic field range corresponding to a first control switch, wherein the first control switch is connected to the first communication module;
[0018] The first communication module receives a wake-up instruction sent by the main control module of the head-mounted display device;
[0019] The first communication module reaches a preset wake-up time.
[0020] Optionally, the method further includes:
[0021] Obtaining wake-up cycle configuration information from the server through the first communication module;
[0022] Setting the wake-up cycle of the first communication module according to the wake-up cycle configuration information.
[0023] According to a second aspect of the present disclosure, a pairing method is provided, which is applied to a server, and the method includes:
[0024] Receiving a first message sent by a first communication module of a head-mounted display device and a second message sent by a second communication module of a first handle, wherein the first message includes first identification information and format information of the head-mounted display device, and the second message includes second identification information of the first handle;
[0025] When a pairing relationship has not been established between the head-mounted display device and the first handle, writing the first identification information and the second identification information according to the format information to generate pairing information;
[0026] Send the pairing information to the head-mounted display device, so that when there is target identification information in the identification information of the scanned handle that matches the second identification information in the pairing information, the head-mounted display device establishes a pairing relationship with the handle corresponding to the target identification information.
[0027] Optionally, the first message further includes first positioning information of the head-mounted display device, and the second message further includes second positioning information of the first handle; before generating pairing information by writing the first identification information and the second identification information according to the format information when the head-mounted display device and the first handle have not established a pairing relationship, the method further includes:
[0028] When the time difference between the first time and the second time is less than or equal to a preset time threshold, determine a first distance between the first handle and the head-mounted display device according to the first positioning information and the second positioning information;
[0029] When the first distance is less than or equal to a preset distance threshold, determine whether a pairing relationship has been established between the head-mounted display device and the first handle;
[0030] Wherein, the first time is the sending time or the receiving time of the first message; the second time is the sending time or the receiving time of the second message.
[0031] Optionally, the method further includes:
[0032] Provide a configuration interface;
[0033] Receive user input on the configuration interface;
[0034] In response to the user input on the configuration interface, obtain wake-up period configuration information;
[0035] Send the wake-up period configuration information to the head-mounted display device, so that the head-mounted display device sets the wake-up period of the first communication module according to the wake-up period configuration information.
[0036] According to the embodiments of the present application, by providing a first communication module, in an area where the wireless network is not covered, the head-mounted display device can establish a communication connection with the server, and thus can send information to the server. Further, the first identification information of the head-mounted display device can be sent to the server through the first communication module, so that the server generates pairing information based on the first identification information of the head-mounted display device and the second identification information of the first handle. After that, when the head-mounted display device is paired with the handle, the identification information of the scanned handle is compared with the pairing information sent by the server. When there is a target identification information in the scanned handle identification information that matches the second identification information in the pairing information, a pairing relationship between the head-mounted display device and the handle corresponding to the target identification information is established. In this way, the problem in the prior art that the head-mounted display device needs to be returned to the factory for pairing settings is solved, and the head-mounted display device and the handle can be quickly paired, making the use more convenient. Moreover, it is not necessary to disclose the pairing algorithm of the head-mounted display device manufacturer, which can improve the security of using the head-mounted display device.
[0037] Other features and advantages of the present invention will become clear through the following detailed description of the exemplary embodiments of the present invention with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS
[0038] In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the accompanying drawings required for use in the embodiments will be briefly introduced below. It should be understood that the following drawings only show some embodiments of the present invention and should not be regarded as limiting the scope. For those of ordinary skill in the art, other related drawings can be obtained based on these drawings without creative efforts.
[0039] Figure 1 is a schematic diagram of the hardware configuration of a display system that can be used to implement the pairing method of an embodiment;
[0040] Figure 2 is a schematic diagram of the structure of a head-mounted display device according to an embodiment;
[0041] Figure 3 is a schematic diagram of the usage state of a head-mounted display device according to an embodiment;
[0042] Figure 4 is a schematic diagram of the structure of a handle according to an embodiment;
[0043] Figure 5 is a schematic flowchart of the pairing method according to an embodiment;
[0044] Figure 6 is a schematic flowchart of the pairing method according to another embodiment;
[0045] Figure 7Schematic diagram of the hardware structure of a head-mounted display device according to an embodiment;
[0046] Figure 8 Schematic diagram of the hardware structure of a server according to another embodiment;
[0047] Figure 9 Schematic diagram of the hardware structure of a display system according to an embodiment. Detailed implementation manners
[0048] Various exemplary embodiments of the present invention will now be described in detail with reference to the accompanying drawings. It should be noted that: unless otherwise specifically stated, the relative arrangements, numerical expressions, and numerical values of the components and steps set forth in these embodiments do not limit the scope of the present invention.
[0049] The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way a limitation on the present invention or its application or use.
[0050] Technologies, methods, and devices known to those of ordinary skill in the relevant art may not be discussed in detail, but where appropriate, such technologies, methods, and devices should be regarded as part of the specification.
[0051] In all the examples shown and discussed herein, any specific values should be construed as merely exemplary and not as a limitation. Thus, other examples of the exemplary embodiments may have different values.
[0052] It should be noted that: like reference numerals and letters denote like items in the following drawings, and thus, once an item is defined in one drawing, it need not be further discussed in subsequent drawings.
[0053] Next, various embodiments and examples according to the present disclosure will be described with reference to the accompanying drawings.
[0054] <Hardware configuration>
[0055] Figure 1 Schematic diagram of the hardware configuration of a display system that can be used to implement a pairing method according to an embodiment.
[0056] As Figure 1 shown, the display system 100 may include a head-mounted display device 1000, a handle 2000, and a server 3000.
[0057] The head-mounted display device 1000 may be, for example, a VR (Virtual Reality) device, an AR (Augmented Reality) device, an MR (Mixed Reality) device, etc., and the embodiments of the present disclosure do not limit this.
[0058] In one embodiment, as Figure 1 shown, the head-mounted display device 1000 may include a processor 1100, a memory 1200, an interface device 1300, a communication device 1400, a display device 1500, an input device 1600, a microphone 1700, and a speaker 1800. The processor 1100 may include, but is not limited to, a central processing unit CPU, a microcontroller unit MCU, etc. The memory 1200 includes, for example, a ROM (read-only memory), a RAM (random access memory), a non-volatile memory such as a hard disk, etc. The interface device 1300 includes, for example, various bus interfaces, such as a serial bus interface (including a USB interface), a parallel bus interface, etc. The communication device 1400 can perform wired or wireless communication, for example. The communication device 1400 may include a narrowband Internet of Things module (Narrow Band Internet of Thing, NBIOT) for establishing periodic communication based on narrowband Internet of Things between the head-mounted display device and the server. The display device 1500 is, for example, a liquid crystal display screen, an LED display screen, a touch display screen, etc. The input device 1600 includes, for example, a touch screen, a keyboard, etc. The microphone 1700 can be used to input voice information. The speaker 1800 can be used to output voice information.
[0059] In this embodiment, the memory 1200 of the head-mounted display device 1000 is used to store instructions for controlling the processor 1100 to operate to implement or support the implementation of the pairing method according to any embodiment. Those skilled in the art can design the instructions according to the solutions disclosed in this specification. How the instructions control the processor to operate is well known in the art, so it will not be described in detail here.
[0060] In one embodiment, as Figure 1 shown, the handle 200 may include a processor 2100, a memory 2200, an interface device 2300, a communication device 2400, an input device 2500, and a sensor 2600. The processor 2100 may include, but is not limited to, a central processing unit CPU, a microcontroller unit MCU, etc. The memory 2200 includes, for example, a ROM (read-only memory), a RAM (random access memory), a non-volatile memory such as a hard disk, etc. The interface device 2300 includes, for example, various bus interfaces, such as a serial bus interface (including a USB interface), a parallel bus interface, etc. The communication device 2400 can perform wired or wireless communication, for example. The communication device 2400 may include a narrowband Internet of Things module (Narrow Band Internet of Thing, NBIOT) for establishing periodic communication based on narrowband Internet of Things between the handle and the server. The input device 2500 includes, for example, a touch screen, etc.
[0061] In this embodiment, the memory 2200 of the handle 2000 is used to store instructions for controlling the processor 2100 to operate so as to implement or support the implementation of the pairing method according to any embodiment. Those skilled in the art can design the instructions according to the solutions disclosed in this specification. How the instructions control the operation of the processor is well known in the art and will not be described in detail herein.
[0062] The server 3000 is a service point that provides processing, database, and communication facilities. The server 3000 can be an integrated server or a distributed server across multiple computers or computer data centers. The server can be of various types, such as, but not limited to, a web server, a news server, a mail server, a messaging server, an advertising server, a file server, an application server, an interactive server, a database server, or a proxy server. In some embodiments, each server can include hardware, software, or an embedded logic component for performing the appropriate functions supported or implemented by the server, or a combination of two or more such components. For example, the server such as a blade server, a cloud server, etc., or can be a server group composed of multiple servers, and can include one or more of the above types of servers, and so on.
[0063] In one embodiment, as Figure 1 shown, the server 3000 can include a processor 3100, a memory 3200, an interface device 3300, a communication device 3400, a display device 3500, and an input device 3600. The processor 3100 can include, but is not limited to, a central processing unit CPU, a microprocessor MCU, etc. The memory 3200 includes, for example, a ROM (read-only memory), a RAM (random access memory), a non-volatile memory such as a hard disk, etc. The interface device 3300 includes, for example, various bus interfaces, such as a serial bus interface (including a USB interface), a parallel bus interface, etc. The communication device 3400 can, for example, perform wired or wireless communication. The display device 3500 is, for example, a liquid crystal display screen, an LED display screen, a touch display screen, etc.
[0064] In this embodiment, the memory 3200 of the server 3000 is used to store instructions for controlling the processor 3100 to operate so as to implement or support the implementation of the pairing method according to any embodiment. Those skilled in the art can design the instructions according to the solutions disclosed in this specification. How the instructions control the operation of the processor is well known in the art and will not be described in detail herein.
[0065] In this embodiment, the head-mounted display device 1000 and the server 3000 can communicate through a narrowband Internet of Things module. The handle 2000 and the server 3000 can communicate through a narrowband Internet of Things module. The head-mounted display device 1000 and the handle 2000 can communicate through other communication modules. Figure 1The shown display system 100 is only explanatory and is by no means intended to limit this specification, its applications or uses.
[0066] Embodiments of the present disclosure provide a pairing method, which is implemented by a head-mounted display device. First, the head-mounted display device for implementing this control method will be introduced below.
[0067] Please refer to Figure 2 and Figure 3 , the head-mounted display device 20 includes a main control module 21, a first communication module 22, and a first control switch 23. The first communication module 22 is communicatively connected to the main control module 21, and the first control switch 23 is connected to the first communication module 22. When the first magnetic member 31 disposed in the handle 30 is within the magnetic field range corresponding to the first communication module 22, the first communication module 22 is awakened to send the first information of the head-mounted display device 20 to the server 40 or / and receive the second information sent by the server 40 through the first communication module 22.
[0068] In this embodiment, the first communication module 22 is used to establish a communication connection between the head-mounted display device 20 and the server. In some embodiments, the first communication module 22 and the main control module 21 are communicatively connected through a serial port. The serial port is an I2C interface, an SPI interface, or a UART interface. The first communication module 22 communicates with the server through the UDP (User Datagram Protocol) protocol.
[0069] In some embodiments, the first communication module 22 may be a Narrow Band Internet of Things (NBIoT) module. The first communication module 22 is used to establish periodic communication between the head-mounted display device 20 and the server based on narrow band Internet of things. Exemplarily, the first communication module 22 includes a narrow band Internet of things chipset 221 and an antenna group 222. In this embodiment, by using the characteristics of wide coverage and low power consumption of the narrow band Internet of things module, the head-mounted display device can establish a communication connection with the server and can reduce the power consumption of the head-mounted display device.
[0070] In this embodiment, the first communication module 22 has multiple wake-up methods.
[0071] Optionally, the first communication module 22 can be woken up regularly according to the wake-up period. The user can set the wake-up period of the first communication module according to actual needs. For example, the wake-up period is 12 hours or 24 hours.
[0072] Optionally, the first communication module can also be actively woken up by other modules or switches. Exemplarily, the first communication module 22 can be woken up by the main control module 21. Exemplarily, the first communication module 22 can be woken up by the first control switch 22.
[0073] In this embodiment, the first control switch 23 is a reed switch, also known as a dry reed tube. This first control switch is an electrical switch that can be operated by an applied magnetic field. When other magnetic components approach the first control switch 23, the external magnetic field generated by the other magnetic components causes the two reed pieces of the reed switch to attract and conduct the circuit. Among them, the other magnetic components can be a permanent magnet or an electromagnetic coil. For example, the other magnetic component is the first magnetic component 31 disposed in the handle 30. More specifically, the first control switch 23 is short-circuited with the wake-up pin of the first communication module 22. When the first magnetic component 31 disposed in the handle 30 is within the magnetic field range corresponding to the first communication module 22, the first control switch 33 is turned on to wake up the first communication module.
[0074] In some embodiments, as Figure 2 shown, the head-mounted display device 20 further includes a positioning module 24, and the positioning module 24 is connected to the main control module 21. The positioning module 24 is configured to collect the first positioning information of the head-mounted display device 20 to facilitate the user to find the head-mounted display device 20. Exemplarily, the positioning module 24 may be a GNSS positioning chip. For example, a GPS positioning chip, a Beidou positioning chip, etc.
[0075] In some embodiments, as Figure 2 shown, the head-mounted display device 20 further includes a battery module 25, and the battery module 25 is connected to the first communication module 22 to supply power to the first communication module 22. Exemplarily, the battery module 25 may be, for example, a 18500 power supply battery.
[0076] In some embodiments, the head-mounted display device 20 further includes a second magnetic component (not shown in the figure), and the second magnetic component is disposed outside the magnetic field range corresponding to the first control switch 23, and the second magnetic component is used to wake up the second communication module 32 of the handle 30.
[0077] Exemplarily, the second magnetic component may be, for example, a permanent magnet.
[0078] In this embodiment, as Figure 4As shown, the handle 30 further includes a second communication module 32 and a second control switch 33. Exemplarily, the second control switch 33 is a reed switch, also known as a dry reed tube. The second control switch 33 is an electrical switch that can be operated by an applied magnetic field. When other magnetic components are close to the second control switch 33, the external magnetic field generated by the other magnetic components causes the two reed pieces of the reed switch to attract and conduct the circuit. Among them, the other magnetic components can be a permanent magnet or an electromagnetic coil. For example, the other magnetic component is a second magnetic component provided in the head-mounted display device. More specifically, the second control switch 33 is short-circuited with the wake-up pin of the second communication module 32. When the first magnetic component provided in the head-mounted display device is within the magnetic field range corresponding to the second communication module 32, the second control switch 33 is turned on to wake up the second communication module.
[0079] In this embodiment, by providing the second magnetic component, the head-mounted display device can also wake up the second communication module of the handle, making it more convenient to use.
[0080] According to an embodiment of the present disclosure, by providing the first communication module, in an area where the wireless network is not covered, the head-mounted display device can establish a communication connection with the server, and then can send information to the server. Further, the first communication module can send the first identification information of the head-mounted display device to the server, so that the server generates pairing information according to the first identification information of the head-mounted display device and the second identification information of the first handle. After that, when the head-mounted display device is paired with the handle, the scanned identification information of the handle is compared with the pairing information sent by the server. When there is a target identification information in the scanned identification information of the handle that matches the second identification information in the pairing information, a pairing relationship between the head-mounted display device and the handle corresponding to the target identification information is established. In this way, the problem that the head-mounted display device needs to be returned to the factory for pairing settings in the prior art is solved, and the head-mounted display device and the handle can be quickly paired, making it more convenient to use. Moreover, the pairing algorithm of the head-mounted display device manufacturer does not need to be disclosed, which can improve the security of using the head-mounted display device.
[0081] Figure 5 The flowchart of the pairing method according to an embodiment of the present disclosure is shown. The pairing method is applied to the head-mounted display device described in the above embodiment. As Figure 5 shown, the pairing method provided in this embodiment may include the following steps S5100 to step S5300.
[0082] Step S5100, send a first message including the first identification information of the head-mounted display device to the server through the first communication module, so that the server generates and sends pairing information to the head-mounted display device according to the first identification information and the second identification information of the first handle when the head-mounted display device and the first handle do not establish a pairing relationship.
[0083] Among them, the pairing information includes first identification information and second identification information.
[0084] In this embodiment, the head-mounted display device can be a device that establishes a communication connection with the server. Based on the communication connection established between the head-mounted display device and the server, a first message is sent to the server. The first message includes at least the first identification information. The first identification information can be the identity information of the head-mounted display device. Exemplarily, the first identification information can be the coding information of the head-mounted display device. For example, the International Mobile Equipment Identity (IMEI) of the head-mounted display device.
[0085] The first handle can be a handle that establishes a communication connection with the server. Based on the communication connection established between the handle and the server, the second identification information is sent to the server. The second identification information can be the identity information of the first handle. Exemplarily, the second identification information can be the coding information of the first handle. For example, the IMEI identification code of the first handle.
[0086] The pairing information includes first identification information and second identification information. Exemplarily, the first identification information of the head-mounted display device and the second identification information of the first handle are written according to the preset format information to obtain the pairing information.
[0087] The first communication module is used to establish a communication connection between the head-mounted display device and the server. Exemplarily, it can be an NBIOT module. The first communication module is used to establish periodic communication between the head-mounted display device and the server based on narrowband Internet of Things. In this embodiment, by utilizing the characteristics of wide coverage and low power consumption of the narrowband Internet of Things module, the head-mounted display device can establish a communication connection with the server and the power consumption of the head-mounted display device can be reduced.
[0088] The server can be a server provided by a communication operator. This server is used to receive the first message including the first identification information and generate the pairing information of the head-mounted display device and the first handle according to the first identification information and the second identification information.
[0089] In this embodiment, the head-mounted display device is usually paired with a handle for use. Based on this, after the head-mounted display device is started, the first communication module of the head-mounted display device establishes a communication connection with the server. Based on the communication connection established between the first communication module and the server, the head-mounted display device sends a first message including first identification information to the server. At the same time, after the first handle is started, the second communication module of the first handle establishes a communication connection with the server. Based on the communication connection established between the second communication module and the server, the first handle sends second identification information. After that, the server determines whether the head-mounted display device and the first handle have established a pairing relationship. In the case where the head-mounted display device and the first handle have not established a pairing relationship, pairing information is generated according to the first identification information and the second identification information, and the pairing information is sent to the head-mounted display device so that the head-mounted display device can be paired and connected with the handle according to the pairing information.
[0090] After step S5100, step S5200 is executed to receive the identification information of the scanned handle and the pairing information sent by the server.
[0091] In this embodiment, the identification information of the scanned handle is used to represent the identity information of the scanned handle. For example, it can be the coding information of the scanned handle. For example, the IMEI identification code of the scanned handle. The scanned handle includes the handle that will be paired with the head-mounted display device. The scanned handle can be one or multiple.
[0092] Step S5300, in the case where there is target identification information in the identification information of the scanned handle that matches the second identification information in the pairing information, establish a pairing relationship between the head-mounted display device and the handle corresponding to the target identification information.
[0093] In this embodiment, in the case where the head-mounted display device receives the pairing information sent by the server through the first communication module, the first communication module sends the pairing information to the main control module, and the main control module writes the pairing information into the pairing information list of the head-mounted display device for pairing and connecting the head-mounted display device and the handle. After that, the head-mounted display device scans the surrounding handles, and compares the identification information of the scanned handles with the pairing information in the pairing information list. In the case where there is target identification information in the identification information of the scanned handles that matches the pairing information in the pairing information list, establish a pairing relationship between the head-mounted display device and the handle corresponding to the target identification information, that is, pair and connect the head-mounted display device with the handle corresponding to the target identification information.
[0094] In one embodiment, after receiving the identified information of the scanned handle, the method further includes: comparing the identified information of the scanned handle with the paired information stored in the head-mounted display device, and establishing a pairing relationship between the head-mounted display device and the handle corresponding to the target identified information when there is a target identified information in the identified information of the scanned handle that matches the stored paired information.
[0095] According to the embodiments of the present application, by providing the first communication module, the head-mounted display device can establish a communication connection with the server in an area where the wireless network is not covered, and thus can send information to the server. Further, the first identification information of the head-mounted display device can be sent to the server through the first communication module, so that the server generates paired information based on the first identification information of the head-mounted display device and the second identification information of the first handle. After that, when the head-mounted display device is paired with the handle, the identified information of the scanned handle is compared with the paired information sent by the server, and a pairing relationship between the head-mounted display device and the handle corresponding to the target identified information is established when there is a target identified information in the identified information of the scanned handle that matches the second identified information in the paired information. In this way, the problem in the prior art that the head-mounted display device needs to be returned to the factory for pairing settings is solved, and the head-mounted display device and the handle can be quickly paired, which is more convenient to use. Moreover, it is not necessary to disclose the pairing algorithm of the head-mounted display device manufacturer, which can improve the security of using the head-mounted display device.
[0096] In one embodiment, the first message further includes the first positioning information of the head-mounted display device, and the method further includes: when the head-mounted display device enables the anti-loss mode, sending the first message to the server through the first communication module, so that other devices can obtain the first positioning information from the server to search for the head-mounted display device according to the first positioning information.
[0097] Among them, the other devices can be mobile phones, tablet computers, laptop computers, wearable devices, etc.
[0098] In specific implementation, the other devices establish a communication connection with the server and query the first positioning information of the head-mounted display device according to the first identification information of the head-mounted display device (for example, IMEI identification code).
[0099] In this embodiment, when the head-mounted display device enables the anti-loss mode, the first communication module regularly sends the first positioning information to the server according to the wake-up period. In this way, when the head-mounted display device is lost, the user can obtain the first positioning information of the head-mounted display device from the server through other devices and search for the head-mounted display device according to the first positioning information.
[0100] In one embodiment, before sending a first message to a server through a first communication module when an anti-loss mode of a head-mounted display device is enabled, the method further includes: receiving a first input from a user; and in response to the first input, enabling the anti-loss mode.
[0101] The first input may be an input for enabling the anti-loss mode. Exemplarily, the first input may be a click input of a user on a target control through a handle, which may be specifically determined according to actual usage requirements, and the embodiments of the present application do not limit this.
[0102] In this embodiment, the user may select to enable the anti-loss mode of the head-mounted display device according to actual needs. While obtaining the first positioning information of the head-mounted display device, the power consumption of the head-mounted display device can be reduced, the usage duration of the head-mounted display device can be extended, and the user experience can be improved.
[0103] In one embodiment, sending a first message including the first identification information of the head-mounted display device to the server through the first communication module may further include: when a preset event is detected, the first communication module enters a wake-up mode to send a first message including the first identification information of the head-mounted display device to the server through the first communication module.
[0104] In this embodiment, the preset event may be an event for waking up the first communication module.
[0105] Exemplarily, the preset event may be that a first magnetic member of an external device is within the magnetic field range corresponding to a first control switch, where the first control switch is connected to the first communication module.
[0106] In this example, the external device may be a handle or other electronic devices. The first control switch may be a reed switch, also known as a dry reed tube. The first control switch is an electrical switch that can be operated by an applied magnetic field. When another magnetic member approaches the first control switch, the external magnetic field generated by the other magnetic member causes the two reed pieces of the reed switch to attract and conduct the circuit. Among them, the other magnetic member may be a permanent magnet or an electromagnetic coil. More specifically, the first control switch is short-circuited with the wake-up pin of the first communication module 22. When the first magnetic member of the external device is within the magnetic field range corresponding to the first communication module, the first control switch conducts, waking up the first communication module.
[0107] Exemplarily, the first communication module receives a wake-up instruction sent by the main control module of the head-mounted display device.
[0108] Exemplarily, the first communication module reaches a preset wake-up time.
[0109] In this example, the first communication module can be woken up regularly according to the wake-up period. The user can set the wake-up period of the first communication module according to actual needs. For example, the wake-up period is 12 hours or 24 hours.
[0110] In this embodiment, the first communication module has multiple wake-up methods. The user can choose any one of the wake-up methods to wake up the first communication module according to actual needs, which is more convenient to use. Furthermore, by setting the first control switch, when the first magnetic member in the external device approaches the first control switch, the first control switch can be turned on, thereby waking up the first communication module. In this way, the first communication module can be quickly woken up, the operation is simple, and the user experience is better.
[0111] In one embodiment, the method further includes: obtaining wake-up period configuration information from the server through the first communication module; setting the wake-up period of the first communication module according to the wake-up period configuration information.
[0112] The wake-up period configuration information can be the configuration information for setting the wake-up period of the first communication module. In specific implementation, the user can set the wake-up period of the first communication module of the head-mounted display device through other devices, that is, the acquisition period of the first positioning information of the head-mounted display device. Based on the communication connection between the other device and the server, the other device sends the wake-up period configuration information of the head-mounted display device to the server. When the head-mounted display device establishes a communication connection with the server through the first communication module, the wake-up period of the first communication module is updated according to the wake-up period configuration information.
[0113] In this embodiment, the user can set the wake-up period of the first communication module according to actual needs. Furthermore, the first communication module can upload the first positioning information of the head-mounted display device according to the wake-up period, which can reduce the power consumption of the head-mounted display device while realizing the anti-loss function of the head-mounted display device.
[0114] In one embodiment, the method further includes: obtaining an encryption instruction from the server through the first communication module, and performing encryption settings on the head-mounted display device according to the encryption instruction. In this way, data leakage in the head-mounted display device can be avoided, and the security of using the head-mounted display device can be improved.
[0115] Figure 6 The flowchart of the pairing method according to an embodiment of the present disclosure is shown. The pairing method is applied to the server. As Figure 6 shown, the pairing method provided in this embodiment may include the following steps S6100 to step S6300.
[0116] Step S6100: Receive a first message sent by the first communication module of the head-mounted display device and a second message sent by the second communication module of the first handle. The first message includes the first identification information and format information of the head-mounted display device, and the second message includes the second identification information of the first handle.
[0117] The first identification information may be the identity information of the head-mounted display device. Exemplarily, the first identification information may be the coding information of the head-mounted display device. For example, the International Mobile Equipment Identity (IMEI) of the head-mounted display device.
[0118] The second identification information may be the identity information of the first handle. Exemplarily, the second identification information may be the coding information of the first handle. For example, the IMEI identification code of the first handle.
[0119] The format information may be the format information of the pairing information.
[0120] Step S6200: In the case where the head-mounted display device and the first handle have not established a pairing relationship, write the first identification information and the second identification information according to the format information to generate pairing information.
[0121] In this embodiment, the head-mounted display device is usually used in pair with the handle. Based on this, after the head-mounted display device is started, the first communication module of the head-mounted display device establishes a communication connection with the server. Based on the communication connection established between the first communication module and the server, the head-mounted display device sends a first message including the first identification information to the server. At the same time, after the first handle is started, the second communication module of the first handle establishes a communication connection with the server. Based on the communication connection established between the second communication module and the server, the first handle sends the second identification information. Then, the server determines whether the head-mounted display device and the first handle have established a pairing relationship. In the case where the head-mounted display device and the first handle have not established a pairing relationship, the server generates pairing information according to the first identification information and the second identification information, and sends the pairing information to the head-mounted display device so that the head-mounted display device performs pairing connection with the handle according to the pairing information.
[0122] In this embodiment, before determining whether the head-mounted display device and the first handle have established a pairing relationship, it is also necessary to determine whether the first handle and the head-mounted display device meet the preset pairing conditions. The pairing conditions may measure whether the distance between the first handle and the head-mounted display device meets the pairing requirements, and whether the usage time of the first handle and the head-mounted display device meets the pairing requirements.
[0123] In one embodiment, the first message further includes first positioning information of the head-mounted display device, and the second message further includes second positioning information of the first handle. When the head-mounted display device and the first handle have not established a pairing relationship, before writing the first identification information and the second identification information according to the format information to generate pairing information, the method further includes: when the time difference between the first time and the second time is less than or equal to a preset time threshold, determining a first distance between the first handle and the head-mounted display device according to the first positioning information and the second positioning information; and when the first distance is less than or equal to a preset distance threshold, determining whether a pairing relationship has been established between the head-mounted display device and the first handle.
[0124] In this embodiment, the preset time threshold is used to measure whether the usage times of the head-mounted display device and the first handle are close, that is, whether the head-mounted display device and the first handle are used at the same time. For example, the preset time threshold is 30s. The first time is the sending time or the receiving time of the first message. The second time is the sending time or the receiving time of the second message. That is, it is possible to determine whether the head-mounted display device and the first handle are used at the same time according to the sending times of the first message and the second message. It is also possible to determine whether the head-mounted display device and the first handle are used at the same time according to the receiving times of the first message and the second message.
[0125] The preset distance threshold is used to measure whether the usage locations of the head-mounted display device and the first handle are close, that is, whether the head-mounted display device and the first handle are used at the same location. For example, the preset distance threshold is 30cm. According to the first distance between the first handle and the head-mounted display device, it is possible to determine whether the head-mounted display device and the first handle are used at the same location.
[0126] Based on this, when the time difference between the first time and the second time is less than or equal to the preset time threshold and the first distance is less than or equal to the preset distance threshold, it indicates that the usage location of the first handle and the head-mounted display device is close and the usage times are close. The first handle is a handle that may be paired and connected to the head-mounted display device. Furthermore, it is determined whether a pairing relationship has been established between the head-mounted display device and the first handle, and when the head-mounted display device and the first handle have not established a pairing relationship, the first identification information and the second identification information are written according to the format information to generate pairing information.
[0127] In this embodiment, before generating the pairing information, it is determined whether the head-mounted display device and the first handle meet the preset pairing conditions, so that when the head-mounted display device and the first handle meet the pairing conditions, the pairing information is generated. In this way, the accuracy of pairing can be provided, the computing amount can be reduced, and the response speed can be improved.
[0128] After step S6200, step S6300 is executed to send the pairing information to the head-mounted display device, so that when there is a target identification information in the identification information of the scanned handle that matches the second identification information in the pairing information, a pairing relationship between the head-mounted display device and the handle corresponding to the target identification information is established.
[0129] In this embodiment, after the pairing information is sent to the head-mounted display device, the head-mounted display device sends the pairing information to the main control module through the first communication module, and the main control module writes the pairing information into the pairing information list of the head-mounted display device for pairing and connecting the head-mounted display device and the handle. Then, the head-mounted display device scans the surrounding handles and compares the identification information of the scanned handles with the pairing information in the pairing information list. When there is a target identification information in the identification information of the scanned handle that matches the pairing information in the pairing information list, a pairing relationship between the head-mounted display device and the handle corresponding to the target identification information is established, that is, the head-mounted display device is paired and connected with the handle corresponding to the target identification information.
[0130] According to the embodiment of the present application, when the server receives the first identification information sent by the head-mounted display device, pairing information is generated according to the first identification information of the head-mounted display device and the second identification information of the first handle, and the pairing information is sent to the head-mounted display device. Then, when the head-mounted display device is paired with the handle, the identification information of the scanned handle is compared with the pairing information sent by the server. When there is a target identification information in the identification information of the scanned handle that matches the second identification information in the pairing information, a pairing relationship between the head-mounted display device and the handle corresponding to the target identification information is established. In this way, the problem that the head-mounted display device needs to be returned to the factory for pairing settings in the prior art is solved, and the quick pairing of the head-mounted display device and the handle can be realized, which is more convenient to use. Moreover, the pairing algorithm of the manufacturer of the head-mounted display device does not need to be disclosed, which can improve the security of using the head-mounted display device.
[0131] In one embodiment, the method further includes: providing a configuration interface; receiving an input from the user to the configuration interface; obtaining wake-up cycle configuration information in response to the input from the user to the configuration interface; and sending the wake-up cycle configuration information to the head-mounted display device, so that the head-mounted display device sets the wake-up cycle of the first communication module according to the wake-up cycle configuration information.
[0132] The wake-up cycle configuration information may be the configuration information for setting the wake-up cycle of the first communication module. In specific implementation, the user may set the wake-up cycle of the first communication module of the head-mounted display device through another device, that is, the acquisition cycle of the first positioning information of the head-mounted display device. Based on the communication connection between the other device and the server, the other device sends the wake-up cycle configuration information of the head-mounted display device to the server. When the head-mounted display device establishes a communication connection with the server through the first communication module, the wake-up cycle of the first communication module is updated according to the wake-up cycle configuration information.
[0133] In this embodiment, the user may set the wake-up cycle of the first communication module according to actual needs. Furthermore, the first communication module may upload the first positioning information of the head-mounted display device according to the wake-up cycle, and while implementing the anti-loss function of the head-mounted display device, the power consumption of the head-mounted display device may be reduced.
[0134] Figure 7 It is a schematic diagram of the hardware structure of a head-mounted display device according to an embodiment. As Figure 7 shown, the head-mounted display device 700 includes a memory 701 and a processor 702. The head-mounted display device 700 further includes a first communication module 703.
[0135] The memory 701 may be used to store executable computer instructions.
[0136] The processor 702 may be used to execute the pairing method according to the method embodiment of the present disclosure under the control of the executable computer instructions.
[0137] The first communication module 703 is used to communicate with the server.
[0138] In one embodiment, the head-mounted display device 700 may be, for example, a VR device, an AR device, an MR device, etc., and the embodiments of the present disclosure do not limit this.
[0139] Figure 8 It is a schematic diagram of the hardware structure of a server according to an embodiment. As Figure 8 shown, the server 800 includes a memory 801 and a processor 802.
[0140] The memory 801 may be used to store executable computer instructions.
[0141] The processor 802 may be used to execute the pairing method according to the method embodiment of the present disclosure under the control of the executable computer instructions.
[0142] Figure 9 It is a schematic diagram of the hardware structure of a display system according to an embodiment. As Figure 9As shown, the display system 900 includes a head-mounted display device 901 and a handle 902.
[0143] Among them, the head-mounted display device 901 can be the head-mounted display device described in any of the foregoing embodiments.
[0144] Embodiments of the present disclosure also provide a computer-readable storage medium, on which computer instructions are stored. When the computer instructions are run by a processor, the pairing method provided by the embodiments of the present disclosure is executed.
[0145] Embodiments of the present disclosure can be a system, a method, and / or a computer program product. The computer program product can include a computer-readable storage medium, on which computer-readable program instructions for causing a processor to implement various aspects of the embodiments of the present disclosure are loaded.
[0146] A computer-readable storage medium can be a tangible device that can hold and store instructions used by an instruction execution device. A computer-readable storage medium can be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples (non-exhaustive list) of a computer-readable storage medium include: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a static random access memory (SRAM), a portable compact disc read-only memory (CD-ROM), a digital versatile disc (DVD), a memory stick, a floppy disk, a mechanical encoding device, such as a punched card or raised structures in grooves storing instructions thereon, and any suitable combination of the foregoing. The computer-readable storage medium used herein is not construed as an instantaneous signal itself, such as a radio wave or other freely propagating electromagnetic wave, an electromagnetic wave propagating through a waveguide or other transmission medium (e.g., an optical pulse through an optical fiber cable), or an electrical signal transmitted through a wire.
[0147] The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to various computing / processing devices, or downloaded to an external computer or external storage device through a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. The network can include a copper transmission cable, an optical fiber transmission, a wireless transmission, a router, a firewall, a switch, a gateway computer, and / or an edge server. A network adapter or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in the computer-readable storage medium in each computing / processing device.
[0148] The computer program instructions for performing the operations of the embodiments of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine - related instructions, microcode, firmware instructions, state - setting data, or source code or object code written in any combination of one or more programming languages, including object - oriented programming languages such as Smalltalk, C++, etc., and conventional procedural programming languages such as the "C" language or similar programming languages. The computer - readable program instructions may be executed entirely on the user's computer, partially on the user's computer, executed as a stand - alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider). In some embodiments, by using the state information of the computer - readable program instructions to customize an electronic circuit, such as a programmable logic circuit, a field - programmable gate array (FPGA), or a programmable logic array (PLA), the electronic circuit can execute the computer - readable program instructions to implement various aspects of the embodiments of the present disclosure.
[0149] Aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present disclosure. It should be understood that each block of the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer - readable program instructions.
[0150] These computer - readable program instructions can be provided to a processor of a general - purpose computer, a special - purpose computer, or other programmable data - processing apparatus to produce a machine such that the instructions, when executed by the processor of the computer or other programmable data - processing apparatus, create a means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer - readable program instructions can also be stored in a computer - readable storage medium, which causes a computer, a programmable data - processing apparatus, and / or other devices to operate in a particular manner. Thus, the computer - readable medium storing the instructions includes a manufacture, which includes instructions for implementing various aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.
[0151] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other devices to produce a computer-implemented process such that the instructions executed on the computer, other programmable data processing apparatus, or other devices implement the functions / acts specified in one or more blocks of the flowchart and / or block diagram.
[0152] The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, a segment of a program, or a portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions noted in the blocks may occur out of the order noted in the figures. For example, two consecutive blocks may in fact be executed substantially in parallel, or they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block of the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented by a dedicated hardware-based system that performs the specified functions or acts, or by a combination of dedicated hardware and computer instructions. It is well known to those skilled in the art that implementation by hardware, implementation by software, and implementation by a combination of software and hardware are equivalent.
[0153] The embodiments of the present disclosure have been described above. The above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and variations will be apparent to those of ordinary skill in the art in the field of the present technology without departing from the scope and spirit of the described embodiments. The selection of the terms used herein is intended to best explain the principles of the embodiments, the practical application, or the improvement of technology in the market, or to enable other ordinary skilled persons in the field of the present technology to understand the embodiments disclosed herein. The scope of the embodiments of the present disclosure is defined by the appended claims.
Claims
1. A pairing method, applied to a head-mounted display device, characterized in that The head-mounted display device includes a first communication module, and the method includes: Sending a first message including first identification information of the head-mounted display device to a server through the first communication module, so that when no pairing relationship is established between the head-mounted display device and a first handle, the server generates and sends pairing information to the head-mounted display device according to the first identification information and second identification information of the first handle, where the pairing information includes the first identification information and the second identification information, and the second identification information is sent by the first handle to the server based on a communication connection established between a second communication module of the first handle and the server; Scanning for surrounding handles, and receiving identification information of the scanned handles and the pairing information sent by the server; When there is target identification information in the identification information of the scanned handle that matches the second identification information in the pairing information, establishing a pairing connection between the head-mounted display device and the handle corresponding to the target identification information.
2. The method according to claim 1, wherein The first message further includes first positioning information of the head-mounted display device, and the method further includes: When the head-mounted display device enables the anti-loss mode, sending the first message to the server through the first communication module, so that other devices obtain the first positioning information from the server to search for the head-mounted display device according to the first positioning information.
3. The method according to claim 2, wherein Before sending the first message to the server through the first communication module when the head-mounted display device enables the anti-loss mode, the method further includes: Receiving a first input from a user; In response to the first input, enabling the anti-loss mode.
4. The method according to claim 1, characterized in that, Sending the first message including the first identification information of the head-mounted display device through the first communication module includes: When a preset event is detected, the first communication module enters a wake-up mode to send a first message including the first identification information of the head-mounted display device to the server through the first communication module; where the preset event includes at least one of the following: A first magnetic member of an external device is within a magnetic field range corresponding to a first control switch, where the first control switch is connected to the first communication module; The first communication module receives a wake-up instruction sent by a main control module of the head-mounted display device; The first communication module reaches a preset wake-up time.
5. The method according to claim 1, wherein The method further includes: Obtaining wake-up cycle configuration information from the server through the first communication module; Setting a wake-up cycle of the first communication module according to the wake-up cycle configuration information.
6. A pairing method, applied to a server, comprising: The method includes: Receiving a first message sent by a first communication module of a head-mounted display device and a second message sent by a second communication module of a first handle, where the first message includes first identification information and format information of the head-mounted display device, and the second message includes second identification information of the first handle; When the head-mounted display device and the first handle are not paired, write the first identification information and the second identification information according to the format information to generate pairing information; Send the pairing information to the head-mounted display device, so that when the head-mounted display device scans the surrounding handles and there is a target identification information in the identification information of the scanned handle that matches the second identification information in the pairing information, establish a pairing connection between the head-mounted display device and the handle corresponding to the target identification information.
7. The method according to claim 6, wherein The first message further includes the first positioning information of the head-mounted display device, and the second message further includes the second positioning information of the first handle; before writing the first identification information and the second identification information according to the format information to generate pairing information when the head-mounted display device and the first handle are not paired, the method further includes: When the time difference between the first time and the second time is less than or equal to a preset time threshold, determine a first distance between the first handle and the head-mounted display device according to the first positioning information and the second positioning information; When the first distance is less than or equal to a preset distance threshold, determine whether a pairing relationship has been established between the head-mounted display device and the first handle; Wherein, the first time is the sending time or the receiving time of the first message; the second time is the sending time or the receiving time of the second message.
8. The method according to claim 6, characterized in that The method further includes: Provide a configuration interface; Receive user input to the configuration interface; In response to the user input to the configuration interface, obtain wake-up cycle configuration information; Send the wake-up cycle configuration information to the head-mounted display device, so that the head-mounted display device sets the wake-up cycle of the first communication module according to the wake-up cycle configuration information.
9. A head-mounted display device, characterized in that, Includes: A memory for storing executable computer instructions; A processor for executing the pairing method according to any one of claims 1-5 under the control of the executable computer instructions.
10. A server, characterized in that, Includes: A memory for storing executable computer instructions; A processor for executing the pairing method according to any one of claims 6-8 under the control of the executable computer instructions.
11. A display system, characterized in that, Includes: The head-mounted display device according to claim 9; A handle.
Citation Information
Patent Citations
Wearable device pairing method and system based on IoT cloud
CN113505157A