Interaction method and apparatus for split type head-mounted device, device and medium

By splitting the smart headset display device into two parts: control device and headset, the problem of increasing weight of the smart headset display device is solved, achieving thinner and better user experience.

WO2025091930A1PCT designated stage expired Publication Date: 2025-05-08GOERTEK INC
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/099752
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-10-30
Filing Date
2024-06-18
Publication Date
2025-05-08

AI Technical Summary

Technical Problem

The smart head-mounted display device integrates a large number of data computing units, which increases weight, affects the user experience.

Method used

The intelligent headset display device is divided into two parts: control device and headset. Through the communication connection between the control device and the headset, the interactive function is realized and the number of data calculation units on the headset is reduced.

Benefits of technology

Through the split design, the weight of the headset is reduced, the lightness and thinness of the smart headset display device is realized, and the user experience is improved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024099752_08052025_PF_FP_ABST
    Figure CN2024099752_08052025_PF_FP_ABST
Patent Text Reader

Abstract

An interaction method and apparatus for a split type head-mounted device, a device and a medium, relating to the field of head-mounted technologies. The split type head-mounted device comprises a control device and at least one head-mounted display. The method is applied to any head-mounted display, and comprises: receiving first demand information input by a wearer of the head-mounted display (S1100); according to the first demand information and a device identifier of the head-mounted display, generating second demand information (S1200); on the basis of a communication connection between a control device and the head-mounted display, sending the second demand information to the control device (S1300); on the basis of the communication connection, receiving output content information sent by the control device on the basis of the second demand information; and outputting the output content information (S1400). The head-mounted display does not need to be provided with a large number of data computing units, thus greatly reducing the weight of the head-mounted display, and achieving a thin and lightweight design.
Need to check novelty before this filing date? Find Prior Art

Description

Interaction method, device, equipment and medium for split head-mounted device

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on October 30, 2023, with application number 202311419505.7 and invention name “Interaction method, device, equipment and medium for split-type head-mounted device”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present invention relates to the field of head-mounted technology, and more specifically, to an interaction method for a split head-mounted device, an interaction device for a split head-mounted device, a head display, a control device, a split head-mounted device, and a computer-readable storage medium. Background Art

[0003] With the development of science and technology and economy, smart head-mounted display devices (such as AR glasses) have been increasingly widely used.

[0004] At present, in order to realize functions such as display, smart head-mounted display devices integrate a large number of data computing units, which greatly increases the weight of the smart head-mounted display devices.

[0005] When using a smart head-mounted display device, the user needs to wear the smart head-mounted display device on the head. Therefore, in order to improve the user experience, how to make the smart head-mounted display device lighter and thinner has become a technical problem that needs to be solved urgently.

[0006] Summary of the Invention

[0007] An object of the present invention is to provide a new technical solution for interaction of a split-type head-mounted device.

[0008] According to a first aspect of the present invention, there is provided an interaction method for a split-type head-mounted device, the split-type head-mounted device comprising a control device and at least one head-mounted display (HMD). The method is applied to any of the HMDs and comprises:

[0009] receiving first demand information input by a wearer of the head display;

[0010] Generate second demand information according to the first demand information and the device identifier of the head display;

[0011] Sending the second demand information to the control device based on the communication connection between the control device and the head display;

[0012] receiving, based on the communication connection, output content information sent by the control device based on the second demand information;

[0013] The output content information is output.

[0014] Optionally, before sending the second requirement information to the control device based on the communication connection between the control device and the head display, the method further includes:

[0015] Performing an encryption operation on the second requirement information according to the first pre-encryption rule to obtain encrypted requirement information;

[0016] The second requirement information is updated to the encryption requirement information.

[0017] Optionally, the outputting the output content information includes:

[0018] performing a decryption operation on the output content information according to a first preset decryption rule to obtain decrypted output content information;

[0019] Outputting the decrypted output content information;

[0020] The first preset decryption rule corresponds to a second preset encryption rule, and the second preset encryption rule is an encryption rule corresponding to the output content information.

[0021] Optionally, the second demand information is conversation-type demand information, and the outputting the output content information includes:

[0022] Playing the voice corresponding to the output content information;

[0023] And, displaying the text corresponding to the output content information.

[0024] According to a second aspect of the present invention, there is provided an interaction method for a split-type head-mounted device, the split-type head-mounted device comprising a control device and at least one head-mounted display. The method is applied to the control device and comprises:

[0025] For any of the head-mounted displays, receiving second demand information sent by the head-mounted display based on the communication connection between the control device and the head-mounted display;

[0026] Determine output content information according to the second requirement information, where the output content information carries a device identifier of the head display;

[0027] determining, according to the device identifier of the head display in the output content information, a communication connection identifier for the communication connection between the head display and the control device;

[0028] The output content information is sent to the head display via the communication connection corresponding to the communication connection identifier.

[0029] Optionally, before determining the output content information according to the second requirement information, the method further includes:

[0030] When the second requirement information is received for the first time, recording a correspondence between the communication connection identifier corresponding to the communication connection and the device identifier of the head display included in the second requirement information to form an identifier mapping relationship;

[0031] The determining, based on the device identifier of the head display in the output content information, a communication connection identifier for the communication connection between the head display and the control device, includes:

[0032] According to the device identifier of the head display in the output content information, a communication connection identifier that matches the device identifier is searched from the identifier mapping relationship.

[0033] Optionally, determining output content information according to the second requirement information includes:

[0034] Performing a decryption operation on the second requirement information according to a second preset decryption rule to obtain decryption requirement information;

[0035] Determining output content information according to the decryption requirement information;

[0036] The second preset decryption rule corresponds to the first preset encryption rule, and the first preset encryption rule is the encryption rule corresponding to the second requirement information.

[0037] Optionally, before sending the output content information to the head-mounted display through the communication connection corresponding to the communication connection identifier, the method further includes:

[0038] Encrypting the output content information according to a second preset encryption rule to obtain encrypted output content information;

[0039] The output content information is updated to the encrypted output content information.

[0040] Optionally, determining output content information according to the second requirement information includes:

[0041] extracting keyword information from the second demand information;

[0042] determining a target application based on the keyword information;

[0043] Output content information is obtained according to the second requirement information and the target application.

[0044] Optionally, the second demand information is conversation-type demand information, and determining output content information according to the second demand information includes:

[0045] The output content information is determined according to the second demand information and the dialog class mapping relationship.

[0046] According to a third aspect of the present invention, an interactive device for a split-type head-mounted device is provided. The split-type head-mounted device includes a control device and a head-mounted display (HMD). The device is applied to the HMD and includes:

[0047] A first receiving module, configured to receive first demand information input by a wearer of the head display;

[0048] a generating module, configured to generate second demand information according to the first demand information and the device identifier of the head display;

[0049] A first sending module, configured to send the second demand information to the control device based on the communication connection between the control device and the head display;

[0050] a second receiving module, configured to receive, based on the communication connection, output content information sent by the control device based on the second requirement information;

[0051] An output module is used to output the output content information.

[0052] According to a fourth aspect of the present invention, an interactive device for a one-piece head-mounted device is provided, wherein the two-piece head-mounted device includes a control device and a head-mounted display. The device is applied to the control device and includes:

[0053] A third receiving module is configured to receive, for any of the head-mounted display, second demand information sent by the head-mounted display based on the communication connection between the control device and the head-mounted display;

[0054] A first determining module is configured to determine output content information according to the second requirement information, wherein the output content information carries a device identifier of the head display;

[0055] a second determining module, configured to determine a communication connection identifier for the communication connection between the head display and the control device according to the device identifier of the head display in the output content information;

[0056] A second sending module is configured to send the output content information to the head display through a communication connection corresponding to the communication connection identifier.

[0057] According to a fifth aspect of the present invention, there is provided a head-mounted display, comprising the interactive device of the split head-mounted device according to the third aspect;

[0058] Alternatively, the head display includes a first memory and a first processor, the first memory is used to store computer instructions, and the first processor is used to call the computer instructions from the first memory to execute the interaction method of the split head-mounted device as described in any one of the first aspects.

[0059] According to a sixth aspect of the present invention, there is provided a control device, the control device comprising the interaction device of the split-type head-mounted device according to the fourth aspect;

[0060] Alternatively, the control device includes a second memory and a second processor, the second memory is used to store computer instructions, and the second processor is used to call the computer instructions from the second memory to execute the interaction method of the split head-mounted device as described in any one of the second aspects.

[0061] According to a seventh aspect of the present invention, a split head-mounted device is provided, comprising the head display as described in the fifth aspect and the control device as described in the sixth aspect.

[0062] According to an eighth aspect of the present invention, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the computer program implements the interaction method of the split head-mounted device according to any one of the first aspect or the second aspect.

[0063] An embodiment of the present invention provides an interaction method for a split-type head-mounted display. The split-type head-mounted display includes a control device and at least one head-mounted display (HMD). The method is applicable to any HMD and includes: receiving first demand information input by a wearer of the HMD; generating second demand information based on the first demand information and a device identifier of the HMD; sending the second demand information to the control device based on a communication connection between the control device and the HMD; receiving output content information sent by the control device based on the second demand information based on the communication connection; and outputting the output content information. In this embodiment of the present invention, a conventional smart head-mounted display device is split into two parts: a control device for data processing and a HMD for display and wearer interaction. By employing the interaction method for a split-type head-mounted display provided by this embodiment of the present invention, the control device and HMD can interact to realize the functions of a conventional smart head-mounted display device. It can be understood that because the control device for data processing and the HMD for display and wearer interaction are separately provided, the HMD does not need to be equipped with a large number of data computing units, thereby significantly reducing the weight of the HMD and achieving a lightweight and thin design.

[0064] Further features and advantages of the present invention will become apparent from the following detailed description of exemplary embodiments of the present invention with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0065] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the structures shown in these drawings without paying any creative work.

[0066] FIG1 is a flowchart of a method for interacting with a head-mounted device provided by an embodiment of the present invention;

[0067] FIG2 is a second flow chart of an interaction method for a split head-mounted device provided by an embodiment of the present invention;

[0068] FIG3 is a third flow chart of a method for interacting with a head-mounted device provided by an embodiment of the present invention;

[0069] FIG4 is a schematic diagram of an implementation architecture of an interaction method for a split head-mounted device provided by an embodiment of the present invention;

[0070] FIG5 is a first structural diagram of an interactive device provided by an embodiment of the present invention, which is a separate head-mounted device;

[0071] FIG6 is a second structural diagram of an interactive device provided by an embodiment of the present invention, wherein the separate body is a head-mounted device;

[0072] FIG7 is a schematic structural diagram of a head-mounted display provided by an embodiment of the present invention;

[0073] FIG8 is a schematic structural diagram of a control device provided by an embodiment of the present invention.

[0074] The purpose, features and advantages of the present invention will be further described with reference to the accompanying drawings and in conjunction with the embodiments. DETAILED DESCRIPTION

[0075] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present invention without making any creative efforts shall fall within the scope of protection of the present invention.

[0076] It should be noted that if the embodiments of the present invention involve directional indications (such as up, down, left, right, front, back, etc.), the directional indications are only used to explain the relative position relationship, movement status, etc. between the various components under a certain specific posture (as shown in the accompanying drawings). If the specific posture changes, the directional indications will also change accordingly.

[0077] In addition, if there are descriptions involving "first", "second", etc. in the embodiments of the present invention, the descriptions of "first", "second", etc. are only for descriptive purposes and cannot be understood as indicating or suggesting their relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of such features. In addition, the meaning of "and / or" appearing throughout the text includes three parallel schemes. Taking "A and / or B" as an example, it includes scheme A, or scheme B, or a scheme in which A and B are satisfied at the same time. In addition, the technical solutions between the various embodiments can be combined with each other, but it must be based on the ability of ordinary technicians in this field to implement. When the combination of technical solutions is mutually contradictory or cannot be implemented, it should be deemed that such a combination of technical solutions does not exist and is not within the scope of protection required by the present invention.

[0078] An embodiment of the present invention provides an interaction method for a split-type head-mounted device. The split-type head-mounted device includes a control device and at least one head-mounted display (HMD). This means that the control device and the HMD are not in a one-to-one correspondence. For example, one control device may correspond to three HMDs.

[0079] Among them, the head display can be exemplified by AR, MR, VR or XR glasses or helmets.

[0080] The control device is specifically the data processing unit of the headset, also known as the computing unit. The control device is a device with an operating system. This operating system can be Android, iOS, or other possible operating systems, which are not specifically limited in this embodiment of the present invention. Furthermore, the control device can be a cloud server or a terminal device.

[0081] An embodiment of the present invention provides an interaction method for a split-type head-mounted device, which is applicable to any head-mounted display. As shown in FIG1 , the method includes the following steps S1100 to S1500 .

[0082] S1100: Receive first demand information input by a wearer of a head display.

[0083] In an embodiment of the present invention, the first demand information is information indicating to the wearer the content that the head display needs to output.

[0084] The first demand information can be audio input by the wearer or text input by the wearer. It should be noted that the embodiment of the present invention is not limited to the embodiment of the first demand information.

[0085] In one example, the first demand information may be an audio input of “Navigate to City A” by the wearer.

[0086] In one embodiment of the present invention, in order to avoid the problem of inaccurate recognition of the received first demand information by the head display, the split head-mounted device interaction method provided in the embodiment of the present invention also includes: displaying the first demand information, such as displaying the text "Navigate to City A", for the wearer to preview and / or confirm.

[0087] Based on the above content, in one embodiment of the present invention, when the wearer confirms that the first requirement information is correct, for example, the wearer touches a display button on the head display, the head display then executes the following S1200.

[0088] S1200: Generate second demand information according to the first demand information and the device identifier of the head display.

[0089] In the embodiment of the present invention, the device identification of the head-mounted display is used to uniquely identify the head-mounted display. That is, the unique head-mounted display can be located through the device identification.

[0090] The specific implementation of the above S1200 may be: converting the first requirement information into a character string that can be recognized by the control device, and adding a device identifier to the converted character string.

[0091] Continuing with the example of the first demand information being the audio input of "Navigate to City A" by the wearer, the second demand information obtained based on the above S1200 is specifically: Navigation_To_A_DeviceID, where DeviceID is the device identifier of the head display.

[0092] S1300: Send second demand information to the control device based on the communication connection between the control device and the head display.

[0093] In embodiments of the present invention, a communication connection between the control device and the head-mounted display can be established using a wired or wireless method. The wired method may be a USB connection, and the wireless method may be a WiFi, TCP persistent connection, or UDP short connection. If the control device is a cloud server, the communication connection between the control device and the head-mounted display is typically established using a TCP persistent connection or a UDP short connection.

[0094] Taking a split-type head-mounted device comprising HMD 1, HMD 2, and HMD 3 as an example, when the control device establishes a connection with the HMDs, communication connection 1 is established between the control device and HMD 1, communication connection 2 is established between the control device and HMD 2, and communication connection 3 is established between the control device and HMD 3. Simultaneously, the control device assigns communication connection identifier 1 to communication connection 1, communication connection identifier 2 to communication connection 2, and communication connection identifier 3 to communication connection 3. Based on this, HMD 1 initially sends data carrying its device identifier to the control device via communication connection 1. After initially receiving data sent by HMD 1 via communication connection 1, the control device records the mapping between the HMD's device identifier and communication connection identifier 1 of communication connection 1. When subsequently sending data to HMD 1, the control device determines, based on this mapping, that HMD 1's device identifier corresponds to communication connection identifier 1. Furthermore, data is sent to HMD 1 based on this determined communication connection identifier 1. Similarly, the data exchange between HMD 2 and HMD 3 and the control device is similar.

[0095] In one embodiment of the present invention, when the head display and the control device establish a communication connection using a TCP persistent connection, the communication connection identifier may specifically be a SocketID.

[0096] It should be noted that, when the headset is not sending data to the control device for the first time, that is, when the control device is not receiving data sent by the headset for the first time, the control device may no longer record the mapping relationship between the device identifier and the communication connection identifier, and directly use the mapping relationship between the device identifier and the communication connection identifier 1 recorded when the data sent by the headset is received for the first time.

[0097] Based on the above S1300, the control device can receive the second demand information sent by any head-mounted display. When the control device receives the second demand information, it responds to the second demand information, obtains output content information, and sends the output content information to the head-mounted display based on the communication connection between the control device and the head-mounted display for display by the head-mounted display. Specifically: based on the communication connection between the control device and the head-mounted display, the second demand information sent by the head-mounted display is received; based on the second demand information, the output content information is determined, and the output content information carries the device identifier of the head-mounted display; based on the device identifier of the head-mounted display in the output content information, the communication connection identifier of the communication connection between the head-mounted display and the control device is determined; and the output content information is sent to the head-mounted display via the communication connection corresponding to the communication connection identifier.

[0098] Continuing with the example of the first demand information being the audio of "Navigate to City A" input by the wearer, the output content information may be specifically: 1000km_12h_13service_DeviceID, or Navigation_To_A_1000km_12h_13service_DeviceID.

[0099] S1400: Receive output content information sent by a control device based on second demand information based on a communication connection.

[0100] S1500: Output content information.

[0101] In the embodiment of the present invention, the output content information is response information to the wearer's first demand information.

[0102] Based on the above S1100-S1500, the head display can output output content information that meets the wearer's first requirement information. This means that in the embodiment of the present invention, the traditional intelligent head-mounted display device is split into two parts: a control device for data processing and a head display for displaying and interacting with the wearer. In addition, the interaction method of the split head-mounted device provided by the embodiment of the present invention is adopted, and the control device interacts with the head display to realize the functions of the traditional intelligent head-mounted display device. Based on this, it can be understood that since the control device for data processing and the head display for displaying and interacting with the wearer are set separately, there is no need to set up a large number of data calculation units on the head display, so the weight of the head display is greatly reduced, and it can be made lighter and thinner.

[0103] An embodiment of the present invention provides an interaction method for a split-type head-mounted display. The split-type head-mounted display includes a control device and at least one head-mounted display (HMD). The method is applicable to any HMD and includes: receiving first demand information input by a wearer of the HMD; generating second demand information based on the first demand information and a device identifier of the HMD; sending the second demand information to the control device based on a communication connection between the control device and the HMD; receiving output content information sent by the control device based on the second demand information based on the communication connection; and outputting the output content information. In this embodiment of the present invention, a conventional smart head-mounted display device is split into two parts: a control device for data processing and a HMD for display and wearer interaction. By employing the interaction method for a split-type head-mounted display provided by this embodiment of the present invention, the control device and HMD can interact to realize the functions of a conventional smart head-mounted display device. It can be understood that because the control device for data processing and the HMD for display and wearer interaction are separately provided, the HMD does not need to be equipped with a large number of data computing units, thereby significantly reducing the weight of the HMD and achieving a lightweight and thin design.

[0104] In one embodiment of the present invention, the interaction method of the split head-mounted device provided by the embodiment of the present invention further includes the following S1600 and S1700 before the above S1300.

[0105] S1600: Perform an encryption operation on the second demand information according to a first preset encryption rule to obtain encrypted demand information.

[0106] S1700: Update the second requirement information to encryption requirement information.

[0107] The first preset encryption rule is an encryption rule agreed upon by the head display and the control device. The first preset encryption rules of different head displays can be the same or different.

[0108] In one example, the first preset encryption rule may specifically be a symmetric encryption algorithm or an asymmetric encryption algorithm. The symmetric encryption algorithm may exemplarily be any one of the DES algorithm, the 3DES algorithm, and the AES algorithm, and the asymmetric encryption algorithm may exemplarily be any one of the RSA algorithm, the Elgamal algorithm, and the ECC algorithm.

[0109] It should be noted that this embodiment does not limit the specific form of the first preset encryption rule.

[0110] In the embodiment of the present invention, in order to ensure data security, the second demand information is encrypted to obtain encrypted demand information. Further, the second demand information is updated to the encrypted demand information. That is, in this embodiment, the second demand information is an encrypted information.

[0111] It is understood that in order for the control device to recognize the second demand information encrypted according to the first encryption rule, the control device has a decryption rule that matches the first preset encryption rule. In this embodiment of the present invention, the decryption rule that matches the first preset encryption rule provided by the control device is referred to as the second preset decryption rule. The control device decrypts the second demand information using the second preset decryption rule.

[0112] In the embodiment of the present invention, the second requirement information can be encrypted through the above S1600 and S1700, which reduces the risk of the second requirement information being tampered with during the process of sending it to the control device and improves the security of the second requirement information.

[0113] In one embodiment of the present invention, to enhance the security of the output content information during transmission to the head-mounted display, the control device encrypts the output content information, thereby obtaining encrypted output content information. Furthermore, the control device updates the output content information to the encrypted output content information before transmitting it to the head-mounted display. In this case, the aforementioned S1500 can be implemented via the following S1510 and S1511.

[0114] S1510: Perform a decryption operation on the output content information according to a first preset decryption rule to obtain decrypted output content information.

[0115] S1511. Output encrypted output content information.

[0116] The first preset decryption rule corresponds to the second preset encryption rule, and the second preset encryption rule is an encryption rule corresponding to the output content information.

[0117] In an embodiment of the present invention, the control device encrypts the output content information using a second preset encryption rule. The first preset decryption rule is a decryption rule agreed upon by the head display and the control device, and can decrypt data encrypted using the second preset encryption rule.

[0118] In one embodiment of the present invention, when the second demand information is second conversation type demand information, the above S1500 may also be implemented through the following S1520 and S1521.

[0119] S1520: Play the voice corresponding to the output content.

[0120] And, S1521, display the text corresponding to the output content.

[0121] For example, if the output content is "Navigation_To_A_1000km_12h_13service_DeviceID," the voice message outputted by step S1520 is a preset voice message playing the phrase "It takes 12 hours to reach City A, the route is 1000km, and there are 13 service areas along the way." The text displayed by step S1521 is also a specific text message: "It takes 12 hours to reach City A, the route is 1000km, and there are 13 service areas along the way."

[0122] In this example of the present invention, for the second demand information of the dialogue type, the head display can display two different types of output content information, so that the wearer can obtain the output content information as the response information of the wearer's first demand information in a multi-dimensional manner.

[0123] In another embodiment of the present invention, when the second demand information is audio and video demand information, the specific implementation of the above S1500 may be: playing the audio and video content corresponding to the output content information.

[0124] Corresponding to the above-mentioned interaction method of the split head-mounted device applied to the head display, as shown in FIG2 , the interaction method of the split head-mounted device applied to the control device provided by the embodiment of the present invention includes the following S2100-S2400.

[0125] S2100: For any head-mounted display, based on the communication connection between the control device and the head-mounted display, receive second demand information sent by the head-mounted display.

[0126] S2200: Determine output content information of the device identifier carrying the head display according to the second requirement information.

[0127] In an embodiment of the present invention, the output content information includes a device identifier of a head display, so that the control device can identify to which head display the output content information needs to be sent.

[0128] In one embodiment of the present invention, determining the output content information according to the second requirement information in the above S2200 can be specifically implemented through the following S2210-S2212.

[0129] S2210: Extract keyword information from the second demand information.

[0130] In an embodiment of the present invention, keyword information is used to locate a desired application and to control the running of multiple applications on a device.

[0131] S2211. Determine the target application based on the keyword information.

[0132] In the embodiment of the present invention, the application located by the keyword information extracted from the second demand information is recorded as the target program.

[0133] Taking the second requirement information as Navigation_To_A_DeviceID as an example, the keyword information extracted based on the above S2210 is Navigation. Furthermore, the target application determined based on the above S2211 is a navigation application.

[0134] S2212: Obtain output content information according to the second requirement information and the target application.

[0135] In an embodiment of the present invention, the specific implementation of the above S2212 is: the second requirement is newly input into the target application; the target application extracts valid parameters from the second requirement information and calls the third-party SDK; records the return value of the third-party navigation SDK; the application generates output content information based on the return value of the third-party SDK.

[0136] Taking the second demand information as Navigation_To_A_DeviceID as an example, the specific implementation of the above S2212 is: input the second demand information into the navigation application; the navigation application extracts A from the second demand information, inputs A as a valid parameter, and calls the third-party navigation SDK; the third-party navigation SDK returns 1000km_12h_13service to the navigation application; the navigation application generates the output content information of Navigation_To_Beijing_1000km_12h_13service_DeviceID based on 1000km_12h_13service and the device identifier DeviceID of the headset in the second demand information.

[0137] In one embodiment of the present invention, when the second demand information is conversation-type demand information, determining the output content information according to the second demand information in S2200 can be specifically implemented by the following S2220.

[0138] S2220: Determine output content information according to the second demand information and the dialog class mapping relationship.

[0139] In an embodiment of the present invention, the dialog class mapping relationship is used to reflect the corresponding relationship between the input dialog and the response. In one example, the dialog class mapping relationship can be a neural network model, such as ChatGpt.

[0140] Through the above-mentioned S2200, there is no need to run a large number of applications in the control device, nor is there any need to pre-install a large number of third-party SDKs corresponding to the applications. The "required routing" can be completed only through the learning ability of the dialogue class mapping relationship.

[0141] In one embodiment of the present invention, when the second requirement information is information encrypted using the first preset encryption rule, the above S2200 is specifically implemented through the following S2230 and S2231.

[0142] S2230: Perform a decryption operation on the second requirement information according to the second preset decryption rule to obtain decryption requirement information.

[0143] S2231. Determine output content based on decryption requirement information.

[0144] The second preset decryption rule corresponds to the first preset encryption rule, and the first preset encryption rule is the encryption rule corresponding to the second requirement information.

[0145] It should be noted that the second preset decryption rule in the above S2230 can be found in the relevant description of the embodiments shown in the above S1600 and S1700, and will not be repeated here.

[0146] S2300: Determine a communication connection identifier for the communication connection between the head display and the control device according to the device identifier of the head display in the output content information.

[0147] In an embodiment of the present invention, mapping data exists between the device identifier of the head-mounted display and the communication connection identifier of the communication connection between the head-mounted display and the control device. The control device searches for a matching communication connection identifier from the mapping data based on the device identifier of the head-mounted display.

[0148] After finding a matching communication connection identifier, the control device can determine which communication connection to use to send the output content information to the correct head display.

[0149] In one embodiment of the present invention, the control device may record the mapping relationship between the device identifier and the communication connection identifier according to the following S2310.

[0150] S2310. When the second requirement information is received for the first time, record the correspondence between the communication connection identifier corresponding to the communication connection and the device identifier of the head display included in the second requirement information to form an identifier mapping relationship.

[0151] Based on the above S2310, the problem of the control device repeatedly recording the correspondence between the communication connection identifier corresponding to the communication connection and the device identifier of the head display included in the second demand information each time the control device receives the second demand information can be avoided, which can reduce the computing overhead of the control device.

[0152] On the basis of the above S2310, the specific implementation of the above S2300 is: according to the device identifier of the head display in the output content information, searching the communication connection identifier corresponding to the device identifier from the identifier mapping relationship.

[0153] S2400: Send the output content information to the head-mounted display through the communication connection corresponding to the communication connection identifier.

[0154] In an embodiment of the present invention, after determining the communication connection identifier based on the above S2300, the control device searches for the communication connection corresponding to the communication connection identifier and sends the output content information to the correct head display.

[0155] Based on S2400 above, after receiving the output content information, the head-mounted display may check the device identifier in the output content information to determine whether the output content information belongs to itself. If so, the head-mounted display outputs the content. If not, the head-mounted display discards the content.

[0156] In one embodiment of the present invention, in order to prevent the output content information from being tampered with when the control device sends the output content information to the head display, the interaction method of the split head-mounted device provided by the embodiment of the present invention further includes the following S2410 and S2411 before the above S2400.

[0157] S2410: Encrypt the output content information according to a second preset encryption rule to obtain encrypted output content information.

[0158] S2411. Update the output content information to encrypted output content information.

[0159] In an embodiment of the present invention, the second preset encryption rule is an encryption rule agreed upon by the control device and the head display. The second preset encryption rules corresponding to different head displays can be the same or different.

[0160] In one example, the second preset encryption rule may specifically be a symmetric encryption algorithm or an asymmetric encryption algorithm. The symmetric encryption algorithm may exemplarily be any one of the DES algorithm, the 3DES algorithm, and the AES algorithm, and the asymmetric encryption algorithm may exemplarily be any one of the RSA algorithm, the Elgamal algorithm, and the ECC algorithm.

[0161] It should be noted that this embodiment does not limit the specific form of the second preset encryption rule. The output content information is specifically an encrypted information.

[0162] It is understood that in order for the HMD to recognize the output content information encrypted according to the second encryption rule, the HMD has a decryption rule that matches the second preset encryption rule. In this embodiment of the present invention, the decryption rule that matches the second preset encryption rule provided by the HMD is referred to as the first decryption rule. The HMD decrypts the output content information using the first decryption rule.

[0163] In an embodiment of the present invention, through the above-mentioned S2410 and S2411, the risk of the output content information being tampered with during the process of being sent to the head display can be reduced, and the security of the output content information can be improved.

[0164] An embodiment of the present invention provides an interaction method for a split-type head-mounted display. The split-type head-mounted display includes a control device and at least one head-mounted display (HMD). The method, applied to the control device, comprises: for any HMD, based on a communication connection between the control device and the HMD, receiving second demand information sent by the HMD; determining output content information based on the second demand information, wherein the output content information carries the device identifier of the HMD; determining a communication connection identifier for the communication connection between the HMD and the control device based on the device identifier of the HMD in the output content information; and transmitting the output content information to the HMD via a communication connection corresponding to the communication connection identifier. In this embodiment of the present invention, a conventional smart head-mounted display device is split into a control device for data processing and a HMD for display and wearer interaction. By employing the interaction method for a split-type head-mounted display provided by this embodiment of the present invention, the control device and HMD can interact to implement the functions of a conventional smart head-mounted display device. As can be understood, since the control device for data processing and the HMD for display and wearer interaction are separately provided, the HMD does not need to be equipped with a large number of data computing units, thereby significantly reducing the weight of the HMD, thereby achieving a lightweight and thin design.

[0165] In combination with the above embodiment, as shown in FIG3 , the interaction method of the split head-mounted device provided in the embodiment of the present invention may specifically include the following S3001 - S3015.

[0166] S3001: The head display receives first demand information input by a wearer of the head display.

[0167] S3002: The head display generates second demand information based on the first demand information and the device identifier of the head display.

[0168] S3003. The head display performs an encryption operation on the second requirement information according to the first pre-encryption rule to obtain encrypted requirement information.

[0169] S3004: The head display updates the second requirement information to encrypted requirement information.

[0170] S3005. The head display sends second demand information to the control device based on the communication connection between the control device and the head display.

[0171] S3006. The control device receives the second demand information sent by the head display based on the communication connection between the control device and the head display.

[0172] S3007: The control device performs a decryption operation on the second requirement information according to a second preset decryption rule to obtain decryption requirement information.

[0173] S3008. The control device determines output content information based on the decryption requirement information.

[0174] S3009: The control device determines a communication connection identifier for the communication connection between the head display and the control device according to the device identifier of the head display in the output content information.

[0175] S3010: The control device encrypts the output content information according to a second preset encryption rule to obtain encrypted output content information.

[0176] S3011. The control device updates the output content information to encrypted output content information.

[0177] S3012. The control device sends the output content information to the head display through the communication connection corresponding to the communication connection identifier.

[0178] S3013. The head display receives, based on the communication connection, output content information sent by the control device based on the second demand information.

[0179] S3014: The head display performs a decryption operation on the output content information according to the first preset decryption rule to obtain decrypted output content information.

[0180] S3015. The head display outputs the decrypted output content information.

[0181] In combination with the above embodiments, in an example of the present invention, the head-mounted display is AR glasses 1, the first demand information is the audio input of "navigate to City A" by the wearer, and the head-mounted display and the control device are connected by a TCP long connection. The specific implementation process of the interaction method of the split head-mounted device provided by the embodiment of the present invention can be shown in Figure 4. Specifically:

[0182] The AR glasses 1 are divided into the following functions: business module, sound module, conversion module, and communication module.

[0183] The control device is divided into the following functional parts: a communication module, a device management module, a service distribution engine, at least one application, and an SDK module. It should be noted that FIG4 shows an example in which the applications are: a navigation app, a translation app, and ChatGpt, and the SDK modules include a navigation SDK and a translation SDK.

[0184] The sound module on the AR glasses 1 side collects the audio of "navigate to City A" input by the wearer as the first demand information, and inputs it to the conversion module.

[0185] The conversion module converts the first request information into the string "Navigation_To_A" and inputs this string into the service module for preview by the wearer. Furthermore, the conversion module adds the headset's device identifier, DeviceID, to the string "Navigation_To_A" to obtain the second request information, "Navigation_To_A_DeviceID." Furthermore, the conversion module inputs the second request information into the communication module.

[0186] The communication module encrypts the second demand information to obtain encrypted demand information, updates the second demand information to the encrypted demand information, and further sends the updated second demand information to the control device via a communication connection method corresponding to the TCP long connection.

[0187] The communication module of the control device receives the second demand information sent by the head-mounted display, decrypts the second demand information to obtain decrypted demand information, and updates the second demand information to the decrypted demand information. The communication module of the control device then forwards the second demand information to the device management module and the service distribution engine.

[0188] The device management module records the device identifier included in the second requirement information and the communication connection identifier of the communication connection for transmitting the second requirement information to form an identifier mapping relationship.

[0189] The service distribution engine extracts keyword information from the second demand information to obtain Navigation, determines the target application to be a navigation APP based on the Navigation, and then sends the second demand information to the navigation APP.

[0190] The navigation APP uses A in the second requirement information as a valid parameter to call the navigation SDK.

[0191] The navigation SDK returns 1000km_12h_13service to the navigation app based on A.

[0192] The navigation app obtains the output content information Navigation_To_Beijing_1000km_12h_13service_DeviceID based on 1000km_12h_13service and DeviceID, and outputs it to the device management module.

[0193] The device management module determines the SocketID from the recorded mapping relationship according to the DeviceID in the Navigation_To_Beijing_1000km_12h_13service_DeviceID as the output content information, and sends the SocketID and Navigation_To_Beijing_1000km_12h_13service_DeviceID to the communication module.

[0194] The communication module encrypts the second demand information sent by the device management module: Navigation_To_Beijing_1000km_12h_13service_DeviceID, and sends the encrypted Navigation_To_Beijing_1000km_12h_13service_DeviceID to the AR glasses 1 through the communication connection corresponding to the SocketID determined by the device management module;

[0195] After receiving the encrypted Navigation_To_Beijing_1000km_12h_13service_DeviceID, the communication module on the AR glasses 1 side will decrypt it, obtain the decrypted Navigation_To_Beijing_1000km_12h_13service_DeviceID, and send it to the conversion module.

[0196] The conversion module converts the information into corresponding text and voice. Furthermore, the voice is sent to the sound module, which plays the information and the business unit displays the information in text.

[0197] It should be noted that in Figure 4, the device management module in the control device records the device identification and communication connection identification of AR glasses 1, AR glasses 2,..., AR glasses N, and the business module in AR glasses 1 can process the data of navigation, translation, and dialogue applications.

[0198] As shown in FIG5 , an embodiment of the present invention further provides an interactive device 500 for a split-type head-mounted device. The split-type head-mounted device includes a control device and a head-mounted display. The device 500 is applied to the head-mounted display and includes:

[0199] A first receiving module 510 is configured to receive first demand information input by a wearer of the head display;

[0200] A generating module 520 is configured to generate second demand information based on the first demand information and the device identifier of the head display;

[0201] A first sending module 530 is configured to send the second demand information to the control device based on the communication connection between the control device and the head display;

[0202] A second receiving module 540 is configured to receive, based on the communication connection, output content information sent by the control device based on the second requirement information;

[0203] The output module 550 is configured to output the output content information.

[0204] In one embodiment of the present invention, the apparatus 500 further includes:

[0205] a first encryption module, configured to perform an encryption operation on the second requirement information according to a first pre-encryption rule to obtain encrypted requirement information;

[0206] The first updating module is configured to update the second requirement information to the encryption requirement information.

[0207] In one embodiment of the present invention, the output module 550 is specifically configured to perform a decryption operation on the output content information according to a first preset decryption rule to obtain decrypted output content information;

[0208] Outputting the decrypted output content information;

[0209] The first preset decryption rule corresponds to a second preset encryption rule, and the second preset encryption rule is an encryption rule corresponding to the output content information.

[0210] In one embodiment of the present invention, the output module 550 is specifically configured to play the voice corresponding to the output content information;

[0211] And, displaying the text corresponding to the output content information.

[0212] As shown in FIG6 , an embodiment of the present invention further provides an interactive device 600 for a split head-mounted device. The split head-mounted device includes a control device and a head-mounted display. The device 600 is applied to the control device and includes:

[0213] A third receiving module 610 is configured to receive, for any of the head-mounted displays, second demand information sent by the head-mounted display based on the communication connection between the control device and the head-mounted display;

[0214] A first determining module 620 is configured to determine output content information based on the second requirement information, where the output content information carries a device identifier of the head display;

[0215] A second determining module 630 is configured to determine a communication connection identifier for the communication connection between the head display and the control device based on the device identifier of the head display in the output content information;

[0216] The second sending module 640 is configured to send the output content information to the head-mounted display via the communication connection corresponding to the communication connection identifier.

[0217] In one embodiment of the present invention, the apparatus 600 further includes:

[0218] a recording module configured to, when receiving the second requirement information for the first time, record a correspondence between a communication connection identifier corresponding to the communication connection and a device identifier of the head display included in the second requirement information to form an identifier mapping relationship;

[0219] In this embodiment of the present invention, the second determining module 630 is specifically configured to search, from the identifier mapping relationship, for a communication connection identifier that matches the device identifier of the head display in the output content information.

[0220] In one embodiment of the present invention, the first determining module 620 is specifically configured to perform a decryption operation on the second requirement information according to a second preset decryption rule to obtain decryption requirement information;

[0221] Determining output content information according to the decryption requirement information;

[0222] The second preset decryption rule corresponds to the first preset encryption rule, and the first preset encryption rule is the encryption rule corresponding to the second requirement information.

[0223] In one embodiment of the present invention, the apparatus 600 further includes:

[0224] a second encryption module, configured to encrypt the output content information according to a second preset encryption rule to obtain encrypted output content information;

[0225] The second updating module is configured to update the output content information to the encrypted output content information.

[0226] In one embodiment of the present invention, the first determining module 620 is specifically configured to extract keyword information from the second demand information;

[0227] determining a target application based on the keyword information;

[0228] Output content information is obtained according to the second requirement information and the target application.

[0229] In one embodiment of the present invention, the first determining module 620 is specifically configured to determine the output content information according to the second demand information and the dialog class mapping relationship.

[0230] Based on the above-mentioned device 500 and / or device 600, there is no need to set up a large number of data computing units on the head display, so the weight of the head display is greatly reduced, and it can be made light and thin.

[0231] An embodiment of the present invention further provides an electronic device, in which case the electronic device is a head mounted display (HMD) 700, the HMD 700 includes the interactive device 500 of any split-type head mounted device provided in the above device embodiment;

[0232] Alternatively, the head display 700, as shown in FIG7 , includes a first memory 710 and a first processor 720, wherein the first memory 710 is used to store computer instructions, and the first processor 720 is used to call the computer instructions from the first memory 710 to execute the above-mentioned interaction method for a split-type head-mounted device applied to the head display 700;

[0233] In the case where the electronic device is a control device 800, the control device 800 includes the interaction device 600 of the split head-mounted device as provided in any of the above device embodiments;

[0234] Alternatively, the control device 800, as shown in Figure 8, includes a second memory 810 and a second processor 820, the second memory 810 is used to store computer instructions, and the second processor 820 is used to call the computer instructions from the second memory 810 to execute the interaction method of the split head-mounted device applied to the control device 800 as described above.

[0235] An embodiment of the present invention further provides a split head-mounted device, comprising a head display as provided in the above device embodiment and a control device as provided in the above device embodiment.

[0236] An embodiment of the present invention further provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the computer program implements the interaction method of the split head-mounted device according to any one of the above method embodiments.

[0237] The present invention may be a system, a method and / or a computer program product. The computer program product may include a computer-readable storage medium carrying computer-readable program instructions for causing a processor to implement various aspects of the present invention.

[0238] A computer-readable storage medium can be a tangible device that can hold and store instructions used by an instruction execution device. A computer-readable storage medium can be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a static random access memory (SRAM), a portable compact disc read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanical encoding device, such as a punch card or a raised structure in a groove on which instructions are stored, and any suitable combination thereof. As used herein, a computer-readable storage medium is not to be construed as a transient signal per se, such as a radio wave or other freely propagating electromagnetic wave, an electromagnetic wave propagating through a waveguide or other transmission medium (e.g., a light pulse passing through a fiber optic cable), or an electrical signal transmitted through an electrical wire.

[0239] The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to each computing / processing device, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. The network can include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. The network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions to be stored in the computer-readable storage medium in each computing / processing device.

[0240] The computer program instructions for performing the operation of the present invention can be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, and conventional procedural programming languages ​​such as "C" language or similar programming languages. The computer readable program instructions can be executed entirely on the user's computer, partially on the user's computer, as an independent software package, partially on the user's computer, partially on a remote computer, or completely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any type of network including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (e.g., using an Internet service provider to connect via the Internet). In some embodiments, an electronic circuit, such as a programmable logic circuit, a field programmable gate array (FPGA), or a programmable logic array (PLA), is personalized by utilizing the state information of the computer readable program instructions, and the electronic circuit can execute the computer readable program instructions, thereby realizing various aspects of the present invention.

[0241] Various aspects of the present invention are described herein with reference to flowcharts and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present invention. It should be understood that each block of the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.

[0242] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processor of the computer or other programmable data processing device, a device is generated that implements the functions / actions specified in one or more blocks in the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium, where these instructions cause the computer, programmable data processing device, and / or other device to operate in a specific manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing various aspects of the functions / actions specified in one or more blocks in the flowchart and / or block diagram.

[0243] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more blocks in the flowchart and / or block diagram.

[0244] The flowcharts and block diagrams in the accompanying drawings show the possible implementation architecture, functions and operations of the systems, methods and computer program products according to multiple embodiments of the present invention. In this regard, each box in the flowchart or block diagram can represent a module, program segment or part of an instruction, and the module, program segment or part of the instruction contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions marked in the box can also occur in an order different from that marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of boxes in the block diagram and / or flowchart, can be implemented by a dedicated hardware-based system that performs the specified function or action, or can be implemented by a combination of dedicated hardware and computer instructions. It is well known to those skilled in the art that implementation by hardware, implementation by software, and implementation by a combination of software and hardware are all equivalent.

[0245] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or system comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or system. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or system comprising the element.

[0246] The serial numbers of the above embodiments of the present invention are for description only and do not represent the advantages or disadvantages of the embodiments.

[0247] Through the description of the above embodiments, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better embodiment. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as mentioned above, and includes a number of instructions for enabling a terminal device (which can be a mobile phone, computer, server, TV, or network device, etc.) to execute the methods of various embodiments of the present invention.

[0248] The above description is only a preferred embodiment of the present invention and does not limit the patent scope of the present invention. All equivalent structural transformations made by using the contents of the present invention description and drawings under the inventive concept of the present invention, or direct / indirect application in other related technical fields are included in the patent protection scope of the present invention.

Claims

1. An interactive method for a split head-mounted device, characterized in that: The split head mounted device includes a control device and at least one head mounted display, and the method is applied to any of the head mounted displays, including: Receiving first demand information input by a wearer of the head display; Generate second demand information according to the first demand information and the device identifier of the head display; Based on the communication connection between the control device and the head display, sending the second demand information to the control device; Based on the communication connection, receiving output content information sent by the control device based on the second demand information; The output content information is output.

2. The method according to claim 1, characterized in that: Before sending the second requirement information to the control device based on the communication connection between the control device and the head display, the method further includes: Performing an encryption operation on the second demand information according to the first pre-encryption rule to obtain encrypted demand information; The second requirement information is updated to the encryption requirement information.

3. The method according to claim 1, characterized in that The outputting the output content information includes: According to a first preset decryption rule, a decryption operation is performed on the output content information to obtain decrypted output content information; Outputting the decrypted output content information; The first preset decryption rule corresponds to the second preset encryption rule, and the second preset encryption rule is an encryption rule corresponding to the output content information.

4. The method according to claim 1, characterized in that: The second demand information is dialog demand information, and the outputting the output content information includes: Playing the voice corresponding to the output content information; And, display the text corresponding to the output content information.

5. An interactive method for a split head-mounted device, characterized in that: The split head mounted device comprises a control device and at least one head mounted display, and the method is applied to the control device, comprising: For any of the head mounted displays, based on the communication connection between the control device and the head mounted display, receiving second demand information sent by the head mounted display; Determine output content information according to the second requirement information, where the output content information carries a device identifier of the head display; Determine, according to the device identifier of the head display in the output content information, a communication connection identifier for the communication connection between the head display and the control device; The output content information is sent to the head display through the communication connection corresponding to the communication connection identifier.

6. The method according to claim 5, characterized in that Before determining output content information according to the second requirement information, the method further includes: When the second requirement information is received for the first time, recording a correspondence between a communication connection identifier corresponding to the communication connection and a device identifier of the head display included in the second requirement information to form an identifier mapping relationship; The determining, according to the device identifier of the head display in the output content information, a communication connection identifier of the communication connection between the head display and the control device includes: According to the device identifier of the head display in the output content information, a communication connection identifier matching the device identifier is searched from the identifier mapping relationship.

7. The method according to claim 5, characterized in that The step of determining output content information according to the second requirement information includes: According to a second preset decryption rule, a decryption operation is performed on the second requirement information to obtain decryption requirement information; Determining output content information according to the decryption requirement information; The second preset decryption rule corresponds to the first preset encryption rule, and the first preset encryption rule is the encryption rule corresponding to the second requirement information.

8. The method according to claim 5, characterized in that Before sending the output content information to the head display through the communication connection corresponding to the communication connection identifier, the method further includes: Encrypting the output content information according to a second preset encryption rule to obtain encrypted output content information; The output content information is updated to the encrypted output content information.

9. The method according to claim 5, characterized in that The step of determining output content information according to the second requirement information includes: extracting keyword information from the second demand information; Determining a target application according to the keyword information; Output content information is obtained according to the second requirement information and the target application.

10. The method according to claim 5, characterized in that The second demand information is dialog-type demand information, and the step of determining output content information according to the second demand information includes: The output content information is determined according to the second demand information and the dialog class mapping relationship.

11. An interactive device for a split head-mounted device, characterized in that: The split head-mounted device includes a control device and a head display, and the device is applied to the head display, including: A first receiving module, configured to receive first demand information input by a wearer of the head display; A generating module, configured to generate second demand information according to the first demand information and the device identifier of the head display; A first sending module, configured to send the second demand information to the control device based on a communication connection between the control device and the head display; A second receiving module, configured to receive, based on the communication connection, output content information sent by the control device based on the second demand information; An output module is used to output the output content information.

12. An interactive device for a split head-mounted device, characterized in that: The split head-mounted device includes a control device and a head display, and the device is applied to the control device, including: A third receiving module is used to receive, for any of the head mounted displays, second demand information sent by the head mounted display based on the communication connection between the control device and the head mounted display; A first determining module, configured to determine output content information according to the second requirement information, wherein the output content information carries a device identifier of the head display; A second determining module, configured to determine a communication connection identifier for a communication connection between the head display and the control device according to a device identifier of the head display in the output content information; The second sending module is used to send the output content information to the head display through the communication connection corresponding to the communication connection identifier.

13. An electronic device, characterized in that: In the case where the electronic device is a head mounted display, the head mounted display comprises the interactive device of the split head mounted device as claimed in claim 12; Alternatively, the head display includes a first memory and a first processor, the first memory is used to store computer instructions, and the first processor is used to call the computer instructions from the first memory to execute the interaction method of the split head mounted device according to any one of claims 1 to 4; In the case where the electronic device is a control device, the control device comprises the interaction device of the split head mounted device as claimed in claim 12; Alternatively, the control device includes a second memory and a second processor, the second memory is used to store computer instructions, and the second processor is used to call the computer instructions from the second memory to execute the interaction method of the split head-mounted device as described in any one of claims 5-10.

14. A split head-mounted device, characterized in that: It comprises the head display as claimed in claim 13 and the control device as claimed in claim 13.

15. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and when the computer program is executed by a processor, the computer program implements the interaction method of the split head-mounted device according to any one of claims 1-10.

Citation Information

Patent Citations

  • Split type head-mounted display system and interaction method

    CN108646925A

  • Control method, head-mounted device, server and operation system

    CN112068693A

  • Data processing method, device and equipment of split type head-mounted equipment

    CN112506272A

  • Interaction method and device of split type head-mounted equipment, equipment and medium

    CN117572959A

  • Voice-driven interface to control multi-layered content in a head mounted display

    US20180067717A1