Information interaction method and device, electronic equipment and computer readable storage medium

Abstract

The embodiment of the invention discloses an information interaction method and device, electronic equipment and a computer readable storage medium, and the method comprises the steps: responding to a detected information interaction request for opposite-end equipment, and displaying target content information in a virtual display image of augmented reality equipment; in response to an interaction operation for the target content information, generating target interaction information; and sending the target interaction information to the opposite-end equipment so as to perform information interaction with the opposite-end equipment. Through interaction between the virtual display picture of the augmented reality device and the opposite-end device, the privacy security problem of input or output display of sensitive information is solved by using the characteristic of good privacy of the virtual display picture.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of extended reality technology, and specifically to an information interaction method, device, electronic device, and computer-readable storage medium. Background Art

[0002] Extended Reality (XR) is a comprehensive term that covers virtual reality (VR), augmented reality (AR) and mixed reality (MR). XR technology expands the way humans perceive and interact, interacting with the real world through digital technology to create virtual, augmented and mixed reality experiences. XR devices are widely used in scenarios such as navigation, information display and augmented reality experience.

[0003] At present, when customers conduct business in offline physical places (such as bank counters, commercial counters or open office environments), they often need to enter important sensitive information (such as account passwords to verify customer identities). In order to protect customers' important sensitive information and prevent people around them from peeping, service providers will take certain information security protection measures. Traditional information security protection measures are mostly physical shielding, that is, the input device is semi-enclosed, with one side reserved for the user's palm to enter, and the other three sides are shielded or semi-shielded.

[0004] However, this security protection measure has shortcomings in terms of security. For example, when inputting through the palm of your hand, there are still problems such as the input process being exposed and the input fingerprints and prints being retained on the input device.

[0005] With the development of extended reality technology, how to use extended reality technology to achieve input control or output display control of sensitive information is the current research direction. Summary of the invention

[0006] The embodiments of the present application provide an information interaction method, device, electronic device and computer-readable storage medium, which can realize information interaction based on an extended reality device and solve the privacy and security issues of the input or output display of sensitive information.

[0007] In a first aspect, an embodiment of the present application provides an information interaction method, which is applied to an extended reality device, and the method includes:

[0008] In response to detecting an information interaction request for a peer device, displaying target content information in a virtual display screen of the extended reality device;

[0009] In response to the interactive operation on the target content information, generating target interactive information;

[0010] The target interaction information is sent to the opposite-end device to perform information interaction with the opposite-end device.

[0011] In a second aspect, an embodiment of the present application further provides an information interaction device, which is applied to an extended reality device, and the device includes:

[0012] A display module, configured to display target content information in a virtual display screen of the extended reality device in response to detecting an information interaction request for a peer device;

[0013] A generating module, configured to generate target interaction information in response to an interaction operation on the target content information;

[0014] The sending module is used to send the target interaction information to the opposite-end device so as to perform information interaction with the opposite-end device.

[0015] Optionally, in some embodiments of the present application, the information interaction request includes an information input request, and in response to detecting the information interaction request for the peer device, displaying the target content information in the virtual display screen of the extended reality device includes:

[0016] In response to detecting an information input request for the peer device, displaying target content information in a virtual display screen of the extended reality device, the target content information including a virtual input control;

[0017] The generating target interaction information in response to the interaction operation on the target content information includes:

[0018] In response to an interaction operation on the virtual input control, target interaction information is generated, where the interaction operation includes at least one of an eye movement interaction operation, a head posture operation, a voice operation, or a gesture operation.

[0019] Optionally, in some embodiments of the present application, the information interaction request includes an information confirmation request, and in response to detecting the information interaction request for the peer device, displaying the target content information in the virtual display screen of the extended reality device includes:

[0020] In response to detecting an information confirmation request for the peer device, displaying target content information in a virtual display screen of the extended reality device, the target content information including the to-be-confirmed information sent by the peer device;

[0021] The generating target interaction information in response to the interaction operation on the target content information includes:

[0022] Display virtual input controls;

[0023] In response to an interactive operation on the virtual input control, target interaction information for the information to be confirmed is generated.

[0024] Optionally, in some embodiments of the present application, after generating target interaction information in response to the interaction operation on the target content information, the method further includes:

[0025] Displaying the target interaction information in the virtual display screen;

[0026] In response to the editing operation on the target interaction information, obtaining optimization information to be sent;

[0027] In response to a sending instruction for the optimization information to be sent, the optimization information to be sent is sent to the opposite-end device.

[0028] Optionally, in some embodiments of the present application, the device further includes:

[0029] Detecting a wearing state of the extended reality device;

[0030] If the wearing status indicates that the extended reality device is not worn, a wearing prompt message is issued.

[0031] In a third aspect, an embodiment of the present application provides an information interaction method, which is applied to a peer device, and the method includes:

[0032] Receive target interaction information sent by an extended reality device, where the target interaction information is generated by the extended reality device in response to an interaction operation on target content information displayed in a virtual display screen, and the target content information is displayed in the virtual display screen by the extended reality device in response to an information interaction request for the opposite device.

[0033] In a fourth aspect, an embodiment of the present application provides an information interaction device, which is applied to a peer device, and the device includes:

[0034] The receiving module is used to receive target interaction information sent by the extended reality device, where the target interaction information is generated by the extended reality device in response to an interactive operation of target content information displayed in a virtual display screen.

[0035] Optionally, in some embodiments of the present application, the device further includes:

[0036] a response module, configured to generate an information confirmation request in response to a sending operation for the information to be confirmed, and send the information confirmation request to the extended reality device, wherein the extended reality device displays the information to be confirmed and a virtual input control in a virtual display screen in response to the information confirmation request;

[0037] or,

[0038] In response to a sending operation for information to be input, an information input request is generated, and the information input request is sent to the extended reality device, wherein the extended reality device displays a virtual input control in a virtual display screen in response to the information input request.

[0039] In a fifth aspect, an embodiment of the present application further provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and which implements the steps in the above-mentioned information interaction method when the computer program is executed by the processor.

[0040] In a sixth aspect, an embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps in the above-mentioned information interaction method are implemented.

[0041] In a seventh aspect, the embodiments of the present application further provide a computer program product or a computer program, the computer program product or the computer program including computer instructions, the computer instructions being stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the methods provided in the various optional implementations described in the embodiments of the present application.

[0042] The extended reality device of an embodiment of the present application displays target content information in a virtual display screen of the extended reality device in response to detecting an information interaction request for a peer device, generates target interaction information in response to an interactive operation for the target content information, and sends the target interaction information to the peer device to interact with the peer device.

[0043] Among them, the embodiment of the present application uses the virtual display screen of the extended reality device to interact with the opposite device, thereby utilizing the good privacy characteristics of the virtual display screen to solve the privacy and security issues of the input or output display of sensitive information. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] In order to more clearly illustrate the technical solutions in the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0045] Figure 1 is a schematic diagram of a scenario in which an extended reality device provided in an embodiment of the present application executes the information interaction method;

[0046] Figure 2It is a flowchart of the information interaction method provided in the embodiment of the present application;

[0047] Figure 3 is a structural diagram of an information interaction device provided in an embodiment of the present application;

[0048] Figure 4 It is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0049] The following will be combined with the drawings in this application to clearly and completely describe the technical solutions in this application. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of them. Based on the embodiments in the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0050] The embodiments of the present application provide an information interaction method, device, electronic device and computer-readable storage medium. Specifically, the embodiments of the present application provide an information interaction device suitable for electronic devices, which is used to solve the privacy and security issues of input or output display of sensitive information when handling business offline. Specifically, the electronic device includes an extended reality device, which includes but is not limited to a head-mounted display, wearable glasses, and the extended reality device can also be an integrated extended reality device built into a computing processing unit, or a split extended reality device external to the computing processing unit. Among them, the extended reality device includes but is not limited to an airborne optical display system, i.e., a head-up display system, applied to vehicles such as aircraft, automobiles, and ships, for example, an AR-HUD (Augmented reality hud-up display) mounted on an intelligent networked car, an extended reality application applied to handheld mobile devices such as mobile phones, laptops, and tablets (such as extended reality games, virtual tourism, telemedicine, or virtual experiments, etc.), and a near-eye display system for wearable devices such as head-mounted displays and smart glasses.

[0051] See also Figure 1 , Figure 1 : is a schematic diagram of a scenario in which an extended reality device according to an embodiment of the present application performs the information interaction method, wherein the specific execution process of the extended reality device performing the information interaction method is as follows:

[0052] In response to detecting an information interaction request for the peer device 11, the extended reality device 10 displays the target content information in the virtual display screen of the extended reality device 10, generates target interaction information in response to the interactive operation for the target content information, and sends the target interaction information to the peer device 11 to interact with the peer device 11.

[0053] For example, in an offline scenario, after a user uses an extended reality device to establish a connection with a peer device, the target content information is displayed in the virtual display screen of the extended reality device, and the extended reality device interacts with the peer device through the target content information of the virtual display screen. The target content information can be information received from the peer device, or information generated by the user after operating the extended reality device.

[0054] In summary, the embodiments of the present application utilize the good privacy characteristics of the virtual display screen to interact with the peer device through the virtual display screen of the extended reality device, and solve the privacy and security issues of the input or output display of sensitive information.

[0055] It should be noted that the order of description of the following embodiments is not intended to limit the priority order of the embodiments.

[0056] See also Figure 2 , Figure 2 A flowchart of an information interaction method provided in an embodiment of the present application. Although a logical order is shown in the flowchart, in some cases, the steps shown or described may be performed in an order different from that shown in the flowchart. Specifically, the execution subject of the information interaction method is an extended reality device. Specifically, the process of the extended reality device executing the information interaction method specifically includes:

[0057] 101. In response to detecting an information interaction request for a peer device, display target content information in a virtual display screen of the extended reality device.

[0058] The information interaction request includes a request received from a peer device, or a request generated by an extended reality device for interacting with a peer device. It is understandable that the target content information is displayed in a virtual display screen of the extended reality device and is used to implement information interaction between the extended reality device and the peer device.

[0059] For example, the target content information includes pending confirmation information sent by the peer device for confirmation by the user wearing the extended reality device, and may also include information to be sent to the peer device, or include virtual input controls, etc., wherein the virtual input controls are used to generate information to be sent to the peer device.

[0060] The virtual display screen is the screen provided by the virtual display screen of the extended reality device. It can be understood that the extended reality device has the characteristics of superimposing the virtual display screen and the real scene screen. For example, the extended display device includes virtual reality (VR) devices, augmented reality (AR) devices, and mixed reality (MR) devices.

[0061] 102. In response to an interactive operation on the target content information, generate target interaction information.

[0062] Among them, by generating target interaction information based on a virtual display screen of an extended reality device, the convenience of generating target interaction information is improved.

[0063] For example, target interaction information is generated based on the extended reality device through at least one of eye movement interaction operation, head posture operation, voice operation or gesture operation.

[0064] Compared with the traditional operation based on physical buttons for input, the embodiments of the present application improve the convenience of operation and overcome the many shortcomings of physical buttons. For example, in the traditional physical button input method, the information security protection measures are mostly physical shielding, that is, the input device corresponding to the physical button is semi-enclosed, except for one side reserved for the user's palm to extend, the other three sides are closed or shielded or semi-shielded. However, this kind of security protection measure is insufficient in terms of operational convenience and safety. For example, the user's hand is very limited in interacting with the input device in a small space, and input errors often lead to interaction failures. The embodiments of the present application perform information interaction by extending the virtual display screen of the reality device, which overcomes the problem of inconvenient physical button operation and reduces the situation where interaction failures are caused by input errors.

[0065] 103. Send the target interaction information to the opposite-end device to perform information interaction with the opposite-end device.

[0066] It can be understood that by sending the target interaction information to the peer device, information interaction between the extended reality device and the peer device is achieved.

[0067] In summary, the embodiments of the present application use the virtual display screen of the extended reality device to interact with the peer device, thereby utilizing the good privacy characteristics of the virtual display screen to solve the privacy security issues of the input or output display of sensitive information. For example, a user wearing the extended reality device can input target interaction information for interacting with the peer device through the virtual display screen of the extended reality device, or receive information sent by the peer device that requires confirmation by the user, and during the entire interaction process, the information is presented in the virtual display screen, which has a good privacy protection effect.

[0068] For example, taking the business processing scenario of an offline bank counter as an example, the bank staff is located inside the counter, and the user who handles the business is outside the counter. In addition, the peer device is set up inside the counter and operated by the bank staff, and the extended reality device is set up outside the counter and operated by the user who handles the business. The bank staff and the user who handles the business can exchange information through the peer device and the extended reality device, replacing the direct real interaction at the offline counter window, thereby ensuring the privacy and security of the information interaction.

[0069] In order to more clearly understand the information interaction method of the embodiment of the present application, the following will take the case where the user interacts with the peer device by inputting information through the extended reality device as an example. Correspondingly, in the virtual display screen of the extended reality device, a virtual input control can be displayed, and the user's input is received through the virtual input control to obtain the target interaction information. That is, optionally, in some embodiments of the present application, the information interaction request includes an information input request, and the step of "in response to detecting the information interaction request for the peer device, displaying the target content information in the virtual display screen of the extended reality device" includes:

[0070] In response to detecting an information input request for the peer device, displaying target content information in a virtual display screen of the extended reality device, the target content information including a virtual input control;

[0071] The generating target interaction information in response to the interaction operation on the target content information includes:

[0072] In response to an interaction operation on the virtual input control, target interaction information is generated, where the interaction operation includes at least one of an eye movement interaction operation, a head posture operation, a voice operation, or a gesture operation.

[0073] The virtual input control includes a virtual keyboard, and the target interaction information is obtained by obtaining input from the virtual keyboard in response to the user's interaction operation.

[0074] Among them, in an embodiment of the present application, the information input request can be sent by the peer device. For example, the peer device sends an information input request to the extended reality device based on business needs. Then, after receiving the information input request, the extended reality device directly displays a virtual input control on the virtual display screen, such as directly displaying a virtual keyboard, so that the user can input the target interaction information through the virtual input control (such as a virtual keyboard).

[0075] For example, taking the business processing scenario of an offline bank counter as an example, when the bank staff generates a need for the user to input information during the processing process, the bank staff can send an information input request to the extended reality device through the peer device. Then, after receiving the information input request, the extended reality device directly displays a virtual keyboard in the virtual display screen. The user handling the business directly wears the extended reality device and then inputs the target interaction information through the virtual keyboard. For example, the target interaction information can be an account password used to verify the identity of the user.

[0076] Among them, in the embodiment of the present application, based on different business types, the virtual display screen can be adjusted to display different contents. In addition, based on different business types, the display tone of the virtual display screen can also be adjusted.

[0077] Among them, through the display of the target content information after the information input request is detected, the display content of the extended reality device is controlled based on the peer device, which makes it convenient for the user of the peer device to interact with other users through the extended reality device.

[0078] Similarly, in order to more clearly understand the information interaction method of the embodiment of the present application, the following will be described by taking the case where the user confirms the information to be confirmed sent by the opposite device through the extended reality device as an example, that is, the opposite device sends the information that needs to be confirmed by the user to the extended reality device, and then the extended reality device displays the information to be confirmed on the virtual display screen for user confirmation, that is, optionally, in some embodiments of the present application, the information interaction request includes an information confirmation request, and the step of "in response to detecting the information interaction request for the opposite device, displaying the target content information in the virtual display screen of the extended reality device" includes:

[0079] In response to detecting an information confirmation request for the peer device, displaying target content information in a virtual display screen of the extended reality device, the target content information including the to-be-confirmed information sent by the peer device;

[0080] The generating target interaction information in response to the interaction operation on the target content information includes:

[0081] Display virtual input controls;

[0082] In response to an interactive operation on the virtual input control, target interaction information for the information to be confirmed is generated.

[0083] Among them, the information to be confirmed is information that needs to be confirmed by the user wearing the extended reality device. For example, in the scenario of offline business processing, the information to be confirmed includes entered personal information, selected business type information, business details information, etc.

[0084] Among them, by displaying the information to be confirmed in the virtual display screen of the extended reality device, the privacy security of the information to be confirmed is ensured by utilizing the high privacy characteristics of the virtual display screen.

[0085] It should be noted that in traditional offline business processing, when users input information through physical buttons, in order to ensure the privacy of the user's input information, the user cannot view the information he or she has previously entered, and cannot provide a basis for subsequent corrections. For example, if the system prompts that the password input is wrong, the user cannot view the information just entered, and does not know where the error is and how to correct it. Based on this, in an embodiment of the present application, the target interaction information input by the user is displayed on a virtual display screen, so that the user can know the specific content of the input, that is, optionally, in some embodiments of the present application, the step of "generating target interaction information in response to the interactive operation on the target content information" includes:

[0086] Displaying the target interaction information in the virtual display screen;

[0087] In response to the editing operation on the target interaction information, obtaining optimization information to be sent;

[0088] In response to a sending instruction for the optimization information to be sent, the optimization information to be sent is sent to the opposite-end device.

[0089] Among them, the design of displaying the target interaction information in the virtual display screen not only realizes the display of the target interaction information, making it easier for users to know the input content, but also ensures the privacy security of the target interaction information when it is displayed by displaying it in the virtual display screen.

[0090] After the target interaction information is displayed, if an input error occurs, the user can also modify the target interaction information to obtain the optimized information to be sent, so as to ensure the accuracy of the data to be sent.

[0091] Accordingly, in the embodiment of the present application, when an interaction demand is generated, it is also possible to detect whether the extended reality device is in a worn state. If it is not in a worn state, a wearing reminder is issued to instruct the user to wear the extended reality device to handle business. That is, optionally, in some embodiments of the present application, before the step of "responding to the interactive operation on the target content information, generating target interaction information", the method further includes:

[0092] Detecting a wearing state of the extended reality device;

[0093] If the wearing status indicates that the extended reality device is not worn, a wearing prompt message is issued.

[0094] Among them, whether the extended reality device is worn can be detected and analyzed through sensors such as specific sensors, light sensors, etc. set on the extended reality device.

[0095] In summary, the embodiments of the present application utilize the good privacy characteristics of the virtual display screen to interact with the peer device through the virtual display screen of the extended reality device, and solve the privacy and security issues of the input or output display of sensitive information.

[0096] Among them, based on the above content, it can be known that the counterpart device is a device that cooperates with the extended reality device to perform information interaction, and the counterpart device at least has the ability to receive target interaction information, send information confirmation requests, information input requests, etc., that is, in an embodiment of the present application, the counterpart device can receive target interaction information sent by the extended reality device, wherein the target interaction information is generated by the extended reality device in response to the interactive operation on the target content information displayed in the virtual display screen, and the target content information is displayed in the virtual display screen by the extended reality device in response to the information interaction request of the counterpart device.

[0097] And, it is also possible to generate an information confirmation request in response to a sending operation for the information to be confirmed, and send the information confirmation request to the extended reality device, wherein the extended reality device displays the information to be confirmed and the virtual input control in a virtual display screen in response to the information confirmation request;

[0098] or,

[0099] In response to a sending operation for information to be input, an information input request is generated, and the information input request is sent to the extended reality device, wherein the extended reality device displays a virtual input control in a virtual display screen in response to the information input request.

[0100] For example, a bank staff sends an information confirmation request or an information input request through a peer device, or displays target interaction information sent by a business processing staff through an extended reality device.

[0101] It is understandable that in order to ensure the smoothness and stability of information interaction, a control processor can also be set up, which includes computing devices such as computers, servers, and workstations, and the computer program corresponding to the business handled by the user runs on the control processor. Based on the control processor identifying the current business progress, business needs, etc., an information confirmation request or information input request is sent to the user's extended reality device. Among them, the control processor acts as a flow device between the opposite device and the extended reality device to realize the flow control of information.

[0102] For example, bank staff generally input and receive instructions on the peer device of the control processor (externally connected to the control processor). The control processor receives a request from the bank staff through the peer device requiring the user to input information / confirm information, or the program running the control processor automatically executes and triggers the request requiring the user to input information / confirm information. The control processor responds to the request and sends the content to be displayed to the extended reality device (such as smart glasses).

[0103] The extended reality device detects the user's wearing status, and after the user has completed wearing and has the correct posture, the target content information (information to be confirmed or virtual input controls, etc.) is displayed in front of the customer in an augmented reality manner. The extended reality device detects and identifies the customer's eye gaze point, head posture, and gestures on the virtual keyboard, generates target interaction information and sends it to the control processor.

[0104] Furthermore, the target interaction information input by the user can be displayed in a partial area of ​​the virtual display screen for the user to check and verify. The control processor feeds back the target interaction information, and the feedback information can be transmitted to the user through the extended reality device.

[0105] In order to better implement the information interaction method of the present application, the present application also provides an information interaction device based on the above information interaction method. The meanings of the terms are the same as those in the above information interaction method, and the specific implementation details can refer to the description in the method embodiment.

[0106] See also Figure 3 , Figure 3 : is a schematic diagram of the structure of an information interaction device provided in an embodiment of the present application. The information interaction device is applied to an extended reality device. The information interaction device can be specifically as follows:

[0107] The display module 201 is used to display target content information in a virtual display screen of the extended reality device in response to detecting an information interaction request for the peer device;

[0108] A generating module 202, configured to generate target interaction information in response to an interaction operation on the target content information;

[0109] The sending module 203 is used to send the target interaction information to the opposite device to perform information interaction with the opposite device.

[0110] Optionally, in some embodiments of the present application, the information interaction request includes an information input request, and in response to detecting the information interaction request for the peer device, displaying the target content information in the virtual display screen of the extended reality device includes:

[0111] In response to detecting an information input request for the peer device, displaying target content information in a virtual display screen of the extended reality device, the target content information including a virtual input control;

[0112] The generating target interaction information in response to the interaction operation on the target content information includes:

[0113] In response to an interaction operation on the virtual input control, target interaction information is generated, where the interaction operation includes at least one of an eye movement interaction operation, a head posture operation, a voice operation, or a gesture operation.

[0114] Optionally, in some embodiments of the present application, the information interaction request includes an information confirmation request, and in response to detecting the information interaction request for the peer device, displaying the target content information in the virtual display screen of the extended reality device includes:

[0115] In response to detecting an information confirmation request for the peer device, displaying target content information in a virtual display screen of the extended reality device, the target content information including the to-be-confirmed information sent by the peer device;

[0116] The generating target interaction information in response to the interaction operation on the target content information includes:

[0117] Display virtual input controls;

[0118] In response to an interactive operation on the virtual input control, target interaction information for the information to be confirmed is generated.

[0119] Optionally, in some embodiments of the present application, after generating target interaction information in response to the interaction operation on the target content information, the method further includes:

[0120] Displaying the target interaction information in the virtual display screen;

[0121] In response to the editing operation on the target interaction information, obtaining optimization information to be sent;

[0122] In response to a sending instruction for the optimization information to be sent, the optimization information to be sent is sent to the opposite-end device.

[0123] Optionally, in some embodiments of the present application, the device further includes:

[0124] Detecting a wearing state of the extended reality device;

[0125] If the wearing status indicates that the extended reality device is not worn, a wearing prompt message is issued.

[0126] Among them, the counterpart device is used to receive target interaction information sent by the extended reality device, and the target interaction information is generated by the extended reality device in response to the interactive operation on the target content information displayed in the virtual display screen, and the target content information is displayed in the virtual display screen by the extended reality device in response to the information interaction request of the counterpart device.

[0127] Furthermore, the counterpart device is also capable of generating an information confirmation request in response to a sending operation for information to be confirmed, and sending the information confirmation request to the extended reality device, wherein the extended reality device displays the information to be confirmed and virtual input controls in a virtual display screen in response to the information confirmation request; or, generating an information input request in response to a sending operation for information to be input, and sending the information input request to the extended reality device, wherein the extended reality device displays virtual input controls in a virtual display screen in response to the information input request.

[0128] In the embodiment of the present application, the display module 201 displays the target content information in the virtual display screen of the extended reality device in response to detecting an information interaction request for the peer device, the generation module 202 generates target interaction information in response to the interaction operation for the target content information, and the sending module 203 sends the target interaction information to the peer device to interact with the peer device.

[0129] Among them, the embodiment of the present application uses the virtual display screen of the extended reality device to interact with the opposite device, thereby utilizing the good privacy characteristics of the virtual display screen to solve the privacy and security issues of the input or output display of sensitive information.

[0130] In addition, the present application also provides an electronic device, such as Figure 4 As shown, it shows a schematic diagram of the structure of the electronic device involved in this application, specifically:

[0131] The electronic device may include components such as a processor 301 with one or more processing cores, a memory 302 with one or more computer-readable storage media, a power supply 303, and an input unit 304. Those skilled in the art will appreciate that Figure 4 The electronic device structure shown in the figure does not constitute a limitation on the electronic device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0132] The processor 301 is the control center of the electronic device. It uses various interfaces and lines to connect various parts of the entire electronic device. By running or executing software programs and / or modules stored in the memory 302, and calling data stored in the memory 302, it executes various functions of the electronic device and processes data, thereby monitoring the electronic device as a whole. Optionally, the processor 301 may include one or more processing cores; preferably, the processor 301 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 301.

[0133] The memory 302 can be used to store software programs and modules. The processor 301 executes various functional applications and information interactions by running the software programs and modules stored in the memory 302. The memory 302 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area may store data created according to the use of the electronic device, etc. In addition, the memory 302 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices. Accordingly, the memory 302 may also include a memory controller to provide the processor 301 with access to the memory 302.

[0134] The electronic device also includes a power supply 303 for supplying power to various components. Preferably, the power supply 303 can be logically connected to the processor 301 through a power management system, so as to manage charging, discharging, and power consumption through the power management system. The power supply 303 can also include any components such as one or more DC or AC power supplies, recharging systems, power supply device debugging circuits, power converters or inverters, and power status indicators.

[0135] The electronic device may further include an input unit 304, which may be used to receive input digital or character information and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.

[0136] Although not shown, the electronic device may further include a display unit, etc., which will not be described in detail herein. Specifically in this embodiment, the processor 301 in the electronic device will load the executable file corresponding to the process of one or more application programs into the memory 302 according to the following instructions, and the processor 301 will run the application program stored in the memory 302, thereby implementing the steps in any one of the information interaction methods provided in the embodiments of the present application.

[0137] Among them, in the embodiment of the present application, the electronic device includes an extended reality device, and the extended reality device includes smart glasses in the form of natural glasses, and the smart glasses have at least the functions of extended reality display, wearing state detection, biometric recognition, human-computer interaction, data processing, etc. It includes a frame, temples, processors, sensors, optical display components, microphones, speakers, etc. There are cavities inside the temples and frames, and circuits and electronic components are placed in the cavities. Sensors include cameras, eye trackers, iris meters, IMUs, gyroscopes, etc. The optical display components include micro-projection optical machines and optical couplers. The micro-projection optical machines can be based on Micro-Oled, Micro-Led, LCOS, or LBS. The optical coupler can be an optical lens or an optical waveguide. The processor can be an XR professional processor or an ordinary general-purpose processor. The frame and temples are the supporting structure of the entire glasses. The temples have a certain elasticity, and the length and clamping force can be adjusted to suit the wearing of users with different head shapes; the camera can take pictures of the user's hands, face, eyes, etc., the microphone can listen to the user's voice, and the processor can calculate and process various data.

[0138] The extended reality device of an embodiment of the present application displays target content information in a virtual display screen of the extended reality device in response to detecting an information interaction request for a peer device, generates target interaction information in response to an interactive operation for the target content information, and sends the target interaction information to the peer device to interact with the peer device.

[0139] Among them, the embodiment of the present application uses the virtual display screen of the extended reality device to interact with the opposite device, thereby utilizing the good privacy characteristics of the virtual display screen to solve the privacy and security issues of the input or output display of sensitive information.

[0140] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.

[0141] A person of ordinary skill in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be completed by instructions, or by controlling related hardware through instructions. The instructions may be stored in a computer-readable storage medium and loaded and executed by a processor.

[0142] To this end, the present application provides a computer-readable storage medium, on which a computer program is stored. The computer program can be loaded by a processor to execute the steps in any information interaction method provided in the present application.

[0143] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.

[0144] The computer-readable storage medium may include: a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0145] Since the instructions stored in the computer-readable storage medium can execute the steps in any information interaction method provided in the present application, the beneficial effects that can be achieved by any information interaction method provided in the present application can be achieved. Please refer to the previous embodiments for details and will not be repeated here.

[0146] The above is a detailed introduction to an information interaction method, device, electronic device and computer-readable storage medium provided by the present application. Specific examples are used herein to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for those skilled in the art, according to the idea of ​​the present invention, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.

Claims

1. An information interaction method, characterized in that: Applied to an extended reality device, the method comprises: In response to detecting an information interaction request for a peer device, displaying target content information in a virtual display screen of the extended reality device; In response to the interactive operation on the target content information, generating target interactive information; The target interaction information is sent to the opposite-end device to perform information interaction with the opposite-end device.

2. The information interaction method according to claim 1, characterized in that: The information interaction request includes an information input request, and in response to detecting the information interaction request for the peer device, displaying target content information in a virtual display screen of the extended reality device includes: In response to detecting an information input request for the peer device, displaying target content information in a virtual display screen of the extended reality device, the target content information including a virtual input control; The generating target interaction information in response to the interaction operation on the target content information includes: In response to an interaction operation on the virtual input control, target interaction information is generated, where the interaction operation includes at least one of an eye movement interaction operation, a head posture operation, a voice operation, or a gesture operation.

3. The information interaction method according to claim 1, characterized in that: The information interaction request includes an information confirmation request, and the response to detecting the information interaction request for the peer device, displaying the target content information in the virtual display screen of the extended reality device includes: In response to detecting an information confirmation request for the peer device, displaying target content information in a virtual display screen of the extended reality device, the target content information including the to-be-confirmed information sent by the peer device; The generating target interaction information in response to the interaction operation on the target content information includes: Display virtual input controls; In response to an interactive operation on the virtual input control, target interaction information for the information to be confirmed is generated.

4. The information interaction method according to claim 1, characterized in that: After generating target interaction information in response to the interaction operation on the target content information, the method further includes: Displaying the target interaction information in the virtual display screen; In response to the editing operation on the target interaction information, obtaining optimization information to be sent; In response to a sending instruction for the optimization information to be sent, the optimization information to be sent is sent to the opposite-end device.

5. The information interaction method according to claim 1, characterized in that: Before generating target interaction information in response to the interaction operation on the target content information, the method further includes: Detecting a wearing state of the extended reality device; If the wearing status indicates that the extended reality device is not worn, a wearing prompt message is issued.

6. An information interaction method, characterized in that: Applied to a peer device, the method comprises: Receive target interaction information sent by an extended reality device, where the target interaction information is generated by the extended reality device in response to an interaction operation on target content information displayed in a virtual display screen, and the target content information is displayed in the virtual display screen by the extended reality device in response to an information interaction request for the opposite device.

7. The information interaction method according to claim 6, characterized in that: The method further comprises: In response to a sending operation for the information to be confirmed, generating an information confirmation request, and sending the information confirmation request to the extended reality device, wherein the extended reality device displays the information to be confirmed and a virtual input control in a virtual display screen in response to the information confirmation request; or, In response to a sending operation for information to be input, an information input request is generated, and the information input request is sent to the extended reality device, wherein the extended reality device displays a virtual input control in a virtual display screen in response to the information input request.

8. An information interaction device, characterized in that: Applied to an extended reality device, the device comprises: A display module, configured to display target content information in a virtual display screen of the extended reality device in response to detecting an information interaction request for a peer device; A generating module, configured to generate target interaction information in response to an interaction operation on the target content information; The sending module is used to send the target interaction information to the opposite-end device so as to perform information interaction with the opposite-end device.

9. An electronic device, characterized in that: The method comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the method implements the steps of the information interaction method as claimed in any one of claims 1 to 5, or implements the steps of the information interaction method as claimed in any one of claims 6 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the information interaction method according to any one of claims 1 to 7 are implemented.

Images