Information display method and device, equipment and storage medium

Abstract

The embodiment of the invention provides an information display method and device, equipment and a storage medium. The method comprises the following steps: displaying a target virtual scene through a display generation component, wherein the target virtual scene comprises a target object; and in response to a preset operation instruction input through one or more input components, displaying the current real environment of the user through the display generation component, and presenting the target object in the real environment. According to the embodiment of the invention, accurate switching display of the target object from the target virtual scene to the real environment can be realized, so that the target object in the target virtual scene can enter the real environment to interact with the user, and the diversity of interaction scenes of the user to the target object is ensured; interaction interestingness between the target object and the user is enhanced, and immersive interaction experience of the user for the target object in a real environment is improved.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of data processing technology, and in particular, to an information display method, device, equipment and storage medium. Background Art

[0002] In a virtual reality scenario, virtual reality technology can enable users to immersively watch various virtual scene images. For example, users can experience real virtual interactive scenes by wearing a head mounted display (HMD).

[0003] Usually, the corresponding video stream can be directly played in the 3D video playback field screen in the virtual space to present the corresponding virtual scene image in the virtual space, which makes the display effect of the virtual scene relatively simple and lacks certain interactive fun. Summary of the invention

[0004] The embodiments of the present application provide an information display method, apparatus, device and storage medium to achieve accurate scene switching of a target object from a target virtual scene to a real environment, thereby ensuring the diversity of user interaction scenes with the target object.

[0005] In a first aspect, an embodiment of the present application provides an information display method, which is applied to an electronic device that communicates with a display generation component and one or more input components, and the method includes:

[0006] Displaying a target virtual scene via the display generation component, wherein the target virtual scene includes a target object;

[0007] In response to a preset operation instruction input via the one or more input components, the real environment in which the user is currently located is displayed via the display generation component, and the target object is presented in the real environment.

[0008] In a second aspect, an embodiment of the present application provides an information display device, which is configured on an electronic device that communicates with a display generation component and one or more input components, and the device includes:

[0009] A virtual scene display module, used for displaying a target virtual scene via the display generation component, wherein the target virtual scene includes a target object;

[0010] The real environment display module is used to respond to the preset operation instructions input via the one or more input components, display the real environment where the user is currently located via the display generation component, and present the target object in the real environment.

[0011] In a third aspect, an embodiment of the present application provides an electronic device, the electronic device comprising:

[0012] A processor and a memory, the memory being used to store a computer program, and the processor being used to call and run the computer program stored in the memory to execute the information display method provided in the first aspect of the present application.

[0013] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium for storing a computer program, which enables a computer to execute the information display method provided in the first aspect of the present application.

[0014] In a fifth aspect, an embodiment of the present application provides a computer program product, including a computer program / instructions, which enable a computer to execute an information display method as provided in the first aspect of the present application.

[0015] Through the technical solution of the present application, a target virtual scene can be displayed via a display generation component. When a preset operation instruction input via one or more input components is detected, the display generation component can switch the display from the target virtual scene to the real environment in which the user is currently located, and display the target object in the target virtual scene in the real environment, thereby achieving accurate switching display of the target object from the target virtual scene to the real environment, so that the target object in the target virtual scene can enter the real environment to interact with the user, ensuring the diversity of the user's interaction scenes with the target object, enhancing the interactive interest between the target object and the user, and improving the user's immersive interactive experience with the target object in the real environment. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0017] Figure 1 A flowchart of an information display method provided in an embodiment of the present application;

[0018] Figure 2 A schematic diagram of the principle of switching a target virtual scene to display a real environment via a display generation component provided in an embodiment of the present application;

[0019] Figure 3 A flowchart of another information display method provided in an embodiment of the present application;

[0020] Figure 4 A schematic diagram of the principle of dividing the safety zones in a real environment provided in an embodiment of the present application;

[0021] Figure 5 A flow chart of a method for determining a presentation position of a target object in a real environment provided in an embodiment of the present application;

[0022] Figure 6 A flowchart of another method for determining a presentation position of a target object in a real environment provided in an embodiment of the present application;

[0023] Figure 7 A flowchart of a method for a specific presentation process of a target object in a real environment provided by an embodiment of the present application;

[0024] Figure 8 A schematic diagram of an information display device provided in an embodiment of the present application;

[0025] Fig. 9 A schematic block diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0026] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0027] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or server that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0028] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or scheme described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or schemes. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0029] Before introducing the specific technical solution of the present application, the application scenario of the present application is first described accordingly:

[0030] In order to realize information display in a virtual reality scene, the present application can display the corresponding virtual scene through a display generation component that communicates with any electronic device. The electronic device can be any extended reality (Extended Reality, referred to as XR) device, which can specifically include virtual reality (Virtual Reality, referred to as VR) devices, augmented reality (Augmented Reality, referred to as AR) devices and mixed reality (Mixed Reality, referred to as MR) devices, etc., and the present application does not limit this.

[0031] The display generation component may be any display screen that has established a communication connection with the above-mentioned electronic device, etc. For example, the display generation component may be a display screen configured on a VR device, an AR device, or an MR device, which is not limited in this application.

[0032] Moreover, in order to realize normal interaction of users in virtual reality scenes, the present application can initiate corresponding interactive operations on the virtual scene displayed by the display generation component through one or more input components that communicate with the above-mentioned electronic devices, thereby supporting users to perform various interactions in the virtual scene.

[0033] Among them, one or more input components can be any control device and information collection module that establishes a communication connection with the above-mentioned electronic device. For example, one or more input components can be a handle configured on a VR device, an AR device, or an MR device, or a collection module for detecting hand operation and eye movement information, or a voice collector for collecting user voice information, etc., and this application does not limit this.

[0034] At present, in order to solve the problem that the scene display effect is relatively single after the user enters any virtual scene, the inventive concept of the present application is: for the target virtual scene displayed by the display generation component, a scene switching function can be set. Then, through the preset operation instructions input by one or more input components, the target virtual scene can be switched and displayed as the real environment where the user is currently located through the display generation component, and the target object in the target virtual scene can be presented in the real environment, so as to realize the accurate switching display of the target object from the target virtual scene to the real environment, so that the target object in the target virtual scene can enter the real environment to interact with the user, ensuring the diversity of the user's interactive scenes with the target object.

[0035] Figure 1A flowchart of an information display method provided in an embodiment of the present application, the method can be applied to an electronic device that communicates with a display generation component and one or more input components, but is not limited thereto. The method can be executed by an information display device provided in the present application, wherein the information display device can be implemented in any software and / or hardware manner. Exemplarily, the information display device can be configured in an electronic device such as AR / VR / MR that can simulate a virtual scene, and the present application does not impose any restrictions on the specific type of electronic device.

[0036] Specifically, Figure 1 As shown, the method may include the following steps:

[0037] S110, displaying a target virtual scene via a display generation component, wherein the target virtual scene includes a target object.

[0038] In this application, in order to realize the display of various information in the virtual reality scene, a display component connected to the electronic device in communication can usually be supported to display the corresponding virtual reality scene. The display generation component can be any display screen, such as a display screen configured on a VR device, an AR device, or an MR device.

[0039] Moreover, the target virtual scene can be a corresponding virtual environment simulated for a certain interactive scene selected by any user, so as to display corresponding interactive operation information in the target virtual scene. For example, the target virtual scene can be a three-dimensional live scene screen of any live studio.

[0040] The target virtual scene may be a simulation environment of the real world, a semi-simulation and semi-fictional virtual scene, or a purely fictional virtual scene.

[0041] In order to achieve normal interaction between users in the target virtual scene, the target virtual scene may include multiple types of virtual objects. Among them, the target object in this application may be a virtual object in the target virtual scene that has specific interaction requirements with the user, such as a virtual person, a virtual prop, etc.

[0042] Generally, after the user activates the virtual reality interactive function of the electronic device, he can first select a virtual scene as the target virtual scene. Then, the target virtual scene is displayed by displaying the generating component, so that the user enters the target virtual scene.

[0043] Among them, various types of virtual objects can be presented in the target virtual scene, including but not limited to the target object in the present application, to support the user to interact with the target object accordingly.

[0044] As an optional implementation scheme in the present application, the target virtual scene in the present application can be a live video stream of any live broadcast room, and the live video stream can be a 180° 3D video stream.

[0045] Then, for the target virtual scene displayed by the display generation component, if the user wants to watch the live content of a certain live broadcast room in the virtual space, the user can select the live broadcast room from multiple live broadcast rooms in the virtual space and enter the live broadcast room to watch the live broadcast.

[0046] Therefore, when a selection instruction of any live broadcast room in the virtual space is detected, it means that the user currently wants to watch the live broadcast content of the live broadcast room in the virtual space. Therefore, in response to the selection instruction of any live broadcast room, the live video stream of the live broadcast room can be obtained. Then, the live video stream of the live broadcast room can be played via the display generation component to present the live broadcast content of the live broadcast room in the 3D playback field of the virtual space, so that the user enters the target virtual scene of the live broadcast room and immersively feels the three-dimensional space and stereoscopic sense under the target virtual scene.

[0047] In some implementable methods, in order to ensure the convenience of interaction in the target virtual scene, after the target virtual scene is displayed via the display generation component, a corresponding control screen and public screen can also be set for the user in the target virtual scene. The control screen can be provided with various types of interactive control controls, such as adjusting the volume, viewing the details of the live broadcast room, etc., so that the user can perform various control operations on the corresponding virtual objects in the target virtual scene by triggering the corresponding interactive control controls. The public screen can be used to display various bullet screens, comments and other messages sent by each audience in the target virtual scene to realize the interaction between each audience in the target virtual scene.

[0048] S120, in response to a preset operation instruction input via one or more input components, display the real environment in which the user is currently located via a display generation component, and present a target object in the real environment.

[0049] After the target virtual scene is displayed via the display generation component, in order to avoid the problem of a relatively single interactive effect of the target virtual scene, the present application may set a scene switching function within the target virtual scene to support each user to switch from the target virtual scene to different real scenes to interact with the same target object.

[0050] For example, Figure 2As shown, the present application can pre-set a scene switching control in the control screen or public screen in the target virtual scene. The scene switching control can be used to switch the display effect of the target virtual scene in a diversified way, supporting switching from a single target virtual scene to the real scenes of different users, so that each user can immerse themselves in the real scene to interact with the same target object accordingly.

[0051] For a scene switching function set in a target real scene, a corresponding scene switching request may be initiated via a preset operation instruction inputted via one or more input components.

[0052] The preset operation instructions inputted via one or more input components may include at least one of the following operation instructions:

[0053] 1) A first operation instruction is generated through preset handle manipulation information input by a user handle.

[0054] The user can manipulate a specific button or joystick on any handle that is communicatively connected to the electronic device to send corresponding handle manipulation information to the electronic device. When the electronic device detects the preset handle manipulation information input via the user's handle, it indicates that the user currently wants to switch the target virtual scene, thereby generating a corresponding first operation instruction.

[0055] 2) A second operation instruction is generated by detecting a preset gesture initiated by the user's hand via the hand detection component.

[0056] The electronic device may be equipped with a corresponding hand detection component to detect various gesture information made by the user's hand in real time. For example, the user's hand image may be captured in real time by a camera on the electronic device. Then, the hand detection component performs corresponding feature analysis on the hand image to identify various gesture information initiated by the user's hand. When the hand detection component on the electronic device detects a preset gesture initiated by the user's hand, it indicates that the user currently wants to switch the target virtual scene, thereby generating a corresponding second operation instruction.

[0057] 3) A third operation instruction is generated by detecting preset eye movement information initiated by the user's eyes through the eye detection component and a preset gesture initiated by the hand detected by the hand detection component.

[0058] The electronic device may be configured with corresponding eye detection components and hand detection components to respectively detect various eye movement information initiated by the user's eyes and various gesture information made by the user's hands. For example, the user's eye image and the user's hand image may be captured in real time by a camera on the electronic device. Then, the eye detection component performs corresponding feature analysis on the eye image to identify various eye movement information initiated by the user's eyes. Moreover, the hand detection component performs corresponding feature analysis on the hand image to identify various gesture information initiated by the user's hands. When the eye detection component on the electronic device detects the preset eye movement information initiated by the user's eyes, and the hand detection component on the electronic device simultaneously detects the preset gesture initiated by the user's hand, it indicates that the user currently wants to switch the target virtual scene, thereby generating a corresponding third operation instruction.

[0059] 4) A fourth operation instruction generated by preset voice information collected by any voice collecting component.

[0060] Any voice collection component installed on the electronic device can collect audio data sent by the user in real time, and perform corresponding voice recognition processing on the audio data to identify it as corresponding voice information. When the electronic device recognizes the preset voice information collected by any voice collection component, it means that the user currently wants to switch the target virtual scene, thereby generating a corresponding fourth operation instruction.

[0061] It can be understood that any one of the above-mentioned first operation instruction, second operation instruction, third operation instruction and fourth operation instruction can be a trigger instruction for the scene switching function in the target real scene.

[0062] Then, after the target virtual scene is displayed via the display generation component, various operation instructions input via one or more input components can be detected in real time to determine whether there is a scene switching requirement for the target virtual scene.

[0063] When a preset operation instruction inputted via one or more input components is detected, it indicates that there is a scene switching demand in the target virtual scene. Then, the video see-through (VST) function configured by the electronic device can be enabled to shoot the real environment around the user in real time, so as to continuously collect the real environment picture in the real scene where the user is.

[0064] Then, the display generation component can stop displaying the target virtual scene and replace it with various real environment pictures taken in real time in the real scene where the user is located, so that the target virtual scene is switched to be presented as the real environment where the user is currently located.

[0065] It should be understood that when the target virtual scene is switched to be displayed as the real environment in which the user is currently located via the display generation component, in order to ensure the normal interaction of the user in the real environment, the control screen and public screen in the target virtual scene will usually continue to be presented in the real environment so that the user can continue to use the various control and interaction functions of the target virtual scene normally.

[0066] Among them, by real-time analysis of the user's position information in the real environment, and then in the real environment displayed by the display generation component, the control screen and public screen in the target virtual scene can be presented facing the user at a default relative position between the user, so that the control screen and public screen in the target virtual scene can always be presented in front of the user, to ensure the user's convenient control and interaction in the real environment.

[0067] After the target virtual scene is switched to the user's current real environment via the display generation component, in order to ensure the user's normal interaction in the real environment, the corresponding target object can first be determined from the various virtual objects in the target virtual scene according to the user's interaction needs.

[0068] In some possible implementations, such as Figure 2 As shown, the target object in the present application may at least include character objects in the target virtual scene, so that the user can interact with each character object in the real environment, such as the anchor of a live broadcast room.

[0069] In order to ensure that after the target virtual scene is switched to the real environment, the user can still interact with the target object in the target virtual scene, the present application can continuously project the target object in the virtual live scene into the real environment displayed after the switch, so that the target object in the target virtual scene can be additionally presented in the real environment. In other words, it can support the target object to enter the real environment currently located by different users from the target virtual scene, so that each user can interact with the same target object in their respective real environment, ensuring the diversity of the user's interactive scenes with the target object and enhancing the interactive fun between the target object and the user.

[0070] In some possible implementations, if the target virtual scene is a live video stream of any live broadcast room, then the target object may be a target object image in a real-time live frame of the live video stream.

[0071] Then, for the target object image, the present application can determine it in the following manner: perform image matting processing on the target object in the real-time live frame of the live video stream to obtain the corresponding target object image.

[0072] That is to say, when a preset operation instruction inputted via one or more input components is detected, for a live video stream of any live broadcast room representing a target virtual scene, the present application can collect the live frame at the current moment from the live video stream of the live broadcast room in real time, thereby obtaining the real-time live frame in the present application. Then, for each real-time live frame, the present application can perform a matte processing on the target object in the real-time live frame, thereby obtaining the corresponding target object image.

[0073] In one embodiment, if the live video stream of any live broadcast room is a binocular video stream captured in real time by a binocular camera of the live broadcast environment where the anchor is located, then the real-time live broadcast frame of the live broadcast room can be the left-eye video frame and the right-eye video frame collected by the left-eye camera and the right-eye camera at the same time in the binocular video stream. Therefore, the present application can start from detecting the preset operation instruction input via one or more input components, and perform image matting processing on the target objects in the left-eye video frame and the right-eye video frame collected by the binocular camera at the same time in the live broadcast environment where the anchor is located, so as to obtain the first target object image in the left-eye video frame and the second target object image in the right-eye video frame. Then, by fusing the first target object image and the second target object image at the same time, the corresponding target object image can be obtained, so that the target object image can be a three-dimensional stereo image.

[0074] According to the above method, the two target object images after the matting processing in the binocular video frame collected at each moment after detecting the preset operation instruction input through one or more input components are fused, so as to continuously obtain the target object image corresponding to each real-time live frame.

[0075] The technical solution provided in the embodiment of the present application can display a target virtual scene via a display generation component. When a preset operation instruction input via one or more input components is detected, the display generation component can switch the display from the target virtual scene to the real environment in which the user is currently located, and display the target object in the target virtual scene in the real environment, thereby realizing accurate switching display of the target object from the target virtual scene to the real environment, so that the target object in the target virtual scene can enter the real environment to interact with the user, ensuring the diversity of the user's interaction scenes with the target object, enhancing the interactive interest between the target object and the user, and improving the user's immersive interactive experience with the target object in the real environment.

[0076] As an optional implementation scheme in the present application, after the target virtual scene is switched to be displayed as the real environment in which the user is currently located via the display generation component, in order to ensure the accurate presentation of the target object in the real environment, the present application needs to accurately analyze the presentation position of the target object in the real environment, so as to explain the specific presentation process of the target object in the real environment.

[0077] Figure 3 A flowchart of another information display method provided in an embodiment of the present application, such as Figure 3 As shown, the method may include the following steps:

[0078] S310: Displaying a target virtual scene via a display generation component, wherein the target virtual scene includes a target object.

[0079] S320: In response to a preset operation instruction input via one or more input components, display the current real environment of the user via a display generation component.

[0080] S330: Determine the relative display position of the target object in the target virtual scene.

[0081] After the target virtual scene is switched to the real environment via the display generation component, in order to ensure that the user can still interact normally with a target object in the target virtual scene, the target object in the target virtual scene needs to appear in the real environment to support the interaction between the user and the target object.

[0082] Therefore, starting from detecting a preset operation instruction input via one or more input components, the present application can analyze in real time the position information of the target object in the target virtual scene and the position information of the virtual camera in the target virtual scene to determine the relative position information between the target object in the target virtual scene and the virtual camera, as the relative display position of the target object in the present application.

[0083] In some embodiments, if the target virtual scene is a live video stream of any live broadcast room, then the present application can analyze in real time the depth information of the target object in each real-time live frame obtained in the live video stream starting from the detection of a preset operation instruction, to determine the relative position information of the target object in the target virtual scene and the virtual camera represented by the live camera, thereby obtaining the relative display position of the target object in the present application.

[0084] Among them, the relative display position of the target object can represent the relative position relationship between the target object and the live broadcast camera in the live broadcast scene where the anchor is located.

[0085] S340, determining the presentation position of the target object in the real environment according to the spatial origin and the relative display position in the real environment, wherein the spatial origin is the spatial position of the user in the real environment when the preset operation instruction is detected.

[0086] Whether in the target virtual scene displayed before the display generation component is switched, or in the real environment displayed after the display generation component is switched, each virtual object in it is usually viewed from the user's perspective, that is, the user can be equivalent to a virtual camera in the target virtual scene. Therefore, when a preset operation instruction inputted via one or more input components is detected, in addition to displaying the real environment in which the user is currently located via the display generation component, the spatial position of the user in the real environment when the preset operation instruction inputted via one or more input components is detected will also be determined. Then, considering that after the real environment is displayed via the display generation component, the user views the target object in the real environment from the user's perspective, and the target object is displayed by the virtual camera in the target virtual scene, the spatial position of the user in the real environment when the preset operation instruction is detected can be used as the spatial origin in the real environment to represent the position of the virtual camera in the target virtual scene.

[0087] Then, by analyzing the relative display position of the target object, the relative position relationship between the target object and the virtual camera can be determined. Then, based on the relative position relationship between the target object and the virtual camera, combined with the position of the virtual camera represented by the spatial origin in the real environment, the presentation position of the target object in the real environment can be determined.

[0088] It is understandable that the target object can move in real time in the target virtual scene, and when the real-time scene image of the target virtual scene is obtained through the virtual camera, the position of the target object in the target virtual scene also changes relative to the virtual camera. After detecting the preset operation instruction input through one or more input components, for the target object in the target virtual scene, the presentation position of the target object in the real environment can be determined by analyzing the relative position relationship between the target object and the virtual camera represented by the relative display position of the target object based on the virtual camera position represented by the spatial origin in the real environment.

[0089] S350: Present the target object in the real environment according to the presentation position.

[0090] After determining the presentation position of the target object in the real environment, the target object can be directly placed at the presentation position in the real environment displayed by the display generation component, so as to accurately present the target object in the real environment.

[0091] S360: If the relative distance between the presentation position and the current position of the user in the real environment is less than a preset distance threshold, a model wearing effect of the target object is presented in the real environment.

[0092] Since the target object may move in real time in the target virtual scene, and the user may also move in real time in the real environment, when the target object is presented in the real environment, the user and the target object may collide with each other.

[0093] Therefore, in order to improve the interaction effect between the user and the target object, the present application can determine the user's position in the real environment in real time as the user's current position in the real environment. Then, by comparing the relative distance between the target object's presentation position in the real environment and the user's current position with the preset distance threshold, it can be determined whether the user and the target object in the real environment are too close to touch each other.

[0094] If the relative distance between the presentation position of the target object in the real environment and the user's current position is less than a preset distance threshold, it means that the user is too close to the target object and may touch it. Therefore, when presenting the target object at the presentation position in the real environment, the present application will further present a model-wearing effect of the target object. The model-wearing effect may include gradually increasing the transparency of the target object in the real environment, so that the target object gradually becomes transparent, and presenting a prompt message "the user is too close to the target object" in the real environment to prompt the user to stay away from the target object, thereby improving the virtual interaction effect.

[0095] S370: If the presentation position is on the boundary of the safety zone in the real environment, a fading effect of the target object is presented in the real environment.

[0096] Since the target virtual scene can be a relatively closed virtual space environment, such as the real live broadcast room where the anchor is broadcasting live, the target virtual scene cannot include objects outside the closed space environment. During the movement of the target object, the target object may step out of the closed space environment, so that the target virtual scene no longer exists with the target object, and the target object cannot continue to be presented in the real environment. In this case, the user will suddenly not be able to see the target object in the real environment, but cannot promptly understand the reason for the disappearance of the target object.

[0097] Therefore, in order to ensure the user's immersive interactive experience in the real environment, the present application can divide the corresponding safety zone in the real environment according to the spatial size of the target virtual scene and use the spatial origin in the real environment to represent the virtual camera position in the target virtual scene.

[0098] Then, after presenting the target object at the presentation position in the real environment, it can be further determined whether the presentation position of the target object is on the boundary of the safety zone in the real environment, so as to analyze whether the target object has stepped out of the spatial environment corresponding to the target virtual scene.

[0099] If the target object is presented at the boundary of the safety zone in the real environment, it means that the target object will step out of the space environment corresponding to the target virtual scene, so that the target object will no longer be presented in the real environment. Therefore, when the target object is presented at the presentation position in the real environment, the application will further present the target object's fading effect in the real environment. Figure 4 As shown, the fade-out effect may include gradually increasing the transparency of the target object in the real environment so that the target object gradually becomes transparent, and presenting a prompt message "the target object leaves and will be back soon" in the real environment to prompt the user to wait for the target object to return to the target virtual scene, thereby ensuring the user's immersive interactive experience in the real environment.

[0100] In some implementations, the boundary of the safety zone in the real environment may be determined by the following steps: determining the boundary of the safety zone in the real environment according to the spatial boundary of the target virtual scene and the spatial origin in the real environment.

[0101] That is to say, when a preset operation instruction inputted via one or more input components is detected, the present application can perform corresponding feature analysis on the real-time scene picture of the target virtual scene at the current moment, thereby extracting scene boundary feature points in the real-time scene picture. Then, according to the relative display position of each scene boundary feature point, the relative position relationship between it and the virtual camera is expressed, thereby determining the spatial boundary of the target virtual scene.

[0102] According to the relative position relationship between the scene boundary feature points and the virtual camera represented by the relative display position of each scene boundary feature point within the spatial boundary of the target virtual scene, combined with the virtual camera position represented by the spatial origin in the real environment, the mapping point position of each scene boundary feature point in the real environment can be determined, so as to form a corresponding safety zone in the real environment and obtain the corresponding safety zone boundary.

[0103] The technical solution provided in the embodiment of the present application analyzes the presentation position of the target object in the real environment through the relative display position of the spatial origin and the target object in the real environment, so that the target object can be accurately presented at the presentation position in the real environment, thereby improving the accurate presentation of the target object in the real environment while ensuring the diversity of the interactive scenes, enhancing the interactive interest between the user and the target object, and improving the user's immersive interactive experience with the target object in the real environment.

[0104] According to one or more embodiments of the present application, after the target object is accurately switched from the target virtual scene to the real environment via the display generation component, various real objects will be presented in the real environment displayed after the switch, and the target object (such as the anchor) will continue to move in the target virtual scene, so that the target object will also continue to move in the real environment.

[0105] This shows that the target object may overlap with the corresponding real object in the real environment. In order to ensure the authenticity of the target object in the real environment, it is required to avoid overlap between the target object and the real object in the real environment as much as possible.

[0106] Therefore, in order to prevent the position of the target object and the real object in the real environment from overlapping, the present application can determine the calibration position of each real object in the real environment in response to the object calibration operation in the real environment.

[0107] That is to say, after the target virtual scene is switched to be displayed as a real environment via the display generation component, the user can be supported to perform spatial calibration on various real objects in the real environment by triggering the calibration control under the perspective function.

[0108] After detecting the trigger operation for the calibration control, the present application can control each real object in the real environment to enter the object calibration state, so as to support the user to perform the corresponding object calibration operation on each real object through the physical controller such as the joystick. At this time, for each real object in the real environment, the present application can detect the object calibration operation of the user on the real object in real time, and perform position analysis on the object calibration operation, so as to obtain the position of the real object in the real environment, which is used as the calibration position of the real object in the present application.

[0109] According to the same calibration method as above, the calibration position of each real object in the real environment can be determined.

[0110] Subsequently, when the target object in the target virtual scene needs to be presented in the real environment, the presentation position of the target object in the real environment, such as Figure 5 As shown, this application can be determined by the following steps:

[0111] S510, determining an initial position of the target object in the real environment according to the spatial origin and the relative display position in the real environment.

[0112] In order to avoid the target object from overlapping with various real objects when it is presented in the real environment, the present application can determine the relative display position of the target object relative to the virtual camera. Then, based on the virtual camera position represented by the spatial origin in the real environment, combined with the relative position relationship between the target object and the virtual camera represented by the relative display position of the target object, the initial position of the target object in the real environment can be preliminarily determined to determine whether the initial position of the target object overlaps with various real objects in the real environment.

[0113] S520, determining a presentation position of the target object in the real environment according to the initial position and the calibrated position of each real object in the real environment.

[0114] After determining the initial position of the target object in the real environment, by comparing the difference between the initial position and the calibrated position of each real object in the real environment, it is determined whether the target object overlaps with the real objects when presented at the initial position.

[0115] If the target object does not overlap with any real object when presented at the initial position, then the initial position can be directly used as the presentation position of the target object in the real environment.

[0116] If the target object will overlap with a certain real object when it is presented at the initial position, then the space occupied by each real object in the real environment can be determined according to the calibrated position of each real object. In this way, the initial position of the target object can be adjusted accordingly to re-determine the presentation position of the target object in the real environment outside the space occupied by each real object, so as to avoid the target object overlapping with the position of each real object when it is presented in the real environment.

[0117] In other embodiments, after the target object is presented in the real environment, in order to ensure normal interaction in the real environment, the user may be supported to perform corresponding drag operations on the target object to enhance the interaction diversity of the target object in the real environment.

[0118] It can be seen that in the real environment, the target object will move accordingly under the user's dragging operation. Figure 6 As shown, the presentation position of the target object in the real environment can also be determined by the following steps:

[0119] S610, in response to the drag operation of the target object, determining an initial position of the target object in the real environment according to the spatial origin and the relative display position in the real environment.

[0120] After the target object is continuously presented in the real environment, the user expresses the user's intention to present the target object in the real environment by dragging the target object presented at the previous moment, and the presentation position of the target object to be presented during the dragging process can be re-planned accordingly.

[0121] Therefore, when the user's dragging operation on the target object is detected, the present application can determine the relative display position of the target object relative to the virtual camera. Then, according to the virtual camera position represented by the spatial origin in the real environment, combined with the relative position relationship between the target object and the virtual camera represented by the relative display position of the target object, the initial position of the target object in the real environment can be preliminarily determined, so that the presentation position of the target object in the real environment can be re-planned based on the initial position of the target object according to the presentation intention represented by the user's dragging operation on the target object.

[0122] S620: Update the initial position according to the drag amplitude corresponding to the drag operation to determine the presentation position of the target object in the real environment.

[0123] After determining the initial position of the target object in the real environment, the drag amplitude corresponding to the drag operation can be determined by analyzing the user's drag operation on the target object, and the drag amplitude can indicate the degree of position change of the target object in the real environment. Then, according to the degree of position change indicated by the drag amplitude, the initial position of the target object in the real environment can be adjusted to obtain the presentation position of the target object in the real environment.

[0124] It can be understood that for the presentation position of the target object in the real environment, the present application can also combine the above two schemes, that is, according to the dragging amplitude corresponding to the dragging operation of the target object and the calibrated position of each real object, the initial position of the target object in the real environment is jointly adjusted to re-determine the presentation position of the target object in the real environment, so as to ensure the accurate presentation of the target object in the real environment.

[0125] In the present application, after determining the presentation position of the target object in the real environment, the target object will be placed at the presentation position in the real environment to accurately present the target object in the real environment.

[0126] However, since the target object in the real environment is presented with respect to the spatial origin used to represent the virtual camera in the real environment, and the user may be constantly moving in the real environment, when viewing the target object from the user's perspective in the real environment, the target object may be distorted because it is not presented facing the user.

[0127] Therefore, in order to improve the authenticity of the target object when it is presented in the real environment, the presentation of the target object in the real environment, such as Figure 7 As shown, this application can be implemented through the following steps:

[0128] S710, determining a presentation direction of the target object according to the presentation position and the current position of the user in the real environment.

[0129] After determining the presentation position of the target object in the real environment, since the target object is presented in the real environment with respect to the spatial origin in the real environment used to represent the position of the virtual camera, in order to avoid distortion when viewing the target object from the user's perspective, the present application can determine the user's position in the real environment in real time as the user's current position in the present application.

[0130] Then, according to the relative relationship between the presentation position of the target object and the current position of the user, the target object can be controlled to transform from a direction toward the origin of the space to a direction toward the user, thereby determining the presentation direction of the target object.

[0131] In some possible implementations, the present application can determine the presentation direction of the target object in the following manner: determine the user's viewing angle rotation value for the target object based on the presentation position, the spatial origin, and the user's current position in the real environment; determine the presentation direction of the target object based on the viewing angle rotation value and a preset angle rotation threshold.

[0132] That is to say, after determining the presentation position of the target object in the real environment, in the real environment, the position point corresponding to the presentation position can be connected with the spatial origin and the position point corresponding to the user's current position in the real environment, respectively, so as to obtain a first connection line between the position point corresponding to the presentation position and the spatial origin, and a second connection line between the position point corresponding to the presentation position and the position point corresponding to the user's current position. Based on this, the angle between the first connection line and the second connection line can be determined as the rotation angle of the target object when it is transformed from the spatial origin to the user's current position, that is, the user's viewing angle rotation value for the target object in this application.

[0133] If the viewing angle rotation value is small, there is little difference between viewing the target object from the user's perspective and viewing the target object from the spatial origin. Therefore, in order to ensure the efficient presentation of the target object, the present application may pre-set a viewing angle rotation threshold to indicate the maximum rotation angle that can be supported when viewing the target object from the user's perspective without distortion.

[0134] Therefore, after determining the user's viewing angle rotation value for the target object, the present application can determine whether there will be distortion if the target object is presented toward the spatial origin by comparing the viewing angle rotation value with the preset angle rotation threshold.

[0135] If the viewing angle rotation value is less than or equal to the preset viewing angle rotation threshold, it means that the target object is presented towards the origin of the space, and there is no distortion when viewing the target object from the user's perspective. Therefore, there is no need to change the orientation of the target object, and it can be determined that the presentation orientation of the target object is still towards the origin of the space.

[0136] If the viewing angle rotation value is greater than the preset viewing angle rotation threshold, it means that if the target object is presented toward the spatial origin, then the target object will be distorted when viewed from the user's perspective. Therefore, the present application can control the target object to be transformed from the direction toward the spatial origin to the direction toward the user, thereby determining that the presentation direction of the target object is the direction toward the user's current position.

[0137] S720, determining a presentation height of the target object according to the current height of the user in the real environment.

[0138] Since the user may squat in the real environment, from the user's perspective, the user may look up or down at the target object presented in the real environment, which will still cause viewing distortion of the target object.

[0139] Therefore, in order to ensure the accurate presentation of the target object, the present application can detect the various movements of the user in the real environment in real time to determine the current height of the user in the real environment. Then, by comparing the height of the target object with the current height of the user, the target object can be controlled to be presented at a height flush with the user's horizontal line of sight, thereby determining the presentation height of the target object to avoid the user viewing the target object from an upward or downward angle, and prevent the target object from being distorted.

[0140] S730: Present the target object at the presentation position in the real environment according to the presentation direction and the presentation height.

[0141] After determining the presentation direction and presentation height of the target object, the target object can be placed at the presentation position of the target object in the real environment according to the presentation direction and presentation height, so that the target object can face the direction of the user in the real environment and be presented at a height that is flush with the user's horizontal line of sight, thereby ensuring an immersive interactive effect when the target object is presented in the real environment.

[0142] The technical solution provided in the embodiment of the present application can display a target virtual scene via a display generation component. When a preset operation instruction input via one or more input components is detected, the display generation component can switch the display from the target virtual scene to the real environment in which the user is currently located, and display the target object in the target virtual scene in the real environment, thereby realizing accurate switching display of the target object from the target virtual scene to the real environment, so that the target object in the target virtual scene can enter the real environment to interact with the user, ensuring the diversity of the user's interaction scenes with the target object, enhancing the interactive interest between the target object and the user, and improving the user's immersive interactive experience with the target object in the real environment.

[0143] Figure 8 This is a schematic diagram of an information display device provided in an embodiment of the present application. The information display device 800 can be configured on an electronic device that communicates with a display generation component and one or more input components. The information display device 800 includes:

[0144] A virtual scene display module 810, configured to display a target virtual scene via the display generation component, wherein the target virtual scene includes a target object;

[0145] The real environment display module 820 is used to respond to the preset operation instructions input via the one or more input components, display the real environment where the user is currently located via the display generation component, and present the target object in the real environment.

[0146] In some implementations, the real environment display module 820 may include:

[0147] A target object determination unit, used to determine a relative display position of the target object in the target virtual scene;

[0148] a presentation position determination unit, configured to determine a presentation position of the target object in the real environment according to a spatial origin in the real environment and the relative display position, wherein the spatial origin is a spatial position of the user in the real environment when the preset operation instruction is detected;

[0149] A target object presenting unit is used to present the target object in the real environment according to the presenting position.

[0150] In some possible implementations, the target object presenting unit may include:

[0151] a presentation direction determining subunit, configured to determine a presentation direction of the target object according to the presentation position and a current position of the user in the real environment;

[0152] A presentation height determination subunit, used to determine the presentation height of the target object according to the current height of the user in the real environment;

[0153] The target object presentation subunit is used to present the target object at the presentation position in the real environment according to the presentation direction and the presentation height.

[0154] In some implementations, the presentation direction determination subunit may be specifically configured to:

[0155] Determining a viewing angle rotation value of the user with respect to the target object according to the presentation position, the spatial origin, and the current position of the user in the real environment;

[0156] The presentation direction of the target object is determined according to the viewing angle rotation value and a preset viewing angle rotation threshold.

[0157] In some possible implementations, the information display device 800 may further include:

[0158] The real object calibration module is used to determine the calibration position of each real object in the real environment in response to the object calibration operation in the real environment.

[0159] In some possible implementations, the presentation position determination unit may be specifically configured to:

[0160] Determining an initial position of the target object in the real environment according to the spatial origin in the real environment and the relative display position;

[0161] The presentation position of the target object in the real environment is determined according to the initial position and the calibrated position of each real object in the real environment.

[0162] In some implementations, the presentation position determination unit may also be specifically configured to:

[0163] In response to the drag operation of the target object, determining an initial position of the target object in the real environment according to the spatial origin in the real environment and the relative display position;

[0164] The initial position is updated according to the drag amplitude corresponding to the drag operation to determine the presentation position of the target object in the real environment.

[0165] In some possible implementations, the information display device 800 may further include:

[0166] The model-wearing effect presentation module is used to present the model-wearing effect of the target object in the real environment if the relative distance between the presentation position and the current position of the user in the real environment is less than a preset distance threshold.

[0167] In some possible implementations, the information display device 800 may further include:

[0168] A fading special effect presentation module is used to present a fading special effect of the target object image in the real environment if the presentation position is on the boundary of the safety zone in the real environment.

[0169] In some implementations, the information display device 800 may further include a safety zone determination module. The safety zone determination module may be used to:

[0170] The safety zone boundary in the real environment is determined according to the spatial boundary of the target virtual scene and the spatial origin in the real environment.

[0171] In some possible implementations, the target virtual scene is a live video stream of any live broadcast room, and the live video stream is a 180° 3D video stream.

[0172] In some possible implementations, the target object is a target object image in a real-time live frame of the live video stream.

[0173] In some implementations, the information display device 800 may further include a target object image determination module. The target object image determination module may be used to:

[0174] The target object in the real-time live frame of the live video stream is subjected to a matting process to obtain a corresponding target object image.

[0175] In some possible implementations, the target object includes at least a character object in the target virtual scene.

[0176] In some implementations, the preset operation instruction input via the one or more input components includes at least one of the following operation instructions:

[0177] A first operation instruction generated by preset handle manipulation information inputted by a user handle;

[0178] A second operation instruction generated by a preset gesture initiated by a user's hand;

[0179] A third operation instruction generated by preset eye movement information initiated by the user's eyes;

[0180] The fourth operation instruction is generated by the preset voice information collected by any voice collecting component.

[0181] In an embodiment of the present application, a target virtual scene can be displayed via a display generation component. When a preset operation instruction input via one or more input components is detected, the display generation component can switch the display from the target virtual scene to the real environment in which the user is currently located, and display the target object in the target virtual scene in the real environment, thereby achieving accurate switching display of the target object from the target virtual scene to the real environment, so that the target object in the target virtual scene can enter the real environment to interact with the user, ensuring the diversity of the user's interaction scenes with the target object, enhancing the interactive interest between the target object and the user, and improving the user's immersive interactive experience with the target object in the real environment.

[0182] It should be understood that the device embodiment and the method embodiment in the present application may correspond to each other, and similar descriptions may refer to the method embodiment in the present application. To avoid repetition, they will not be described here.

[0183] Specifically, Figure 8 The device 800 shown can execute any method embodiment provided in this application, and Figure 8 The aforementioned and other operations and / or functions of each module in the illustrated device 800 are respectively for implementing the corresponding processes of the aforementioned method embodiment, and for the sake of brevity, they are not described in detail herein.

[0184] The above method embodiment of the embodiment of the present application is described from the perspective of the functional module in conjunction with the accompanying drawings. It should be understood that the functional module can be implemented in hardware form, can be implemented by instructions in software form, and can also be implemented by a combination of hardware and software modules. Specifically, the steps of the method embodiment in the embodiment of the present application can be completed by the hardware integrated logic circuit and / or software form instructions in the processor, and the steps of the method disclosed in the embodiment of the present application can be directly embodied as a hardware decoding processor to perform, or a combination of hardware and software modules in the decoding processor to perform. Optionally, the software module can be located in a mature storage medium in the field such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, an electrically erasable programmable memory, a register, etc. The storage medium is located in a memory, and the processor reads the information in the memory, and completes the steps in the above method embodiment in conjunction with its hardware.

[0185] Fig. 9 A schematic block diagram of an electronic device provided in an embodiment of the present application.

[0186] like Fig. 9 As shown, the electronic device 900 may include:

[0187] The memory 910 and the processor 920, the memory 910 is used to store the computer program and transmit the program code to the processor 920. In other words, the processor 920 can call and run the computer program from the memory 910 to implement the method in the embodiment of the present application.

[0188] For example, the processor 920 may be configured to execute the above method embodiments according to instructions in the computer program.

[0189] In some embodiments of the present application, the processor 920 may include but is not limited to:

[0190] General-purpose processor, digital signal processor (DSP), application-specific integrated circuit (ASIC), field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, etc.

[0191] In some embodiments of the present application, the memory 910 includes but is not limited to:

[0192] Volatile memory and / or non-volatile memory. Among them, the non-volatile memory can be read-only memory (ROM), programmable ROM (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM) or flash memory. The volatile memory can be random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link DRAM (SLDRAM), and direct RAM bus random access memory (DR RAM).

[0193] In some embodiments of the present application, the computer program may be divided into one or more modules, which are stored in the memory 910 and executed by the processor 920 to complete the method provided by the present application. The one or more modules may be a series of computer program instruction segments capable of completing specific functions, and the instruction segments are used to describe the execution process of the computer program in the electronic device 900.

[0194] like Fig. 9 As shown, the electronic device may also include:

[0195] The transceiver 930 may be connected to the processor 920 or the memory 910 .

[0196] The processor 920 may control the transceiver 930 to communicate with other devices, specifically, to send information or data to other devices, or to receive information or data sent by other devices. The transceiver 930 may include a transmitter and a receiver. The transceiver 930 may further include an antenna, and the number of antennas may be one or more.

[0197] It should be understood that the various components in the electronic device 900 are connected via a bus system, wherein the bus system includes not only a data bus but also a power bus, a control bus and a status signal bus.

[0198] The present application also provides a computer storage medium on which a computer program is stored. When the computer program is executed by a computer, the computer is enabled to execute the method of the above method embodiment.

[0199] The embodiment of the present application also provides a computer program product including instructions, which, when executed by a computer, enables the computer to execute the method of the above method embodiment.

[0200] When software is used for implementation, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (digital subscriber line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integration. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a digital video disc (digital video disc, DVD)), or a semiconductor medium (e.g., a solid state drive (solid state disk, SSD)), etc.

[0201] The above are only specific implementations of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. An information display method, characterized in that: Applied on an electronic device in communication with a display generation component and one or more input components, the method comprises: Displaying a target virtual scene via the display generation component, wherein the target virtual scene includes a target object; In response to a preset operation instruction input via the one or more input components, the real environment in which the user is currently located is displayed via the display generation component, and the target object is presented in the real environment.

2. The method according to claim 1, characterized in that The presenting the target object in the real environment comprises: Determining a relative display position of the target object within the target virtual scene; Determining the presentation position of the target object in the real environment according to the spatial origin in the real environment and the relative display position, wherein the spatial origin is the spatial position of the user in the real environment when the preset operation instruction is detected; The target object is presented in the real environment according to the presentation position.

3. The method according to claim 2, characterized in that The presenting the target object in the real environment according to the presentation position includes: Determining a presentation direction of the target object according to the presentation position and a current position of a user in the real environment; Determining a presentation height of the target object according to a current height of the user in the real environment; The target object is presented at the presentation position in the real environment according to the presentation direction and the presentation height.

4. The method according to claim 3, characterized in that The determining the presentation direction of the target object according to the presentation position and the current position of the user in the real environment includes: Determining a viewing angle rotation value of the user with respect to the target object according to the presentation position, the spatial origin, and the current position of the user in the real environment; The presentation direction of the target object is determined according to the viewing angle rotation value and a preset viewing angle rotation threshold.

5. The method according to claim 2, characterized in that: The method further comprises: In response to the object calibration operation in the real environment, a calibration position of each real object in the real environment is determined.

6. The method according to claim 5, characterized in that The determining the presentation position of the target object in the real environment according to the spatial origin in the real environment and the relative display position includes: Determining an initial position of the target object in the real environment according to the spatial origin in the real environment and the relative display position; The presentation position of the target object in the real environment is determined according to the initial position and the calibrated position of each real object in the real environment.

7. The method according to claim 2, characterized in that The determining the presentation position of the target object in the real environment according to the spatial origin in the real environment and the relative display position also includes: In response to the drag operation of the target object, determining an initial position of the target object in the real environment according to the spatial origin in the real environment and the relative display position; The initial position is updated according to the drag amplitude corresponding to the drag operation to determine the presentation position of the target object in the real environment.

8. The method according to claim 2, characterized in that: After presenting the target object in the real environment according to the presentation position, the method further includes: If the relative distance between the presentation position and the current position of the user in the real environment is less than a preset distance threshold, the model wearing effect of the target object is presented in the real environment.

9. The method according to claim 2, characterized in that: After presenting the target object in the real environment according to the presentation position, the method further includes: If the presentation position is on the boundary of the safety zone in the real environment, a fading effect of the target object is presented in the real environment.

10. The method according to claim 9, characterized in that The safety zone boundary in the real environment is determined by the following steps: The safety zone boundary in the real environment is determined according to the spatial boundary of the target virtual scene and the spatial origin in the real environment.

11. The method according to claim 1, characterized in that: The target virtual scene is a live video stream of any live broadcast room, and the live video stream is a 180° 3D video stream.

12. The method according to claim 11, characterized in that The target object is a target object image in a real-time live frame of the live video stream.

13. The method according to claim 12, characterized in that The target object image is determined by the following steps: The target object in the real-time live frame of the live video stream is subjected to a matting process to obtain a corresponding target object image.

14. The method according to claim 1, characterized in that The target object at least includes a character object in the target virtual scene.

15. The method according to claim 1, characterized in that The preset operation instructions inputted via the one or more input components include at least one of the following operation instructions: A first operation instruction generated by preset handle manipulation information inputted by a user handle; A second operation instruction generated by detecting a preset gesture initiated by a user's hand via a hand detection component; A third operation instruction generated by detecting preset eye movement information initiated by the user's eyes by the eye detection component and a preset gesture initiated by the hand by the hand detection component; The fourth operation instruction is generated by the preset voice information collected by any voice collecting component.

16. An information display device, characterized in that: The device is configured on an electronic device in communication with a display generating component and one or more input components, and includes: A virtual scene display module, used for displaying a target virtual scene via the display generation component, wherein the target virtual scene includes a target object; The real environment display module is used to respond to the preset operation instructions input via the one or more input components, display the real environment where the user is currently located via the display generation component, and present the target object in the real environment.

17. An electronic device, characterized in that: include: processor; as well as A memory, configured to store executable instructions of the processor; Wherein, the processor is configured to execute the information display method described in any one of claims 1-15 by executing the executable instructions.

18. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the information display method according to any one of claims 1 to 15 is implemented.

19. A computer program product comprising instructions, characterized in that When the computer program product runs on an electronic device, the electronic device executes the information display method according to any one of claims 1 to 15.

Images