Display method and apparatus

Abstract

This application provides a display method and apparatus, belonging to the field of electronic device technology. The method includes: acquiring a mirror object within the visual field of an AR device; if the mirror object is an object in a real scene, performing reflection processing on a first object to generate a second object, and reconstructing a virtual scene displayed by the AR device based on the first object, the second object, the third object, and the fourth object; the first object is a virtual object displayed within the visual field of the AR device, the third object is a real object acquired within the visual field of the AR device, and the fourth object is an image of the third object after reflection by the mirror object; if the mirror object is an object in the virtual scene displayed by the AR device, performing reflection processing on a first fused object based on the mirror object to generate a second fused object, and reconstructing the virtual scene displayed by the AR device based on the first fused object and the second fused object.

Description

Technical Field

[0001] This application belongs to the field of electronic equipment technology, and specifically relates to a display method and apparatus. Background Technology

[0002] With the continuous development of Augmented Reality (AR) technology, AR-based devices are widely accepted and used by users, such as AR glasses and AR helmets. AR devices can generate virtual scenes that include virtual objects and adjust the virtual scenes according to the real objects existing in the real scene, making the virtual scenes more realistic.

[0003] However, when there are reflective surfaces such as lake surfaces in the virtual or real-world scenes, the virtual scene deviates from the real-world scene, which reduces the display effect of the virtual scene. Summary of the Invention

[0004] The purpose of this application is to provide a display method and apparatus that can solve the problem that the virtual scene displayed by the AR device deviates from the real scene, thereby reducing the display effect of the virtual scene.

[0005] In a first aspect, embodiments of this application provide a display method applied to an AR device, the AR device being capable of displaying a virtual scene, the method comprising:

[0006] Obtain the mirror object within the visual locality of the AR device;

[0007] When the mirror object is an object in a real scene, the first object is subjected to reflection processing to generate a second object, and the virtual scene displayed by the AR device is reconstructed based on the first object, the second object, the third object, and the fourth object; the first object is a virtual object displayed within the visual field of the AR device, the third object is a real object obtained within the visual field of the AR device, and the fourth object is an image of the third object after being reflected by the mirror object;

[0008] When the mirror object is an object in the virtual scene displayed by the AR device, a second fused object is generated by performing reflection processing on the first fused object based on the mirror object, and the virtual scene displayed by the AR device is reconstructed based on the first fused object and the second fused object; the first fused object is an object generated by performing fusion processing on the first object and the third object.

[0009] Secondly, embodiments of this application provide a display device, the device comprising:

[0010] The acquisition module is used to acquire mirror objects within the visual locality;

[0011] The first processing module is configured to, when the mirror object is an object in a real scene, perform reflection processing on the first object to generate a second object, and reconstruct a virtual scene based on the first object, the second object, the third object, and the fourth object; the first object is a virtual object displayed within the visual field of the display device, the third object is a real object obtained within the visual field of the display device, and the fourth object is an image of the third object after being reflected by the mirror object;

[0012] The second processing module is configured to, when the mirror object is an object in the virtual scene displayed by the display device, perform reflection processing on the first fused object based on the mirror object to generate a second fused object, and reconstruct the virtual scene displayed by the display device based on the first fused object and the second fused object; the first fused object is an object generated based on the fusion processing of the first object and the third object.

[0013] Thirdly, embodiments of this application provide an electronic device including a processor, a memory, and a program or instructions stored in the memory and executable on the processor, wherein the program or instructions, when executed by the processor, implement the steps of the method described in the first aspect.

[0014] Fourthly, embodiments of this application provide a readable storage medium on which a program or instructions are stored, which, when executed by a processor, implement the steps of the method described in the first aspect.

[0015] Fifthly, embodiments of this application provide a chip, the chip including a processor and a communication interface, the communication interface being coupled to the processor, the processor being used to run programs or instructions to implement the method as described in the first aspect.

[0016] In a sixth aspect, embodiments of this application provide a computer program product stored in a storage medium, which is executed by at least one processor to implement the method described in the first aspect.

[0017] In this embodiment, regardless of whether the mirror object is an object in a real scene or an object in a virtual scene displayed by the AR device, the mirror object reflects the real objects within the visual field of the AR device and the virtual objects displayed by the AR device, thereby reconstructing the virtual scene displayed by the AR device, thereby improving the display effect of the virtual scene generated by the AR device and making the virtual scene more realistic. Attached Figure Description

[0018] Figure 1 This is a flowchart of the display method provided in the embodiments of this application;

[0019] Figure 2 This is one of the application scenario diagrams of the display method provided in the embodiments of this application;

[0020] Figure 3 This is one of the application flowcharts of the display method provided in the embodiments of this application;

[0021] Figure 4 This is the second application scenario diagram of the display method provided in the embodiments of this application;

[0022] Figure 5 This is the second application flowchart of the display method provided in the embodiments of this application;

[0023] Figure 6 This is a structural diagram of the display device provided in the embodiments of this application;

[0024] Figure 7 This is a structural diagram of the electronic device provided in the embodiments of this application;

[0025] Figure 8 This is a hardware structure diagram of the electronic device provided in the embodiments of this application. Detailed Implementation

[0026] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.

[0027] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.

[0028] The display method provided in this application is applied to a display device, which may be an AR device, a smart wearable device, a smart TV, or other devices. The following description uses an AR device as an example to illustrate the technical solution.

[0029] This application provides a display method. The display method provided by this application will be described in detail below with reference to the accompanying drawings, through specific embodiments and application scenarios.

[0030] This application provides a display method; please refer to [link / reference]. Figure 1 , Figure 1 This is a flowchart of a display method provided in an embodiment of this application. The display method provided in an embodiment of this application includes the following steps:

[0031] S101, Obtain the mirror object within the visual locality of the AR device.

[0032] It should be understood that AR devices can create virtual scenes, and the objects in the virtual scenes are called virtual objects. AR devices can also capture real-world scenes within the visual field, and the objects in the real-world scenes are called real objects. These objects include, but are not limited to, objects and human bodies.

[0033] The aforementioned mirror objects can be objects existing in the real scene or objects in the virtual scene displayed by the AR device. Optionally, the aforementioned mirror objects include, but are not limited to, mirrors, water surfaces, and other planar objects that can emit images.

[0034] S102, if the mirror object is an object in a real scene, the first object is subjected to reflection processing to generate a second object, and the virtual scene displayed by the AR device is reconstructed based on the first object, the second object, the third object and the fourth object.

[0035] It should be noted that the first object mentioned above is a virtual object displayed within the visual field of the AR device, the third object mentioned above is a real object within the visual field of the AR device, and the fourth object mentioned above is an image of the third object after being reflected by the mirror object.

[0036] The mirror object in this step is an object in the real-world scene. In this case, the first object can be reflected based on the mirror object to generate the second object, and then the virtual scene displayed by the AR device can be reconstructed based on the first object, the second object, the third object, and the fourth object. For specific implementation details, please refer to the following embodiments.

[0037] S103, if the mirror object is an object in the virtual scene displayed by the AR device, the first fused object is subjected to reflection processing based on the mirror object to generate a second fused object, and the virtual scene displayed by the AR device is reconstructed based on the first fused object and the second fused object.

[0038] It should be noted that the first fusion object mentioned above is an object generated based on the fusion processing of the first object and the third object.

[0039] The mirror object in this step is an object in the virtual scene. In this case, the first object and the third object can be merged to generate a first merged object, and then the first merged object can be reflected based on the mirror object to generate a second merged object. For a detailed implementation of generating the second merged object, please refer to the following embodiments.

[0040] It should be understood that after obtaining the first fusion object and the second fusion object, the virtual scene corresponding to the AR device is reconstructed based on the first fusion object and the second fusion object using AR technology, so as to improve the display effect and realism of the reconstructed virtual scene.

[0041] In this embodiment, regardless of whether the mirror object is an object in a real scene or an object in a virtual scene displayed by the AR device, the mirror object reflects the real objects within the visual field of the AR device and the virtual objects displayed by the AR device, thereby reconstructing the virtual scene displayed by the AR device, thereby improving the display effect of the virtual scene generated by the AR device and making the virtual scene more realistic.

[0042] Optionally, the step of performing reflection processing on the first object to generate the second object includes:

[0043] Based on the first object and the positional relationship between the first object and the fourth object, a fifth object is generated;

[0044] The display size and content of the fifth object are adjusted to obtain the second object.

[0045] It should be understood that the real-world scene and the virtual scene created by the AR device are constructed based on the same three-dimensional coordinate system, meaning that the first object and the fourth object mentioned above can reside in the same three-dimensional coordinate system. The positional relationship between the first object and the fourth object is used to characterize their relative spatial position, which can be understood as the spatial distance between the coordinates of the first object and the coordinates of the fourth object in the three-dimensional coordinate system.

[0046] In this embodiment, a fifth object is generated based on the first object and the positional relationship between the first and fourth objects. This fifth object is a virtual object. For details on how the fifth object is generated, please refer to subsequent embodiments. Furthermore, the display size and content of the fifth object are adjusted to obtain a second object.

[0047] To facilitate understanding of the first object, second object, third object, and fourth object involved in this embodiment, please refer to [link to relevant documentation]. Figure 2 , Figure 2 The illustrations show real-world application scenarios where reflective surfaces exist. Figure 2In the diagram, identifier 210 is used to represent the first object, identifier 220 is used to represent the second object, identifier 230 is used to represent the third object, identifier 240 is used to represent the fourth object, identifier 250 is used to represent the mirror object, identifier 260 is used to represent the first merged object, and identifier 270 is used to represent the second merged object.

[0048] from Figure 2 It can be seen that the first object 210 and the second object 220 are virtual objects, the third object 230 and the fourth object 240 are real objects, and the second object 220 is an object obtained by reflecting the first object 210 based on the mirror object 250.

[0049] In this embodiment, when a mirror object exists in the real scene, the real object and the virtual object after being reflected by the mirror object in the real scene are obtained. Then, in subsequent steps, the virtual scene corresponding to the AR device is reconstructed, thereby improving the display effect of the virtual scene generated by the AR device and making the virtual scene more realistic.

[0050] Optionally, generating the fifth object based on the first object and the positional relationship between the first object and the fourth object includes:

[0051] Based on the positional relationship between the third object and the fourth object, the reflection angle of the third object in the mirror object is determined;

[0052] The fifth object is generated by using a pre-acquired real-time positioning and mapping algorithm, based on the positional relationship between the first object and the fourth object, as well as the reflection angle.

[0053] It should be understood that if there is a certain angle between the mirror object and the third object, then the second object generated by reflecting the first object through the mirror object will also have a certain angle with the mirror object. In this embodiment, the reflection angle of the third object in the mirror object can be determined based on the positional relationship between the third object and the fourth object.

[0054] As mentioned above, both the real-world scene and the virtual scene created by the AR device are constructed based on the same three-dimensional coordinate system. The reflection angle can be determined by comparing the coordinates of the third object and the fourth object in the same three-dimensional coordinate system. For example, if the fourth object is rotated 30 degrees clockwise along the horizontal line relative to the third object, then the reflection angle of the third object in the mirror object can be determined to be 30 degrees.

[0055] In this embodiment, after determining the reflection angle, the first object, the coordinates of the first object, the coordinates of the fourth object, and the aforementioned reflection angle are input into the pre-acquired Simultaneous Localization and Mapping (SLAM) algorithm, and the fifth object is generated through the SLAM algorithm.

[0056] Optionally, adjusting the display size and content of the fifth object to obtain the second object includes:

[0057] Adjust the display size of the fifth object according to the ratio between the display size of the third object and the display size of the fourth object;

[0058] The fifth image, after being resized, is flipped to obtain the second object.

[0059] It should be understood that the display size and content of the object obtained after reflection may differ from the display size and content of the object before reflection. In this case, it is necessary to adjust the display size and content of the virtual object after reflection.

[0060] The third object is a real object that is not reflected by the mirror object, and the fourth object is a real object that is reflected by the mirror object. In this embodiment, the display size of the fifth object is adjusted according to the ratio between the display size of the third object and the display size of the fourth object.

[0061] For example, if the display size of the fourth object is 20% smaller than that of the third object, then the display size of the fifth object needs to be reduced by 20%.

[0062] Furthermore, since the fifth object is a reflection of the mirror object, it is necessary to flip the fifth object 180 degrees and adjust the display content of the fifth image to obtain the second object.

[0063] In this embodiment, by adjusting the display size and display content of the fifth object, a second object is obtained, so that the image features of the second object conform to the image characteristics of the virtual object after reflection by the mirror object, thereby improving the realism of the second object.

[0064] Optionally, reconstructing the virtual scene displayed by the AR device based on the first object, the second object, the third object, and the fourth object includes:

[0065] The first object and the third object are fused together to generate a first fused object, and the second object and the fourth object are fused together to generate a second fused object;

[0066] Based on the first fusion object and the second fusion object, the virtual scene displayed by the AR device is reconstructed.

[0067] In this embodiment, after obtaining the first object, the second object, the third object, and the fourth object, the first object and the third object are fused to generate the first fused object, and the second object and the fourth object are fused to generate the second fused object.

[0068] Optionally, the first and third objects can be processed using a SLAM algorithm to obtain a first merged object; the second and fourth objects can be processed using a SLAM algorithm to obtain a second merged object. The SLAM algorithm described above can merge virtual and real objects based on the positional relationship between them displayed on the AR device, and then render the merged virtual and real objects to generate the merged object.

[0069] In other methods, the first and third objects can be processed using the Laplace pyramid algorithm to obtain the first fused object; the second and fourth objects can be processed using the Laplace pyramid algorithm to obtain the second fused object. The specific fusion processing method is not limited here.

[0070] In this embodiment, after obtaining the first fusion object and the second fusion object, the virtual scene corresponding to the AR device is reconstructed based on the first fusion object and the second fusion object using AR technology, so as to improve the display effect and realism of the reconstructed virtual scene.

[0071] To better understand the technical solutions for reconstructing virtual scenes when mirrored objects exist in the real-world environment, please refer to [link / reference]. Figure 3 .

[0072] like Figure 3 As shown, the system acquires a first object displayed by the AR device, a third object in the real scene, and a fourth object emitted by a mirror object; it uses a SLAM algorithm to reflect the first object to obtain the third object; it uses a SLAM algorithm to fuse the first object and the third object to obtain a first fused object, and uses a SLAM algorithm to fuse the second object and the fourth object to obtain a second fused object; and it reconstructs the virtual scene of the AR device based on the first fused object and the second fused object.

[0073] Optionally, generating a second blended object by performing reflection processing on the first blended object based on the mirror object includes:

[0074] Using a pre-acquired real-time positioning and mapping algorithm, a second fusion object is generated based on the first fusion object and the positional relationship between the first fusion object and the mirror object.

[0075] In this embodiment, the positional relationship between the first fused object and the mirror object is obtained, and the first fused object and the positional relationship are input into the SLAM algorithm to generate the second fused object.

[0076] The positional relationship between the first fused object and the mirror object is used to characterize the spatial relative position between the first fused object and the mirror object in the virtual scene. The spatial relative position can be understood as the spatial distance between the coordinates of the first fused object and the coordinates of the mirror object in the three-dimensional coordinate system. The real scene captured by the AR device and the virtual scene generated by the AR device can be constructed based on the three-dimensional coordinate system.

[0077] To better understand the technical solutions for reconstructing virtual scenes when mirrored objects exist in the virtual scene generated by an AR device, please refer to [link / reference]. Figure 4 and Figure 5 .

[0078] Please see Figure 4 , Figure 4 This illustrates an application scenario where a virtual scene generated by an AR device contains mirrored objects. Figure 4 In the diagram, identifier 410 is used to represent the first object, identifier 420 is used to represent the third object, identifier 430 is used to represent the mirror object, identifier 440 is used to represent the first merged object, and identifier 450 is used to represent the second merged object.

[0079] from Figure 4 It can be seen that the first object 410 is a virtual object, the third object 420 is a real object, the first fusion object 440 is an object generated based on the first object 410 and the third object 420, and the second fusion object 450 is an object generated based on the first fusion object 440 and the positional relationship between the first fusion object 440 and the mirror object 430.

[0080] like Figure 5 As shown, the first object in the virtual scene generated by the AR device and the third object in the real scene are obtained; the first object and the third object are fused using the SLAM algorithm to obtain the first fused object; the positional relationship between the first fused object and the mirror object is obtained; the second fused object is generated using the SLAM algorithm based on the first fused object and the above positional relationship; the virtual scene of the AR device is reconstructed based on the first fused object and the second fused object.

[0081] The display device provided in this application will be described in detail below with reference to the accompanying drawings, through specific embodiments and application scenarios.

[0082] like Figure 6 As shown, the display device 600 includes:

[0083] Module 601 is used to acquire mirror objects within the visual locality.

[0084] The first processing module 602 is used to perform reflection processing on the first object to generate a second object when the mirror object is an object in a real scene, and to reconstruct a virtual scene based on the first object, the second object, the third object and the fourth object; the first object is a virtual object displayed in the visual field of the display device, the third object is a real object obtained in the visual field of the display device, and the fourth object is an image of the third object after being reflected by the mirror object;

[0085] The second processing module 603 is configured to, when the mirror object is an object in the virtual scene displayed by the display device, perform reflection processing on the first fused object based on the mirror object to generate a second fused object, and reconstruct the virtual scene displayed by the display device based on the first fused object and the second fused object; the first fused object is an object generated based on the fusion processing of the first object and the third object.

[0086] Optionally, the first processing module 602 is specifically used for:

[0087] Based on the first object and the positional relationship between the first object and the fourth object, a fifth object is generated;

[0088] The display size and content of the fifth object are adjusted to obtain the second object.

[0089] Optionally, the first processing module 602 is further specifically used for:

[0090] Based on the positional relationship between the third object and the fourth object, the reflection angle of the third object in the mirror object is determined;

[0091] The fifth object is generated by using a pre-acquired real-time positioning and mapping algorithm, based on the positional relationship between the first object and the fourth object, as well as the reflection angle.

[0092] Optionally, the first processing module 602 is further specifically used for:

[0093] Adjust the display size of the fifth object according to the ratio between the display size of the third object and the display size of the fourth object;

[0094] The fifth image, after being resized, is flipped to obtain the second object.

[0095] Optionally, the first processing module 602 is further specifically used for:

[0096] The first object and the third object are fused together to generate a first fused object, and the second object and the fourth object are fused together to generate a second fused object;

[0097] Based on the first fusion object and the second fusion object, the virtual scene displayed by the display device is reconstructed.

[0098] Optionally, the second processing module 603 is specifically used for:

[0099] Using a pre-acquired real-time positioning and mapping algorithm, a second fusion object is generated based on the first fusion object and the positional relationship between the first fusion object and the mirror object.

[0100] In this embodiment, regardless of whether the mirror object is an object in a real scene or an object in a virtual scene displayed by the AR device, the mirror object reflects the real objects within the visual field of the AR device and the virtual objects displayed by the AR device, thereby reconstructing the virtual scene displayed by the AR device, thereby improving the display effect of the virtual scene generated by the AR device and making the virtual scene more realistic.

[0101] The display device in this application embodiment can be an electronic device or a component within an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices besides a terminal. For example, the electronic device can be a mobile phone, tablet computer, laptop computer, PDA, in-vehicle electronic device, mobile internet device (MID), augmented reality (AR) / virtual reality (VR) device, robot, wearable device, ultra-mobile personal computer (UMPC), netbook, or personal digital assistant (PDA), etc. It can also be a server, network attached storage (NAS), personal computer (PC), television set (TV), ATM, or self-service machine, etc. This application embodiment does not specifically limit the scope of the device.

[0102] The display device in this application embodiment can be a device with an operating system. This operating system can be Android, iOS, or other possible operating systems; this application embodiment does not specifically limit the specific operating system used.

[0103] The display device provided in this application embodiment can achieve... Figure 1 The various processes implemented in the method implementation examples will not be described again here to avoid repetition.

[0104] Optionally, such as Figure 7 As shown, this application embodiment also provides an electronic device 700, including a processor 701, a memory 702, and a program or instructions stored in the memory 702 and executable on the processor 701. When the program or instructions are executed by the processor 701, they implement the various processes of the above-described display method embodiment and achieve the same technical effect. To avoid repetition, they will not be described again here.

[0105] It should be noted that the electronic devices in the embodiments of this application include the mobile electronic devices and non-mobile electronic devices described above.

[0106] Figure 8 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of this application.

[0107] The electronic device 800 includes, but is not limited to, components such as: radio frequency unit 801, network module 802, audio output unit 803, input unit 804, sensor 805, display unit 806, user input unit 808, interface unit 808, memory 809, and processor 810.

[0108] Those skilled in the art will understand that the electronic device 800 may also include a power supply (such as a battery) for supplying power to various components. The power supply may be logically connected to the processor 810 through a power management system, thereby enabling functions such as managing charging, discharging, and power consumption through the power management system. Figure 8 The electronic device structure shown does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.

[0109] The input unit 804 is also used to acquire mirror objects within the visual locality of the AR device;

[0110] The processor 810 is also configured to, when the mirror object is an object in a real scene, perform reflection processing on the first object to generate a second object, and reconstruct the virtual scene displayed by the AR device based on the first object, the second object, the third object and the fourth object;

[0111] When the mirror object is an object in the virtual scene displayed by the AR device, the first fused object is subjected to reflection processing based on the mirror object to generate a second fused object, and the virtual scene displayed by the AR device is reconstructed based on the first fused object and the second fused object.

[0112] In this embodiment, regardless of whether the mirror object is an object in a real scene or an object in a virtual scene displayed by the AR device, the mirror object reflects the real objects within the visual field of the AR device and the virtual objects displayed by the AR device, thereby reconstructing the virtual scene displayed by the AR device, thereby improving the display effect of the virtual scene generated by the AR device and making the virtual scene more realistic.

[0113] It should be understood that, in this embodiment, the input unit 804 may include a graphics processing unit (GPU) 8041 and a microphone 8042. The GPU 8041 processes image data of still images or videos obtained by an image capture device (such as a camera) in video capture mode or image capture mode. The display unit 806 may include a display panel 8061, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, or the like. The user input unit 806 includes at least one of a touch panel 8061 and other input devices 8062. The touch panel 8061 is also called a touch screen. The touch panel 8061 may include a touch detection device and a touch controller. Other input devices 8062 may include, but are not limited to, physical keyboards, function keys (such as volume control buttons, power buttons, etc.), trackballs, mice, and joysticks, which will not be described in detail here.

[0114] The memory 809 can be used to store software programs and various data. The memory 809 may primarily include a first storage area for storing programs or instructions and a second storage area for storing data. The first storage area may store the operating system, application programs or instructions required for at least one function (such as sound playback, image playback, etc.). Furthermore, the memory 809 may include volatile memory or non-volatile memory, or both. The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus RAM (DRRAM). The memory 809 in the embodiments of this application includes, but is not limited to, these and any other suitable types of memory.

[0115] Processor 810 may include one or more processing units; optionally, processor 810 integrates an application processor and a modem processor, wherein the application processor mainly handles operations involving the operating system, user interface, and applications, and the modem processor mainly handles wireless communication signals, such as a baseband processor. It is understood that the aforementioned modem processor may also not be integrated into processor 810.

[0116] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the above-described display method embodiments and achieve the same technical effect. To avoid repetition, they will not be described again here.

[0117] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.

[0118] This application embodiment also provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run programs or instructions to implement the various processes of the above-described display method embodiments and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0119] It should be understood that the chip mentioned in the embodiments of this application may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.

[0120] This application provides a computer program product, which is stored in a storage medium and executed by at least one processor to implement the various processes of the above-described display method embodiments, and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0121] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0122] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0123] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

Claims

1. A display method applied to an AR device, characterized in that, The AR device can display a virtual scene, and the display method comprises: acquiring a mirror object in a visual local area of the AR device; in a case where the mirror object is an object in a real scene, performing reflection processing on a first object to generate a second object, and reconstructing a virtual scene displayed by the AR device based on the first object, the second object, a third object and a fourth object; the first object is a virtual object displayed in the visual local area of the AR device, the third object is a real object in the visual local area of the AR device acquired, and the fourth object is an image of the third object after reflection by the mirror object; in a case where the mirror object is an object in a virtual scene displayed by the AR device, performing reflection processing on a first fusion object based on the mirror object to generate a second fusion object, and reconstructing the virtual scene displayed by the AR device based on the first fusion object and the second fusion object; the first fusion object is an object generated based on fusion processing on the first object and the third object.

2. The method of claim 1, wherein, The reflection processing on the first object to generate the second object comprises: generating a fifth object based on the first object and a positional relationship between the first object and the fourth object; adjusting a display size and display content of the fifth object to obtain the second object.

3. The method of claim 2, wherein, The generation of the fifth object based on the first object and the positional relationship between the first object and the fourth object comprises: determining a reflection angle of the third object in the mirror object based on a positional relationship between the third object and the fourth object; generating the fifth object according to the first object, the positional relationship between the first object and the fourth object and the reflection angle by using a pre-acquired simultaneous localization and mapping algorithm.

4. The method of claim 2, wherein, The adjustment of the display size and display content of the fifth object to obtain the second object comprises: adjusting the display size of the fifth object according to a ratio between a display size of the third object and a display size of the fourth object; performing flip processing on the fifth object after the adjustment of the display size to obtain the second object.

5. The method of claim 1, wherein, The reconstruction of the virtual scene displayed by the AR device based on the first object, the second object, the third object and the fourth object comprises: generating a first fusion object by fusion processing on the first object and the third object, and generating a second fusion object by fusion processing on the second object and the fourth object; reconstructing the virtual scene displayed by the AR device based on the first fusion object and the second fusion object.

6. The method of claim 1, wherein, The reflection processing on the first fusion object based on the mirror object to generate the second fusion object comprises: generating the second fusion object according to the first fusion object and a positional relationship between the first fusion object and the mirror object by using a pre-acquired simultaneous localization and mapping algorithm.

7. A display device, characterized by comprising: comprises: an acquisition module configured to acquire a mirror object in a visual local area; The first processing module is configured to, in a case where the mirror object is an object in a real scene, perform reflection processing on the first object to generate a second object, and reconstruct a virtual scene based on the first object, the second object, a third object, and a fourth object; the first object is a virtual object displayed in a visual local area of the display device, the third object is a real object in the visual local area of the display device, and the fourth object is an image of the third object after being reflected by the mirror object; The second processing module is configured to, in a case where the mirror object is an object in a virtual scene displayed by the display device, perform reflection processing on a first fusion object based on the mirror object to generate a second fusion object, and reconstruct the virtual scene displayed by the display device based on the first fusion object and the second fusion object. The first fusion object is an object generated based on fusion processing on the first object and the third object.

8. The apparatus of claim 7, wherein, The first processing module is specifically configured to: generate a fifth object based on the first object and a positional relationship between the first object and the fourth object; and adjust a display size and display content of the fifth object to obtain the second object.

9. An electronic device, comprising: The display device comprises a processor, a memory, and a program or instructions stored in the memory and executable on the processor, and the program or instructions are executed by the processor to implement the steps of the display method according to any one of claims 1-6.

10. A readable storage medium, characterized by, The readable storage medium stores a program or instructions, and the program or instructions are executed by the processor to implement the steps of the display method according to any one of claims 1-6.

Images