Augmented reality content display method, device, electronic device and storage medium

Abstract

The present disclosure provides a method, device, electronic device, and storage medium for displaying augmented reality content. The method comprises: obtaining augmented reality (AR) content; fusing a target transparent video with the AR content according to different fusion methods based on the display stage corresponding to the AR content to obtain fused animation content; and displaying the fused animation content. In the disclosed embodiment, augmented reality (AR) content at different display stages is combined with a target transparent video to obtain fused animation content, which is beneficial for improving the display effect of the animation content at different stages, thereby enhancing the user's viewing experience.

Description

Technical Field

[0001] The present disclosure relates to the field of augmented reality (AR) technology, and in particular to a method for displaying AR content, an AR content display device, an electronic device, and a computer-readable storage medium. Background Art

[0002] Augmented reality (AR) is a technology that integrates virtual information with real-world scenes. Due to its advantages of strong presence, high entertainment value, and strong interactivity, AR technology has been widely used in various fields.

[0003] However, current AR content usually directly displays virtual objects based on real-world scene content, which makes the virtual objects appear stiff and affects the user's AR experience. Summary of the Invention

[0004] The embodiments of the present disclosure at least provide a method for displaying augmented reality content, a display device for augmented reality content, an electronic device, and a computer-readable storage medium, which can make the display effect of AR animation content in different display stages softer, thereby helping to enhance the user's viewing experience.

[0005] The present disclosure provides a method for displaying augmented reality content, including:

[0006] Get augmented reality (AR) content;

[0007] According to the display stage corresponding to the AR content, the target transparent video is fused with the AR content according to different fusion methods to obtain fused animation content;

[0008] The fused animation content is displayed.

[0009] In the disclosed embodiment, according to different display stages, the target transparent video is fused with the AR content according to different fusion methods to obtain fused animation content. That is, in the fused animation content, different animation effects can be presented in different display stages, which is conducive to improving the display effect of the fused animation content, and further conducive to improving the user's viewing experience.

[0010] In an optional embodiment, the target transparent video includes foreground content for blocking the AR content and transparent background content; and fusing the target transparent video with the AR content according to different fusion methods according to the display stage corresponding to the AR content to obtain fused animation content includes:

[0011] Determining the current display stage of the AR content;

[0012] Determining, according to a current presentation stage of the AR content, foreground content that matches the AR content in the current presentation stage;

[0013] Based on the foreground content that matches the AR content, the target transparent video is fused with the AR content according to different fusion methods to obtain the fused animation content.

[0014] In the disclosed embodiment, the target transparent video includes foreground content for blocking the AR content. The foreground content of the target transparent video in different display stages may be different. That is, as the AR content of the current display stage changes, the foreground content of the target transparent video is matched thereto. In this way, the relevance and adaptability between the target transparent video and the AR content can be improved.

[0015] In an optional embodiment, the target transparent video includes foreground content for blocking the AR content and transparent background content; and fusing the target transparent video with the AR content according to different fusion methods according to the display stage corresponding to the AR content to obtain fused animation content includes:

[0016] Determining the current display stage of the AR content;

[0017] determining, according to a current display stage of the AR content, an occlusion range of the AR content by the foreground content, wherein the occlusion range of the AR content by the foreground content is different in different display stages;

[0018] Based on the occlusion range of the AR content by the foreground content, the target transparent video is fused with the AR content to obtain fused animation content.

[0019] In the disclosed embodiment, the occlusion range of the AR content by the foreground content in the current display stage is determined according to the current display stage. That is, different occlusion effects of the target transparent video on the AR content can be presented in different display stages. In this way, the changes between the animation content in different display stages are more coherent and smooth, which is conducive to improving the display effect of the fused animation content, and further helps to improve the user's viewing experience.

[0020] In an optional embodiment, the display stage includes at least one of an opening display stage, a transition display stage, and an exit display stage;

[0021] The occlusion range of the AR content by the foreground content in the opening presentation phase is greater than the occlusion range of the AR content by the foreground content in the transition presentation phase; or

[0022] The occlusion range of the AR content by the foreground content in the exit presentation stage is greater than the occlusion range of the AR content by the foreground content in the transition presentation stage.

[0023] In the disclosed embodiments, by limiting the relationship between the occlusion range of AR content by foreground content during the opening presentation phase and the occlusion range of AR content by foreground content during the transition presentation phase, a smooth transition effect can be achieved from the opening presentation phase to the transition presentation phase. Similarly, a smooth transition effect can also be achieved from the transition presentation phase to the exit presentation phase, thereby enhancing the user viewing experience.

[0024] In an optional embodiment, the target transparent video includes an opening transparent video; and when the current display stage of the AR content is the opening display stage, determining the occlusion range of the AR content by the foreground content based on the current display stage of the AR content includes:

[0025] Determining, according to the opening presentation stage, an occlusion range of a target virtual object in the AR content by the foreground content in the opening transparent video, wherein the occlusion range of the target virtual object by the foreground content in the opening transparent video is greater than a first preset range;

[0026] The step of fusing the target transparent video with the AR content based on the occlusion range of the foreground content on the AR content to obtain fused animation content includes:

[0027] The opening transparent video is fused with the AR content according to an occlusion range of the target virtual object in the AR content by the foreground content in the opening transparent video to obtain the fused animation content.

[0028] In the embodiment of the present disclosure, in the opening display stage, the occlusion range of the foreground content on the AR content in the opening display stage is first determined, and then the opening transparent video and the AR content are merged based on the occlusion range to achieve occlusion of the target virtual object by the foreground content in the opening transparent video. That is, in this display stage, the user cannot see the target virtual object. In this way, the AR content in the opening display stage has a mysterious color, which can attract the user's attention.

[0029] In an optional embodiment, the target transparent video includes a transition transparent video; and when the current display stage of the AR content is the transition display stage, determining the occlusion range of the AR content by the foreground content based on the current display stage of the AR content includes:

[0030] Determining, according to the transition display stage, an occlusion range of the target virtual object in the AR content by the foreground content in the transition transparent video, wherein the occlusion range of the target virtual object by the foreground content in the transition transparent video is greater than a second preset range and less than a third preset range;

[0031] The step of fusing the target transparent video with the AR content based on the occlusion range of the foreground content on the AR content to obtain fused animation content includes:

[0032] According to the occlusion range of the target virtual object in the AR content by the foreground content in the transition transparent video, the transition transparent video is fused with the AR content to obtain the fused animation content.

[0033] In the disclosed embodiment, the occlusion range of the AR content by the foreground content in the transition display stage is first determined, and then the transition transparent video and the AR content are merged based on the occlusion range to achieve partial occlusion of the target virtual object by the foreground content in the transition transparent video. By setting the occlusion range, the target virtual object in the AR content appears to be looming, and the AR display effect presented in the transition display stage can achieve a smooth transition, which is conducive to improving the user's viewing experience.

[0034] In an optional embodiment, the target transparent video includes an exit transparent video; and when the current display stage of the AR content is the exit display stage, determining the occlusion range of the AR content by the foreground content based on the current display stage of the AR content includes:

[0035] Determining, according to the exit presentation stage, an occlusion range of a target virtual object in the AR content by the foreground content in the exit transparent video, wherein the occlusion range of the target virtual object by the foreground content in the exit transparent video is greater than a fourth preset range;

[0036] The step of fusing the target transparent video with the AR content based on the occlusion range of the foreground content on the AR content to obtain fused animation content includes:

[0037] The exiting transparent video is fused with the AR content according to an occlusion range of the target virtual object in the AR content by the foreground content in the exiting transparent video to obtain the fused animation content.

[0038] In the disclosed embodiment, the occlusion range of the AR content by the foreground content in the exit presentation phase is first determined. Then, based on the occlusion range, the exit transparent video is merged with the AR content to achieve occlusion of the target virtual object by the foreground content in the exit transparent video. That is, in the exit presentation phase, the target virtual object will appear to disappear from the animation content, thereby making the presentation of the animation content more complete.

[0039] In an optional implementation, the animation content is displayed via a display device. During the display of the animation content, the display position of the foreground content in the animation content remains unchanged relative to the display position of the display device.

[0040] In the disclosed embodiment, during the display of animation content, the display position of the foreground content in the animation content remains unchanged relative to the display position of the display device. That is, even if the display device moves or rotates, the occlusion position of the foreground content remains unchanged. In this way, the occurrence of the situation where the foreground content cannot achieve the preset occlusion effect on the AR content can be reduced.

[0041] In an optional embodiment, the animation content is displayed by a display device. During the display of the animation content, the display form of the foreground content in the animation content changes as the relative position of the display device relative to the target virtual object changes.

[0042] In the embodiment of the present disclosure, the position of the display device relative to the target virtual object can be changed, that is, if the display device moves or rotates, the target virtual object will be displayed from different perspectives. Since the foreground content blocks the target virtual object, the display form of the foreground content displayed in the display device will also change. In this way, the display effect of the foreground content can be improved.

[0043] The present disclosure also provides an augmented reality content display device, comprising:

[0044] A generation module for obtaining augmented reality (AR) content;

[0045] a fusion module, configured to fuse the target transparent video with the AR content according to different fusion methods according to the display stage corresponding to the AR content, to obtain fused animation content;

[0046] The display module is used to display the fused animation content.

[0047] In an optional embodiment, the target transparent video includes foreground content for blocking the AR content and transparent background content; and the fusion module is specifically configured to:

[0048] Determining the current display stage of the AR content;

[0049] Determining, according to a current presentation stage of the AR content, foreground content that matches the AR content in the current presentation stage;

[0050] Based on the foreground content that matches the AR content, the target transparent video is fused with the AR content according to different fusion methods to obtain the fused animation content.

[0051] In an optional embodiment, the target transparent video includes foreground content for blocking the AR content and transparent background content; and the fusion module is specifically configured to:

[0052] Determining the current display stage of the AR content;

[0053] determining, according to a current display stage of the AR content, an occlusion range of the AR content by the foreground content, wherein the occlusion range of the AR content by the foreground content is different in different display stages;

[0054] Based on the occlusion range of the AR content by the foreground content, the target transparent video is fused with the AR content to obtain fused animation content.

[0055] In an optional embodiment, the display stage includes at least one of an opening display stage, a transition display stage, and an exit display stage;

[0056] The occlusion range of the AR content by the foreground content in the opening presentation phase is greater than the occlusion range of the AR content by the foreground content in the transition presentation phase; or

[0057] The occlusion range of the AR content by the foreground content in the exit presentation stage is greater than the occlusion range of the AR content by the foreground content in the transition presentation stage.

[0058] In an optional implementation, the target transparent video includes an opening transparent video; and the fusion module is specifically configured to:

[0059] When the current display stage of the AR content is the opening display stage, determining, according to the opening display stage, an occlusion range of the target virtual object in the AR content by the foreground content in the opening transparent video, wherein the occlusion range of the target virtual object by the foreground content in the opening transparent video is greater than a first preset range;

[0060] The opening transparent video is fused with the AR content according to an occlusion range of the target virtual object in the AR content by the foreground content in the opening transparent video to obtain the fused animation content.

[0061] In an optional implementation, the target transparent video includes a transition transparent video; and the fusion module is specifically configured to:

[0062] When the current display stage of the AR content is the transition display stage, determining, according to the transition display stage, an occlusion range of the foreground content in the transition transparent video on the target virtual object in the AR content, wherein the occlusion range of the foreground content in the transition transparent video on the target virtual object is greater than a second preset range and less than a third preset range;

[0063] According to the occlusion range of the target virtual object in the AR content by the foreground content in the transition transparent video, the transition transparent video is fused with the AR content to obtain the fused animation content.

[0064] In an optional implementation, the target transparent video includes an exit transparent video; and the fusion module is specifically configured to:

[0065] When the current display stage of the AR content is the exit display stage, determining, according to the exit display stage, an occlusion range of the target virtual object in the AR content by the foreground content in the exit transparent video, wherein the occlusion range of the target virtual object by the foreground content in the exit transparent video is greater than a fourth preset range;

[0066] The exiting transparent video is fused with the AR content according to an occlusion range of the target virtual object in the AR content by the foreground content in the exiting transparent video to obtain the fused animation content.

[0067] In an optional implementation, the animation content is displayed via a display device. During the display of the animation content, the display position of the foreground content in the animation content remains unchanged relative to the display position of the display device.

[0068] In an optional embodiment, the animation content is displayed by a display device. During the display of the animation content, the display form of the foreground content in the animation content changes as the relative position of the display device relative to the target virtual object changes.

[0069] An embodiment of the present disclosure also provides an electronic device, including: a processor, a memory and a bus, wherein the memory stores machine-readable instructions executable by the processor. When the electronic device is running, the processor and the memory communicate through the bus, and when the machine-readable instructions are executed by the processor, the above-mentioned method for displaying augmented reality content is executed.

[0070] An embodiment of the present disclosure further provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the computer program executes the above-mentioned method for displaying augmented reality content.

[0071] For a description of the effects of the above-mentioned augmented reality content display device, electronic device, and computer-readable storage medium, please refer to the description of the above-mentioned augmented reality content display method, which will not be repeated here.

[0072] In order to make the above-mentioned objectives, features and advantages of the present disclosure more obvious and easy to understand, preferred embodiments are given below and described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0073] In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the following briefly introduces the drawings required for use in the embodiments. The drawings herein are incorporated into and constitute a part of the specification. These drawings illustrate embodiments consistent with the present disclosure and, together with the specification, are used to illustrate the technical solutions of the present disclosure. It should be understood that the following drawings only illustrate certain embodiments of the present disclosure and should not be regarded as limiting the scope. For those of ordinary skill in the art, other relevant drawings can be obtained based on these drawings without inventive effort.

[0074] Figure 1 A schematic diagram showing an execution body of a method for displaying augmented reality content provided by an embodiment of the present disclosure;

[0075] Figure 2 A flowchart of a method for displaying augmented reality content provided by an embodiment of the present disclosure;

[0076] Figure 3 A schematic diagram of an AR content provided by an embodiment of the present disclosure;

[0077] Figure 4 A schematic diagram of a target transparent video provided by an embodiment of the present disclosure;

[0078] Figure 5 A flowchart of a method for fusing a target transparent video with AR content provided by an embodiment of the present disclosure;

[0079] Figure 6A schematic diagram of fused animation content provided by an embodiment of the present disclosure;

[0080] Figure 7 A flowchart of another method for fusing a target transparent video with AR content provided by an embodiment of the present disclosure;

[0081] Figure 8 A fusion schematic diagram of the opening presentation stage provided by an embodiment of the present disclosure;

[0082] Figure 9 A fusion diagram of a transition display stage provided by an embodiment of the present disclosure;

[0083] Figure 10 A fusion schematic diagram of an exit display stage provided by an embodiment of the present disclosure;

[0084] Figure 11 A schematic diagram of a display mode of foreground content provided by an embodiment of the present disclosure;

[0085] Figure 12 A schematic structural diagram of an augmented reality content display device provided by an embodiment of the present disclosure;

[0086] Figure 13 A schematic diagram of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0087] In order to make the purpose, technical solutions and advantages of the embodiments of the present disclosure clearer, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of the embodiments. The components of the embodiments of the present disclosure generally described and shown in the drawings herein can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present disclosure provided in the drawings is not intended to limit the scope of the disclosure for which protection is sought, but merely represents selected embodiments of the present disclosure. Based on the embodiments of the present disclosure, all other embodiments obtained by those skilled in the art without making creative work are within the scope of protection of the present disclosure.

[0088] It should be noted that similar reference numerals and letters denote similar items in the following drawings, and therefore, once an item is defined in one drawing, it does not need to be further defined or explained in subsequent drawings.

[0089] The term "and / or" herein simply describes an association relationship, indicating that three relationships can exist. For example, A and / or B can represent the existence of A alone, the simultaneous existence of A and B, and the existence of B alone. In addition, the term "at least one" herein refers to any combination of at least two of any one or more of a plurality of items. For example, "at least one of A, B, and C" can represent any one or more elements selected from the set consisting of A, B, and C.

[0090] Augmented Reality (AR) technology is a technology that integrates virtual information with real scenes. It widely uses a variety of technical means such as multimedia, three-dimensional modeling, real-time tracking and registration, intelligent interaction, and sensing. It simulates computer-generated virtual information such as text, images, three-dimensional models, music, and videos, and applies them to real scenes. The two types of information complement each other, thereby achieving "enhancement" of the real scene.

[0091] Due to its advantages of strong presence, high entertainment value, and strong interactivity, AR technology has been widely used in various fields, such as the construction industry, gaming, and cultural tourism. Since the user's viewing experience of AR content is often affected by the display effect of AR content, how to improve the display effect of AR content has become one of the goals currently pursued by researchers in this field.

[0092] Based on the above research, an embodiment of the present disclosure provides a method for displaying augmented reality content, which includes: obtaining augmented reality AR content; according to the display stage corresponding to the AR content, fusing the target transparent video with the AR content according to different fusion methods to obtain fused animation content; and displaying the fused animation content.

[0093] In the disclosed embodiment, the target transparent video is fused with the AR content according to different display stages to obtain fused animation content. That is, in the fused animation content, different animation effects can be presented in different display stages, which is conducive to improving the display effect of the fused animation content, and further conducive to improving the user's viewing experience.

[0094] See also Figure 1 , which is a schematic diagram of an execution subject of a method for displaying augmented reality content provided by an embodiment of the present disclosure, such as Figure 1As shown in , the method is performed by an electronic device 100, which includes a server 10 and a terminal. The server 10 can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud storage, big data, and artificial intelligence platforms. In some embodiments, the method can also be applied to an implementation environment consisting of a terminal and server 10.

[0095] The terminal can be Figure 1 The smartphone 20, desktop computer 30 or laptop computer 40 shown in FIG. 4 may also be Figure 1 Tablet computers, smart speakers, smart watches, etc. not shown in the figure are not limited.

[0096] In an optional embodiment, the terminal may further include an AR (Augmented Reality) device, a VR (Virtual Reality) device, an MR (Mixed Reality) device, etc. For example, the AR device may be a mobile phone or tablet computer with AR functionality, or may be AR glasses, which are not limited here.

[0097] It should be noted that, when the execution subject is the server 10, the server 10 can communicate with the smartphone 20, the desktop computer 30 or the laptop 40 respectively through the network 50. The network 50 can include various connection types, such as wired, wireless communication links or fiber optic cables.

[0098] Optionally, the method for displaying augmented reality content may be implemented by a processor calling computer-readable instructions stored in a memory.

[0099] See also Figure 2 , Figure 2 This is a flow chart of a method for displaying augmented reality content provided by an embodiment of the present disclosure. Figure 2 As shown, the embodiment of the present disclosure provides a method for displaying augmented reality content, including the following steps S101 to S103:

[0100] S101, obtaining augmented reality (AR) content.

[0101] Specifically, after acquiring the real scene content, the augmented reality AR content can be generated based on the real scene content and the target virtual object.

[0102] Wherein, the real scene content can be based on the Figure 1The real scene is captured in real time by the camera device of the terminal 20 shown in FIG. , and the content of the real scene can reflect in real time the environmental information of the environment in which the camera device is currently located, such as roads, pedestrians, scenery, vehicles, etc.

[0103] The target virtual object may include a virtual human image, a virtual animal image, a virtual plant image, a virtual cartoon image, etc., which is not limited here.

[0104] It is understood that after obtaining the real scene content, the target virtual object that matches the real scene content can be determined. For example, if the real scene content obtained is a cultural relic museum, the ancient cultural relics (such as ancient utensils or ancient books) that match the cultural relic museum can be determined. For another example, if the real scene obtained is an animal theme park, the animals (such as dinosaurs or lions) that match the animal theme park can be determined. Then, the real scene content is integrated with the target virtual object to generate AR content.

[0105] The following uses an animal theme park as an example to explain AR content. Figure 3 , which is a schematic diagram of an AR content provided by an embodiment of the present disclosure, Figure 3 The display screen 60 shown in the figure is one of the screens of AR content, wherein the dinosaur 61 included in the screen 60 is the target virtual object, and the animal-themed real scene 62 in the screen 60 is the real scene content.

[0106] In some embodiments, the acquisition of real-world scene content can be based on a trigger event. For example, when a trigger event is detected, the real-world scene content is acquired. Optionally, the trigger event can be triggered based on location information. Specifically, the location information of the terminal can be acquired. If the location information of the terminal is detected to be in a preset area, it is considered that a trigger event is detected, and the terminal will acquire the real-world scene content of the current environment. In other embodiments, the trigger event can also be generated based on a manual trigger operation of the user. For example, if the terminal is in a preset area, a trigger event is generated when the user triggers the acquisition icon in the display interface of the terminal.

[0107] S102 , according to the display stage corresponding to the AR content, the target transparent video is fused with the AR content according to different fusion methods to obtain fused animation content.

[0108] The display phase corresponding to the AR content includes at least one of an opening display phase, a transition display phase, and an exit display phase.

[0109] The target transparent video includes foreground content for shielding the AR content and transparent background content.

[0110] For example, see Figure 4 , which is a schematic diagram of a target transparent video provided by an embodiment of the present disclosure, such as Figure 4 As shown in , the target transparent video 70 includes foreground content 71 for blocking AR content and transparent background content 72. That is, "fog" 71 is the display content of the target transparent video in the animation content. In the embodiment of the present disclosure, the display form of the foreground content is "fog". In other embodiments, the display form of the foreground content can also be "smoke", "gravel" or "flame", etc., which are not limited here. The transparent background content 72 can be display content formed by transparent pixels. In some embodiments, the transparent video is generated based on an image in PNG format, where the image in PNG format supports the transparency feature of the alpha channel. In this way, the transparency of the pixels can be changed to obtain a transparent video with foreground content and background content.

[0111] It should be noted that the target transparent video can be generated based on a single transparent image or multiple transparent images, without limitation. Since the AR content changes in real time, for ease of understanding, the embodiments of this disclosure are illustrated using a single transparent image as an example.

[0112] In some embodiments, the foreground image that matches the AR content can be determined based on the AR content in the current display stage. Specifically, for step S102, when the target transparent video is fused with the AR content according to the display stage corresponding to the AR content to obtain the fused animation content, please refer to Figure 5 , which may include the following S102A~S102C:

[0113] S102A: Determine the current display stage of the AR content.

[0114] S102B: Determine, based on the current display stage of the AR content, foreground content that matches the AR content in the current display stage.

[0115] S102C: Based on the foreground content matching the AR content, fuse the target transparent video with the AR content according to different fusion methods to obtain the fused animation content.

[0116] It can be understood that in different display stages, the foreground content used to block the AR content is different. Specifically, since the AR content displayed in different display stages is different, the corresponding foreground content can be determined. For example, if the current display stage is the opening display stage, the matching foreground content, such as flames, can be determined based on the AR content in the opening display stage; if the current display stage is the transition display stage, the matching foreground content, such as smoke, can be determined based on the AR content in the transition display stage; if the current display stage is the exit display stage, the matching foreground content, such as gravel, can be determined based on the AR content in the exit display stage. That is, as the AR content of the current display stage changes, the foreground content of the target transparent video is matched with it, so that the relevance and adaptability between the target transparent video and the AR content can be improved.

[0117] After determining the foreground content corresponding to the AR content in the current display phase, the target transparent video can be fused with the AR content according to different fusion methods to obtain the fused animation content.

[0118] For example, see Figure 6 , is a schematic diagram of a fused animation content provided by an embodiment of the present disclosure, Figure 6 The image 80 shown in the figure is one of the fused animation content images. The AR content in the fused animation content includes the real scene content 81 of the animal theme park, the target virtual object 82, and the foreground content 83 of the transparent video. The foreground content can block the AR content. It should be noted that the range of the foreground content blocking the AR content can be set according to actual needs.

[0119] S103: Display the fused animation content.

[0120] It is understood that the fused animation content can be displayed through a display device, wherein the display device can be Figure 1 The terminal 20 shown in FIG. 1 may also be Figure 1 Tablet computers, smart speakers, smart watches, AR devices, VR devices, or MR devices not shown in the figure are not limited here.

[0121] In the disclosed embodiment, according to different display stages, the target transparent video is fused with the AR content according to different fusion methods to obtain fused animation content. That is, in the fused animation content, different animation effects can be presented in different display stages, which is conducive to improving the display effect of the fused animation content, and further conducive to improving the user's viewing experience.

[0122] In some embodiments, with respect to step S102, in the display phase corresponding to the AR content, the target transparent video is fused with the AR content according to different fusion methods to obtain the fused animation content. Figure 7 , which may include the following S1021 to S1023:

[0123] S1021: Determine the current display stage of the AR content.

[0124] S1022: Determine, based on the current display stage of the AR content, a range of the AR content that is blocked by the foreground content.

[0125] In different display stages, the occlusion range of the AR content by the foreground content is different.

[0126] S1023 : Based on the occlusion range of the AR content by the foreground content, fuse the target transparent video with the AR content to obtain fused animation content.

[0127] It is understood that to achieve a better animation presentation, the extent to which the foreground content blocks the AR content can be determined based on the current presentation stage of the AR content. This means that the extent to which the foreground content blocks the AR content varies across presentation stages. The specific process of fusing the target transparent video with the AR content based on the extent to which the foreground content blocks the AR content for different presentation stages is described below.

[0128] In the disclosed embodiment, the occlusion range of the AR content by the foreground content in the current display stage is determined according to the current display stage. That is, different occlusion effects of the target transparent video on the AR content can be presented in different display stages. In this way, the changes between the animation content in different display stages are more coherent and smooth, which is conducive to improving the display effect of the fused animation content, and further helps to improve the user's viewing experience.

[0129] In some embodiments, the foreground content in the opening presentation phase blocks the AR content to a greater extent than the foreground content in the transition presentation phase. This allows for a smooth transition from the opening presentation phase to the transition presentation phase. Similarly, the foreground content in the exit presentation phase blocks the AR content to a greater extent than the foreground content in the transition presentation phase. This allows for a smooth transition from the transition presentation phase to the exit presentation phase, thereby enhancing the user's viewing experience.

[0130] According to the above content, since the display stage corresponding to the AR content includes at least one of the opening display stage, the transition display stage and the exit display stage, in the embodiment of the present disclosure, Figure 8 、 Figure 9 as well as Figure 10 The fusion diagrams at different presentation stages are shown in , and the fusion process of each presentation stage is described in detail.

[0131] Since the target transparent videos in different display stages are different, that is, the opening display stage corresponds to the opening transparent video, the transition display stage corresponds to the transition transparent video, and the exit display stage corresponds to the exit transparent video.

[0132] In some embodiments, the target transparent video includes an opening transparent video. When the current display stage of the AR content is the opening display stage, when determining the occlusion range of the foreground content on the AR content based on the current display stage of the AR content, the occlusion range of the foreground content in the opening transparent video on the target virtual object in the AR content can be first determined in the opening display stage, wherein the occlusion range of the foreground content on the AR content is greater than a first preset range. Then, based on the occlusion range of the foreground content on the target virtual object, the opening transparent video is fused with the AR content to obtain fused animation content.

[0133] Among them, the first preset range can be set according to actual conditions. Specifically, it can be set according to the size of the target virtual object in the opening display stage. In this way, by completely blocking the target virtual object, the mystery of the opening display stage can be enhanced, which is conducive to attracting the user's attention.

[0134] For example, see Figure 8 , is a fusion diagram of the opening presentation stage provided by the embodiment of the present disclosure. Figure 8 As shown in , the opening transparent video 801 includes foreground content 5011 for blocking the target virtual object and transparent background content 8012. The opening transparent video 801 is fused with the AR content 802 to generate fused animation content 803. In the animation content 803 in the opening display stage, the foreground content 8011 (i.e., "fog") in the opening transparent video blocks the target virtual object 8021.

[0135] In other embodiments, the target transparent video includes a transition transparent video; when the current display stage of the AR content is the transition display stage, the occlusion range of the foreground content in the transition transparent video on the target virtual object in the AR content can be determined according to the transition display stage, wherein the occlusion range of the foreground content in the transition transparent video on the target virtual object is greater than the second preset range and less than the third preset range, that is, the occlusion range of the foreground content in the transition transparent video on the target virtual object is set to be greater than the second preset range and less than the third preset range, so as to achieve partial occlusion of the target virtual object, and then, according to the occlusion range of the foreground content in the transition transparent video on the target virtual object in the AR content, the transition transparent video is fused with the AR content to obtain the fused animation content.

[0136] Among them, the second preset range and the third preset range can be set according to actual conditions. Specifically, they can be set according to the size of the target virtual object in the transition display stage. That is, in order to block part of the content of the target virtual object, it is necessary to limit the blocking range of the foreground content in the transition transparent video on the target virtual object. In this way, the target virtual object in the AR content can appear to be looming, and the display effect presented in the transition display stage can achieve a smooth transition, which is conducive to improving the user's viewing experience.

[0137] For example, see Figure 9 , is a fusion diagram of a transition display stage provided by an embodiment of the present disclosure. Figure 9 As shown in the figure, the transition transparent video 901 includes foreground content 9011 for blocking the target virtual object and transparent background content 9012, and the transition transparent video 901 is integrated with the AR content 902. In the animation content 903 in the transition display stage, the foreground content 9011 (i.e., "fog") in the transition transparent video blocks part of the content of the target virtual object 9021.

[0138] In other embodiments, the target transparent video includes an exit transparent video; when the AR content is currently in the exit display stage, when determining the occlusion range of the foreground content on the AR content based on the current display stage of the AR content, the occlusion range of the foreground content in the exit transparent video on the target virtual object in the AR content can be determined based on the exit display stage, wherein the occlusion range of the foreground content in the exit transparent video on the target virtual object is greater than a fourth preset range. Then, based on the occlusion range of the foreground content in the exit transparent video on the target virtual object in the AR content, the exit transparent video is fused with the AR content to obtain the fused animation content. Since the target virtual object in the AR content disappears from the screen during the exit display stage, by setting the occlusion range of the foreground content in the exit transparent video on the target virtual object to be greater than the fourth preset range, the effect of the target virtual object disappearing in the animation content can be achieved.

[0139] The fourth preset range may be set as described above for the first preset range, and will not be described in detail here. It should be noted that the fourth preset range may be the same as or different from the first preset range, and this is not limited here.

[0140] For example, see Figure 10 , is a fusion diagram of a transition display stage provided by an embodiment of the present disclosure. Figure 10 As shown in FIG, the exit transparent video 1001 includes foreground content 10011 for occluding the target virtual object and transparent background content 10012. The exit transparent video 1001 is integrated with the AR content 1002. In the animation content 1003 in the exit presentation phase, the foreground content 10011 (i.e., "fog") in the exit transparent video partially occludes the target virtual object 10021. In other words, in the exit presentation phase, the target virtual object will appear to disappear from the animation content, making the presentation of the animation content more complete.

[0141] In some embodiments, in the process of displaying AR content, in addition to the above-mentioned opening, transition and exit display stages, it can also include a main screen display stage. In the main screen display stage, there is no need for transparent video to block the AR content, which is not elaborated here.

[0142] In some embodiments, by Figure 1During the display of the fused animation content on the display device shown in FIG, the display position of the foreground content in the animation content remains unchanged relative to the display position of the display device. That is, if the display device moves or rotates, the display position of the foreground content in the animation content remains unchanged relative to the display device. Thus, during the movement or rotation of the display device, the occlusion effect of the foreground content can meet a predetermined occlusion effect.

[0143] In other embodiments, when displaying the fused animation content via the display device, the display form of the foreground content within the animation content changes as the display device's relative position relative to the target virtual object changes. That is, when the display device moves or rotates, the target virtual object will be displayed from different perspectives. Because the foreground content obscures the target virtual object, the display form of the foreground content displayed on the display device will also change, thereby enhancing the presentation of the foreground content.

[0144] For example, see Figure 11 , is a schematic diagram of a display form of foreground content provided by an embodiment of the present disclosure. Figure 11 As shown, when a user at position A holds the display device directly in front of the dinosaur's head, the foreground content "fog" displayed on the display device at position A is displayed in a form that blocks the front of the dinosaur. For example, it can be vertical, and the blocking range of the foreground content is smaller than the width of the dinosaur itself. When a user at position B holds the display device at the side of the dinosaur's body, the foreground content "fog" displayed on the display device at position B is displayed in a form that blocks part of the dinosaur's side. For example, it can be flat, and the blocking range of the foreground content is smaller than the height of the dinosaur itself. That is, since different parts of the dinosaur are displayed on the display device at different viewing angles when viewing the dinosaur at different positions, in order to achieve a preset effect of the foreground content blocking the dinosaur, the form of the foreground content displayed changes as the position of the display device changes.

[0145] The following is a detailed description of the above-mentioned method for displaying augmented reality content in combination with the scenarios in which the method can be applied.

[0146] In some embodiments, the aforementioned augmented reality content display method can be applied to AR guided tour vehicles. For example, a screen can replace the vehicle window glass, and a camera mounted on the vehicle body can capture the real scene outside the vehicle window. AR content is then generated based on the real scene and the target virtual object. At different display stages, the target transparent video is fused with the AR content to generate and display the fused animation content.

[0147] Specifically, when the AR guide car drives to the first preset position, it enters the opening display stage and displays the fused animation content in this stage; then, if it is detected that the display time of the opening display stage reaches the preset time (or when it is detected that the AR guide car drives to the second preset position), it enters the transition display stage and displays the fused animation content in the transition display stage. Since the transition display stage is only used for transition, after the transition display stage ends, the main screen of the AR content will be displayed. During this process, the transparent video will not block the AR content until the main screen is displayed.

[0148] After the main screen display ends, the fused animation content from the transition display phase can be displayed again. It should be noted that the transparent video content in the two transition display phases can be the same or different, and this is not limited here. Finally, after the transition display phase ends, the exit display phase begins, and the corresponding fused animation content is displayed. The transparent video in the exit display phase can be the same or different from the transparent video in the opening display phase, and this is not limited here.

[0149] Those skilled in the art will understand that in the above method of the specific implementation method, the writing order of each step does not mean a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of each step should be determined by its function and possible internal logic.

[0150] Based on the same inventive concept, the embodiments of the present disclosure also provide an augmented reality content display device corresponding to the augmented reality content display method. Since the principle of solving the problem by the device in the embodiments of the present disclosure is similar to the above-mentioned augmented reality content display method in the embodiments of the present disclosure, the implementation of the device can refer to the implementation of the method, and the repeated parts will not be repeated.

[0151] See also Figure 12 , is a structural diagram of an augmented reality content display device provided by an embodiment of the present disclosure, wherein the augmented reality content display device 1200 includes: a generation module 1210, a fusion module 1220, and a display module 1230; wherein,

[0152] A generation module 1210 is configured to obtain real-world scene content and generate augmented reality (AR) content based on the real-world scene content and a target virtual object.

[0153] a fusion module 1220 for fusing a target transparent video with the AR content according to a display stage corresponding to the AR content to obtain fused animation content, wherein the target transparent video has different occlusion effects on the AR content at different display stages, and the target transparent video includes foreground content for occluding the AR content and transparent background content;

[0154] The display module 1230 is used to display the fused animation content.

[0155] In an optional implementation, the target transparent video includes foreground content for blocking the AR content and transparent background content; the fusion module 1220 is specifically configured to:

[0156] Determining the current display stage of the AR content;

[0157] Determining, according to a current presentation stage of the AR content, foreground content that matches the AR content in the current presentation stage;

[0158] Based on the foreground content that matches the AR content, the target transparent video is fused with the AR content according to different fusion methods to obtain the fused animation content.

[0159] In an optional implementation, the target transparent video includes foreground content for blocking the AR content and transparent background content; the fusion module 1220 is specifically configured to:

[0160] Determining the current display stage of the AR content;

[0161] determining, according to a current display stage of the AR content, an occlusion range of the AR content by the foreground content, wherein the occlusion range of the AR content by the foreground content is different in different display stages;

[0162] Based on the occlusion range of the AR content by the foreground content, the target transparent video is fused with the AR content to obtain fused animation content.

[0163] In an optional embodiment, the display stage includes at least one of an opening display stage, a transition display stage, and an exit display stage;

[0164] The occlusion range of the AR content by the foreground content in the opening presentation phase is greater than the occlusion range of the AR content by the foreground content in the transition presentation phase; or

[0165] The occlusion range of the AR content by the foreground content in the exit presentation stage is greater than the occlusion range of the AR content by the foreground content in the transition presentation stage.

[0166] In an optional implementation, the target transparent video includes an opening transparent video; and the fusion module 1220 is specifically configured to:

[0167] When the current display stage of the AR content is the opening display stage, determining, according to the opening display stage, an occlusion range of the target virtual object in the AR content by the foreground content in the opening transparent video, wherein the occlusion range of the target virtual object by the foreground content in the opening transparent video is greater than a first preset range;

[0168] The opening transparent video is fused with the AR content according to an occlusion range of the target virtual object in the AR content by the foreground content in the opening transparent video to obtain the fused animation content.

[0169] In an optional implementation, the target transparent video includes a transition transparent video; and the fusion module 1220 is specifically configured to:

[0170] When the current display stage of the AR content is the transition display stage, determining, according to the transition display stage, an occlusion range of the foreground content in the transition transparent video on the target virtual object in the AR content, wherein the occlusion range of the foreground content in the transition transparent video on the target virtual object is greater than a second preset range and less than a third preset range;

[0171] According to the occlusion range of the target virtual object in the AR content by the foreground content in the transition transparent video, the transition transparent video is fused with the AR content to obtain the fused animation content.

[0172] In an optional implementation, the target transparent video includes an exiting transparent video; and the fusion module 1220 is specifically configured to:

[0173] When the current display stage of the AR content is the exit display stage, determining, according to the exit display stage, an occlusion range of the target virtual object in the AR content by the foreground content in the exit transparent video, wherein the occlusion range of the target virtual object by the foreground content in the exit transparent video is greater than a fourth preset range;

[0174] The exiting transparent video is fused with the AR content according to an occlusion range of the target virtual object in the AR content by the foreground content in the exiting transparent video to obtain the fused animation content.

[0175] In an optional implementation, the animation content is displayed via a display device. During the display of the animation content, the display position of the foreground content in the animation content remains unchanged relative to the display position of the display device.

[0176] In an optional embodiment, the animation content is displayed by a display device. During the display of the animation content, the display form of the foreground content in the animation content changes as the relative position of the display device relative to the target virtual object changes.

[0177] For descriptions of the processing flow of each module in the device and the interaction flow between each module, reference can be made to the relevant descriptions in the above method embodiment, which will not be described in detail here.

[0178] Based on the same technical concept, the embodiment of the present disclosure also provides an electronic device. Figure 13 1 is a schematic diagram of the structure of an electronic device 1300 provided in an embodiment of the present disclosure, including a processor 1301, a memory 1302, and a bus 1303. The memory 1302 is used to store execution instructions and includes a memory 13021 and an external memory 13022. The memory 13021 is also referred to as internal memory and is used to temporarily store calculation data in the processor 1301 and data exchanged with an external memory 13022 such as a hard disk. The processor 1301 exchanges data with the external memory 13022 through the memory 13021.

[0179] In the embodiment of the present application, the memory 1302 is specifically used to store application code for executing the solution of the present application, and the execution is controlled by the processor 1301. That is, when the electronic device 1300 is running, the processor 1301 communicates with the memory 1302 via the bus 1303, so that the processor 1301 executes the application code stored in the memory 1302, thereby performing the method of any of the aforementioned embodiments.

[0180] The processor 1301 may be an integrated circuit chip with signal processing capabilities. The above-mentioned processor may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it may also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component. It can implement or execute the various methods, steps, and logic block diagrams disclosed in the embodiments of the present disclosure. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0181] Among them, the memory 1302 can be, but is not limited to, random access memory (RAM), read only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), etc.

[0182] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 1300. In other embodiments of the present application, the electronic device 1300 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0183] The present disclosure also provides a computer-readable storage medium having a computer program stored thereon. When executed by a processor, the computer program executes the steps of the method for displaying augmented reality content described in the above method embodiment. The storage medium may be a volatile or non-volatile computer-readable storage medium.

[0184] The embodiments of the present disclosure also provide a computer program product, which carries program code. The instructions included in the program code can be used to execute the steps of the method for displaying augmented reality content described in the above method embodiment. For details, please refer to the above method embodiment and will not be repeated here.

[0185] The computer program product may be implemented in hardware, software, or a combination thereof. In one embodiment, the computer program product is implemented as a computer storage medium. In another embodiment, the computer program product is implemented as a software product, such as a software development kit (SDK).

[0186] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems and terminals described above can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here. In the several embodiments provided in the present disclosure, it should be understood that the disclosed systems, terminals and methods can be implemented in other ways. The terminal embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, or indirect coupling or communication connection of units, which can be electrical, mechanical or other forms.

[0187] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0188] In addition, each functional unit in each embodiment of the present disclosure may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0189] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a non-volatile computer-readable storage medium that is executable by a processor. Based on this understanding, the technical solution of the present disclosure, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling an electronic device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present disclosure. The aforementioned storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0190] Finally, it should be noted that the above-described embodiments are only specific implementation methods of the present disclosure, which are used to illustrate the technical solutions of the present disclosure, rather than to limit them. The scope of protection of the present disclosure is not limited thereto. Although the present disclosure has been described in detail with reference to the above-described embodiments, those skilled in the art should understand that any person skilled in the art can modify or easily conceive of changes to the technical solutions described in the above-described embodiments within the technical scope disclosed in the present disclosure, or replace some of the technical features therein with equivalents. Such modifications, changes, or replacements do not deviate from the spirit and scope of the technical solutions of the embodiments of the present disclosure, and should be included in the scope of protection of the present disclosure. Therefore, the scope of protection of the present disclosure shall be subject to the scope of protection of the claims.

Claims

1. A method for displaying augmented reality content, characterized in that: include: Get augmented reality (AR) content; According to the display stage corresponding to the AR content, a target transparent video is fused with the AR content according to different fusion methods to obtain fused animation content; wherein the display stage includes at least one of an opening display stage, a transition display stage, and an exit display stage; and the target transparent video includes foreground content for blocking the AR content and transparent background content; Displaying the fused animation content; The step of fusing the target transparent video with the AR content according to different fusion methods according to the display stage corresponding to the AR content to obtain fused animation content includes: Determining the current display stage of the AR content; determining, according to a current display stage of the AR content, an occlusion range of the AR content by the foreground content, wherein the occlusion range of the AR content by the foreground content is different in different display stages; Based on the occlusion range of the AR content by the foreground content, the target transparent video is fused with the AR content to obtain fused animation content.

2. The method according to claim 1, characterized in that The display stage includes at least one of an opening display stage, a transition display stage, and an exit display stage; the occlusion range of the AR content by the foreground content in the opening display stage is greater than the occlusion range of the AR content by the foreground content in the transition display stage; or, The occlusion range of the AR content by the foreground content in the exit presentation stage is greater than the occlusion range of the AR content by the foreground content in the transition presentation stage.

3. The method according to claim 2, characterized in that The target transparent video includes an opening transparent video; and when the current display stage of the AR content is the opening display stage, determining, based on the current display stage of the AR content, an occlusion range of the AR content by the foreground content includes: Determining, according to the opening presentation stage, an occlusion range of a target virtual object in the AR content by the foreground content in the opening transparent video, wherein the occlusion range of the target virtual object by the foreground content in the opening transparent video is greater than a first preset range; The step of fusing the target transparent video with the AR content based on the occlusion range of the foreground content on the AR content to obtain fused animation content includes: The opening transparent video is fused with the AR content according to an occlusion range of the target virtual object in the AR content by the foreground content in the opening transparent video to obtain the fused animation content.

4. The method according to claim 2, characterized in that The target transparent video includes a transition transparent video; and when the current display stage of the AR content is the transition display stage, determining, based on the current display stage of the AR content, an occlusion range of the AR content by the foreground content includes: Determining, according to the transition display stage, an occlusion range of the target virtual object in the AR content by the foreground content in the transition transparent video, wherein the occlusion range of the target virtual object by the foreground content in the transition transparent video is greater than a second preset range and less than a third preset range; The step of fusing the target transparent video with the AR content based on the occlusion range of the foreground content on the AR content to obtain fused animation content includes: According to the occlusion range of the target virtual object in the AR content by the foreground content in the transition transparent video, the transition transparent video is fused with the AR content to obtain the fused animation content.

5. The method according to claim 2, characterized in that The target transparent video includes an exit transparent video; and when the current display stage of the AR content is the exit display stage, determining, based on the current display stage of the AR content, an occlusion range of the AR content by the foreground content includes: Determining, according to the exit presentation stage, an occlusion range of a target virtual object in the AR content by the foreground content in the exit transparent video, wherein the occlusion range of the target virtual object by the foreground content in the exit transparent video is greater than a fourth preset range; The step of fusing the target transparent video with the AR content based on the occlusion range of the foreground content on the AR content to obtain fused animation content includes: The exiting transparent video is fused with the AR content according to an occlusion range of the target virtual object in the AR content by the foreground content in the exiting transparent video to obtain the fused animation content.

6. The method according to any one of claims 1 to 5, characterized in that: The animation content is displayed by a display device. During the display of the animation content, the display position of the foreground content in the animation content remains unchanged relative to the display position of the display device.

7. The method according to any one of claims 1 to 5, characterized in that: The animation content is displayed through a display device. During the display of the animation content, the display form of the foreground content in the animation content changes as the relative position of the display device relative to the target virtual object changes.

8. A display device for augmented reality content, characterized in that: include: A generation module for obtaining augmented reality (AR) content; a fusion module, configured to fuse a target transparent video with the AR content according to different fusion methods according to the display stage corresponding to the AR content, to obtain fused animation content; wherein the display stage includes at least one of an opening display stage, a transition display stage, and an exit display stage; and the target transparent video includes foreground content for obscuring the AR content and transparent background content; A display module, used to display the fused animation content; The fusion module is specifically used for: Determining the current display stage of the AR content; determining, according to a current display stage of the AR content, an occlusion range of the AR content by the foreground content, wherein the occlusion range of the AR content by the foreground content is different in different display stages; Based on the occlusion range of the AR content by the foreground content, the target transparent video is fused with the AR content to obtain fused animation content.

9. An electronic device, characterized in that: include: A processor, a memory and a bus, wherein the memory stores machine-readable instructions executable by the processor, and when the electronic device is running, the processor and the memory communicate via the bus, and when the machine-readable instructions are executed by the processor, the method for displaying augmented reality content as described in any one of claims 1 to 7 is executed.

10. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, which, when executed by a processor, executes the method for displaying augmented reality content according to any one of claims 1 to 7.

Images