A special effect prop display method, device, equipment and storage medium

Abstract

The method comprises the following steps: receiving a trigger operation of a special effect prop in an execution device, wherein the execution device currently has first pose information; displaying an enhanced effect of the special effect prop in a set display state; receiving a pose adjustment operation of the execution device, wherein the first pose information of the execution device is changed into second pose information; and maintaining the set display state and continuing to display the enhanced effect of the special effect prop. By using the method, the display state of the enhanced effect of the special effect prop can be maintained unchanged when the pose of the execution device of the special effect prop changes, so that the enhanced effect of the special effect prop can be effectively presented when the execution device is in each pose, and thus the enhanced effect of the special effect prop is optimized, and the use experience of a user is improved.

Description

TECHNICAL FIELD

[0001] Embodiments of the present disclosure relate to the field of augmented reality (AR) technology, and particularly, to a special effect prop display method and device, equipment and a storage medium. BACKGROUND

[0002] Augmented reality (AR) technology is also known as augmented reality. AR technology not only effectively reflects the content of the real world, but also displays virtual information content. These detailed contents complement and superimpose each other. With the development of network technology, AR technology is increasingly applied to live streaming and short video applications. By providing AR special effect props, visual effects can be enhanced in a live streaming interface or a short video interface.

[0003] However, the display state of the existing AR special effect props that present the enhancement effect is often adjusted with the adjustment of the pose of the electronic device, and the enhancement effect cannot be displayed in a suitable display state at all times, thereby affecting the user experience. SUMMARY

[0004] Embodiments of the present disclosure provide a special effect prop display method to effectively optimize the display state of the enhancement effect of the special effect prop.

[0005] In a first aspect, the embodiments of the present disclosure provide a special effect prop display method, which includes:

[0006] receiving a trigger operation of a special effect prop in an execution device, wherein the execution device currently has first pose information;

[0007] displaying the enhancement effect of the special effect prop in a set display state;

[0008] receiving a pose adjustment operation of the execution device, wherein the first pose information of the execution device is changed to second pose information;

[0009] maintaining the set display state and continuing to display the enhancement effect of the special effect prop.

[0010] In a second aspect, the embodiments of the present disclosure also provide a special effect prop interaction device, which includes:

[0011] a first receiving module configured to receive a trigger operation of a special effect prop in an execution device, wherein the execution device currently has first pose information;

[0012] a first display module configured to display the enhancement effect of the special effect prop in a set display state;

[0013] The second receiving module is configured to receive a pose adjustment operation of the execution device, wherein first pose information of the execution device is changed to second pose information.

[0014] The second display module is configured to maintain the set display state and continue to display the enhancement effect of the special effect prop.

[0015] In a third aspect, the embodiments of the present disclosure further provide an electronic device, which comprises:

[0016] one or more processors;

[0017] a storage device configured to store one or more programs,

[0018] When the one or more programs are executed by the one or more processors, the one or more processors implement the special effect prop display method provided by any of the embodiments of the present disclosure.

[0019] In a fourth aspect, the embodiments of the present disclosure further provide a computer readable storage medium, which stores a computer program, and the computer program is executed by a processor to implement the special effect prop display method provided by any of the embodiments of the present disclosure.

[0020] The embodiments of the present disclosure provide a special effect prop display method, device, equipment and storage medium. The display method comprises the following steps: first, receiving a trigger operation of a special effect prop in an execution device, wherein the execution device currently has first pose information; then, displaying an enhancement effect of the special effect prop in a set display state; then, receiving a pose adjustment operation of the execution device, wherein the execution device currently has second pose information, and the set display state can be maintained to continue to display the enhancement effect of the special effect prop. The above technical solution gives the display state of the enhancement effect of the special effect prop when the execution device is in the first pose after the special effect prop is started, and when the pose of the execution device is changed to the second pose which is different from the first pose, the enhancement effect of the special effect prop can still be controlled to maintain the previous display state, so that the display state of the displayed enhancement effect is prevented from being adjusted to other display states with poor display effect due to the change of the pose of the execution device. Through the above technical solution, the enhancement effect of the special effect prop can be ensured to always maintain a suitable display state, so as to optimize the enhancement effect of the special effect prop, and the electronic device can effectively present the enhancement effect in each pose, thereby better improving the user experience. BRIEF DESCRIPTION OF DRAWINGS

[0021] In order to more clearly illustrate the technical solutions of the exemplary embodiments of the present disclosure, the drawings needed in the description of the embodiments are briefly introduced as follows. Obviously, the drawings introduced are only a part of the drawings of the present disclosure, and not all the drawings, and other drawings can be obtained by those skilled in the art without creative labor on the basis of these drawings.

[0022] Figure 1 A flowchart of a display method of a special effect prop provided by the first embodiment of the present disclosure is shown in FIG. 1.

[0023] Figures 1a-1c An effect display diagram of a fireworks prop when the existing mode is used to render the enhancement effect is shown in FIG. 2.

[0024] Figures 1d-1f An effect display diagram of a fireworks prop when the method provided by the present embodiment is used to render the enhancement effect is shown in FIG. 3.

[0025] Figure 2 A structural diagram of an interactive device of a special effect prop provided by the second embodiment of the present disclosure is shown in FIG. 4.

[0026] Figure 3 A structural diagram of an electronic device provided by the third embodiment of the present disclosure is shown in FIG. 5. DETAILED DESCRIPTION

[0027] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although some embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure can be implemented in various forms, and should not be interpreted as being limited to the embodiments set forth herein, but rather, these embodiments are provided to more thoroughly and completely understand the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes, and are not intended to limit the scope of protection of the present disclosure.

[0028] It should be understood that each step described in the method embodiments of the present disclosure can be executed in different orders and / or in parallel. In addition, the method embodiments can include additional steps and / or omit the execution of the steps shown. The scope of the present disclosure is not limited in this respect.

[0029] The term "comprising" and variations thereof as used in the present disclosure are open-ended, that is, "including but not limited to". The term "based on" is "at least partially based on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Related definitions of other terms will be given in the following description.

[0030] It should be noted that the terms "first", "second", and the like in the present disclosure are only used to distinguish different devices, modules or units, and do not limit the order or interdependence of the functions performed by these devices, modules or units. It should be noted that the terms "one", "multiple" mentioned in the present disclosure are illustrative and not limiting, and those skilled in the art should understand that unless the context clearly indicates otherwise, it should be understood as "one or more".

[0031] The names of the messages or information exchanged between the plurality of devices in the embodiments of the present disclosure are only for illustrative purposes, and are not used to limit the scope of the messages or information.

[0032] Embodiment one

[0033] Figure 1 A flowchart of a display method of a special effect prop provided by the first embodiment of the present disclosure, the present embodiment can be applicable to the case of optimizing the enhancement effect of the special effect prop. The method can be executed by an interactive device of the special effect prop, which can be implemented by software and / or hardware, and can be configured in an electronic device such as a terminal and / or a server to implement the display method of the special effect prop in the present disclosure.

[0034] It should be noted that in the application of existing live broadcast, short video and other entertainment software, augmented reality special effect props have been added. Through the special effect prop, the actual application scene such as live broadcast or short video can be rendered with special effects, and visual rendering is the most common in special effect rendering. Generally, the special effect rendering of the special effect prop is mainly realized in the augmented reality scene.

[0035] Generally, when visual rendering is performed by a special effect prop in an actual application scene, the specific process of visual rendering is mainly realized in an augmented reality scene. Finally, the visual rendering data related picture is projected onto the device screen, which can realize the display of the enhancement effect of visual rendering in the actual application scene. Among them, the augmented reality scene can be considered as a three-dimensional space, which is provided with a camera (virtual camera). Through the camera, the corresponding special effect virtual object of the special effect prop in visual rendering can be captured. Then, by projecting the captured special effect virtual object on the device screen, the visual enhancement effect of the special effect prop can be displayed in the actual application scene.

[0036] In the prior art, when special effect rendering is performed in an augmented reality scene, the display state (which can be the display size) of the rendered picture presented on the screen of the electronic device changes (for example, the display size becomes smaller or larger) as the pose of the electronic device changes (for example, rotation or tilting). The problem of the above rendering method is that, after the special effect prop is started, the display state of the special effect picture presented on the screen of the electronic device can be relatively suitable for the actual application scene. When the display state of the special effect picture changes as the pose of the electronic device changes, the display state presented can not match the actual application scene or can not be required by the user.

[0037] Alternatively, there can also be a problem that, after the user adjusts the pose of the electronic device to adjust the display state of the special effect picture presented by the special effect prop to the display state required by the user, the display state is also adjusted due to the adjustment of the pose of the electronic device during the holding of the electronic device by the user, thereby causing the display size of the special effect picture to change, and further affecting the augmented rendering effect of the special effect prop.

[0038] Taking a firework prop in a special effect prop as an example, Figures 1a-1c a display diagram of the augmented effect rendering of the firework prop by the prior art is given. Specifically, Figures 1a-1c the first reality scene picture 11 captured by the camera of the electronic device and the first firework special effect picture 12 rendered by the firework prop in the augmented reality scene are included, wherein the augmented reality scene is a three-dimensional space, a virtual camera is arranged in the space and can be used to input the special effect content of the special effect prop, and the firework special effect picture is equivalent to the special effect content of the firework prop.

[0039] It can be assumed that Figure 1a the first reality scene picture 11 in the first position is a picture captured by the electronic device when the electronic device is in a first position, Figure 1b the first reality scene picture 11 in the second position is a picture captured by the electronic device when the electronic device is in a second position, Figure 1c the first reality scene picture 11 in the third position is a picture captured by the electronic device when the electronic device is in a third position, wherein the first position, the second position and the third position have different pose information, and the first position can be taken as an initial position after the firework special effect is started.

[0040] And Figures 1a-1c the first firework special effect picture 12 in the first position can be regarded as different picture frames when animation rendering is performed in the augmented effect displayed by the firework prop, and different special effect contents are specifically presented, such as Figure 1a the first firework special effect picture 12 in the second position mainly presents the special effect content of the explosion moment of the firework, such as Figure 1bThe first fireworks effect scene in the video, number 12, mainly showcases one frame of the special effects after the fireworks explode, such as... Figure 1c The first fireworks effect scene, number 12, primarily showcases the special effects of the fireworks' second burst after the initial explosion. Despite... Figures 1a-1c The special effects shown in the first fireworks scene are changing, but if the position of the electronic device does not change, Figures 1a-1c The first firework effect scene 12 in the three images will be displayed at the same screen size.

[0041] However, through Figures 1a-1c It can be observed that as the pose of the electronic device changes, the actual display size of the first firework effect image 12 rendered in the augmented reality scene on the electronic device screen also changes. Furthermore, it can be seen that the display size of the rendered first firework effect image 12 changes from... Figures 1a-1c It's gradually shrinking, it's quite obvious. Figure 1c The first fireworks effect image 12, after being scaled down, is too small to meet the rendering needs of users in actual application scenarios.

[0042] Based on this, this embodiment provides a method for displaying special effects props. Through the method provided in this embodiment, the display state of the special effects image rendered by the special effects prop can be decoupled from the pose of the electronic device on which it is mounted, so that when the pose of the electronic device changes, the special effects image can still be presented on the screen of the electronic device in a suitable display state.

[0043] like Figure 1 As shown, the method for displaying special effects props provided in this embodiment one may specifically include:

[0044] S101, Receive the trigger operation of the special effects prop in the execution device, wherein the execution device currently has first pose information.

[0045] In this embodiment, the execution device can be specifically understood as an electronic device that executes the method provided in this embodiment, preferably a mobile terminal such as a mobile phone or tablet. The execution device is equipped with application software that has augmented reality functionality, which can be live streaming or short video software. The augmented reality functionality can be integrated into the application software as a plugin. For example, the augmented reality functionality can be presented as a special effects prop option in the application window interface. By triggering the special effects prop option, a prop frame including at least one special effects prop can be displayed.

[0046] In this embodiment, as one of the examples, the triggering operation of the special effect prop in this step can be the triggering operation of the user on any special effect prop in the displayed prop frame. This step can receive the triggering operation of the user on the special effect prop. This embodiment does not make specific limitation on the special effect prop, which can be any special effect prop launched by the application software developer, such as the firework special effect, the petal rain special effect, and the like.

[0047] It should be noted that this step can obtain the pose information of the pose of the execution device when the user triggers the special effect prop, and use the pose information as the first pose information of this embodiment. In the pose information, the spatial coordinates of the execution device in the set spatial coordinate system can be included, which can represent the position information of the execution device, and can also represent the attitude angle and other information of the execution device. For example, this embodiment can capture the related pose information by the gyroscope in the execution device.

[0048] S102, display the augmented effect of the special effect prop in a set display state.

[0049] In this embodiment, this step can be a response step of S102, that is, after receiving the triggering operation of the special effect prop, this step can respond to the triggering operation, so that the augmented effect of the selected special effect prop can be displayed on the current screen interface of the execution device, and the display can be performed according to the set display state.

[0050] In this embodiment, the augmented effect can be understood as the special effect content rendered by the special effect prop. Different special effect props can correspond to different special effect contents, and the augmented effect can include but is not limited to visual augmented effect, auditory augmented effect, and tactile augmented effect. For example, the special effect content rendered by the firework prop can be the explosion and blooming of the firework, and the vibration of the execution device can also be felt at the same time of the explosion of the firework, which can be considered as the augmented effect of the firework prop in the application scene.

[0051] In this embodiment, the set display state can be understood as the display form of the augmented effect rendered by the special effect prop when the augmented effect is displayed by the execution device. The display form can include the audio form related to the hearing, the picture form related to the vision, and the vibration form related to the touch, and the like.

[0052] For the audio form related to the hearing, it can be embodied in the playing form of the rendered sound augmented effect, such as playing through the loudspeaker or earphone of the device. For the vibration form related to the touch, it can be embodied in the vibration form of the rendered vibration augmented effect, such as vibration through the vibration device on the device. For the picture form related to the vision, it can be embodied in the display position and display size of the rendered special effect augmented picture on the screen of the device.

[0053] It should be noted that the above S101 and S102 of the embodiment can be considered as a conventional execution step after starting the special effect props. As can be known from the above exemplary description, in the process of displaying the enhancement effect, the pose of the execution device will change according to the actual application requirement, and when the pose of the execution device changes, the display state of the enhancement effect (especially the visual enhancement effect) rendered by the special effect props will also change accordingly. The following S103 and S104 of the embodiment give an effective improvement to the above-mentioned problems, and the effective decoupling of the pose of the execution device and the display state of the enhancement effect is realized through the following S103 and S104, so that the display state of the enhancement effect does not change with the adjustment of the pose of the execution device.

[0054] S103, receiving the pose adjustment operation of the execution device, wherein the first pose information possessed by the execution device is changed to second pose information.

[0055] Specifically, in the method implementation of the embodiment, the pose change of the execution device can also be monitored, that is, whether the execution device has rotated or moved can be monitored, and if the above-mentioned pose change exists, which means that the pose adjustment operation has occurred, the pose adjustment operation can be received through the step. It can be understood that the pose information of the execution device after the pose adjustment can be obtained, which can be recorded as second pose information. Compared with the first pose information possessed by the execution device, the spatial coordinate position or the attitude angle of the execution device in the second pose information has changed.

[0056] S104, maintaining the set display state and continuing to display the enhancement effect of the special effect props.

[0057] In the embodiment, the step can be considered as a response execution to the pose adjustment operation received by the above-mentioned S103, and in the response execution, the display state of the enhancement effect of the special effect props on the device screen is still maintained as the set display state in the above-mentioned S102, and the enhancement effect of the special effect props can continue to be displayed on the basis of the pose adjustment of the execution device, and will not affect the display progress of the enhancement effect.

[0058] For example, the enhanced effect of the special effect prop is an animation rendering. Assuming that the animation rendering is performed to the second picture frame by S102 before the adjustment of the device pose, if the device pose is adjusted at this time, S104 in response to the adjustment operation can continue to display the third picture frame after the second picture frame displayed by the animation rendering. Through this step, the display size of the third picture frame displayed on the screen of the execution device is the same as the display size of the third picture frame corresponding to the execution device pose before the adjustment of the device pose. Meanwhile, if there is no manual adjustment, the subsequent picture frames of the animation rendering are still displayed at the original screen position on the device screen.

[0059] For example, the visual enhanced effect of the special effect prop is displayed. In the conventional implementation, the display size of the special effect enhanced picture displayed on the device screen is adjusted according to the adjustment of the device pose. The reason can be described as follows: assuming that the visual rendering data of the special effect prop is presented as a special effect virtual object in the augmented reality scene, the special effect enhanced picture displayed on the device screen can be regarded as the projection of the special effect virtual object captured by the camera in the augmented reality scene on the device screen. The augmented reality scene is associated with the space coordinate system of the execution device. If the pose of the execution device is adjusted, the capture angle of the camera in the augmented reality scene is also adjusted, so that the capture picture size of the special effect virtual object captured by the camera is also adjusted. When the capture picture size is adjusted, the display size of the special effect enhanced picture projected on the device screen is also adjusted.

[0060] Based on the above description, when the pose of the execution device is adjusted, the camera in the augmented reality scene can be controlled to still have the original capture angle. When the original capture angle is kept unchanged, the capture picture size of the captured special effect virtual object can be kept unchanged, so that the display size of the special effect enhanced picture projected on the device screen can be kept unchanged, and finally the display state of the enhanced effect of the special effect prop can be kept unchanged in the visualization layer.

[0061] For example, one of the implementation manners of controlling the camera in the augmented reality scene to still have the original capture angle can be as follows: a limited condition is set, that is, the capture angle plane of the special effect virtual object is always perpendicular to the camera in the augmented reality scene. After the limited condition is known, the augmented reality plane satisfying the limited condition can be determined in the augmented reality scene as the capture angle plane for capturing the special effect virtual object.

[0062] It can be known that, after the camera in the augmented reality scene is controlled to keep the original capture angle in response to the above pose adjustment operation, the same display state as S102 can be kept in the visualization layer, and the enhanced effect of the special effect prop can be continued to be displayed.

[0063] It should be noted that the method provided in this embodiment gives the implementation of the special effect props after the pose of the execution device is adjusted once. However, this embodiment is not limited to the display of only one pose adjustment. As long as the pose of the execution device is adjusted, the steps of S103 and S104 in this embodiment can be executed cyclically, so that the enhanced effect display state of the special effect props can remain unchanged in the pose adjustment of the execution device.

[0064] To better understand the method provided in this embodiment, an example is used for illustration. Specifically, still taking the fireworks prop in the special effect prop as an example, Figures 1d-1f the effect display diagram of the fireworks prop when the enhanced effect rendering is performed by the method provided in this embodiment is given. Similarly, Figures 1d-1f the second real scene picture 13 captured by the camera of the electronic device and the second fireworks special effect picture 14 rendered by the fireworks prop in the augmented reality scene are also included in the

[0065] Similarly, it can be assumed that Figure 1d the second real scene picture 13 in the Figure 1e the second real scene picture 13 in the Figure 1f the second real scene picture 13 in the, which is captured by the electronic device when it is in the sixth position, wherein the fourth pose, the fifth pose and the sixth pose have different pose information, and the fourth pose can be taken as the initial pose after the fireworks special effect is started.

[0066] In addition, the second fireworks special effect picture 14 in the Figures 1d-1f can also be regarded as different picture frames when the enhanced effect displayed by the fireworks prop is animated, which specifically presents different special effect contents, such as Figures 1d-1f the second fireworks special effect picture 14 in the respectively displays one frame of special effect content in the fireworks blooming process, wherein Figures 1d-1f the special effect content of the second fireworks special effect picture 14 presented is changed.

[0067] As can be seen, Figures 1d-1f with the change of the position of the execution device, the display size of the second fireworks special effect picture 14 rendered in the augmented reality scene on the screen of the execution device also changes. If the fourth pose of the execution device in Figure 1d is taken as the initial pose, it can be seen that the special effect content presented by the second fireworks special effect picture 14 in the subsequent Figure 1e and Figure 1f changes. Figure 1dContinuation of the special effect content being presented.

[0068] The technical solution of the embodiment provides an enhanced effect display state of the special effect prop after the special effect prop is started and the execution device is in a first pose, and when the pose of the execution device is changed to a second pose different from the first pose, the enhanced effect of the special effect prop can still be controlled to remain in the previous display state, so that the display state of the enhanced effect is prevented from being adjusted to another display state with poor display effect due to the change of the pose of the execution device. The above technical solution can ensure that the enhanced effect of the special effect prop always remains in a suitable display state, thereby optimizing the enhanced effect of the special effect prop, and enabling the enhanced effect to be effectively presented when the electronic device is in each pose, and better improving the user experience.

[0069] As a first optional embodiment of the embodiment one, on the basis of the above-mentioned embodiment one, the first optional embodiment further optimizes the enhanced effect to include a visual enhanced effect. Correspondingly, the step of S102, that is, displaying the enhanced effect of the special effect prop in the set display state, can be specifically optimized as follows: playing an animation enhanced effect of the special effect prop in an augmented reality scene, and presenting the animation enhanced effect at a set screen position of the execution device in a predetermined special effect display size.

[0070] In the optional embodiment, the enhanced effect of the special effect prop is further specified as a visual enhanced effect, which can be understood as that the special effect content of the special effect prop is displayed on the screen of the device in the form of a special effect image or a special effect animation. In the embodiment, the special effect content of the enhanced effect is preferably a special effect animation, that is, an animation enhanced effect can be played on the screen of the device.

[0071] It can be understood that in the implementation of augmented reality, the special effect content of the special effect prop is actually equivalent to being presented in a specific three-dimensional augmented reality scene and being synchronously presented on the screen of the device through projection processing. Therefore, the enhanced effect displayed in the embodiment is actually equivalent to first playing an animation enhanced effect in the augmented reality scene through the rendering data output of a virtual camera; and then synchronously displaying the animation enhanced effect on the screen of the device through projection from the augmented reality scene to the screen of the device.

[0072] Specifically, the optional embodiment can set the set display state of the presented animation enhanced effect to be presented at the set screen position of the execution device in a special effect display size. For example, the special effect display size can be determined through the current first pose information of the execution device, the selected or pre-set screen position on the screen of the device (that is, the set screen position mentioned above), and the augmented reality plane used when the camera captures the special effect virtual object in the augmented reality scene. Finally, the first optional embodiment can display the animation enhanced effect of the special effect prop at the set screen position in the determined special effect display size.

[0073] As a second optional embodiment of the first embodiment, on the basis of the first optional embodiment, the second optional embodiment further optimizes the process of playing the animation enhancement effect, including: when the animation enhancement effect plays to a preset time point, the light enhancement effect is superimposed and presented.

[0074] In this optional embodiment, the visual enhancement effect of the special effect prop is further optimized, which specifically considers superimposing other special effects on the animation enhancement effect. Specifically, in order to better present the effect of the special effect prop, the light enhancement effect is considered to be superimposed on the animation enhancement effect, and the time point of adding the light enhancement effect is also considered.

[0075] For example, in the special effect presentation of the firework prop, the process of the firework blooming can be used as the presented animation enhancement effect. In order to better simulate the blooming effect of the firework in reality, a flash effect can also be added at the time point of the firework explosion.

[0076] In this optional embodiment, the added light enhancement effect can also be regarded as an animation video or as an image with a flash pattern, and then at the preset time point, the image frame of the animation enhancement effect and the image with the flash pattern are played synchronously, or the animation video of the light enhancement effect is started to play at the preset time point, so as to realize the effect superposition of the animation enhancement effect and the light enhancement effect.

[0077] The light enhancement effect superposition realized by the second optional embodiment further improves the enhancement effect of the special effect prop, thereby improving the user experience of using the special effect prop.

[0078] As a third optional embodiment of the first embodiment, on the basis of any of the above optional embodiments, the step of "playing the animation enhancement effect of the special effect prop in the augmented reality scene" can be specifically optimized as:

[0079] It should be noted that the third optional embodiment is equivalent to the optimization of one of the steps in the first optional embodiment, and specifically gives the bottom operation implementation of playing the animation enhancement effect in the augmented reality scene.

[0080] It is to be known that the material presented by the animation enhanced special effect can be regarded as a video file composed of a plurality of image frames, and a common display form of the video file is a sequential combination of a series of image frames, and the file format of the video file can be recorded as sequence frames. At present, when the special effect props are used in actual application scenarios, it is often necessary to ensure the accuracy of the special effect enhanced picture presented by the special effect props, that is, each image frame in the animation enhanced special effect needs to have high resolution. If the video file in the sequence frame format is used, when the number of high-resolution image frames contained in the animation enhanced special effect is too large, the video file will have a large volume, which is not conducive to the storage of the video file. At present, some ways such as frame extraction and lossy compression of images are used to reduce the volume of the video file, but such a way will affect the resolution of the image frame and may affect the display effect of the animation enhanced special effect in actual application scenarios.

[0081] In order to solve the problem that the video file in the sequence frame format cannot reduce the volume while ensuring the playback accuracy, the third optional embodiment optimizes the file format of the video file used for animation special effect enhancement of the special effect props, and specifically, the file format of the video file can be optimized to a set video format, such as MP4 format. The conversion of the video file from the sequence frame format to the set video format can be realized by a set format converter.

[0082] Taking conversion to the MP4 format as an example, the video file of the MP4 mainly uses the H.264 standard for video encoding of the image frame, wherein the H.264 can be regarded as a highly compressed data video encoder standard. Converting the video file to this video format can realize lossless compression of the video file, thereby ensuring the playback accuracy of the video, and because the image is compressed, the volume of the video file is also greatly reduced. For example, a sequence frame file with a size of 8.1M can be reduced to 2.4M after being converted to an MP4 format file.

[0083] Compared with the sequence frame format used for realizing the animation enhanced special effect, the image frames can be sequentially read from the sequence frame file and played directly; however, the video file with the set video format (such as the MP4 format) used for realizing the animation enhanced special effect cannot be directly sequentially read and played. Therefore, the third optional embodiment further gives the following steps for processing the video file with the set video format to realize the playback of the animation enhanced special effect.

[0084] a1) Obtain the video file corresponding to the special effect prop, and the video file is stored in a set video format.

[0085] For example, the video file with the set video format can be pre-stored on the execution device, and the correspondence between the special effect prop and the video file can be recorded, so that the required video file is obtained through the step.

[0086] b1) decoding the video file and playing the decoded special effect video frame in the augmented reality scene.

[0087] It should be noted that the decoding of the video file is a real-time process, that is, the decoded image frame is played in the augmented reality scene while decoding. In this embodiment, the image frame is preferably referred to as a special effect video frame. The decoding of the video file is specifically used to obtain the next special effect video frame to be played in the real-time playing process. For example, to obtain the next special effect video frame, the position of the next special effect video frame in the entire video file needs to be known. The position can be obtained by determining the time point of the next frame to be played in the video file. The time point of the next frame to be played can be determined according to the playback parameters (total playback time, playback rate, etc.) of the video file itself and the time point at which the current playback is located.

[0088] Therefore, the next special effect video frame to be played can be obtained through the playback parameters of the video file itself and the time point at which the current playback is located.

[0089] Specifically, the above step b1) can be further specified as:

[0090] b11) obtaining the playback parameters of the video file and the current playback information.

[0091] The playback parameters can be regarded as attribute information pre-set for the video file. The playback parameters can include total playback time, playback rate, etc. The current playback information can be understood as information related to the currently played special effect video frame in the augmented reality scene, such as the playback time point of the special effect video frame in the entire video file, which can be referred to as the current playback time point.

[0092] b12) decoding the next special effect video frame to be played according to the playback parameters and the current playback information, and playing in the augmented reality scene.

[0093] After obtaining the playback parameters, the corresponding playback time point of the next special effect video frame in the entire video file can be determined in combination with the current playback information. Then, the image data information at the playback time point can be obtained from the video file. After that, the next special effect video frame in the form of an image can be obtained through the combination processing of the image data information. Finally, the next special effect video frame can be output in the augmented reality scene through a virtual camera, so as to realize the playing of the next special effect video frame.

[0094] It can be known that the step b12) can be considered as a step executed in a loop, and the next special effect video frame to be played can be obtained through the step as long as a special effect playing condition of the augmented reality scene is met, wherein the special effect playing condition can be a preset playing mode. If the playing mode is one-time playing, the loop of the step can be ended after each special effect video frame in the video file is played once. If the playing mode is loop playing, each special effect video frame in the video file needs to be played in a loop until a playing stop instruction is received.

[0095] Specifically, the step b12) can be further specified as:

[0096] b111) determining a next video frame index according to a playing parameter and current playing information of the video file, and in combination with a preset playing mode.

[0097] In the optional embodiment, the preset playing mode can be understood as a preset playing mode of playing the special effect video frame in the augmented reality scene to present the animation enhancement special effect. The playing mode can include one-time playing, loop playing, playing from the beginning to the end and then playing from the end to the beginning in a loop. The playing parameter can include a playing time length, a playing rate and a frame number of the special effect video frame of the video file. The next video frame index can be understood as a playing time point in the video file corresponding to the next special effect video frame to be played.

[0098] In the optional embodiment, the specific execution of the step b111) can be preferably described as follows: extracting the playing time length, the playing rate, the frame number of the special effect video frame of the video file from the playing parameter information, and obtaining a current playing time point in the current playing information; determining a frame playing time of the video file according to the playing time length and the playing rate; determining the next video frame index based on the frame number, the current playing time point and the frame playing time, and in combination with a frame index calculation formula corresponding to the playing mode.

[0099] In the optional embodiment, the current playing time point can be considered as a time point in the video file corresponding to the special effect video frame being played. It can be known that if the playing of the special effect video frame has not been started, the current playing time point can be defaulted as 0.

[0100] In the optional embodiment, the time spent in playing one special effect video frame of the video file can also be calculated, and the time is recorded as a frame playing time.

[0101] For example, when the preset playing mode is one-time playing, the step of determining the next video frame index can be described as:

[0102] The minimum time of the frame playing time and the current playing time point is taken as a candidate time;

[0103] The candidate time is multiplied by the frame number, the product is divided by the frame playing time, the result after division is rounded down, and the time point obtained after rounding down can be taken as the next video frame index.

[0104] For example, when the playing mode is set to loop playing, the determination of the next video frame index can be described as:

[0105] The frame playing time and the current playing time point are subjected to a remainder operation, and the remainder result is taken as a candidate time;

[0106] Similarly, the candidate time is multiplied by the frame number, the product is divided by the frame playing time, the result after division is rounded down, and the time point obtained after rounding down can be taken as the next video frame index.

[0107] For example, when the playing mode is set to play from the beginning to the end and then loop play from the end to the beginning, the determination of the next video frame index can be described as:

[0108] The frame playing time is subjected to a multiplication operation, and the result after multiplication is subjected to a region operation with the current playing time point, and the remainder result is taken as a candidate time;

[0109] If the candidate time is greater than the frame playing time, the original candidate time is subtracted after the frame playing time is multiplied, and the difference value of the operation is taken as a new candidate time;

[0110] Similarly, the updated new candidate time is multiplied by the frame number, the product is divided by the frame playing time, the result after division is rounded down, and the time point obtained after rounding down can be taken as the next video frame index.

[0111] b112) determining the next special effect video frame to be played from the video file according to the next video frame index.

[0112] In this optional embodiment, the next video frame index is obtained through the above steps, which is equivalent to obtaining the corresponding time point of the next video frame to be played in the video file. Therefore, based on the next video frame index, the next special effect video frame to be played can be determined from the video file. Among them, the first obtained through the next video frame index is the image channel data information related to the next special effect video frame, and then the image channel data information is subjected to combination processing, and the texture image running in the image processing unit can be obtained. The texture image can be recorded as the next special effect video frame.

[0113] Specifically, the specific execution of step b112) can be preferably described as:

[0114] determining a next video frame playing position in the video file based on the next video frame index; extracting image channel data information contained at the next video frame playing position; and performing data mixing on each of the image channel data information, and taking a texture image obtained as a next special effect video frame to be played in the video file.

[0115] The third optional embodiment converts the video file from a sequence frame format to a set video format, and realizes the optimization of controlling the video file to have a smaller size while ensuring the play precision of the animation enhancement special effect. Meanwhile, the specific implementation of realizing the effective play of the animation enhancement special effect by using the video file in the set video format is given. Through the third optional embodiment, the storage space of the execution device for storing the video file is effectively saved, and the storage space resource occupation of the video file is optimized.

[0116] As known from the above description, the enhancement effect of the special effect prop displayed in the set display state in the embodiment can be preferably the animation enhancement special effect of the special effect prop played in the augmented reality scene, and is presented at the set screen position of the execution device in the predetermined special effect display size. The implementation of the preferred step mainly depends on the underlying logical operation.

[0117] In addition to supporting the play implementation of the animation enhancement special effect by the underlying logical operation of the third optional embodiment, the specific execution logic of the special effect display size determination can also be given by the fourth optional embodiment.

[0118] Specifically, as the fourth optional embodiment of the first embodiment, on the basis of any optional embodiment, the fourth optional embodiment further optimizes the process of playing the animation enhancement special effect, including: determining the special effect display size of each special effect video frame in the animation enhancement special effect on the device screen according to the first pose information of the execution device.

[0119] In the optional embodiment, the determination step of the special effect display size is added, which is mainly executed in the process of playing the animation enhancement special effect. The determination step can also be regarded as a step of synchronous execution of the animation enhancement special effect, which can determine the special effect display size of each special effect video frame involved in the animation enhancement special effect, wherein the special effect display size is specifically the display size when the special effect video frame is projected on the device screen.

[0120] Exemplarily, the step of determining the special effect display size of the special effect video frame in the device screen can be performed by using the first pose information of the execution device, wherein the first pose information is the pose information of the execution device when the execution device performs S102. In the optional embodiment, the special effect prop has a special effect virtual object in the augmented reality scene, and the camera in the augmented reality scene can capture the special effect virtual object and perform corresponding animation enhancement effect presentation on an augmented reality plane. Then, each special effect video frame presented on the augmented reality plane needs to be projected and displayed on the device screen.

[0121] It can be known that, in the display of the animation enhancement effect on the device screen, the camera (virtual camera) in the augmented reality scene needs to be relied on, the augmented reality plane in the augmented reality scene also needs to be relied on, and the expected presentation position of the animation enhancement effect when presented on the device screen needs to be known.

[0122] The spatial position information of the camera (virtual camera) in the augmented reality scene in the associated spatial coordinate system can be determined by using the pose information of the execution device. The augmented reality plane can be any plane in the augmented reality scene. The expected presentation position when presented on the device screen can be represented by a set screen position on the device screen.

[0123] Further, the fourth optional embodiment can further specify the step of determining the special effect display size of the animation enhancement effect on the device screen according to the first pose information of the execution device as follows:

[0124] a2) determining the spatial coordinate point of the camera in the augmented reality scene according to the first pose information of the execution device.

[0125] Exemplarily, the current spatial coordinate of the execution device in the spatial coordinate system can be obtained by using the first pose information, and the spatial coordinate can be directly used as the spatial coordinate point of the camera in the augmented reality scene.

[0126] b2) obtaining initial plane information of a preset initial vertical plane in the augmented reality scene.

[0127] It can be understood that, in order to make the special effect video frame of the animation enhancement effect better adapt to the actual application scene, the special effect video frame needs to be presented on the device screen with a suitable special effect display size.

[0128] The embodiment can set a suitable augmented reality plane for determining the special effect display size after the special effect prop is started, relative to the space coordinate system associated with the execution device and the augmented reality scene at the moment, and the augmented reality plane needs to satisfy the following defined conditions relative to the space coordinate system: perpendicular to the horizontal axis in the space coordinate system, and the distance from the plane to the origin of the space coordinate system is a set value. The plane satisfying the above defined conditions is referred to as an initial vertical plane in the embodiment.

[0129] The initial plane information of the determined initial vertical plane can be obtained in this step.

[0130] c2) According to the space coordinate point and the initial plane information, the special effect display size of each special effect video frame in the animation augmented special effect on the device screen is determined in combination with the set screen position.

[0131] In the optional embodiment, the special effect prop can be considered to exist as a special effect virtual object in the augmented reality environment. Based on this premise information, the implementation of this step can be considered to follow a logical implementation which can be described as follows: the camera in the augmented display environment can capture the special effect virtual object, and the relevant special effect video frames of the captured special effect virtual object are actually equivalent to being presented on the initial vertical plane; the projection of each pixel point of the relevant special effect video frames presented on the initial vertical plane on the device screen constitutes the display of the animation augmented special effect on the device screen.

[0132] The set screen position can be considered as the picture center point of each special effect video frame to be displayed. To ensure the special effect display size of each special effect video frame on the device screen, it is necessary to first determine the display size of each special effect video frame on the initial vertical plane, and the display size can be determined based on the determined space coordinate point, the initial plane information and the set screen position.

[0133] Specifically, the above step c2) can be further specified as:

[0134] c21) Obtain the center point coordinates of the set screen position, and determine the corresponding plane point coordinates of the center point coordinates on the initial vertical plane according to the space coordinate point and the initial plane information.

[0135] It can be understood that the set screen position can be a position area (which can usually be a rectangular area), and the center point coordinates can be regarded as the coordinates of the center point of the position area.

[0136] According to the mathematical logic principle, the spatial coordinate point of the camera is known, the initial plane information of an initial vertical plane is known, and the center point coordinate on the device screen is known. When a ray passing through the center point coordinate is drawn from the camera position, the ray can intersect the initial vertical plane. In combination with the initial plane information, the coordinate information of the intersection point can be determined. The coordinate information of the intersection point is recorded as the plane point coordinate.

[0137] c22) For each special effect video frame in the animation enhanced special effect, the pixel point coordinates of each pixel point in the special effect video frame on the initial vertical plane are determined with the plane point coordinate as the picture center coordinate of the special effect video frame.

[0138] It can be understood that the special effect virtual object of the special effect prop exists in the form of an animation enhanced special effect in the enhanced display scene. The camera can capture each special effect video frame in the animation enhanced special effect, and each special effect video frame is presented on the initial vertical plane.

[0139] After the position of the special effect video frame on the device screen is determined, the position of the special effect video frame on the initial vertical plane is determined. To determine the position of each pixel point in the special effect video frame on the initial vertical plane, the plane point coordinate corresponding to the center point coordinate of the device screen position on the initial vertical plane can be used as the picture center coordinate of the special effect video frame.

[0140] Since the special effect rendering data of the special effect video frame can be obtained, after the picture center coordinate is determined, the pixel point coordinates of each pixel point in the special effect video frame on the initial vertical plane can be determined in combination with the special effect rendering data.

[0141] c23) Based on the pixel point coordinates, the special effect display size of the special effect video frame on the device screen is determined.

[0142] In this optional embodiment, the projection matrix corresponding to the initial vertical plane and the device screen can be determined. After the pixel point coordinates are known, the pixel projection coordinates of each pixel point of the special effect video frame projected on the device screen can be determined. Finally, the special effect display size can be determined based on the pixel projection coordinates.

[0143] This fourth optional embodiment gives the underlying logic implementation of the determination of the special effect display size, which provides underlying logic operation support for the enhanced special effect display of the special effect prop of this embodiment.

[0144] As the fifth optional embodiment of the first embodiment, on the basis of any of the above optional embodiments, the step "maintain the set display state and continue to display the enhanced effect of the special effect prop" of S104 in the fifth optional embodiment can be further optimized as:

[0145] a3) continuing to play the animated augmented effect of the special effect prop in the augmented reality scene and keeping the special effect display size presented at the set screen position of the execution device.

[0146] The above steps of the fifth optional embodiment correspond to the underlying logic description supporting the implementation of S104. That is, if the original set display state of the augmented effect of the special effect prop is to be maintained, the animated augmented effect of the special effect prop needs to be continued to be played in the augmented reality scene, and each special effect video frame in the animated augmented effect needs to be presented at the set screen position of the execution device with the special effect display size determined above.

[0147] As can be known from the above description of the embodiment, after the pose of the execution device changes, if the visualization level is to maintain the augmented effect with the display state before the pose adjustment, the underlying logic level needs to determine an augmented reality plane in the augmented display scene for presenting each special effect video frame of the animated augmented effect.

[0148] Specifically, the fifth optional embodiment further gives the specific implementation of the step a3) in the above steps in the underlying logic level:

[0149] a31) constructing a target vertical plane in the augmented reality scene according to the second pose information of the execution device.

[0150] Illustratively, the second pose information of the execution device corresponds to the pose information possessed by the execution device after a pose adjustment, and through the second position information, a new spatial coordinate system can be established for the execution device and the augmented reality scene. Then, in the new spatial coordinate system, a new augmented reality plane needs to be determined which is perpendicular to the horizontal axis of the spatial coordinate system and has a distance to the origin of a set value. The augmented reality plane can be recorded as a target vertical plane in the embodiment.

[0151] In the embodiment, the construction of the target vertical plane can be converted in the spatial coordinate system corresponding to the first pose of the execution device. In the spatial coordinate system, relative to the second pose information of the execution device, it can be considered that the attitude angle of the execution device is rotated by a first rotation angle around the vertical axis of the spatial coordinate system from the first pose to the second pose. Based on the initial plane information of the initial vertical plane, the normal vector of the initial vertical plane can be obtained.

[0152] The embodiment can adjust the normal vector based on the first rotation angle, and take the adjusted normal vector as a target normal vector of a target vertical plane to be constructed; after determining that the distance between the target vertical plane to be constructed and the origin also needs to maintain a set distance value, the target plane information can be determined based on the target normal vector and the set distance value, and finally the target vertical plane can be constructed based on the target plane information.

[0153] It can be understood that, through the above description, it can be known that the constructed target vertical plane is actually equivalent to being always in the front of the augmented reality scene, so as to ensure that the special effect display size of the presented special effect video frame is always unchanged.

[0154] a32) controlling the camera in the augmented reality scene to capture the animated augmented special effect of the special effect prop, and presenting the animated augmented special effect on the target vertical plane, so that the animated augmented special effect presented at the set screen position of the execution device maintains the special effect display size.

[0155] In the optional embodiment, the camera in the augmented reality scene still continues to capture the animated augmented special effect of the special effect prop, but at this time, the special effect video frame of the animated augmented special effect is presented on the newly determined target vertical plane. The display size of the special effect video frame of the animated augmented special effect presented on the target vertical plane is the same as the display size of the special effect video frame presented on the target vertical plane. On the basis of the unchanged display size, the special effect display size of the special effect video frame of the animated augmented special effect projected on the device plane for display will also remain unchanged.

[0156] At the same time, as long as the set screen position is not adjusted, the corresponding screen position on the execution device will not change.

[0157] The fifth optional embodiment gives the underlying logic implementation of keeping the special effect display size unchanged, which provides underlying logic operation support for maintaining the original display state of the enhanced effect of the special effect prop.

[0158] As the sixth optional embodiment of the first embodiment, on the basis of any optional embodiment described above, the sixth optional embodiment can further preferably include that the enhanced effect includes an auditory enhanced effect; correspondingly, the step of "displaying the enhanced effect of the special effect prop in a set display state" can be specifically optimized as:

[0159] In the augmented reality scene, the sound enhanced special effect of the special effect prop is played at a set sound effect playing rate; wherein, the sound enhanced special effect is played synchronously with the animated augmented special effect of the visual enhanced effect included in the enhanced special effect.

[0160] In the optional embodiment, the enhanced effect of the special effect prop is further specified as an auditory enhanced effect, which can be understood as the special effect content of the special effect prop being output in the form of audio through the audio playing device of the execution device. The auditory enhanced effect of the embodiment can be used as the enhanced effect of the special effect prop, i.e., the enhanced effect of the special effect prop is no longer limited to visual enhancement, but the authenticity of the special effect prop in the actual application scene is improved by adding the sound enhanced effect.

[0161] Taking the firework prop as an example, when the firework prop plays the special effects such as firework blooming and explosion on the screen of the device, the sound effect of the blooming and explosion of the firework can be output through the audio output device (such as a loudspeaker or earphone) of the device at the same time, so as to enhance the authenticity of the firework special effect in the application scene.

[0162] In the optional embodiment, in order to ensure the synchronization of the sound enhanced effect and the animation enhanced effect in the visual enhanced effect, the playing rate of the sound playing and the playing rate of the animation enhanced effect can be synchronized and bound, wherein the synchronization of the sound playing and the video playing can be realized by using the related algorithm in the technical field, which will not be described here.

[0163] As a seventh optional embodiment of the first embodiment, on the basis of any of the above-mentioned optional embodiments, the seventh optional embodiment can further preferably comprise a tactile enhanced effect in the enhanced effect; and correspondingly, the step of "displaying the enhanced effect of the special effect prop in the set display state" can be specifically optimized as:

[0164] a4) in the augmented reality scene, when the vibration enhanced condition of the special effect prop is met, a vibration enhanced effect is presented by controlling the vibration device on the execution device.

[0165] In the optional embodiment, the enhanced effect of the special effect prop is further specified as a tactile enhanced effect, which can be understood as the special effect content of the special effect prop being displayed by controlling the vibration of the execution device. The tactile enhanced effect is often used in combination with the visual enhanced effect or the auditory enhanced effect. The vibration enhanced condition can be that the special effect picture presented in the visual enhanced effect needs to be held with vibration, or the sound special effect emitted in the auditory enhanced effect needs to be held with vibration. The embodiment can determine the time point at which the vibration enhanced condition is met, so as to present the vibration enhanced effect by controlling the vibration device on the execution device at the determined time point.

[0166] Specifically, the seventh optional embodiment can further optimize the "presenting the vibration enhanced effect by controlling the vibration device on the execution device" in the above-mentioned step a4) as:

[0167] obtaining vibration parameter information corresponding to a current satisfied vibration enhancement condition; and controlling the vibration device to vibrate based on the vibration parameter information to present the vibration enhancement special effect, wherein the vibration parameter information comprises a vibration amplitude, a vibration frequency, and a vibration duration.

[0168] It can be understood that when the animation enhancement special effect is played in the visual enhancement effect of the special effect prop or the sound enhancement special effect is played in the auditory enhancement effect, there can be multiple time points satisfying the vibration enhancement condition in the playing process. The embodiment can set different vibration parameter information for different time points, so that the vibration device of the execution device can be controlled to vibrate according to the corresponding vibration parameter information at the corresponding time points.

[0169] Still taking the firework prop as an example, the execution device can be controlled to perform the vibration special effect enhancement at the time point of the explosion of the firework. The time point of the explosion of the firework can be 0.05 seconds of the playing of the animation enhancement special effect, and the corresponding vibration parameter information can be a vibration amplitude of 0.16, a vibration frequency of 0.92, and a vibration duration of 0.12 seconds. The vibration parameter information in the embodiment is not limited to the above data, and can be any setting satisfying the haptic enhancement effect of the special effect prop, but the vibration amplitude and the vibration frequency are preferably selected from 0 and 1.

[0170] The optional embodiment can also improve the authenticity of the special effect prop in the actual application scene by adding the vibration enhancement special effect.

[0171] As an eighth optional embodiment of the first embodiment, on the basis of any of the above optional embodiments, the eighth optional embodiment further preferably comprises that the special effect prop is a firework prop, and the corresponding enhancement effect of the firework prop comprises a firework blooming animation, a firework explosion sound, a firework explosion flash, and a firework explosion vibration.

[0172] For example, when the special effect prop is preferably a firework prop, it means that the user triggers the prop option of the firework prop. Then, the blooming animation of the firework can be played on the set screen position on the screen of the execution device by the method provided in the embodiment, and the sound effect of the blooming of the firework is played synchronously during the blooming of the firework. Since the explosion of the firework is rendered during the blooming of the firework, the flash effect can be enhanced at the explosion point, and the explosion sound and the vibration of the explosion of the firework can be emitted at the explosion point. Through the above series of operations, the enhancement effect of the firework prop is more realistically and effectively displayed, and the user experience is better improved.

[0173] Meanwhile, in the visual enhancement effect of the firework special effect, the display size of the animation effect of the firework blooming does not change with the change of the pose of the execution device, so that the animation effect of the firework blooming can be presented in a display size more suitable for the application scenario, so as to ensure the authenticity of the firework special effect and improve the user experience of the firework special effect.

[0174] Embodiment Two

[0175] Figure 2 A structural schematic diagram of an interactive device of a special effect prop provided in Embodiment Two of the present disclosure is provided. The interactive device of the special effect prop provided in this embodiment can be implemented by software and / or hardware, and can be configured in a terminal and / or a server to implement the special effect prop display method in the present disclosure. The device can specifically include a first receiving module 21, a first display module 22, a second receiving module 23, and a second display module 24.

[0176] The first receiving module 21 is configured to receive a trigger operation of a special effect prop in an execution device, wherein the execution device currently has first pose information.

[0177] The first display module 22 is configured to display an enhancement effect of the special effect prop in a set display state.

[0178] The second receiving module 23 is configured to receive a pose adjustment operation of the execution device, wherein the first pose information of the execution device is changed to second pose information.

[0179] The second display module 24 is configured to maintain the set display state and continue to display the enhancement effect of the special effect prop.

[0180] The interactive device of the special effect prop disclosed in Embodiment Two provides the display state of the enhancement effect of the special effect prop when the execution device is in the first pose after the special effect prop is started, and when the pose of the execution device is changed to the second pose different from the first pose, the enhancement effect of the special effect prop can still be controlled to maintain the previous display state, so that the display state of the displayed enhancement effect is prevented from being adjusted to other display states with poor display effects due to the change of the pose of the execution device. Through the above technical solution, the enhancement effect of the special effect prop can be ensured to always maintain a suitable display state, so as to optimize the enhancement effect of the special effect prop, so that the enhancement effect can be effectively presented when the electronic device is in each pose, and the user experience is better improved.

[0181] In any optional technical solution in the embodiments of the present disclosure, optionally, the enhancement effect includes a visual enhancement effect.

[0182] Correspondingly, the first display module 22 can include:

[0183] a visual enhancement unit configured to play the animated enhancement effect of the special effect prop in an augmented reality scene and present the animated enhancement effect at a predetermined special effect display size at a set screen position of the execution device.

[0184] Optionally, the first display module 22 can further include a light effect enhancement unit.

[0185] The light effect enhancement unit is configured to superimpose a light enhancement effect and present the light enhancement effect when the animated enhancement effect is played to a preset time point during the playing of the animated enhancement effect.

[0186] Optionally, the visual enhancement unit can include the following steps when playing the animated enhancement effect of the special effect prop in an augmented reality scene:

[0187] An acquisition subunit is configured to acquire a video file corresponding to the special effect prop, wherein the video file is stored in a set video format.

[0188] A playing subunit is configured to decode the video file and play a decoded special effect video frame in the augmented reality scene.

[0189] Further, the playing subunit can be configured to:

[0190] determine a next video frame index according to a playing parameter and current playing information of the video file and in combination with a set playing mode;

[0191] determine a next special effect video frame to be played from the video file according to the next video frame index.

[0192] Further, the playing subunit can be configured to perform the following steps to determine the next video frame index according to the playing parameter and current playing information of the video file and in combination with the set playing mode:

[0193] extract a playing time length, a playing rate, and a frame number of the special effect video frame of the video file from the playing parameter information and acquire a current playing time point in the current playing information;

[0194] determine a frame playing time of the video file according to the playing time length and the playing rate;

[0195] determine the next video frame index based on the frame number, the current playing time point, and the frame playing time and in combination with a frame index calculation formula corresponding to the playing mode.

[0196] Further, the playing sub-unit can perform the following specific steps to determine the next special effect video frame to be played from the video file according to the next video frame index:

[0197] determine a next video frame playing position in the video file based on the next video frame index;

[0198] extract image channel data information contained in the next video frame playing position;

[0199] mix the image channel data information to obtain a texture image as the next special effect video frame to be played in the video file.

[0200] In any of the optional technical solutions in the embodiments of the present disclosure, the first display module 22 can further include an information determining unit,

[0201] The information determining unit is configured to determine a special effect display size of each special effect video frame in the animation enhanced special effect on a device screen according to first pose information of the execution device during playing of the animation enhanced special effect.

[0202] Further, the information determining unit can specifically include:

[0203] A first determining sub-unit configured to determine a spatial coordinate point of a camera in an augmented reality scene according to the first pose information of the execution device;

[0204] An information obtaining sub-unit configured to obtain initial plane information of a preset initial vertical plane in the augmented reality scene;

[0205] A second determining sub-unit configured to determine the special effect display size of each special effect video frame in the animation enhanced special effect on the device screen according to the spatial coordinate point and the initial plane information in combination with the set screen position.

[0206] Further, the second determining sub-unit can be specifically configured to:

[0207] obtain a center point coordinate of the set screen position, and determine a plane point coordinate corresponding to the center point coordinate on the initial vertical plane according to the spatial coordinate point and the initial plane information;

[0208] For each special effect video frame in the animation enhanced special effect, determine a pixel point coordinate of each pixel point in the special effect video frame on the initial vertical plane with the plane point coordinate as a picture center coordinate of the special effect video frame;

[0209] determine a special effect display size of the special effect video frame on the device screen based on the pixel point coordinates.

[0210] In any of the optional technical solutions in the embodiments of the present disclosure, optionally, the second display module 24 can include:

[0211] The state maintaining control unit is configured to continue playing the animation enhanced effect of the special effect prop in the augmented reality scene and maintain the special effect display size at the set screen position of the execution device.

[0212] Further, the specific steps performed by the state maintaining control unit to maintain the special effect display size at the set screen position of the execution device can include:

[0213] According to the second pose information of the execution device, a target vertical plane is constructed in the augmented reality scene;

[0214] The camera in the augmented reality scene is controlled to capture the animation enhanced effect and present it on the target vertical plane, so that the animation enhanced effect presented at the set screen position of the execution device maintains the special effect display size.

[0215] In any of the optional technical solutions in the embodiments of the present disclosure, optionally, the augmented effect includes an auditory augmented effect;

[0216] Correspondingly, the first display module 22 can be specifically configured to:

[0217] In the augmented reality scene, the sound enhanced effect of the special effect prop is played at a set sound effect playing rate; wherein the sound enhanced effect is played synchronously with the animation enhanced effect of the visual augmented effect included in the augmented effect.

[0218] In any of the optional technical solutions in the embodiments of the present disclosure, optionally, the augmented effect includes a tactile augmented effect;

[0219] Correspondingly, the first display module 22 can specifically include:

[0220] The vibration enhancing unit is configured to present a vibration enhanced effect in the augmented reality scene by controlling a vibration device on the execution device when the vibration enhanced condition of the special effect prop is met.

[0221] Further, the specific steps performed by the vibration enhancing unit to present the vibration enhanced effect by controlling the vibration device on the execution device can be described as:

[0222] Obtain vibration parameter information corresponding to the currently met vibration enhanced condition;

[0223] The vibration device is controlled to vibrate based on the vibration parameter information to present the vibration enhancement effect; wherein, the vibration parameter information includes: vibration amplitude, vibration frequency and vibration duration.

[0224] Based on any optional technical solution in the embodiments of this disclosure, the special effects prop may optionally be a fireworks prop;

[0225] The enhancement effects corresponding to the fireworks props include: fireworks blooming animation, fireworks explosion sound, fireworks explosion flash, and fireworks explosion vibration.

[0226] The above-described apparatus can execute the methods provided in any embodiment of this disclosure, and has the corresponding functional modules and beneficial effects for executing the methods.

[0227] It is worth noting that the various units and modules included in the above-mentioned device are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be realized; in addition, the specific names of each functional unit are only for easy differentiation and are not used to limit the protection scope of the embodiments of this disclosure.

[0228] Example 3

[0229] Figure 3 This is a schematic diagram of an electronic device provided in Embodiment 3 of the present disclosure. Referring now to FIG3, it illustrates an electronic device suitable for implementing embodiments of the present disclosure (e.g., [example device]). Figure 3 The diagram shows the structure of the electronic device (or server) 30. The electronic device in this embodiment may include, but is not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), and vehicle terminals (e.g., vehicle navigation terminals), as well as fixed terminals such as digital TVs and desktop computers. Figure 3 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments disclosed herein.

[0230] like Figure 3 As shown, the electronic device 30 may include a processing unit (e.g., a central processing unit, a graphics processing unit, etc.) 31, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 32 or a program loaded from a storage device 38 into a random access memory (RAM) 33. The RAM 33 also stores various programs and data required for the operation of the electronic device 30. The processing unit 31, the ROM 32, and the RAM 33 are interconnected via a bus 35. An edit / output (I / O) interface 34 is also connected to the bus 35.

[0231] Generally, the following devices can be connected to the I / O interface 34: input devices 36 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, and the like; output devices 37 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, and the like; storage devices 38 including, for example, a magnetic tape, a hard disk, and the like; and communication devices 39. The communication devices 39 can allow the electronic device 30 to communicate wirelessly or wired with other devices to exchange data. Although Figure 3 The electronic device 30 is shown with various devices, but it is understood that not all of the shown devices are required to be implemented or present. More or fewer devices can alternatively be implemented or present.

[0232] In particular, according to embodiments of the present disclosure, the processes described above with reference to the flowcharts can be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for executing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network through the communication devices 39, or installed from the storage devices 38, or installed from the ROM 32. When the computer program is executed by the processing device 31, the above-mentioned functions defined in the methods of the embodiments of the present disclosure are performed.

[0233] The names of the messages or information exchanged between the plurality of devices in the embodiments of the present disclosure are only for illustrative purposes, and are not intended to limit the scope of the messages or information.

[0234] The electronic device provided by the embodiments of the present disclosure and the display method of the special effect props provided by the above embodiments belong to the same inventive concept, and the technical details not described in detail in the present embodiment can be referred to the above embodiments, and the present embodiment has the same beneficial effects as the above embodiments.

[0235] Embodiment Four

[0236] The fourth embodiment of the present disclosure provides a computer storage medium, which stores a computer program, and the program is executed by a processor to implement the display method of the special effect props provided by the above embodiments.

[0237] It should be noted that the computer-readable medium described above can be a computer-readable signal medium or a computer-readable storage medium or any combination thereof. The computer-readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or any suitable combination of the above. More specific examples of the computer-readable storage medium can include, but are not limited to, an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, the computer-readable storage medium can be any tangible medium that contains or stores a program used by or in connection with an instruction execution system, apparatus or device. In the present disclosure, the computer-readable signal medium can include a data signal propagated in baseband or propagated as a carrier wave in a propagated data signal, in which the computer-readable program code is contained. Such a propagated data signal can take many forms, including but not limited to, an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer-readable signal medium can also be any computer-readable medium that can send, propagate or transfer the program for use by or in connection with the instruction execution system, apparatus or device. The program code contained in the computer-readable medium can be transmitted by any suitable medium, including but not limited to, wire, cable, RF (radio frequency), etc., or any suitable combination of the above.

[0238] In some embodiments, the client, server, or both can communicate using any current known or future developed network protocol, such as HTTP (HyperText Transfer Protocol), and can be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include local area networks ("LAN"), wide area networks ("WAN"), the Internet, and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any current known or future developed networks.

[0239] The computer-readable medium described above can be included in the electronic device described above; or can exist separately from the electronic device, and is not assembled into the electronic device.

[0240] The above computer readable medium can carry one or more programs which, when executed, can cause the electronic device to: can be written in any of a number of programming languages, including object-oriented programming languages such as Java, Smalltalk, C++, or the like, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code can execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computer (for example, through the Internet using an Internet Service Provider).

[0241] The flow diagrams and the block diagrams in the drawings are illustrations of architectures, functionalities, and operations of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flow diagrams or block diagrams can represent a module, a segment, or a portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that in some alternative implementations, the functions noted in the blocks can occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently or the blocks may

[0242] The units described in the embodiments of the present disclosure can be implemented by software, or by hardware. In some cases, the name of the unit does not constitute a limitation on the unit itself. For example, the first obtaining unit can also be described as a unit for obtaining at least two Internet protocol addresses.

[0243] The functions described above in the detailed description of embodiments of the present disclosure can be implemented in at least one of hardware, software, and firmware. The functions described above in the detailed description of embodiments of the present disclosure can be implemented in at least one of hardware, software, and firmware. The term "and / or" includes combinations thereof. The term "comprise", "comprises" and "comprising" or the like are used herein to generally mean including, containing or comprising, but not necessarily consisting of or composed of. The terms "program" or "software" or the like are used herein to generally refer to any type of computer code or set of computer-executable instructions that can be employed to program a computer or other processor configuration to implement various aspects associated with the present disclosure. The terms "program" or "software" or the like are used herein to generally refer to any type of computer code or set of computer-executable instructions that can be employed to program a computer or other processor configuration to implement various aspects associated with the present disclosure. The terms "program" or "software" or the like are used herein to generally refer to any type of computer code or set of computer-executable instructions that can be employed to program a computer or other processor configuration to implement various aspects associated with the present disclosure.

[0244] In the context of the present disclosure, a machine-readable medium can be a tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of the machine-readable storage medium will include one or more lines of electrical connections, portable computer disks, hard disk drives, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or Flash memory), optical fibers, portable compact disc read-only memories (CD-ROMs), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0245] According to one or more embodiments of the present disclosure, Example One provides a method for displaying a special effect prop, the method comprising:

[0246] receiving a trigger operation of the special effect prop in an execution device, wherein the execution device currently has first pose information;

[0247] displaying an augmented effect of the special effect prop in a set display state;

[0248] receiving a pose adjustment operation of the execution device, wherein the first pose information of the execution device is changed to second pose information;

[0249] maintaining the set display state and continuing to display the augmented effect of the special effect prop.

[0250] According to one or more embodiments of the present disclosure, Example Two provides a method for displaying a special effect prop, the augmented effect preferably including a visual augmented effect; accordingly, the displaying of the augmented effect of the special effect prop in a set display state comprises:

[0251] playing an animated augmented special effect of the special effect prop in an augmented reality scene and presenting the animated augmented special effect at a set screen position of the execution device with a predetermined special effect display size,

[0252] According to one or more embodiments of the present disclosure, Example Three provides a method for displaying a special effect prop, the method preferably further comprising, during the playing of the animated augmented special effect:

[0253] when the animated augmented special effect is played to a preset time point, superimposing a light augmented special effect and presenting the light augmented special effect.

[0254] Optionally, according to one or more embodiments of the present disclosure, example four provides a method for displaying a special effect prop, which preferably plays an animated special effect of the special effect prop in an augmented reality scene, comprising:

[0255] Obtaining a video file corresponding to the special effect prop, the video file being stored in a set video format; decoding the video file, and playing a decoded special effect video frame in the augmented reality scene.

[0256] Optionally,

[0257] According to one or more embodiments of the present disclosure, example five provides a method for displaying a special effect prop, which preferably decodes the video file and plays a decoded special effect video frame in the augmented reality scene, comprising:

[0258] Obtaining a video file corresponding to the special effect prop, the video file being stored in a set video format; decoding the video file, and playing a decoded special effect video frame in the augmented reality scene.

[0259] According to the playing parameters and the current playing information, decoding a next special effect video frame to be played, and playing in the augmented reality scene.

[0260] Optionally,

[0261] According to one or more embodiments of the present disclosure, example six provides a method for displaying a special effect prop, which preferably determines a next video frame index according to the playing parameters and the current playing information of the video file, in combination with a set playing mode, comprising:

[0262] Extracting a playing time length, a playing rate, and a frame number of the special effect video frame of the video file from the playing parameter information, and obtaining a current playing time point in the current playing information;

[0263] Determining a frame playing time of the video file according to the playing time length and the playing rate;

[0264] Based on the frame number, the current playing time point, and the frame playing time, in combination with a frame index calculation formula corresponding to the playing mode, determining a next video frame index.

[0265] According to one or more embodiments of the present disclosure, example seven provides a method for displaying a special effect prop, which preferably determines a next special effect video frame to be played from the video file according to the next video frame index, comprising:

[0266] Based on the next video frame index, determining a next video frame playing position in the video file;

[0267] Extracting image channel data information contained in the next video frame playing position;

[0268] mixing the image channel data information, and obtaining a texture image as a next special effect video frame to be played in the video file.

[0269] According to one or more embodiments of the present disclosure, Example Eight provides a method for displaying a special effect prop, which preferably comprises the following steps during playing of the animation-enhanced special effect:

[0270] According to the first pose information of the execution device, the special effect display size of each special effect video frame in the animation-enhanced special effect on the device screen is determined.

[0271] According to one or more embodiments of the present disclosure, Example Nine provides a method for displaying a special effect prop, which preferably comprises the following steps of determining the special effect display size of each special effect video frame in the animation-enhanced special effect on the device screen according to the first pose information of the execution device:

[0272] According to the first pose information of the execution device, the spatial coordinate point of the camera in the augmented reality scene is determined.

[0273] The initial plane information of a preset initial vertical plane in the augmented reality scene is obtained.

[0274] According to the spatial coordinate point and the initial plane information, the special effect display size of each special effect video frame in the animation-enhanced special effect on the device screen is determined in combination with the set screen position.

[0275] According to one or more embodiments of the present disclosure, Example Ten provides a method for displaying a special effect prop, which preferably comprises the following steps of determining the special effect display size of each special effect video frame in the animation-enhanced special effect on the device screen according to the spatial coordinate point and the initial plane information in combination with the set screen position:

[0276] The center point coordinate of the set screen position is obtained, and the corresponding plane point coordinate of the center point coordinate on the initial vertical plane is determined according to the spatial coordinate point and the initial plane information.

[0277] For each special effect video frame in the animation-enhanced special effect, the pixel point coordinate of each pixel point in the special effect video frame on the initial vertical plane is determined with the plane point coordinate as the picture center coordinate of the special effect video frame.

[0278] Based on each pixel point coordinate, the corresponding special effect display size of the special effect video frame on the device screen is determined.

[0279] According to one or more embodiments of the present disclosure, Example Eleven provides a method for displaying a special effect prop, which preferably maintains the set display state and continues to display the enhanced effect of the special effect prop, comprising:

[0280] continuing to play the animated enhanced effect of the special effect prop in the augmented reality scene and maintaining the special effect display size at the set screen position of the execution device.

[0281] According to one or more embodiments of the present disclosure, Example Twelve provides a method for displaying a special effect prop, which preferably maintains the special effect display size at the set screen position of the execution device, comprising:

[0282] constructing a target vertical plane in the augmented reality scene according to second pose information of the execution device;

[0283] controlling the camera in the augmented reality scene to capture the animated enhanced effect and present it on the target vertical plane, so that the animated enhanced effect presented at the set screen position of the execution device maintains the special effect display size.

[0284] According to one or more embodiments of the present disclosure, Example Thirteen provides a method for displaying a special effect prop, which further comprises:

[0285] According to one or more embodiments of the present disclosure, Example Fourteen provides a method for displaying a special effect prop, which preferably the enhanced effect includes an auditory enhanced effect;

[0286] Correspondingly, the method for displaying the enhanced effect of the special effect prop in the set display state comprises:

[0287] playing the sound enhanced effect of the special effect prop in the augmented reality scene at a set sound effect playback rate;

[0288] wherein the sound enhanced effect is played synchronously with the animated enhanced effect of the visual enhanced effect included in the enhanced effect.

[0289] According to one or more embodiments of the present disclosure, Example Fifteen provides a method for displaying a special effect prop, which preferably the enhanced effect includes a tactile enhanced effect;

[0290] Correspondingly, the method for displaying the enhanced effect of the special effect prop in the set display state comprises:

[0291] presenting a vibration enhanced effect by controlling a vibration device on the execution device when the vibration enhanced condition of the special effect prop is met in the augmented reality scene.

[0292] According to one or more embodiments of the present disclosure, example sixteen provides a method for presenting a special effect prop, which preferably presents a vibration enhancement special effect by controlling a vibration device on an execution device, comprising:

[0293] obtaining vibration parameter information corresponding to a currently satisfied vibration enhancement condition;

[0294] controlling the vibration device to vibrate based on the vibration parameter information, so as to present the vibration enhancement special effect;

[0295] wherein the vibration parameter information comprises a vibration amplitude, a vibration frequency, and a vibration duration.

[0296] According to one or more embodiments of the present disclosure, example seventeen provides a method for presenting a special effect prop, which preferably is a firework prop;

[0297] the enhancement effect corresponding to the firework prop comprises a firework blooming animation, a firework explosion sound, a firework explosion flash, and a firework explosion vibration.

[0298] According to one or more embodiments of the present disclosure, example eighteen provides an interaction device for a special effect prop, comprising:

[0299] a first receiving module configured to receive a trigger operation of a special effect prop in an execution device, wherein the execution device currently has first pose information;

[0300] a first presenting module configured to present an enhancement effect of the special effect prop in a set presentation state;

[0301] a second receiving module configured to receive a pose adjustment operation of the execution device, wherein the first pose information of the execution device is changed to second pose information;

[0302] a second presenting module configured to maintain the set presentation state and continue to present the enhancement effect of the special effect prop.

[0303] The above description is merely preferred embodiments of the present disclosure and a description of the principles of the technology applied. It should be understood by those skilled in the art that the disclosed scope of the present disclosure is not limited to the technical solutions formed by the specific combinations of the above technical features, and should also cover other technical solutions formed by any combinations of the above technical features or equivalent features without departing from the disclosed concept. For example, the above features are replaced with technical features disclosed in the present disclosure (but not limited to) having similar functions to form technical solutions.

[0304] Moreover, while operations are depicted in a particular order, this should not be understood as requiring such an order nor infringing on the scope of the disclosure. Certain features that are, in certain instances, described with respect to a particular embodiment can also be implemented in a combination of embodiments. Conversely, various features that are, in certain instances, described with respect to a single embodiment can also be implemented in multiple embodiments singly or in any suitable sub-combination.

[0305] Although the subject matter has been described in language specific to structural features and / or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.

Claims

1. A method of displaying a special effect prop, characterized by, The method comprises: receiving a trigger operation of a special effect prop in an execution device, wherein the execution device currently has first pose information, the special effect prop is used for special effect rendering on an actual application scene, and special effect rendering of the special effect prop is implemented in an augmented reality scene, the augmented reality scene is a three-dimensional space, and a virtual camera is arranged in the augmented reality scene, and a special effect virtual object corresponding to the special effect prop is captured at a set capture angle through the virtual camera; displaying an augmented effect of the special effect prop in a set display state, the augmented effect comprising a visual augmented effect formed by projecting the captured special effect virtual object on a screen of the execution device; receiving a pose adjustment operation of the execution device, and controlling the virtual camera to keep the capture angle to capture the special effect virtual object, wherein the first pose information of the execution device is changed to second pose information; keeping the set display state, and continuing to display the augmented effect of the special effect prop.

2. The method of claim 1, wherein, The augmented effect comprises a visual augmented effect; correspondingly, the step of displaying the augmented effect of the special effect prop in the set display state comprises: playing an animation augmented effect of the special effect prop in the augmented reality scene, and presenting the animation augmented effect at a set screen position of the execution device with a predetermined special effect display size.

3. The method of claim 2, wherein, In the process of playing the animation augmented effect, the method further comprises: when the animation augmented effect is played to a preset time point, superimposing a light augmented effect and presenting the light augmented effect.

4. The method of claim 2, wherein, The step of playing the animation augmented effect of the special effect prop in the augmented reality scene comprises: obtaining a video file corresponding to the special effect prop, wherein the video file is stored in a set video format; decoding the video file, and playing a decoded special effect video frame in the augmented reality scene.

5. The method of claim 4, wherein, The step of decoding the video file and playing the decoded special effect video frame in the augmented reality scene comprises: obtaining a play parameter and current play information of the video file; decoding a next special effect video frame to be played according to the play parameter and the current play information, and playing the next special effect video frame in the augmented reality scene.

6. The method of claim 5, wherein, The step of decoding the next special effect video frame to be played according to the play parameter and the current play information comprises: determining a next video frame index according to the play parameter and the current play information of the video file and in combination with a set play mode; determining the next special effect video frame to be played from the video file according to the next video frame index.

7. The method of claim 6, wherein, The step of determining the next video frame index according to the play parameter and the current play information of the video file and in combination with the set play mode comprises: extracting a play duration, a play rate and a frame number of the special effect video frame of the video file from the play parameter information, and obtaining a current play time point in the current play information; determining a frame play time of the video file according to the play duration and the play rate; determining the next video frame index based on the frame number, the current play time point and the frame play time, and in combination with a frame index calculation formula corresponding to the play mode.

8. The method of claim 6, wherein, The step of determining the next special effect video frame to be played from the video file according to the next video frame index comprises: determine a next video frame playing position in the video file based on the next video frame index; extract image channel data information contained in the next video frame playing position; perform data mixing on each of the image channel data information, and obtain a texture image as a next special effect video frame to be played in the video file.

9. The method of claim 2, wherein, In the process of playing the animation enhancement special effect, further comprising: determining a special effect display size of each special effect video frame in the animation enhancement special effect on a device screen according to the first pose information of the execution device.

10. The method of claim 9, wherein, The determining a special effect display size of each special effect video frame in the animation enhancement special effect on a device screen according to the first pose information of the execution device comprises: determining a space coordinate point of a camera in an augmented reality scene according to the first pose information of the execution device; obtaining initial plane information of a preset initial vertical plane in the augmented reality scene; determining a special effect display size of each special effect video frame in the animation enhancement special effect on a device screen according to the space coordinate point and the initial plane information, and in combination with the set screen position.

11. The method of claim 10, wherein, The determining a special effect display size of each special effect video frame in the animation enhancement special effect on a device screen according to the space coordinate point and the initial plane information, and in combination with the set screen position comprises: obtaining a center point coordinate of the set screen position, and determining a plane point coordinate corresponding to the center point coordinate on the initial vertical plane according to the space coordinate point and the initial plane information; for each special effect video frame in the animation enhancement special effect, determining a pixel point coordinate of each pixel point in the special effect video frame on the initial vertical plane, taking the plane point coordinate as a picture center coordinate of the special effect video frame; determining a special effect display size of the special effect video frame on a device screen based on each of the pixel point coordinates.

12. The method of claim 2, wherein, maintaining the set display state and continuing to display the enhancement effect of the special effect prop comprises: continuing to play the animation enhancement special effect of the special effect prop in the augmented reality scene, and maintaining the special effect display size to be displayed at the set screen position of the execution device.

13. The method of claim 12, wherein, The maintaining the special effect display size to be displayed at the set screen position of the execution device comprises: constructing a target vertical plane in the augmented reality scene according to second pose information of the execution device; controlling a camera in the augmented reality scene to capture the animation enhancement special effect and display it on the target vertical plane, so that the animation enhancement special effect displayed at the set screen position of the execution device maintains the special effect display size.

14. The method of claim 1, wherein, The enhancement effect comprises an auditory enhancement effect; Correspondingly, the displaying the enhancement effect of the special effect prop in the set display state comprises: playing a sound enhancement special effect of the special effect prop in the augmented reality scene at a set sound effect playing rate; wherein the sound enhancement special effect is played synchronously with the animation enhancement special effect including the visual enhancement effect in the enhancement special effect.

15. The method of claim 1, wherein, The enhancement effect comprises a tactile enhancement effect; Correspondingly, the displaying the enhancement effect of the special effect prop in the set display state comprises: In the augmented reality scene, when the vibration enhancement condition of the special effect prop is met, a vibration enhancement special effect is presented by controlling a vibration device on the execution device.

16. The method of claim 15, wherein, The vibration enhancement special effect is presented by controlling the vibration device on the execution device, including: obtaining vibration parameter information corresponding to the vibration enhancement condition currently met; controlling the vibration device to vibrate based on the vibration parameter information to present the vibration enhancement special effect; The vibration parameter information includes vibration amplitude, vibration frequency, and vibration duration.

17. The method according to any one of claims 1 to 16, characterized in that, The special effect prop is a firework prop. The enhancement effect corresponding to the firework prop includes a firework blooming animation, a firework explosion sound, a firework explosion flash, and a firework explosion vibration.

18. An interactive device for a special effect prop, characterized by, Including: The first receiving module is configured to receive a trigger operation of a special effect prop in an execution device, wherein the execution device currently has first pose information, the special effect prop is used to perform special effect rendering on an actual application scene, special effect rendering of the special effect prop is implemented in an augmented reality scene, the augmented reality scene is a three-dimensional space, a virtual camera is arranged, and a special effect virtual object corresponding to the special effect prop is captured by the virtual camera at a set capture angle; The first display module is configured to display an enhancement effect of the special effect prop in a set display state, the enhancement effect includes a visual enhancement effect, and the visual enhancement effect is formed by projecting the captured special effect virtual object on a screen of the execution device; The second receiving module is configured to receive a pose adjustment operation of the execution device, and control the virtual camera to keep the capture angle to capture the special effect virtual object, wherein the first pose information of the execution device is changed to second pose information; The second display module is configured to keep the set display state and continue to display the enhancement effect of the special effect prop.

19. An electronic device, comprising: The electronic device includes: One or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the special effect prop display method of any one of claims 1-17.

20. A computer readable storage medium having stored thereon a computer program, characterized in that, The program is executed by the processor to implement the special effect prop display method of any one of claims 1-17.

Images