Effect presentation method, device, electronic device, and storage medium

Abstract

The present disclosure relates to a computer technology field, and more particularly to an effect display method, an apparatus, an electronic device, and a storage medium. An effect display method according to an embodiment of the present disclosure includes: displaying a virtual reality space; displaying media content in the virtual reality space; and displaying an effect associated with the media content in the virtual reality space based on the media content. In this embodiment, by displaying an effect associated with the media content in the virtual reality space based on the media content, the corresponding effect can be displayed while displaying the media content in the virtual reality space, and further allows a user to obtain a richer interaction experience in the virtual reality space.

Description

[Technical field]

[0001] This application is filed based on a Chinese application having application number 202210542347.3, filing date May 17, 2022, and titled "Effect Presentation Method, Apparatus, Electronic Device, and Storage Medium," and claims priority to the Chinese application, the entire contents of which are incorporated herein by reference.

[0002] The present disclosure relates to the field of computer technology, and more particularly to an effect presentation method, device, electronic device, and storage medium. [Background technology]

[0003] With the development of virtual reality (VR) technology, an increasing number of virtual social platforms or applications are being developed and used by users. In virtual social platforms, users can control their own avatars through smart terminal devices such as head-mounted VR glasses to engage in social interactions with avatars controlled by other users, entertainment, learning, remote work, and the creation of UGC (User Generated Content). However, the interaction formats provided by related virtual social platforms are relatively single and cannot meet the diversified interaction needs of users. Summary of the Invention

[0004] This Summary is provided to introduce concepts in a simplified form that are described in detail in the subsequent Detailed Description. This Summary is not intended to identify key or essential features of the claimed subject matter, nor is it intended to limit the scope of the claimed subject matter.

[0005] According to a first aspect, one or more embodiments of the present disclosure include: Displaying a virtual reality space; presenting media content in the virtual reality space; and presenting an effect associated with the media content in the virtual reality space based on the media content.

[0006] According to a second aspect, one or more embodiments of the present disclosure include: a space display unit for displaying a virtual reality space; a media content presenting unit for presenting media content in the virtual reality space; An effect presentation unit for presenting an effect associated with the media content in the virtual reality space based on the media content.

[0007] According to a third aspect, one or more embodiments of the present disclosure provide an electronic device including at least one memory and at least one processor, the memory for storing program code, and the processor for calling the program code stored in the memory to cause the electronic device to execute an effect presentation method according to one or more embodiments of the present disclosure.

[0008] According to a fourth aspect, one or more embodiments of the present disclosure provide a non-transitory computer storage medium having stored thereon program code that, when executed by a computing device, causes the computing device to perform an effect presentation method according to one or more embodiments of the present disclosure.

[0009] According to one or more embodiments of the present disclosure, effects associated with media content can be presented in a virtual reality space based on the media content, thereby presenting corresponding effects while displaying the media content in the virtual reality space, and further enabling a user to obtain a richer interaction experience in the virtual reality space. [Brief description of the drawings]

[0010] The above and other features, advantages, and aspects of the embodiments of the present disclosure will become more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which the same or similar elements are designated by the same or similar reference numerals in all the accompanying drawings. It should be understood that the accompanying drawings are schematic and that the parts and elements are not necessarily drawn to scale.

[0011] [Figure 1] FIG. 1 is a schematic diagram of a virtual reality device according to one embodiment of the present disclosure. [Diagram 2] 1 is a flowchart of an effect presentation method according to an embodiment of the present disclosure. [Diagram 3] FIG. 1 is a schematic diagram of a virtual reality space according to one embodiment of the present disclosure. [Figure 4] 1 is a schematic diagram illustrating the configuration of an effect presentation device according to an embodiment of the present disclosure. [Diagram 5] FIG. 1 is a schematic diagram illustrating a configuration of an electronic device according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] The following will describe the embodiments of the present disclosure in more detail with reference to the accompanying drawings. Although several embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be realized in various forms and should not be construed as being limited to the embodiments described herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the accompanying drawings and embodiments of the present disclosure are merely illustrative and do not limit the scope of protection of the present disclosure.

[0013] It should be understood that the steps described in the embodiments of the present disclosure may be performed in a different order and / or in parallel. Further, the embodiments may include additional steps and / or omit the performance of steps that are shown. The scope of the present disclosure is not limited in this respect.

[0014] The term "including" and variations thereof as used herein are open-ended, i.e., mean "including, but not limited to." The term "based on" means "based at least in part on." The term "in one embodiment" means "at least one embodiment," the term "another embodiment" means "at least one other embodiment," and the term "some embodiments" means "at least some embodiments." The term "responsive to" and related terms mean that a signal or event is influenced to some extent by another signal or event, but not necessarily completely or directly. When event x occurs "in response to" event y, x may be directly or indirectly responsive to y. For example, the occurrence of y may ultimately result in the occurrence of x, although there may be other intermediate events and / or conditions. In other cases, y does not necessarily result in the occurrence of x, and x may occur even if y has not occurred. Additionally, the term "responsive to" may mean "at least in part responsive to."

[0015] The term "determining" is broadly inclusive of various operations and may include obtaining, computing, calculating, processing, deriving, investigating, looking up (e.g., looking up in a table, database, or other data structure), ascertaining, and similar operations, and may further include receiving (e.g., receiving information), accessing (e.g., accessing data in a memory), and similar operations, as well as analyzing, selecting, choosing, establishing, and similar operations. Relevant definitions of other terms are provided in the description below. Relevant definitions of other terms are provided in the description below.

[0016] It should be noted that concepts such as "first" and "second" described in this disclosure are merely intended to distinguish between different devices, modules, or units, and are not intended to limit the order of functions performed by these devices, modules, or units or their mutual dependencies.

[0017] In addition, the modifications of "one" and "multiple" described in the present disclosure are illustrative and not limiting. Unless otherwise specified, it is obvious to a person skilled in the art that it should be understood as "one or multiple".

[0018] For purposes of this disclosure, the phrase "A and / or B" means (A), (B), or (A and B).

[0019] The names of messages or information exchanged between devices in the embodiments of the present disclosure are merely descriptive and do not limit the scope of these messages or information.

[0020] 2 is a flowchart of an effect presentation method 100 according to an embodiment of the present disclosure. Referring to FIG. 2, the method 100 includes steps S120 to S160.

[0021] Step S120: The virtual reality space is displayed.

[0022] In some embodiments, a virtual reality space may be realized by an extended reality (abbreviated as XR) device. The extended reality technology can provide a user with a virtual reality space where human-computer interaction is possible by connecting reality and virtuality by a computer, and the virtual reality space may be displayed as a three-dimensional image. In the virtual reality space, a user can control his / her avatar through a smart terminal device such as head-mounted VR glasses or a head-mounted display (HMD) to perform social interactions with avatars controlled by other users, entertainment, learning, work, remote work, creation of UGC (User Generated Content), and the like.

[0023] In this embodiment, the augmented reality technology includes, but is not limited to, technologies such as AR (Augmented Reality), VR (Virtual Reality), MR (Mixed Reality), and Augmented Virtuality (AV).

[0024] The augmented reality devices according to the embodiments of the present disclosure may include, but are not limited to, the following types:

[0025] Computer-side virtual reality (PCVR) device: The PC side is used to perform calculations and output data related to the virtual reality function, and the external computer-side virtual reality device uses the data output by the PC side to realize the virtual reality effect.

[0026] Mobile virtual reality device: Supports the installation of a mobile terminal (e.g., a smartphone) in various ways (e.g., a head-mounted display with a dedicated card slot), and connects to the mobile terminal via wired or wireless connection. The mobile terminal performs calculations related to the virtual reality function and outputs the data to the mobile virtual reality device, for example, to watch virtual reality videos through the APP of the mobile terminal.

[0027] Multifunction virtual reality device: Equipped with a processor for performing calculations related to virtual functions, it has independent virtual reality input and output functions and does not need to be connected to a PC or mobile device, allowing for high flexibility in use.

[0028] Of course, the implementation of the augmented reality device is not limited to these, and may be made smaller or larger as necessary.

[0029] As shown in Figure 1, a user can enter a virtual reality space using a smart terminal device such as head-mounted VR glasses, and control his or her own avatar in the virtual reality space to engage in social interactions with avatars controlled by other users, entertainment, learning, remote work, and the like.

[0030] Here, the virtual reality space may be an environment that simulates the real world, a virtual scene that is half simulated and half virtual, or a purely virtual scene. The virtual scene may be any one of a 2D virtual scene, a 2.5D virtual scene, or a 3D virtual scene, and the embodiments of the present application do not limit the dimension of the virtual scene. For example, the virtual scene may include sky, land, sea, etc., and the land may include environmental elements such as desert, city, etc., and the user can control the virtual object to move in the virtual scene.

[0031] In one embodiment, in the virtual reality space, the user may realize the relevant interaction operation by a controller, the controller may be a pad, for example, the user performs the relevant operation control by operating on the pad key. Of course, in another embodiment, the user may control the target object in the virtual reality device by using gestures, voice or multimodal control method without using a controller.

[0032] In some embodiments, the virtual reality space includes a virtual live streaming space or a virtual social space. In the virtual live streaming space, a user who is a performer can perform live streaming with a virtual character or real video, and a user who is a viewer can control an avatar to watch the performer's live streaming from a viewing perspective such as a first-person perspective. In the virtual social space, a user can perform social interactions through an avatar. For example, a virtual reality technology can be used to build a virtual reality space model of a performer, and a virtual reality environment of a concert can be generated by calculation based on the space model. In addition, technologies including auditory sensing, tactile sensing, motion sensing, and even taste sensing and olfactory sensing can be provided to realize an interactive three-dimensional dynamic vision and entity behavior simulation in which a virtual environment is integrated, so that a user can immerse himself in a simulated virtual reality environment. In this way, it is possible to realize that a performer appears in the virtual reality environment, while a user can enter the concert scene by wearing a virtual reality device, and through the related sensing technology, the user can interact with the performer, listen to a grand concert, and achieve an immersive and realistic concert experience effect.

[0033] It should be noted that in the embodiments of the present disclosure, the image of the avatar may be created based on an actual video image of the user, or may be pre-set by the system, or may be customized and created by the user, and the present disclosure does not impose any limitations thereon.

[0034] Step S140: Present media content in the virtual reality space.

[0035] In some embodiments, the media content may include, but is not limited to, media content such as text, images, video, or audio.

[0036] In some embodiments, a media information stream may be obtained and media content may be presented in a virtual reality space based on the media information stream.

[0037] In some embodiments, the media information stream includes a video stream and / or an audio stream, such as a video live streaming stream, an audio live streaming stream, etc. Exemplarily, the video stream may employ an encoding format such as H.265, H.264, MPEG-4, etc. In a specific embodiment, an audio-video live streaming stream transmitted by a server may be received.

[0038] In some embodiments, the virtual reality space may include one or more predefined display areas that may be used to display media content, illustratively corresponding to virtual screens in the virtual reality space for playing back decoded audio-video content.

[0039] Step S160: Based on the media content, an effect associated with the media content is presented in the virtual reality space.

[0040] In some embodiments, the effects may include one or a group of effects.

[0041] In some embodiments, the presentation time of the effect may last for a preset amount of time, or may continue indefinitely until it is stopped or replaced by another effect.

[0042] In some embodiments, a resource pool may be pre-established in the client to store effect files. After determining the effect indication information, the client may call up a corresponding effect file from the resource pool to perform real-time rendering.

[0043] In some embodiments, the effect includes at least one of an animation effect, a change to a display element in a virtual reality space, and a change to a model of the virtual reality space. For illustrative purposes, a live concert broadcast will be taken as an example. Display elements in the virtual reality space may include, but are not limited to, stage art designs such as a stage, a set, lighting, and props.

[0044] In some embodiments, the effect to be presented corresponds to the style of the media content. For example, the media content is music. If the style of the music is passionate and unrestrained, a gorgeous and dynamic effect may be selected, and if the style of the music is quiet and gentle, a clean and gentle effect may be selected.

[0045] According to one or more embodiments of the present disclosure, effects associated with media content can be presented in a virtual reality space based on the media content, thereby presenting corresponding effects while displaying the media content in the virtual reality space, and further enabling a user to obtain a richer interaction experience in the virtual reality space.

[0046] In some embodiments, there is a pre-established association between the effect and the media content indicated by the media content information.

[0047] In some embodiments, the effects may include one or more pre-defined effects that are presented at one or more pre-defined times.

[0048] In one particular implementation, the duration of the effect corresponds to the duration of its corresponding media content.

[0049] In one specific implementation, when the media content is a song, the effect includes an animated image corresponding to a target lyric or a target melody in the song.

[0050] In some embodiments, effect scripts corresponding to different media contents (e.g., music) may be preset. The effect scripts may be used to set a specific effect to appear at a certain minute and second of the media content, corresponding to the effect and the media content element (e.g., story, lyrics, melody, or emotional flow). For example, when the lyrics "Kongming Light" and "Peach Blossom" and the climax of the music melody appear at 0 minutes 10 seconds, 20 seconds, and 30 seconds of music A, respectively, animation image effects such as "Kongming Light", "Peach Blossom", Kongming Light flying, or peach blossom blooming may be set at 0 minutes 10 seconds, 20 seconds, and 30 seconds, respectively.

[0051] In some embodiments, step S160 further includes, in response to a user's preset operation on the presented media content, obtaining effect information associated with the target media content corresponding to the user operation, and presenting the effect in the virtual reality space based on the effect information.

[0052] In some embodiments, the preset operation includes, but is not limited to, a haptic control operation, a gesture control operation, an eye movement operation, a touch operation, a voice control command, or a preset operation for an external control device.

[0053] For example, a user may operate an avatar to touch text information presented in the media content, thereby triggering effect information corresponding to the text information, and presenting the effect in the virtual reality space based on the effect information. For example, when text information "Kongming Light" is displayed in the media content, a corresponding "Kongming Light" effect resource file may be obtained based on a preset operation on the text information, and the "Kongming Light" effect may be presented in the virtual reality space based on the effect resource file.

[0054] In a specific embodiment, different effect information may be pre-defined for different media content elements and stored in the client, so that when a media content element is triggered by a user, the client can call up the corresponding effect information to present the corresponding effect.

[0055] In some embodiments, step S160 further includes the following steps.

[0056] Step S161: Present an effect associated with the media content in the virtual reality space based on a timeline in which the media content is presented.

[0057] In some embodiments, for multiple media contents presented sequentially at different times, corresponding multiple effects may be set sequentially according to a timeline along which the multiple media contents are presented, or for multiple media content elements presenting the same media content at different times, corresponding multiple effects may be set sequentially according to a timeline along which the multiple media content portions are presented.

[0058] In some embodiments of the present disclosure, a media content element is a component that constitutes a media content. For example, if the media content includes a song, the media content element may include a melody or lyrics of a part of the song. If the media content is a video, the media content element may include a subtitle or a story of a part of the video.

[0059] In some embodiments, step S161 further includes the following steps.

[0060] Step A1: Determine effect indication information for indicating a first effect to be presented together with a media content based on an obtained media information stream.

[0061] Step A2: The first effect is presented in the virtual reality space based on the effect instruction information.

[0062] In some embodiments, the first effect includes an effect of a media content presentation scene set in a virtual reality space, or the first effect includes an animation effect corresponding to a particular element associated with the media content.

[0063] In some embodiments, the effect indication information may be determined based on a currently acquired media information stream. Exemplarily, the effect indication information may take the form of Supplemental Enhancement Information (SEI). The supplemental enhancement information is additional information that may be included in a video stream, for example, information customized by a user, thereby increasing the availability of video and making the video more widely applicable. The supplemental enhancement information may be packetized and transmitted together with a video frame, achieving the effect of transmitting and analyzing the supplemental enhancement information and the video frame synchronously. In this way, when a client decodes a media information stream, the effect indication information can be determined according to the supplemental enhancement information in the media information stream.

[0064] According to one or more embodiments of the present disclosure, by determining effect indication information based on effect indication information carried in a media information stream, when displaying media content, particularly when live streaming video, effects to be corresponding to the media content can be determined and presented in real time.

[0065] In some embodiments, step A11 further includes the following steps:

[0066] Step a11: determining the effect indication information based on supplemental enhancement information in the currently acquired media information stream.

[0067] The following takes video live streaming as an example. When a performer prepares or starts live streaming of an appearance of program A, the performer side may respond to a preset user command to packetize the supplemental enhancement information corresponding to effect a (e.g., including the number of effect a) together with the current video frame into a media information stream and send it to the viewer's client via the service side. The viewer's client may obtain effect indication information based on the supplemental enhancement information while decoding the current video frame. Furthermore, the viewer's client may start presenting effect a accordingly. Similarly, when a performer prepares or starts performing in program B after finishing performing in program A, a related person may again trigger a command to use effect b corresponding to program B at the performer side, so as to finally make the viewer's client present from effect a to effect b. In a specific implementation form, the current video frame is the start frame of program A.

[0068] In some embodiments, the method 100 further includes steps B1-B3.

[0069] Step B1: determining media content information for indicating the media content currently being presented or to be presented.

[0070] By way of example, the media content information may include the name of a program in which the performer is currently appearing or will appear, such as a song title.

[0071] In some embodiments, the media content information may be determined based on a currently acquired media information stream. Exemplarily, the media content information may take the form of supplemental enhancement information. The supplemental enhancement information is additional information that may be included in a video stream, such as user-customized information, thereby increasing the availability of video and making the video more widely applicable. The supplemental enhancement information may be packetized and transmitted together with the video frames, achieving the effect of transmitting and analyzing the supplemental enhancement information and the video frames synchronously. In this way, when the client decodes the media information stream, the media content information can be determined according to the supplemental enhancement information in the media information stream.

[0072] Step B2: Determine a second effect scheme based on the media content information.

[0073] In some embodiments, there is a pre-established association between the second effects scheme and the media content indicated by the media content information.

[0074] In some embodiments, the second effects scheme may be configured to present one or more pre-defined effects at one or more pre-defined times.

[0075] In one particular implementation, the duration of the second effects scheme corresponds to the duration of the corresponding media content.

[0076] In one specific implementation, when the media content is a song, the second effect scheme includes an animated image corresponding to a target lyric or a target melody in the song.

[0077] In some embodiments, corresponding effect scripts may be preset for different media contents (e.g., music), etc. The effect scripts may be used to set a certain effect to appear at a certain minute and second of the media content, and the effect may correspond to a certain media content element (e.g., a story, lyrics, melody, or emotional flow). For example, when the lyrics "Kongming Light" and "Peach Blossom" and the climax of the music melody appear at 0 minutes 10 seconds, 20 seconds, and 30 seconds of music A, respectively, animation image effects such as "Kongming Light", "Peach Blossom", Kongming Light flying, or peach blossom blooming may be set at 0 minutes 10 seconds, 20 seconds, and 30 seconds, respectively.

[0078] Step B3: Present a second effect in the virtual reality space based on the second effect scheme.

[0079] In some embodiments, different second effect schemes may be preset for different media contents, and corresponding effect files may be stored in the client's resource pool. After determining a specific effect scheme, the client may call the corresponding effect file for real-time rendering.

[0080] The following description will be given taking video live distribution as an example. For example, the second effect schemes a to c may be preset for the programs A to C in which the performer is about to appear. When the performer starts to appear on the current program C, the performer side may packetize the supplemental enhancement information corresponding to the program C (e.g., including the program name number of the corresponding program C) into a media information stream together with the current video frame in response to a preset user command, and send it to the viewer's client via the service side. The viewer's client may determine the media content information based on the supplemental enhancement information while decoding the current video frame. Furthermore, the viewer's client may start to present the second effect scheme c accordingly. In a specific implementation form, the current video frame is the start frame of the program.

[0081] In some embodiments, the supplemental enhancement information corresponds to a start frame of the appearing content or the appearing program. For example, the corresponding supplemental enhancement information a to c may be set for the start frames of appearing programs A to C.

[0082] In some embodiments, the first effect includes an effect of a media content presentation scene in a virtual reality space, and / or the second effect includes an animated image corresponding to a media content element in the presented media content.

[0083] In this embodiment, a first effect is set for a presented scene of media content, and a second effect is set for a media content element in the presented media content, thereby enriching the user's interaction experience in the virtual reality space.

[0084] In some embodiments, the media content presentation scene may include scenography such as a stage, set, lighting, or props. For example, the first effect may be a stage set effect or a stage lighting effect.

[0085] In some embodiments, the media content element may be a component that constitutes the media content, such as a story, lyrics, text, melody, or emotional flow of the media content. In one specific implementation, when an object such as a "Kongming Light", a "paper plane", or a "petal" appears in the media content element (e.g., lyrics, a story, or a line), the second effect may include an animated image corresponding to the object such as a "Kongming Light", a "paper plane", or a "petal".

[0086] In some embodiments, the method 100 further includes the following steps.

[0087] Step C1: In response to a preset operation on a target effect presented in the virtual reality space, a secondary level effect corresponding to the target effect is presented.

[0088] For example, a user may trigger a target effect presented in a virtual reality space by a preset operation, such as a body sensation control operation, a gesture control operation, an eye movement operation, a touch operation, a voice control command, or by a preset operation on an external control device, to present a secondary level effect corresponding to the target effect.

[0089] In some embodiments, the target effect includes a secondary effect.

[0090] An illustrative description will be given below. After the second effect corresponding to the media content element is presented in the virtual reality space, the user may operate his / her avatar to touch one or more pre-set second effects. For example, when the user operates the avatar to touch an animated image of "Kongmingdeng", an effect of "Kongmingdeng flying up" is presented. When the user operates the avatar to touch an animated image of "paper airplane", an effect of "paper airplane changing into letters" is presented. When the user operates the avatar to touch an animated image of "petal", an effect of "petals flying" is presented.

[0091] In some embodiments, the virtual reality space includes a virtual live streaming space or a virtual social space, in which a performer can live stream with a virtual character or real video, and a viewer can control an avatar to watch the performer's live stream from a viewing perspective, such as a first-person perspective.

[0092] In some embodiments, the virtual live streaming space includes a performance area and a viewing area, the performance area for presenting a performer's performance content (e.g., a virtual character or real footage of the performer) or other media content and corresponding stage set, and the viewing area for presenting an avatar controlled by a viewer user.

[0093] 3, a virtual reality space is presented in a first-person or other viewpoint screen 10 of an avatar controlled by a user, and the virtual reality space has a predefined video display area 20 and a stage 30, a set 40, and a viewing area 50 that match the video display area. The video display area 20 is for presenting live broadcast video streams of performers. A user, who is a viewer, can control an avatar 60 to enter the viewing area 50 and watch the video displayed in the video display area 20 from a first-person or other viewpoint.

[0094] In one or more embodiments of the present disclosure, when a first media content A is currently displayed in the video display area 20, the stage 30 and set 40 may display a first effect corresponding to the first media content A. When a first media content element a is presented in the first media content A, a second effect corresponding to the first media content element a may be presented in the virtual reality space, for example in the viewing area 50 or other area. The user may further trigger a second level effect corresponding to the second effect when the user controls the avatar to touch the second effect.

[0095] Similarly, when the content displayed in the video display area 20 is switched from a first media content A to a second media content B, a first effect B corresponding to the second media content B may be displayed on the stage 30 and the set 40. When a second media content element b is presented in the second media content B, a second effect corresponding to the second media content element b may be presented in the virtual reality space. The user may further trigger a second level effect corresponding to the second effect when the user controls the avatar to touch the second effect.

[0096] Accordingly, as shown in FIG. 4 , one embodiment of the present disclosure provides an effect presentation device 300, which includes: a space display unit 320 for displaying a virtual reality space; a media content presentation unit 340 for presenting media content in the virtual reality space; and an effect presenting unit for presenting an effect associated with the media content in the virtual reality space based on the media content.

[0097] According to one or more embodiments of the present disclosure, the effect presentation unit 360 is used for determining, based on the acquired media information stream, effect indication information for indicating a first effect to be presented together with the media content, and presenting the first effect in the virtual reality space based on the effect indication information.

[0098] According to one or more embodiments of the present disclosure, the effect presenting unit 360 is used to present effects associated with the media content in the virtual reality space based on the timeline in which the media content is presented.

[0099] According to one or more embodiments of the present disclosure, the effect presentation unit 360 is used to obtain effect information associated with a target media content corresponding to a user's preset operation on the presented media content, and present the effect in the virtual reality space based on the effect information, in response to the user's preset operation on the presented media content.

[0100] An effect presentation device according to one or more embodiments of the present disclosure, The virtual reality space further includes a second level effect unit for presenting a second level effect corresponding to a target effect presented in the virtual reality space in response to a preset operation on the target effect.

[0101] An effect presentation device according to one or more embodiments of the present disclosure, a content information determiner for determining media content information for indicating media content currently being or to be presented; a second effect determiner for determining a second effect scheme based on the media content information; The virtual reality space further includes a second effect presenting unit for presenting a second effect in accordance with the second effect scheme.

[0102] According to one or more embodiments of the present disclosure, determining the effect indication information based on the acquired media information stream as described above includes determining the effect indication information based on supplemental enhancement information in the currently acquired media information stream.

[0103] The device embodiment basically corresponds to the method embodiment, so the relevant parts can be referred to the description of the method embodiment. The above-described device embodiment is merely illustrative, and the modules described as separate modules can be separated or not. According to actual needs, some or all of the modules can be selected to achieve the purpose of the solution of this embodiment. Those skilled in the art can understand and implement it without any creative effort.

[0104] Accordingly, in accordance with one or more embodiments of the present disclosure, An electronic device including at least one memory and at least one processor, An electronic device is provided, wherein the memory is for storing program code, and the processor is for calling the program code stored in the memory to cause the electronic device to execute an effect presentation method according to one or more embodiments of the present disclosure.

[0105] Accordingly, one or more embodiments of the present disclosure provide a non-transitory computer storage medium having stored thereon program code that, when executed by a computing device, causes the computing device to perform an effect presentation method according to one or more embodiments of the present disclosure.

[0106] The following refers to FIG. 5, which shows a schematic configuration diagram of an electronic device (e.g., a terminal device or a server) 800 suitable for implementing an embodiment of the present disclosure. The terminal device of the embodiment of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablets), PMPs (portable multimedia players), and in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. The electronic device shown in FIG. 5 is merely an example, and does not impose any limitations on the functions and scope of use of the embodiment of the present disclosure.

[0107] 5, the electronic device 800 may include a processing unit (e.g., a central processing unit, a graphic processor, etc.) 801, which can perform various appropriate operations and processes according to a program stored in a read-only memory (ROM) 802 or a program loaded from a storage device 808 into a random access memory (RAM) 803. The RAM 803 further stores various programs and data necessary for the operation of the electronic device 800. The processing unit 801, the ROM 802, and the RAM 803 are interconnected via a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.

[0108] Typically, input devices 806 including, for example, a touch screen, touch panel, keyboard, mouse, camera head, microphone, accelerometer, gyro, etc., output devices 807 including, for example, a liquid crystal display (LCD), speaker, oscillator, etc., storage devices 808 including, for example, a magnetic tape, hard disk, etc., and communication devices 809 may be connected to the I / O interface 805. The communication devices 809 enable the electronic device 800 to communicate and exchange data with other devices wirelessly or via wires. Although the electronic device 800 having various devices is shown in FIG. 5, it should be understood that it is not intended to require the electronic device 800 to implement or include all of the devices shown. More or less devices may alternatively be implemented or included.

[0109] In particular, according to an embodiment of the present disclosure, the processes described with reference to the flowcharts can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, including program code for performing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network by the communication device 809, or installed from the storage device 808, or installed from the ROM 802. When the computer program is executed by the processing device 801, it performs the above-mentioned functions defined in the method of the embodiment of the present disclosure.

[0110] In addition, the computer-readable medium in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination thereof. The computer-readable storage medium may be, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. The computer-readable storage medium may include, but is not limited to, an electrical connection having one or more conductors, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present disclosure, the computer-readable storage medium may be any tangible medium that contains or stores a program, which may be used in or in combination with an instruction execution system, apparatus, or device. In the present disclosure, the computer-readable signal medium may include a data signal propagated in baseband or a data signal propagated as part of a carrier wave, in which the computer-readable program code is carried. The data signal thus propagated may take many forms, including, but not limited to, electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which may transmit, propagate, or transmit a program for use in or in connection with an instruction execution system, apparatus, or device. The program code contained in the computer-readable medium may be transmitted over any suitable medium, including, but not limited to, electrical wires, optical cables, RF (radio frequency), or the like, or any suitable combination thereof.

[0111] In some embodiments, clients and servers may communicate using any now known or later developed network protocol, such as HTTP (HyperText Transfer Protocol), and may interconnect with any form or medium of digital data communication (e.g., a communications network). Examples of communications networks include local area networks ("LANs"), wide area networks ("WANs"), the World Wide Web (e.g., the Internet), and end-to-end networks (e.g., ad hoc end-to-end networks), as well as any networks now known or later developed.

[0112] The computer-readable medium may be included in the electronic device, or may be a separate device not mounted on the electronic device.

[0113] The computer-readable medium includes one or more programs that, when executed by the electronic device, cause the electronic device to perform the method of the present disclosure.

[0114] Computer program code for carrying out the operations of the present disclosure can be programmed using one or more programming languages ​​or combinations thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and general procedural programming languages ​​such as "C" or similar. The program code can run entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer by any network, including a local area network (LAN) or wide area network (WAN), or can be connected to an external computer (e.g., via the Internet using an Internet Service Provider).

[0115] The flowcharts and block diagrams in the accompanying drawings illustrate system architectures, functions, and operations that can be realized by the systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowcharts or block diagrams may represent a module, program segment, or part of code, which includes one or more executable instructions for implementing a specified logical function. It should be noted that in some permutation implementations, the functions depicted in the blocks may be implemented in a different order than that depicted in the accompanying drawings. For example, two consecutively depicted blocks may be executed substantially simultaneously, or may be executed in the reverse order depending on the functionality involved. It should be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented by a dedicated system based on hardware that executes a given function or operation, or by a combination of dedicated hardware and computer instructions.

[0116] The units according to the embodiments of the present disclosure may be realized by software or hardware, and the names of the units may not necessarily limit the units themselves.

[0117] The functions described herein may be performed, at least in part, by one or more hardware logic components. For example, exemplary hardware logic components that may be used include, but are not limited to, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), etc.

[0118] In this disclosure, a machine-readable medium may be a tangible medium, and may contain or store a program used by or in combination with an instruction execution system, device, or apparatus. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or apparatus, or any suitable combination of the above. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memories (RAMs), read-only memories (ROMs), erasable programmable read-only memories (EPROMs or flash memories), optical fibers, compact disk read-only memories (CD-ROMs), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0119] According to one or more embodiments of the present disclosure, Displaying a virtual reality space; presenting media content in the virtual reality space; and presenting an effect associated with the media content in the virtual reality space based on the media content.

[0120] According to one or more embodiments of the present disclosure, the step of presenting an effect associated with the media content in the virtual reality space based on the media content as described above includes: Presenting effects associated with the media content in the virtual reality space based on a timeline in which the media content is presented.

[0121] According to one or more embodiments of the present disclosure, the aforementioned method of presenting an effect associated with the media content in the virtual reality space based on a timeline in which the media content is presented may include: determining effect indication information based on the obtained media information stream to indicate a first effect to be presented with the media content; and presenting the first effect in the virtual reality space based on the effect instruction information.

[0122] According to one or more embodiments of the present disclosure, the step of presenting an effect associated with the media content in the virtual reality space based on the media content as described above includes: In response to a user's preset operation on the presented media content, the method includes obtaining effect information associated with the target media content corresponding to the user operation, and presenting the effect in the virtual reality space based on the effect information.

[0123] The method for presenting an effect according to one or more embodiments of the present disclosure includes: The method further includes presenting a secondary level effect corresponding to a target effect presented in the virtual reality space in response to a preset operation on the target effect.

[0124] The method for presenting an effect according to one or more embodiments of the present disclosure includes: determining media content information indicating media content currently being or to be presented; determining a second effects scheme based on the media content information; and The method further includes presenting a second effect in the virtual reality space based on the second effect scheme.

[0125] According to one or more embodiments of the present disclosure, there is a pre-established association between the second effect scheme and the media content indicated by the media content information.

[0126] According to one or more embodiments of the present disclosure, the effect is: The effect includes at least one of animation effects, changes to display elements in the virtual reality space, and changes to a model of the virtual reality space.

[0127] According to one or more embodiments of the present disclosure, the first effect includes an effect of a media content presentation scene set in a virtual reality space, or the first effect includes an animation effect corresponding to a particular element associated with the media content.

[0128] According to one or more embodiments of the present disclosure, the media content presentation scene includes one or more of a stage, a set, lighting, and props.

[0129] According to one or more embodiments of the present disclosure, the second effect includes an animated image that corresponds to a media content element in the presented media content.

[0130] According to one or more embodiments of the present disclosure, when the media content is a song, the second effect scheme includes an animated image corresponding to a target lyric or a target melody in the song.

[0131] According to one or more embodiments of the present disclosure, the target effect includes a secondary effect.

[0132] According to one or more embodiments of the present disclosure, determining the effect indication information based on the acquired media information stream as described above includes determining the effect indication information based on supplemental enhancement information in the currently acquired media information stream.

[0133] One or more embodiments of the present disclosure include: a space display unit for displaying a virtual reality space; a media content presenting unit for presenting media content in the virtual reality space; and an effect presentation unit for presenting an effect associated with the media content in the virtual reality space based on the media content.

[0134] One or more embodiments of the present disclosure provide an electronic device including at least one memory and at least one processor, the memory for storing program code, and the processor for calling the program code stored in the memory to cause the electronic device to execute an effect presentation method according to one or more embodiments of the present disclosure.

[0135] One or more embodiments of the present disclosure provide a non-transitory computer storage medium having stored thereon program code that, when executed by a computing device, causes the computing device to perform an effect presentation method according to one or more embodiments of the present disclosure.

[0136] The above is merely a description of the preferred embodiment of the present disclosure and the technical principles applied thereto. It is obvious to those skilled in the art that the scope of the disclosure of the present disclosure is not limited to the technical solution based on the specific combination of the above technical features, but should also include other technical solutions formed by any combination of the above technical features or features equivalent thereto without departing from the concept of the above disclosure. For example, it also includes technical solutions formed by replacing the above features with technical features having similar functions disclosed in the present disclosure (not limited to those).

[0137] Also, although operations are described in a particular order, this should not be understood as requiring such operations to be performed in the particular order shown, or in sequential order. In certain environments, multitasking and parallel processing may be advantageous. Similarly, although certain specific implementation details are included in the above description, they should not be construed as limiting the scope of the disclosure. Certain features described in the context of a single embodiment can also be implemented in combination with a single embodiment. Conversely, various features described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.

[0138] Although the present subject matter has been described in language specific to structural features and / or logical operations of methods, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or operations described above. Rather, the specific features and operations described above are merely example forms of implementing the claims.

Claims

1. Displaying a virtual reality space; presenting media content in the virtual reality space; and presenting an effect associated with the media content in the virtual reality space based on the media content.

2. The above-mentioned presenting an effect associated with the media content in the virtual reality space based on the media content includes:

10. The method of claim 1, comprising presenting effects associated with the media content in the virtual reality space based on a timeline in which the media content is presented.

3. The above-mentioned presenting of effects associated with the media content in the virtual reality space based on a timeline in which the media content is presented includes: determining effect indication information based on the obtained media information stream to indicate a first effect to be presented with the media content; The method of claim 2 , further comprising: presenting the first effect in the virtual reality space based on the effect indication information.

4. The above-mentioned presenting an effect associated with the media content in the virtual reality space based on the media content includes:

2. The method of claim 1, further comprising: in response to a user's preset operation on a presented media content, obtaining effect information associated with a target media content corresponding to the user operation; and presenting the effect in the virtual reality space based on the effect information.

5. 3. The method of claim 1 or 2, further comprising presenting a secondary level effect corresponding to a target effect presented in the virtual reality space in response to a preset operation on the target effect.

6. determining media content information indicating media content currently being or to be presented; determining a second effects scheme based on the media content information; and The method of claim 1 or 3, further comprising: presenting a second effect in the virtual reality space based on the second effect scheme.

7. 7. The method of claim 6, wherein there is a pre-established association between the second effect scheme and the media content indicated by the media content information.

8. The effect is:

10. The method of claim 1, including at least one of the following: animation effects, modifications to display elements in the virtual reality space, and modifications to a model of the virtual reality space.

9. The first effect includes an effect of a media content presentation scene provided in a virtual reality space; or 4. The method of claim 3, wherein the first effect comprises an animation effect that corresponds to a particular element associated with the media content.

10. 10. The method of claim 9, wherein the media content presentation scene includes one or more of a stage, a set, lighting, and props.

11. 7. The method of claim 6, wherein the second effect includes an animated image that corresponds to a media content element in the presented media content.

12. The method of claim 11, wherein when the media content is a song, the second effect scheme includes an animated image corresponding to a target lyric or a target melody in the song.

13. The method of claim 5 , wherein the target effect includes a secondary effect.

14. Determining effect indication information based on the acquired media information stream as described above includes:

4. The method of claim 3, comprising determining the effect indication information based on supplemental enhancement information in a currently acquired media information stream.

15. a space display unit for displaying a virtual reality space; a media content presenting unit for presenting media content in the virtual reality space; and an effect presentation unit for presenting an effect associated with the media content in the virtual reality space based on the media content.

16. An electronic device including at least one memory and at least one processor, The memory is for storing program code, and the processor is for calling up the program code stored in the memory to cause the electronic device to execute the method according to any one of claims 1 to 14.

17. A non-transitory computer storage medium having stored thereon a program code which, when executed by a computing device, causes said computing device to carry out the method according to any one of claims 1 to 14.

Images