Virtual scene-based interaction method and device, terminal and storage medium

Abstract

The invention discloses an interaction method and device based on a virtual scene, a terminal and a storage medium, and belongs to the technical field of computers. The method comprises the steps of displaying a virtual scene image under the condition that a scene entering condition is met, and displaying a virtual light source and a lighting device on the virtual scene image; a light source area on the virtual scene image is displayed in an illuminated state, a non-light source area on the virtual scene image is displayed in a non-illuminated state, and the light source area refers to an area within a preset range of a virtual light source on the virtual scene image; and when the virtual light source is moved to the lighting device, cancelling the display of the virtual scene image, and displaying the virtual scene in an illuminated state. According to the method and the device, the two-dimensional virtual scene image is switched into the three-dimensional virtual scene, and the transition that part of the area of the virtual scene is illuminated to all the areas of the virtual scene is illuminated is presented, so that abrupt situation caused by direct display of the whole virtual scene is avoided, and immersive experience is brought to a user.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of computer technology, and in particular to an interactive method, device, terminal and storage medium based on a virtual scene. Background Art

[0002] A virtual scene is a digital scene built by computer equipment. It can be used to simulate the environment in the real world. Users can interact with the virtual scene, which provides users with simulations of senses such as vision and hearing, giving users an immersive experience.

[0003] In the related art, when a user wants to experience a virtual scene, the computer device directly displays the loaded virtual scene, and the entry process of the virtual scene is very abrupt, resulting in a poor user experience. Summary of the invention

[0004] The embodiments of the present application provide a virtual scene-based interactive method, device, terminal, and storage medium, which avoid the abruptness caused by directly displaying the virtual scene and are conducive to providing users with an immersive experience. The technical solution is as follows:

[0005] On the one hand, a virtual scene-based interaction method is provided, the method comprising:

[0006] When the scene entry condition is met, a virtual scene image is displayed, and a virtual light source and a lighting device are displayed on the virtual scene image, wherein the virtual scene image is obtained by framing the virtual scene;

[0007] Displaying a light source area on the virtual scene image as being illuminated, and displaying a non-light source area on the virtual scene image as being unilluminated, wherein the light source area refers to an area within a preset range of the virtual light source on the virtual scene image, and the non-light source area refers to an area on the virtual scene image other than the light source area;

[0008] When the virtual light source is moved to the lighting device, the display of the virtual scene image is canceled, and the virtual scene in an illuminated state is displayed.

[0009] On the other hand, a virtual scene-based interactive device is provided, the device comprising:

[0010] A first display module is used to display a virtual scene image when a scene entry condition is met, and to display a virtual light source and a lighting device on the virtual scene image, wherein the virtual scene image is obtained by framing the virtual scene;

[0011] A second display module is used to display the light source area on the virtual scene image as illuminated, and to display the non-light source area on the virtual scene image as unilluminated, wherein the light source area refers to an area within a preset range of the virtual light source on the virtual scene image, and the non-light source area refers to an area on the virtual scene image other than the light source area;

[0012] The second display module is further configured to cancel display of the virtual scene image and display the virtual scene in an illuminated state when the virtual light source is moved to the lighting device.

[0013] Optionally, the device further comprises a light source moving module, which is used to:

[0014] In response to a movement operation on the virtual light source, controlling the virtual light source to move on the virtual scene image;

[0015] During the movement of the virtual light source, the light source area and the non-light source area are controlled to change as the position of the virtual light source changes. The light source area is an area with the virtual light source as the center and a preset size.

[0016] Optionally, the light source moving module is used to implement any of the following:

[0017] In response to a first drag operation on the mouse, controlling the virtual light source to move in a direction of the first drag operation;

[0018] In response to a second drag operation on the virtual joystick, controlling the virtual light source to move in a direction of the second drag operation;

[0019] In response to a sliding operation, controlling the virtual light source to move in a direction of the sliding operation;

[0020] In response to a touch operation on a moving button, the virtual light source is controlled to move in a direction indicated by the moving button.

[0021] Optionally, the second display module is used to cancel display of the virtual scene image and display the virtual scene in an illuminated state in response to a touch operation on the lighting device when the virtual light source is moved to the lighting device.

[0022] Optionally, the second display module is used to:

[0023] When the virtual light source is moved to the lighting device, a target area centered on the lighting device on the virtual scene image is displayed as being illuminated;

[0024] In response to a touch operation on the lighting device, the target area is expanded based on the time after the touch operation is performed until the target area covers all areas on the virtual scene image, the virtual scene image is canceled, and the virtual scene in an illuminated state is displayed.

[0025] Optionally, the first display module is used to:

[0026] In response to the scene interaction request, playing a scene introduction video, wherein the scene introduction video is used to introduce the virtual scene;

[0027] In response to the completion of playing the scene introduction video, the virtual scene image is displayed.

[0028] Optionally, the first display module is used to:

[0029] In response to the completion of playing the scene introduction video, playing a black screen animation;

[0030] In response to the completion of playing the black screen animation, the virtual scene image is displayed.

[0031] Optionally, the device further comprises an interaction module, configured to:

[0032] In response to a first interactive operation performed based on the virtual scene, an interactive result corresponding to the first interactive operation is triggered.

[0033] Optionally, the interaction module is used to:

[0034] In response to an interactive operation on a virtual object in the virtual scene, multimedia data corresponding to the virtual object is played, where the multimedia data is used to introduce the virtual object.

[0035] Optionally, the interaction module is used to implement any of the following:

[0036] In response to a touch operation on the virtual object, playing the multimedia data;

[0037] In response to a touch operation on the interactive button of the virtual object, the multimedia data is played, and the interactive button of the virtual object is displayed at the location where the virtual object is located.

[0038] Optionally, the multimedia data is an object introduction video of the virtual object, and the interaction module is used to:

[0039] During the playing of the object introduction video, in response to the playing time reaching a preset time, the playing of the object introduction video is stopped, and interaction prompt information is displayed, where the interaction prompt information is used to prompt the execution of a second interaction operation;

[0040] In response to the second interactive operation, the object introduction video continues to be played starting from the time point when the playing of the object introduction video is stopped.

[0041] Optionally, the virtual scene includes multiple types of virtual objects, and the number of each type of virtual objects is multiple; the interaction module is used to:

[0042] In response to having performed an interactive operation on each virtual object belonging to a target type, multimedia data corresponding to the target type is played, the multimedia data being used to introduce the virtual objects belonging to the target type, the target type being any one of the multiple types.

[0043] Optionally, the interaction module is used to:

[0044] Display an image of each type of virtual object;

[0045] In response to an interactive operation on any virtual object belonging to the target type, marking an image of the virtual object;

[0046] When the image of each virtual object of the target type is marked, multimedia data corresponding to the target type is played.

[0047] Optionally, the first display module is further used for:

[0048] Displaying the lighting device in a preset area on the virtual scene image; or,

[0049] When the position of the lighting device belongs to the light source area, the lighting device is displayed, and when the position of the lighting device does not belong to the light source area, the lighting device is not displayed.

[0050] Optionally, the virtual scene image is displayed on a mask layer; and the second display module is used to:

[0051] The non-light source area on the virtual scene image is shielded in the mask layer.

[0052] Optionally, the mask layer is superimposed on a scene layer, and the scene layer displays the virtual scene; and the second display module is used to remove the mask layer when the virtual light source is moved to the lighting device.

[0053] On the other hand, a terminal is provided, comprising a processor and a memory, wherein the memory stores at least one computer program, and the at least one computer program is loaded and executed by the processor to implement the operations performed by the virtual scene-based interaction method as described in the above aspects.

[0054] On the other hand, a computer-readable storage medium is provided, in which at least one computer program is stored. The at least one computer program is loaded and executed by a processor to implement the operations performed by the virtual scene-based interaction method as described in the above aspects.

[0055] On the other hand, a computer program product is provided, including a computer program, wherein the computer program is loaded and executed by a processor to implement the operations performed by the virtual scene-based interaction method as described in the above aspects.

[0056] The solution provided by the embodiment of the present application is that when the scene entry conditions are met, a virtual scene image is first displayed, and a virtual light source and a lighting device are displayed on the virtual scene image. Only the light source area within the preset range where the virtual light source is located is illuminated on the virtual scene image, and the user can only view the illuminated light source area. The non-light source area on the virtual scene image is not illuminated, and the user cannot view the non-light source area that is not illuminated, thereby presenting the effect of being in darkness when just entering the virtual scene. When the virtual light source is moved to the lighting device, the display of the virtual scene image is canceled, and the virtual scene in an illuminated state is displayed, presenting the effect that the lighting device illuminates the entire virtual scene. Therefore, the present application provides a method of switching from a two-dimensional virtual scene image to a three-dimensional virtual scene, and by controlling the virtual light source, presenting an entry method in which a partial area of ​​the virtual scene is illuminated and a transition to all areas of the virtual scene are illuminated, avoiding the abruptness caused by directly displaying the entire virtual scene, which is conducive to giving users an immersive experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0057] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0058] Figure 1 It is a schematic diagram of an implementation environment provided by an embodiment of the present application;

[0059] Figure 2 is a flowchart of an interactive method based on a virtual scene provided in an embodiment of the present application;

[0060] Figure 3 is a flowchart of another virtual scene-based interaction method provided in an embodiment of the present application;

[0061] Figure 4 is a schematic diagram of a loading interface provided in an embodiment of the present application;

[0062] Figure 5 is a schematic diagram of a virtual scene interface provided in an embodiment of the present application;

[0063] Figure 6 is a schematic diagram of another virtual scene interface provided in an embodiment of the present application;

[0064] Figure 7 is a schematic diagram of another virtual scene interface provided in an embodiment of the present application;

[0065] Figure 8 is a schematic diagram of another virtual scene interface provided in an embodiment of the present application;

[0066] Fig. 9 is a schematic diagram of another virtual scene interface provided in an embodiment of the present application;

[0067] Fig.10 is a schematic diagram of another virtual scene interface provided in an embodiment of the present application;

[0068] Fig.11 is a schematic diagram of another virtual scene interface provided in an embodiment of the present application;

[0069] Fig.12 is a schematic diagram of another virtual scene interface provided in an embodiment of the present application;

[0070] Fig.13 is a schematic diagram of another virtual scene interface provided in an embodiment of the present application;

[0071] Fig.14 is a schematic diagram of a video playback interface provided in an embodiment of the present application;

[0072] Fig.15 is a schematic diagram of another video playback interface provided in an embodiment of the present application;

[0073] Fig.16 is a schematic diagram of another virtual scene interface provided in an embodiment of the present application;

[0074] Fig.17 is a schematic diagram of another virtual scene interface provided in an embodiment of the present application;

[0075] Fig.18 is a flowchart of another virtual scene-based interaction method provided in an embodiment of the present application;

[0076] Fig.19 It is a structural schematic diagram of an interactive device based on a virtual scene provided in an embodiment of the present application;

[0077] Fig. 20is a structural schematic diagram of another interactive device based on a virtual scene provided in an embodiment of the present application;

[0078] Fig.21 It is a structural diagram of a terminal provided in an embodiment of the present application. DETAILED DESCRIPTION

[0079] In order to make the objectives, technical solutions and advantages of the embodiments of the present application clearer, the implementation methods of the present application will be further described in detail below in conjunction with the accompanying drawings.

[0080] It is understood that the terms "first", "second", etc. used in this application may be used herein to describe various concepts, but unless otherwise specified, these concepts are not limited by these terms. These terms are only used to distinguish one concept from another. For example, a first video may be referred to as a second video, and similarly, a second video may be referred to as a first video without departing from the scope of this application.

[0081] Among them, at least one refers to one or more than one, for example, at least one video can be one video, two videos, three videos, or any other integer greater than or equal to one. Multiple refers to two or more than two, for example, multiple videos can be two videos, three videos, or any other integer greater than or equal to two. Each refers to each of at least one, for example, each video refers to each video in the multiple videos. If the multiple videos are 3 videos, each video refers to each video in the 3 videos.

[0082] It is understandable that in the implementation of the present application, related data such as user information is involved. When the above embodiments of the present application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions.

[0083] The virtual scene involved in the present application can be used to simulate a three-dimensional virtual space, which can be an open space. The virtual scene can be used to simulate a real environment in reality. For example, the virtual scene can include the sky, land, ocean, etc., and the land can include environmental elements such as deserts and cities. Of course, virtual objects can also be included in the virtual scene. The virtual scene can also be used to simulate the real environment under different weather conditions, such as sunny days, rainy days, foggy days, or nights. Various scene elements enhance the diversity and authenticity of the virtual scene.

[0084] When the terminal renders and displays the virtual scene, the virtual scene is displayed in full screen, or the global map is independently displayed in the first preset area of ​​the current display interface while the virtual scene is displayed on the current display interface, or the terminal displays the global map only when a click operation on a preset button is detected. Among them, the global map is used to display a thumbnail of the virtual scene, and the thumbnail is used to describe the geographical features such as the terrain, landform, and geographical location corresponding to the virtual scene. Of course, the terminal can also display a thumbnail of the virtual scene within the current field of view on the current display interface, and when a click operation on the global map is detected, a thumbnail of the entire virtual scene is displayed in the second preset area of ​​the current display interface of the terminal, so that the user can not only view the virtual scene around him, but also the entire virtual scene. When the terminal detects a zoom operation on the complete thumbnail, the complete thumbnail is zoomed and displayed. Optionally, the specific display position and shape of the first preset area and the second preset area are set according to the user's operating habits. For example, in order to avoid excessive occlusion of the virtual scene, the first preset area is a rectangular area at the upper right corner, lower right corner, upper left corner or lower left corner of the current display interface, and the second preset area is a square area on the right or left side of the current display interface, or the first preset area and the second preset area are circular areas or areas of other shapes. The embodiment of the present application does not limit the specific display position and shape of the preset area.

[0085] Figure 1 is a schematic diagram of an implementation environment provided by an embodiment of the present application, such as Figure 1 As shown, the implementation environment includes a terminal 101 and a server 102. The terminal 101 and the server 102 are directly or indirectly connected via wired or wireless communication, which is not limited in the present application.

[0086] Optionally, the terminal 101 is a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart speaker, a smart TV, a smart watch, a VR (Virtual Reality) device or an AR (Augmented Reality) device, etc., but is not limited thereto. Optionally, the server 102 is an independent physical server, or the server 102 is a server cluster or a distributed system composed of multiple physical servers, or the server 102 is a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms.

[0087] Among them, the server 102 provides the terminal 101 with scene data such as virtual scenes, virtual light sources, lighting devices, and virtual scene images. The terminal 101 can display a virtual scene interface through the scene data provided by the server 102, and can display virtual scene images, virtual light sources, lighting devices or virtual scenes in the virtual scene interface, and the terminal 101 can control the virtual scene based on the virtual scene interface. The server 102 is used to perform background processing according to the control of the virtual scene by the terminal 101, and provide background support for the terminal 101.

[0088] Figure 2 is a flowchart of an interactive method based on a virtual scene provided in an embodiment of the present application. The embodiment of the present application is executed by a terminal. Figure 2 , the method comprising:

[0089] 201. When a scene entry condition is met, the terminal displays a virtual scene image, and displays a virtual light source and a lighting device on the virtual scene image. The virtual scene image is obtained by framing the virtual scene.

[0090] The scene entry condition refers to the condition that needs to be met to enter the virtual scene. When the scene entry condition is met, the terminal displays the virtual scene image of the virtual scene and displays the virtual light source and lighting device on the virtual scene image. The virtual scene image of the virtual scene is obtained by framing the virtual scene.

[0091] Among them, the virtual light source refers to a virtual object that can emit visible light, for example, the virtual light source is a virtual flame, a virtual candle flame or a virtual torch, etc., and the lighting device refers to a device that can carry the virtual light source. For example, when the virtual light source is a virtual candle flame, the lighting device is a virtual candlestick, and when the virtual light source is a virtual flame, the lighting device is a virtual candle, etc. The embodiments of the present application do not limit this.

[0092] Optionally, the virtual scene image includes virtual objects. For example, in a treasure hunting scenario, the virtual scene is a cave with virtual treasures hidden, and the virtual scene image includes virtual objects such as virtual treasure chests, virtual gold coins or virtual jewelry. For example, in an adventure scenario, the virtual scene is an abandoned house, and the virtual scene image includes worn-out furniture, etc. For example, in a scene of visiting scenic spots and historical sites, the virtual scene is a cave, and the virtual scene image includes virtual murals, etc.

[0093] 202. The terminal displays the light source area on the virtual scene image as illuminated, and displays the non-light source area on the virtual scene image as unilluminated. The light source area refers to the area within a preset range of the virtual light source on the virtual scene image, and the non-light source area refers to the area on the virtual scene image other than the light source area.

[0094] In an embodiment of the present application, the virtual scene is in darkness, for example, the virtual scene is currently at night, or there is no sunlight in the virtual scene, etc. In order to simulate the effect of a virtual light source illuminating the virtual scene, the area on the virtual scene image is divided into a light source area and a non-light source area. The area within a preset range of the virtual light source on the virtual scene image is the light source area, and the other areas on the virtual scene image except the area within the preset range of the virtual light source are non-light source areas.

[0095] Since there is a virtual light source in the light source area to provide illumination, and there is no virtual light source in the non-light source area to provide illumination, the terminal displays the light source area on the virtual scene image as illuminated, and displays the non-light source area on the virtual scene image as unilluminated. The light source area is displayed as illuminated, which means that the light source area is illuminated by the virtual light source, so the light source area is visible to the user. The non-light source area is displayed as unilluminated, which means that the non-light source area is not illuminated by the virtual light source, and the non-light source area is in darkness, so the non-light source area is invisible to the user, thereby presenting the effect that the virtual light source illuminates part of the area in the virtual scene.

[0096] Optionally, the area within the preset range of the virtual light source refers to an area centered on the virtual light source, such as a circular area centered on the virtual light source and with a preset radius, and the area where the virtual light source is located is only a partial area on the virtual scene image.

[0097] 203. When the virtual light source is moved to the lighting device, the terminal cancels display of the virtual scene image and displays the virtual scene in an illuminated state.

[0098] The virtual light source on the virtual scene image can be moved. When the virtual light source is moved to the lighting device, the lighting device is activated by the virtual light source, and the lighting device can also emit visible light to achieve the lighting function. In addition, the lighting capacity of the lighting device is stronger than that of the virtual light source. The virtual light source can only illuminate the area within the preset range of the virtual light source, while the lighting device can illuminate all areas on the virtual scene image after being activated. Therefore, when the virtual light source is moved to the lighting device, the terminal cancels the display of the virtual scene image and displays the virtual scene in an illuminated state, thereby presenting the effect that the lighting device illuminates the entire virtual scene. At this time, all areas in the virtual scene are visible to the user.

[0099] For example, the virtual light source is a virtual flame, and the lighting device is a virtual candle. When the virtual light source is moved to the lighting device, the virtual flame ignites the virtual candle, and the ignited virtual candle illuminates the entire virtual scene.

[0100] The method provided in the embodiment of the present application, when the scene entry conditions are met, first displays a virtual scene image, and a virtual light source and a lighting device are displayed on the virtual scene image. Only the light source area within the preset range where the virtual light source is located is illuminated on the virtual scene image, and the user can only view the illuminated light source area, and the non-light source area on the virtual scene image is not illuminated, and the user cannot view the non-light source area that is not illuminated, thereby presenting the effect of being in darkness when just entering the virtual scene. When the virtual light source is moved to the lighting device, the display of the virtual scene image is canceled, and the virtual scene in an illuminated state is displayed, presenting the effect that the lighting device illuminates the entire virtual scene. Therefore, the present application provides a method of switching from a two-dimensional virtual scene image to a three-dimensional virtual scene, and by controlling the virtual light source, presenting an entry method in which a partial area of ​​the virtual scene is illuminated and a transition to all areas of the virtual scene are illuminated, thereby avoiding the abruptness caused by directly displaying the entire virtual scene, which is conducive to giving users an immersive experience.

[0101] Above Figure 2 The embodiment shown is only a brief description of the interactive method based on the virtual scene. For more detailed process, please refer to the following Figure 3 The embodiment shown. Figure 3 is a flowchart of an interactive method based on a virtual scene provided in an embodiment of the present application. The embodiment of the present application is executed by a terminal. Figure 3 , the method comprising:

[0102] 301. The terminal plays a scene introduction video in response to a scene interaction request, where the scene introduction video is used to introduce the virtual scene.

[0103] If the user wants to interact with the virtual scene, the terminal performs a scene interaction operation on the virtual scene, and the terminal responds to the scene interaction operation, triggers a scene interaction request, and plays a scene introduction video of the virtual scene in response to the scene interaction request. The scene introduction video is used to introduce the virtual scene. By playing the scene introduction video, the user can have a preliminary understanding of the virtual scene to be displayed, which is conducive to improving the user experience.

[0104] In a possible implementation, the terminal displays a scene interaction link, and in response to a trigger operation on the scene interaction link, the terminal displays a loading interface, which is used to display the resource loading progress. In the process of displaying the loading interface, the terminal loads the scene introduction video and the resources of the virtual scene, and after the loading is completed, a start button is displayed on the loading interface. In response to the trigger operation on the start button, the terminal plays the scene introduction video.

[0105] Figure 4 is a schematic diagram of a loading interface provided in an embodiment of the present application, such as Figure 4As shown, the loading interface displays a display image corresponding to the virtual scene and a start button 401. The display image is used to display the characteristics of the virtual scene. The display image includes an area or a virtual object in the virtual scene. For example, if the virtual scene is a cave, the display image may be a virtual stone statue in the virtual scene. The start button 401 is “click to enter the cave” to remind the user to click the start button 401 to enter the virtual scene.

[0106] 302. In response to completion of the scene introduction video playback, the terminal displays a virtual scene image, and displays a virtual light source and a lighting device on the virtual scene image.

[0107] After playing the scene introduction video of the virtual scene, the terminal displays the virtual scene image of the virtual scene, and displays the virtual light source and the lighting device on the virtual scene image. The virtual scene image of the virtual scene is obtained by framing the virtual scene.

[0108] It should be noted that the virtual scene image in the embodiment of the present application can only be illuminated by a virtual light source or lighting device, and when the virtual scene image is first displayed, the lighting device has not been activated, and only the virtual light source can be illuminated. Therefore, when the virtual scene image is first displayed, most areas in the virtual scene are in darkness, and only some areas are illuminated. For details, please refer to the detailed description of step 302 below.

[0109] In one possible implementation, the terminal plays a black screen animation in response to completion of the scene introduction video, displays a virtual scene image in response to completion of the black screen animation, and displays a virtual light source and lighting device on the virtual scene image.

[0110] After the terminal finishes playing the scene introduction video, it does not directly display the virtual scene image, but first plays a black screen animation, and then displays the virtual scene image after the black screen animation is played. This is because most of the area is in darkness when the virtual scene image is first displayed. Therefore, by playing the black screen animation first, it can be connected with the virtual scene image in darkness, thereby simulating the effect of entering the virtual scene in darkness and not being able to see anything clearly, making the entire entry process of the virtual scene smoother and conducive to improving user experience.

[0111] 303. The terminal displays the light source area on the virtual scene image as illuminated, and displays the non-light source area on the virtual scene image as unilluminated. The light source area refers to the area on the virtual scene image where the virtual light source is located, and the non-light source area refers to the area on the virtual scene image other than the light source area.

[0112] Since there is a virtual light source in the light source area to provide illumination, and there is no virtual light source in the non-light source area to provide illumination, the terminal displays the light source area on the virtual scene image as illuminated, and displays the non-light source area on the virtual scene image as unilluminated. The user can see the appearance of the light source area in the illuminated state, while the non-light source area is unilluminated and completely dark, so the user cannot see the appearance of the non-light source area.

[0113] In one possible implementation, the edge of the light source area presents an edge blur effect, and the light intensity in the light source area is negatively correlated with the distance from the virtual light source. The closer the distance to the virtual light source, the brighter the light and the clearer the displayed image. The farther the distance to the virtual light source, the darker the light and the blurrier the displayed image. The edge of the illuminated area presents a transition effect from bright to dark and from blurry to clear, thereby simulating the light intensity from strong to weak as the distance from the virtual light source increases, making the effect of using the virtual light source to illuminate the light source area more realistic, and improving the realism of the virtual scene seen by the user.

[0114] In a possible implementation, the terminal displays the virtual scene image in a display interface, wherein the display interface includes a video layer, a scene layer, and a mask layer, the video layer is used to display the played video, the scene layer is used to display the virtual scene, and the mask layer is used to display the virtual scene image and shield the virtual scene image. The scene layer is located on the upper layer of the video layer, and the mask layer is located on the upper layer of the scene layer, that is, the mask layer is superimposed on the scene layer. When it is necessary to play the video, the terminal hides the scene layer and the mask layer and plays the video in the video layer.

[0115] The terminal displays the virtual scene on the scene layer and displays the virtual scene image on the mask layer. The mask layer blocks the scene layer, and the user cannot see the virtual scene in the scene layer. The terminal blocks the non-light source area on the virtual scene image on the mask layer, for example, using a black image to block the non-light source area. Since the light source area is not blocked and the non-light source area is blocked, the light source area is visible and the user can see the appearance of the light source area, while the non-light source area is invisible and the user cannot see the appearance of the non-light source area, thereby presenting an effect in which the light source area on the virtual scene image is illuminated and bright, and the non-light source area on the virtual scene image is not illuminated and dark.

[0116] Among them, after obtaining the virtual scene image, the terminal uses the virtual scene image as the background image of the mask layer, determines the light source area and non-light source area in the mask layer according to the position of the virtual light source, and sets the mask effect and edge blur effect in the non-light source area, so as to achieve the effect that the virtual light source illuminates the light source area but does not illuminate the non-light source area.

[0117] 304. The terminal controls the virtual light source to move on the virtual scene image in response to the movement operation on the virtual light source.

[0118] The virtual light source on the virtual scene image is movable. If the user wants to control the virtual light source to move, the user performs a moving operation on the virtual light source. In response to the moving operation on the virtual light source, the terminal controls the virtual light source to move on the virtual scene image according to the instruction of the moving operation.

[0119] In a possible implementation, the terminal controls the virtual light source to move on the virtual scene image in response to the movement operation of the virtual light source, including any of the following:

[0120] (1) In response to a first drag operation on the mouse, the terminal controls the virtual light source to move in the direction of the first drag operation.

[0121] The terminal is connected to the mouse, and the user can move the virtual light source by dragging the mouse. For example, if the user wants to move the virtual light source to the right, the user drags the mouse to the right. In response to the dragging operation of the mouse to the right, the terminal controls the virtual light source to move to the right.

[0122] Optionally, when displaying the virtual scene image, the terminal hides the mouse cursor and displays the virtual light source at the position of the mouse cursor. Therefore, during the movement of the mouse, the position of the mouse cursor changes, so the virtual light source moves with the movement of the mouse.

[0123] (2) In response to a second drag operation on the virtual joystick, the terminal controls the virtual light source to move in the direction of the second drag operation.

[0124] The terminal displays a virtual joystick, which is used to control the moving direction of the virtual light source. The user can move the virtual light source by dragging the virtual joystick. For example, if the user wants to move the virtual light source to the right, the virtual joystick is dragged to the right. The terminal responds to the dragging operation of the virtual joystick to the right and controls the virtual light source to move to the right.

[0125] (3) In response to the sliding operation, the terminal controls the virtual light source to move in the direction of the sliding operation.

[0126] The user can move the virtual light source by performing a sliding operation on the terminal screen. For example, if the user wants to move the virtual light source to the right, the user performs a sliding operation to the right. In response to the sliding operation to the right, the terminal controls the virtual light source to move to the right.

[0127] (4) In response to the touch operation on the moving button, the terminal controls the virtual light source to move in the direction indicated by the moving button.

[0128] The terminal displays a moving button, and the user can control the movement of the virtual light source by performing a touch operation on the moving button. For example, the terminal displays moving buttons for four directions, namely, up, down, left, and right. If the user wants to move the virtual light source to the right, the user performs a touch operation on the right moving button. The terminal responds to the touch operation on the right moving button and controls the virtual light source to move to the right.

[0129] 305. During the movement of the virtual light source, the terminal controls the light source area and the non-light source area to change as the position of the virtual light source changes. The light source area is an area with the virtual light source as the center and a preset size.

[0130] The light source area and non-light source area on the virtual scene image constitute all areas on the virtual scene image. The light source area on the virtual scene image is an area within a preset range of the virtual light source. In the embodiment of the present application, the light source area is an area centered on the virtual light source and of a preset size. For example, the light source area is a circular area centered on the virtual light source and with a radius of a preset length. Since the virtual light source can be moved on the virtual scene image, the light source area and the non-light source area will also change during the movement of the virtual light source, so the illuminated area and the non-illuminated area on the virtual scene image will also change accordingly. For example, if the virtual light source is on the left, the light source area is located on the left accordingly, and the area on the left is displayed as illuminated. Then, when the virtual light source moves to the right, the light source area also becomes the right accordingly, and the area on the right is displayed as illuminated.

[0131] In the embodiment of the present application, since the area where the virtual light source is located is the light source area that can be illuminated, and the remaining area is the non-light source area that is not illuminated, and the virtual light source is movable, the light source area and the non-light source area can change dynamically with the movement of the virtual light source. For example, if a certain position on the virtual scene image is located in the light source area at a certain moment, then the position is illuminated at that moment, the position is in bright light, and the user can see what the position looks like. At another moment, the virtual light source moves to another place, the light source area changes, and the position is no longer located in the light source area. Then, at another moment, the position is not illuminated, the position becomes in darkness, and the user cannot see what the position looks like.

[0132] Therefore, the user can move the virtual light source on the virtual scene image, and the light source area will also change with the movement of the virtual light source, thereby achieving the effect of illuminating the area where the virtual light source is located by following the movement of the virtual light source, making the virtual light source interactive, increasing the fun of interaction based on the virtual light source, and helping to improve the user experience.

[0133] In one possible implementation, the user can move the virtual light source by dragging the mouse, and the virtual light source is displayed at the location of the mouse cursor. Then, in the process of moving the mouse, the virtual light source moves with the movement of the mouse, and the illuminated area also moves with the movement of the mouse, thereby achieving the effect of adjusting the illuminated area by moving the mouse in the virtual scene.

[0134] 306. When the virtual light source is moved to the lighting device, the terminal cancels display of the virtual scene image and displays the virtual scene in an illuminated state in response to a touch operation on the lighting device.

[0135] The lighting device cannot illuminate when it is not activated, and the lighting device can be activated by a virtual light source. When the virtual light source is moved to the lighting device, the lighting device can be activated using the virtual light source. If the user wants to activate the lighting device at this time, a touch operation is performed on the lighting device, and the terminal controls the lighting device to be activated in response to the touch operation. The terminal cancels display of the virtual scene image and displays a virtual scene in an illuminated state, and all areas in the virtual scene are displayed as illuminated.

[0136] For example, the virtual light source is a virtual flame, the lighting device is a virtual candle, the touch operation on the lighting device is a click operation, and after the virtual flame is moved to the virtual candle, the click operation on the virtual candle is performed to simulate the effect of lighting the virtual candle with the virtual flame, so that the lit virtual candle illuminates the entire virtual scene.

[0137] In one possible implementation, when the virtual light source is moved to the lighting device, the terminal cancels display of the virtual scene image, the virtual light source and the lighting device in response to a touch operation on the lighting device, and displays the virtual scene in an illuminated state.

[0138] In one possible implementation, when the virtual light source is moved to the lighting device, the terminal displays the target area on the virtual scene image centered on the lighting device as being illuminated, and in response to a touch operation on the lighting device, expands the target area based on the length of time after the touch operation is performed until the target area covers all areas on the virtual scene image, cancels display of the virtual scene image, and displays the virtual scene in an illuminated state, thereby avoiding obstruction of the virtual scene by the virtual light source and the lighting device, and facilitating user observation of the virtual scene.

[0139] In an embodiment of the present application, after the virtual light source is moved to the lighting device, the target area centered on the lighting device is first illuminated. After a touch operation is performed on the lighting device, the lighting device is activated, and the target area is gradually expanded according to the length of time the lighting device is activated, that is, the illuminated area is gradually expanded, thereby presenting an effect of diffusely illuminating all areas in the virtual scene.

[0140] Optionally, the terminal displays a virtual scene image in a display interface, and the target area is a circle with a lighting device as the center and a target length as the radius, and the lighting device is located at the center point of the display interface. In response to a touch operation on the lighting device, the terminal expands the target length based on the duration after the touch operation is performed, and the target length is positively correlated with the duration. When the target length reaches a length threshold, the expansion of the target length is stopped. The length threshold is equal to half of the hypotenuse of the display interface. When the radius of the circular area is equal to the length threshold, that is, equal to half of the hypotenuse of the display interface, the circular area can cover the entire display interface, that is, the circular area can cover all areas in the virtual scene, thereby illuminating all areas in the virtual scene.

[0141] In a possible implementation, the terminal displays the virtual scene in the scene layer, displays the virtual scene image of the virtual scene in the mask layer, and shields the non-light source area in the virtual scene image in the mask layer. Then, when the virtual light source moves to the lighting device, the terminal removes the mask layer and displays the virtual scene in the scene layer, so that the entire virtual scene is visible to the user, thereby achieving the effect of the entire virtual scene being illuminated.

[0142] Optionally, when the virtual light source is moved to the lighting device, the terminal blocks the area outside the target area in the virtual scene image in the mask layer, and in response to a touch operation on the lighting device, expands the target area based on the length of time after the touch operation is performed until the target area covers all areas in the virtual scene, and the terminal removes the mask layer.

[0143] In the embodiment of the present application, since the virtual scene image displayed by the mask layer is obtained by framing the virtual scene in the scene layer, when the target area covers all areas in the virtual scene, the mask layer can present the complete virtual scene image, that is, the content displayed by the mask layer is consistent with the content displayed by the scene layer. At this time, the mask layer is removed, and the user cannot perceive the switching from the mask layer to the scene layer, which improves the smoothness of switching from the virtual scene image to the virtual scene, which is conducive to improving user experience and retention rate.

[0144] In a possible implementation, the terminal displays the lighting device in a preset area on the virtual scene image. The lighting device is always displayed in the preset area on the virtual scene image, and the user can always see the location of the lighting device. Therefore, the virtual light source can be directly moved to the lighting device, which is conducive to improving the efficiency of entering the virtual scene.

[0145] In another possible implementation, the terminal displays the lighting device when the lighting device is located in the light source area, and does not display the lighting device when the lighting device is located in the light source area. The lighting device is a part located in the virtual scene image. If the lighting device is located in the light source area, the lighting device will also be illuminated, so the terminal will display the lighting device, and the user can see the lighting device. At this time, the virtual light source can be moved to the lighting device. If the lighting device is located in the light source area, the lighting device will not be illuminated. The lighting device is in the dark and the user cannot see the lighting device. Therefore, the user needs to move the virtual light source to find the lighting device. When the lighting device is located in the light source area by moving the virtual light source, the user sees the lighting device and continues to move the virtual light source to the lighting device. The lighting device can illuminate the entire virtual scene image. Therefore, the user needs to actively find the lighting device by moving the virtual light source, which promotes the user's active participation in interaction, brings the user a more immersive experience, and further improves the user experience.

[0146] The following Figure 5-Figure 9 FIG. 1 is a schematic diagram of the virtual scene interface displayed during the virtual scene entry process. Figure 5 As shown, the terminal displays a virtual scene interface, and the virtual scene includes a virtual scene image, a virtual light source, and a lighting device. The virtual light source is a virtual candle, and the circular area around the virtual light source is illuminated, while other areas on the virtual scene image are not illuminated and are in darkness. In addition, a lighting device is displayed in the center area of ​​the virtual scene interface, and the lighting device is a virtual candlestick, and a prompt text "Light up" is displayed under the lighting device. Figure 6 As shown, the user can move the virtual light source. When the position of the virtual light source changes, the illuminated area and the unilluminated area also change accordingly. The lighting device cannot be moved and is always displayed in the center area of ​​the virtual scene interface. Figure 7 As shown in FIG. 1 , after the virtual light source moves to the lighting device, the circular area around the lighting device is illuminated. Figure 8 As shown in FIG. 1 , as the lighting device is illuminated by the virtual light source for a longer period of time, the illuminated circular area around the lighting device becomes larger and larger. Fig. 9As shown, all areas on the final virtual scene image are illuminated, and at this time, the virtual scene image, virtual light source and lighting device are cancelled in the virtual scene interface, and the entire illuminated virtual scene is displayed. In addition, an interactive prompt message "Roll the mouse to zoom in / out to view the mural" is displayed in the virtual scene interface.

[0147] In the embodiment of the present application, a virtual scene image is first displayed, in which only a virtual light source illuminates a part of the area, and the illuminated area and the unilluminated area on the virtual scene image will change with the movement of the virtual light source. When the virtual light source is moved to the lighting device, the lighting device is activated by the virtual light source. At this time, all areas on the virtual scene image are illuminated by the lighting device, then the virtual scene image is canceled, and the virtual scene is displayed, transitioning from a two-dimensional image to a three-dimensional scene. By controlling the virtual light source, a transition effect from dark to bright is presented during the entire entry process of the virtual scene, making the entry process smoother and helping to improve the user experience. In addition, the user is required to interact with the virtual light source during this process, so that the user can have a more immersive experience.

[0148] In another embodiment, the terminal displays an activation button. In response to a touch operation on the activation button, the terminal controls the virtual light source to move to the lighting device, cancels display of the virtual scene image, and displays the virtual scene in an illuminated state.

[0149] 307. The terminal triggers an interaction result corresponding to the first interaction operation in response to the first interaction operation performed based on the virtual scene.

[0150] After the terminal displays the illuminated virtual scene, the user can perform a first interactive operation based on the virtual scene and interact in the virtual scene, and the terminal triggers an interactive result corresponding to the first interactive operation. The first interactive operation and the interactive result are described in detail in the following embodiment.

[0151] The method provided in the embodiment of the present application, when the scene entry conditions are met, first displays a virtual scene image, and a virtual light source and a lighting device are displayed on the virtual scene image. Only the light source area within the preset range where the virtual light source is located is illuminated on the virtual scene image, and the user can only view the illuminated light source area, and the non-light source area on the virtual scene image is not illuminated, and the user cannot view the non-light source area that is not illuminated, thereby presenting the effect of being in darkness when just entering the virtual scene. When the virtual light source is moved to the lighting device, the display of the virtual scene image is canceled, and the virtual scene in an illuminated state is displayed, presenting the effect that the lighting device illuminates the entire virtual scene. Therefore, the present application provides a method of switching from a two-dimensional virtual scene image to a three-dimensional virtual scene, and by controlling the virtual light source, presenting an entry method in which a partial area of ​​the virtual scene is illuminated and a transition to all areas of the virtual scene are illuminated, thereby avoiding the abruptness caused by directly displaying the entire virtual scene, which is conducive to giving users an immersive experience.

[0152] In some embodiments, the terminal triggers an interaction result corresponding to the first interaction operation in response to a first interaction operation performed based on a virtual scene, including: in response to an interaction operation on a virtual object in a virtual scene, multimedia data corresponding to the virtual object is played, and the multimedia data is used to introduce the virtual object. In an embodiment of the present application, the first interaction operation refers to an interaction operation on a virtual object in a virtual scene, and multimedia data for introducing the virtual object can be played by interacting with the virtual object in the virtual scene. Among them, the multimedia data can be video data, audio data, image data, or text data, etc., which is not limited in the embodiment of the present application.

[0153] In a possible implementation, the terminal plays multimedia data corresponding to the virtual object in response to an interactive operation on the virtual object, including the following three situations.

[0154] The first case: the terminal plays multimedia data in response to a touch operation on a virtual object. Alternatively, the terminal plays multimedia data in response to a touch operation on an interactive button of a virtual object, and the interactive button of the virtual object is displayed at the location of the virtual object.

[0155] In the embodiment of the present application, the interactive operation on the virtual object may be a touch operation on the virtual object or a touch operation on an interactive button displayed on the virtual object, and the touch operation may be a click operation, etc.

[0156] Fig.10 is a schematic diagram of another virtual scene interface provided in an embodiment of the present application, such as Fig.10As shown, the terminal displays a virtual scene interface, which is used to display a virtual scene. The virtual scene is a virtual cave, which includes virtual stone statues and virtual murals, etc. Interactive buttons are displayed on the virtual murals, and the interactive buttons are touchable light spots. If the user is interested in a virtual mural, the user can perform a touch operation on the light spot on the virtual mural. Fig.11 As shown, in response to the touch operation, the terminal displays the explanation text of the virtual mural on the virtual scene interface and also plays the explanation voice of the virtual mural so that the user can understand the virtual mural.

[0157] Second situation: the multimedia data is an object introduction video of a virtual object. During the process of playing the object introduction video, in response to the playback time reaching a preset time, the terminal stops playing the object introduction video and displays interaction prompt information, where the interaction prompt information is used to prompt the execution of a second interaction operation. In response to the second interaction operation, the terminal continues playing the object introduction video from the time point when the playback of the object introduction video was stopped.

[0158] In the embodiment of the present application, during the process of playing the object introduction video of the virtual object, the playback is paused to remind the user to perform a second interactive operation. After the user performs the second interactive operation, the object introduction video continues to be played, which is conducive to attracting the user's attention and enhancing the user's sense of participation. For example, the second interactive operation can be rolling the mouse, etc.

[0159] Fig.12 is a schematic diagram of another virtual scene interface provided in an embodiment of the present application, such as Fig.12 As shown, the terminal displays a virtual scene interface, which is used to display a virtual scene, which is a virtual cave, including virtual stone statues and virtual murals. The virtual scene interface displays an interactive prompt message "Roll the mouse to zoom in / out to view the mural", and an interactive button is displayed on the virtual mural of the virtual scene interface, which is a touchable light spot. Fig.13 As shown in FIG. 1 , when the mouse cursor moves to the light spot on the virtual mural, the introduction of the virtual mural corresponding to “Chapter 1 * Faith and Goodness” is displayed below the light spot. Fig.14 As shown, after the user performs a touch operation on the light spot on the virtual mural, the terminal plays a mural introduction video of the virtual mural. Fig.15 As shown, during the process of playing the mural introduction video, the terminal pauses the mural introduction video and displays an interactive prompt message "Turn the mouse wheel to spread good thoughts". When the user turns the mouse wheel according to the interactive prompt message, the terminal continues to play the mural introduction video.

[0160] The third case: the virtual scene includes multiple types of virtual objects, and the number of each type of virtual objects is multiple. In response to having performed an interactive operation on each virtual object belonging to a target type, the terminal plays multimedia data corresponding to the target type, where the multimedia data is used to introduce the virtual objects belonging to the target type, and the target type is any one of the multiple types.

[0161] In the case where there are multiple virtual objects belonging to the target type, multimedia data corresponding to the target type is played after the user performs an interactive operation on each of the multiple virtual objects to introduce the virtual objects belonging to the target type.

[0162] Optionally, the terminal displays an image of each type of virtual object, marks the image of the virtual object in response to an interactive operation on any virtual object of the target type, and plays multimedia data corresponding to the target type when the image of each virtual object of the target type is marked. Optionally, the terminal displays the type of the virtual object at the location of the virtual object to remind the user which type the virtual object belongs to.

[0163] In the embodiment of the present application, by displaying the image of each type of virtual object, the user can be reminded of which virtual objects of the target type are available, so that the user can find the virtual objects of the target type for interaction. Moreover, whenever an interaction operation is performed on a virtual object, the image of the virtual object is marked, so that the user can be reminded of which virtual objects have been interacted with and which virtual objects are left to be interacted with.

[0164] Fig.16 is a schematic diagram of another virtual scene interface provided in an embodiment of the present application, such as Fig.16 As shown, the terminal displays a virtual scene interface, which is used to display a virtual scene. The virtual scene is a virtual cave, which includes virtual stone statues and virtual murals. The virtual cave includes virtual murals belonging to type A, virtual murals belonging to type B, and virtual murals belonging to type C. The lower area of ​​the virtual scene interface displays the image of each type of virtual mural. When the interaction with the virtual mural is not completed, the image of the virtual mural is displayed as a line pattern. When the interaction with the virtual mural is completed, the image of the virtual mural is displayed as a fill pattern for marking. In addition, the type of the virtual mural is also displayed on the virtual mural in the virtual scene interface. As shown Fig.17 As shown, after the user performs an interactive operation on two virtual murals belonging to type B, the terminal displays the explanation text of the virtual murals belonging to type B.

[0165] Fig.18is a flowchart of another interactive method based on a virtual scene provided in an embodiment of the present application, such as Fig.18 As shown, the method includes the following steps.

[0166] 1. The user clicks on the scene interaction link.

[0167] 2. The terminal displays the loading interface, loading the scene introduction video and virtual scene loading resources.

[0168] 3. After the terminal finishes loading the virtual scene at the scene layer, it frames the virtual scene to obtain a virtual scene image.

[0169] 4. The terminal plays the scene introduction video after loading is complete, plays a black screen animation after the playback, and displays the mask layer after the playback.

[0170] 5. The mask layer renders the effect of virtual candlelight, hides the mouse cursor, and uses virtual candlelight instead of mouse positioning.

[0171] 6. The virtual scene image of the scene layer is sent to the mask layer. The mask layer masks the non-light source area and displays the light source area of ​​the virtual scene image, thereby achieving the effect of virtual candlelight illuminating the surrounding area.

[0172] 7. Move the virtual candle and light source area as the mouse moves, so as to achieve the effect of lighting up the light source area following the movement of the mouse.

[0173] 8. After the virtual candle flame moves to the virtual candlestick, the radius of the illuminated target area is set to half of the hypotenuse of the virtual scene interface, so as to achieve the effect that the virtual candlestick illuminates the entire virtual scene.

[0174] 9. Remove the mask layer and display the virtual scene on the scene layer.

[0175] 10. When users perform interactive operations at the scene layer, they can trigger the playback of multimedia data of the virtual scene and introduce the virtual scene.

[0176] 11. After the interaction is completed, return to the scene layer to display the virtual scene.

[0177] Fig.19 is a structural diagram of an interactive device based on a virtual scene provided in an embodiment of the present application. Fig.19 , the device comprises:

[0178] The first display module 1901 is used to display a virtual scene image when a scene entry condition is met, and to display a virtual light source and a lighting device on the virtual scene image, wherein the virtual scene image is obtained by framing the virtual scene;

[0179] The second display module 1902 is used to display the light source area on the virtual scene image as illuminated, and display the non-light source area on the virtual scene image as unilluminated, where the light source area refers to an area within a preset range of the virtual light source on the virtual scene image, and the non-light source area refers to an area on the virtual scene image other than the light source area;

[0180] The second display module 1902 is further used to cancel the display of the virtual scene image and display the virtual scene in an illuminated state when the virtual light source is moved to the lighting device.

[0181] The interactive device based on virtual scene provided by the embodiment of the present application, when the scene entry condition is met, first displays the virtual scene image, and the virtual scene image displays a virtual light source and a lighting device. Only the light source area within the preset range where the virtual light source is located on the virtual scene image is illuminated, and the user can only view the illuminated light source area, and the non-light source area on the virtual scene image is not illuminated, and the user cannot view the non-light source area that is not illuminated, thereby presenting the effect of being in darkness when just entering the virtual scene. When the virtual light source is moved to the lighting device, the display of the virtual scene image is canceled, and the virtual scene in an illuminated state is displayed, presenting the effect that the lighting device illuminates the entire virtual scene. Therefore, the present application provides a method of switching from a two-dimensional virtual scene image to a three-dimensional virtual scene, and by controlling the virtual light source, presenting an entry method in which a partial area of ​​the virtual scene is illuminated and a transition to all areas of the virtual scene are illuminated, avoiding the abruptness caused by directly displaying the entire virtual scene, which is conducive to giving users an immersive experience.

[0182] Alternatively, see Fig. 20 The device further includes a light source moving module 1903, which is used to:

[0183] In response to the movement operation of the virtual light source, controlling the virtual light source to move on the virtual scene image;

[0184] During the movement of the virtual light source, the light source area and the non-light source area are controlled to change with the position of the virtual light source. The light source area is an area with the virtual light source as the center and a preset size.

[0185] Alternatively, see Fig. 20 , the light source moving module 1903 is used to implement any of the following:

[0186] In response to a first drag operation on the mouse, controlling the virtual light source to move in a direction of the first drag operation;

[0187] In response to a second drag operation on the virtual joystick, controlling the virtual light source to move in a direction of the second drag operation;

[0188] In response to the sliding operation, controlling the virtual light source to move in the direction of the sliding operation;

[0189] In response to a touch operation on the moving button, the virtual light source is controlled to move in a direction indicated by the moving button.

[0190] Alternatively, see Fig. 20 The second display module 1902 is used to cancel the display of the virtual scene image and display the virtual scene in an illuminated state in response to a touch operation on the lighting device when the virtual light source is moved to the lighting device.

[0191] Alternatively, see Fig. 20 , the second display module 1902 is used for:

[0192] When the virtual light source is moved to the lighting device, a target area centered on the lighting device on the virtual scene image is displayed as being illuminated;

[0193] In response to a touch operation on the lighting device, based on the time after the touch operation is performed, the target area is expanded until the target area covers all areas on the virtual scene image, the virtual scene image is canceled, and the virtual scene in an illuminated state is displayed.

[0194] Alternatively, see Fig. 20 , the first display module 1901 is used for:

[0195] In response to the scene interaction request, playing a scene introduction video, where the scene introduction video is used to introduce the virtual scene;

[0196] In response to the completion of the scene introduction video playing, a virtual scene image is displayed.

[0197] Alternatively, see Fig. 20 , the first display module 1901 is used for:

[0198] In response to the scene introduction video being played, a black screen animation is played;

[0199] In response to the completion of the black screen animation playing, a virtual scene image is displayed.

[0200] Alternatively, see Fig. 20 The device further includes an interaction module 1904, configured to:

[0201] In response to a first interactive operation performed based on the virtual scene, an interactive result corresponding to the first interactive operation is triggered.

[0202] Alternatively, see Fig. 20 , the interaction module 1904 is used to:

[0203] In response to an interactive operation on a virtual object in a virtual scene, multimedia data corresponding to the virtual object is played, where the multimedia data is used to introduce the virtual object.

[0204] Alternatively, see Fig. 20 , the interaction module 1904 is used to implement any of the following:

[0205] In response to a touch operation on the virtual object, playing multimedia data;

[0206] In response to a touch operation on an interactive button of a virtual object, multimedia data is played, and the interactive button of the virtual object is displayed at a location where the virtual object is located.

[0207] Alternatively, see Fig. 20 The multimedia data is an object introduction video of a virtual object. The interactive module 1904 is used to:

[0208] During the playing of the object introduction video, in response to the playing time reaching a preset time, the playing of the object introduction video is stopped, and interaction prompt information is displayed, where the interaction prompt information is used to prompt the execution of the second interaction operation;

[0209] In response to the second interactive operation, the object introduction video continues to be played starting from the time point when the playing of the object introduction video was stopped.

[0210] Alternatively, see Fig. 20 The virtual scene includes multiple types of virtual objects, and the number of each type of virtual objects is multiple; the interaction module 1904 is used to:

[0211] In response to an interactive operation having been performed on each virtual object belonging to a target type, multimedia data corresponding to the target type is played, the multimedia data being used to introduce the virtual object belonging to the target type, the target type being any one of a plurality of types.

[0212] Alternatively, see Fig. 20 , the interaction module 1904 is used to:

[0213] Display an image of each type of virtual object;

[0214] In response to an interactive operation on any virtual object belonging to a target type, marking an image of the virtual object;

[0215] When the image of each virtual object of the target type is marked, multimedia data corresponding to the target type is played.

[0216] Alternatively, see Fig. 20 The first display module 1901 is further used for:

[0217] Displaying the lighting device in a preset area on the virtual scene image; or,

[0218] When the position of the lighting device belongs to the light source area, the lighting device is displayed, and when the position of the lighting device does not belong to the light source area, the lighting device is not displayed.

[0219] Alternatively, see Fig. 20 , the virtual scene image is displayed on the mask layer; the second display module is used to:

[0220] The non-light source area on the virtual scene image is blocked in the mask layer.

[0221] Alternatively, see Fig. 20 The mask layer is superimposed on the scene layer, and the scene layer displays a virtual scene; the second display module is used to remove the mask layer when the virtual light source is moved to the lighting device.

[0222] It should be noted that the virtual scene-based interactive device provided in the above embodiment is only illustrated by the division of the above functional modules. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the terminal is divided into different functional modules to complete all or part of the functions described above. In addition, the virtual scene-based interactive device provided in the above embodiment and the virtual scene-based interactive method embodiment belong to the same concept. The specific implementation process is detailed in the method embodiment, which will not be repeated here.

[0223] An embodiment of the present application also provides a terminal, which includes a processor and a memory, wherein at least one computer program is stored in the memory, and the at least one computer program is loaded and executed by the processor to implement the operations performed in the virtual scene-based interaction method of the above embodiment.

[0224] Fig.21 A schematic diagram of the structure of a terminal 2100 provided by an exemplary embodiment of the present application is shown.

[0225] The terminal 2100 includes: a processor 2101 and a memory 2102 .

[0226] The processor 2101 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 2101 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field Programmable Gate Array), and PLA (Programmable Logic Array). The processor 2101 may also include a main processor and a coprocessor. The main processor is a processor for processing data in an awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in a standby state. In some embodiments, the processor 2101 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 2101 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.

[0227] The memory 2102 may include one or more computer-readable storage media, which may be non-transitory. The memory 2102 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 2102 is used to store at least one computer program, which is used to be possessed by the processor 2101 to implement the virtual scene-based interaction method provided in the method embodiment of the present application.

[0228] In some embodiments, the terminal 2100 may further optionally include: a peripheral device interface 2103 and at least one peripheral device. The processor 2101, the memory 2102 and the peripheral device interface 2103 may be connected via a bus or a signal line. Each peripheral device may be connected to the peripheral device interface 2103 via a bus, a signal line or a circuit board. Optionally, the peripheral device includes: at least one of a radio frequency circuit 2104, a display screen 2105, a camera assembly 2106, an audio circuit 2107 and a power supply 2108.

[0229] The peripheral device interface 2103 may be used to connect at least one peripheral device related to I / O (Input / Output) to the processor 2101 and the memory 2102. In some embodiments, the processor 2101, the memory 2102, and the peripheral device interface 2103 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 2101, the memory 2102, and the peripheral device interface 2103 may be implemented on a separate chip or circuit board, which is not limited in this embodiment.

[0230] The radio frequency circuit 2104 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 2104 communicates with communication networks and other communication devices through electromagnetic signals. The radio frequency circuit 2104 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals into electrical signals. Optionally, the radio frequency circuit 2104 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, and the like. The radio frequency circuit 2104 can communicate with other devices through at least one wireless communication protocol. The wireless communication protocol includes, but is not limited to: a metropolitan area network, various generations of mobile communication networks (2G, 3G, 4G and 5G), a wireless local area network and / or a WiFi (Wireless Fidelity) network. In some embodiments, the radio frequency circuit 2104 may also include circuits related to NFC (Near Field Communication), which is not limited in this application.

[0231] The display screen 2105 is used to display a UI (User Interface). The UI may include graphics, text, icons, videos, and any combination thereof. When the display screen 2105 is a touch display screen, the display screen 2105 also has the ability to collect touch signals on the surface or above the surface of the display screen 2105. The touch signal can be input to the processor 2101 as a control signal for processing. At this time, the display screen 2105 can also be used to provide virtual buttons and / or virtual keyboards, also known as soft buttons and / or soft keyboards. In some embodiments, the display screen 2105 can be one, arranged on the front panel of the terminal 2100; in other embodiments, the display screen 2105 can be at least two, respectively arranged on different surfaces of the terminal 2100 or in a folding design; in other embodiments, the display screen 2105 can be a flexible display screen, arranged on a curved surface or a folding surface of the terminal 2100. Even, the display screen 2105 can also be arranged as a non-rectangular irregular figure, that is, a special-shaped screen. The display screen 2105 can be made of materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).

[0232] The camera assembly 2106 is used to capture images or videos. Optionally, the camera assembly 2106 includes a front camera and a rear camera. The front camera is arranged on the front panel of the terminal 2100, and the rear camera is arranged on the back of the terminal 2100. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth of field camera, a wide-angle camera, and a telephoto camera, so as to realize the fusion of the main camera and the depth of field camera to realize the background blur function, the fusion of the main camera and the wide-angle camera to realize panoramic shooting and VR (Virtual Reality) shooting function or other fusion shooting functions. In some embodiments, the camera assembly 2106 may also include a flash. The flash can be a monochrome temperature flash or a dual-color temperature flash. The dual-color temperature flash refers to a combination of a warm light flash and a cold light flash, which can be used for light compensation at different color temperatures.

[0233] The audio circuit 2107 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, and convert the sound waves into electrical signals and input them into the processor 2101 for processing, or input them into the radio frequency circuit 2104 to achieve voice communication. For the purpose of stereo acquisition or noise reduction, there may be multiple microphones, which are respectively arranged at different parts of the terminal 2100. The microphone may also be an array microphone or an omnidirectional acquisition microphone. The speaker is used to convert the electrical signal from the processor 2101 or the radio frequency circuit 2104 into sound waves. The speaker may be a traditional film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert the electrical signal into sound waves audible to humans, but also convert the electrical signal into sound waves inaudible to humans for purposes such as ranging. In some embodiments, the audio circuit 2107 may also include a headphone jack.

[0234] The power supply 2108 is used to power various components in the terminal 2100. The power supply 2108 can be an alternating current, a direct current, a disposable battery, or a rechargeable battery. When the power supply 2108 includes a rechargeable battery, the rechargeable battery can support wired charging or wireless charging. The rechargeable battery can also be used to support fast charging technology.

[0235] In some embodiments, the terminal 2100 further includes one or more sensors 2109 , including but not limited to: an acceleration sensor 2110 , a gyroscope sensor 2111 , a pressure sensor 2112 , an optical sensor 2113 , and a proximity sensor 2114 .

[0236] The acceleration sensor 2110 can detect the magnitude of acceleration on the three coordinate axes of the coordinate system established by the terminal 2100. For example, the acceleration sensor 2110 can be used to detect the components of gravity acceleration on the three coordinate axes. The processor 2101 can control the display screen 2105 to display the user interface in a horizontal view or a vertical view according to the gravity acceleration signal collected by the acceleration sensor 2110. The acceleration sensor 2110 can also be used to collect motion data of games or users.

[0237] The gyro sensor 2111 can detect the body direction and rotation angle of the terminal 2100, and the gyro sensor 2111 can cooperate with the acceleration sensor 2110 to collect the user's 3D actions on the terminal 2100. The processor 2101 can implement the following functions based on the data collected by the gyro sensor 2111: motion sensing (such as changing the UI according to the user's tilt operation), image stabilization during shooting, game control, and inertial navigation.

[0238] The pressure sensor 2112 may be provided at the side frame of the terminal 2100 and / or the lower layer of the display screen 2105. When the pressure sensor 2112 is provided at the side frame of the terminal 2100, it may detect the user's holding signal of the terminal 2100, and the processor 2101 may perform left and right hand recognition or shortcut operation according to the holding signal collected by the pressure sensor 2112. When the pressure sensor 2112 is provided at the lower layer of the display screen 2105, the processor 2101 may control the operability control on the UI interface according to the user's pressure operation on the display screen 2105. The operability control includes at least one of a button control, a scroll bar control, an icon control, and a menu control.

[0239] The optical sensor 2113 is used to collect the ambient light intensity. In one embodiment, the processor 2101 can control the display brightness of the display screen 2105 according to the ambient light intensity collected by the optical sensor 2113. Optionally, when the ambient light intensity is high, the display brightness of the display screen 2105 is increased; when the ambient light intensity is low, the display brightness of the display screen 2105 is decreased. In another embodiment, the processor 2101 can also dynamically adjust the shooting parameters of the camera assembly 2106 according to the ambient light intensity collected by the optical sensor 2113.

[0240] The proximity sensor 2114, also called a distance sensor, is disposed on the front panel of the terminal 2100. The proximity sensor 2114 is used to collect the distance between the user and the front of the terminal 2100. In one embodiment, when the proximity sensor 2114 detects that the distance between the user and the front of the terminal 2100 is gradually decreasing, the processor 2101 controls the display screen 2105 to switch from the screen-on state to the screen-off state; when the proximity sensor 2114 detects that the distance between the user and the front of the terminal 2100 is gradually increasing, the processor 2101 controls the display screen 2105 to switch from the screen-off state to the screen-on state.

[0241] Those skilled in the art will understand that Fig.21 The structure shown in the figure does not constitute a limitation on the terminal 2100, and the terminal 2100 may include more or fewer components than those shown in the figure, or combine certain components, or adopt a different component arrangement.

[0242] An embodiment of the present application also provides a computer-readable storage medium, in which at least one computer program is stored. The at least one computer program is loaded and executed by a processor to implement the operations performed by the virtual scene-based interaction method of the above embodiment.

[0243] An embodiment of the present application further provides a computer program product, including a computer program, wherein the computer program is loaded and executed by a processor to implement the operations performed by the virtual scene-based interaction method of the above embodiment.

[0244] A person skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware or by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a disk or an optical disk, etc.

[0245] The above description is only an optional embodiment of the embodiments of the present application and is not intended to limit the embodiments of the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the embodiments of the present application should be included in the protection scope of the present application.

Claims

1. An interactive method based on a virtual scene, characterized in that: The method comprises: When the scene entry condition is met, a virtual scene image is displayed, and a virtual light source and a lighting device are displayed on the virtual scene image, wherein the virtual scene image is obtained by framing the virtual scene; Displaying a light source area on the virtual scene image as being illuminated, and displaying a non-light source area on the virtual scene image as being unilluminated, wherein the light source area refers to an area within a preset range of the virtual light source on the virtual scene image, and the non-light source area refers to an area on the virtual scene image other than the light source area; When the virtual light source is moved to the lighting device, the display of the virtual scene image is canceled, and the virtual scene in an illuminated state is displayed.

2. The method according to claim 1, characterized in that In the case where the scene entry condition is met, after displaying the virtual scene image and displaying the virtual light source and the lighting device on the virtual scene image, the method further comprises: In response to a movement operation on the virtual light source, controlling the virtual light source to move on the virtual scene image; During the movement of the virtual light source, the light source area and the non-light source area are controlled to change as the position of the virtual light source changes. The light source area is an area with the virtual light source as the center and a preset size.

3. The method according to claim 2, characterized in that In response to the movement operation of the virtual light source, controlling the virtual light source to move on the virtual scene image includes any of the following: In response to a first drag operation on the mouse, controlling the virtual light source to move in a direction of the first drag operation; In response to a second drag operation on the virtual joystick, controlling the virtual light source to move in a direction of the second drag operation; In response to a sliding operation, controlling the virtual light source to move in a direction of the sliding operation; In response to a touch operation on a moving button, the virtual light source is controlled to move in a direction indicated by the moving button.

4. The method according to claim 1, characterized in that When the virtual light source is moved to the lighting device, canceling the display of the virtual scene image and displaying the virtual scene in an illuminated state comprises: When the virtual light source is moved to the lighting device, in response to a touch operation on the lighting device, the display of the virtual scene image is canceled, and the virtual scene in an illuminated state is displayed.

5. The method according to claim 4, characterized in that When the virtual light source is moved to the lighting device, in response to a touch operation on the lighting device, the display of the virtual scene image is canceled, and the virtual scene in an illuminated state is displayed, comprising: When the virtual light source is moved to the lighting device, a target area centered on the lighting device on the virtual scene image is displayed as being illuminated; In response to a touch operation on the lighting device, the target area is expanded based on the time after the touch operation is performed until the target area covers all areas on the virtual scene image, the virtual scene image is canceled, and the virtual scene in an illuminated state is displayed.

6. The method according to claim 1, characterized in that The step of displaying a virtual scene image when a scene entry condition is met includes: In response to the scene interaction request, playing a scene introduction video, wherein the scene introduction video is used to introduce the virtual scene; In response to the completion of playing the scene introduction video, the virtual scene image is displayed.

7. The method according to claim 6, characterized in that In response to the completion of playing the scene introduction video, displaying the virtual scene image comprises: In response to the completion of playing the scene introduction video, playing a black screen animation; In response to the completion of playing the black screen animation, the virtual scene image is displayed.

8. The method according to any one of claims 1 to 7, characterized in that: In the case where the virtual light source is moved to the lighting device, after canceling the display of the virtual scene image and displaying the virtual scene in an illuminated state, the method further comprises: In response to a first interactive operation performed based on the virtual scene, an interactive result corresponding to the first interactive operation is triggered.

9. The method according to claim 8, characterized in that The triggering, in response to a first interactive operation performed based on the virtual scene, an interactive result corresponding to the first interactive operation includes: In response to an interactive operation on a virtual object in the virtual scene, multimedia data corresponding to the virtual object is played, where the multimedia data is used to introduce the virtual object.

10. The method according to claim 9, characterized in that The playing of multimedia data corresponding to the virtual object in response to the interactive operation on the virtual object in the virtual scene includes any one of the following: In response to a touch operation on the virtual object, playing the multimedia data; In response to a touch operation on the interactive button of the virtual object, the multimedia data is played, and the interactive button of the virtual object is displayed at the location where the virtual object is located.

11. The method according to claim 9, characterized in that The multimedia data is an object introduction video of the virtual object, and the playing of the multimedia data corresponding to the virtual object includes: During the playing of the object introduction video, in response to the playing time reaching a preset time, the playing of the object introduction video is stopped, and interaction prompt information is displayed, where the interaction prompt information is used to prompt the execution of a second interaction operation; In response to the second interactive operation, the object introduction video continues to be played starting from the time point when the playing of the object introduction video is stopped.

12. The method according to claim 9, characterized in that The virtual scene includes multiple types of virtual objects, and the number of each type of virtual objects is multiple; in response to the interactive operation on the virtual object in the virtual scene, playing the multimedia data corresponding to the virtual object includes: In response to having performed an interactive operation on each virtual object belonging to a target type, multimedia data corresponding to the target type is played, the multimedia data being used to introduce the virtual objects belonging to the target type, the target type being any one of the multiple types.

13. The method according to claim 12, characterized in that In response to the interactive operation being performed on each virtual object belonging to the target type, playing multimedia data corresponding to the target type includes: Display an image of each type of virtual object; In response to an interactive operation on any virtual object belonging to the target type, marking an image of the virtual object; When the image of each virtual object of the target type is marked, multimedia data corresponding to the target type is played.

14. The method according to any one of claims 1 to 7, characterized in that: The method further comprises: Displaying the lighting device in a preset area on the virtual scene image; or, When the position of the lighting device belongs to the light source area, the lighting device is displayed, and when the position of the lighting device does not belong to the light source area, the lighting device is not displayed.

15. The method according to any one of claims 1 to 7, characterized in that: The virtual scene image is displayed on the mask layer; the light source area on the virtual scene image is displayed as being illuminated, and the non-light source area on the virtual scene image is displayed as being not illuminated, including: The non-light source area on the virtual scene image is shielded in the mask layer.

16. The method according to claim 15, characterized in that The mask layer is superimposed on the scene layer, and the scene layer displays the virtual scene; When the virtual light source is moved to the lighting device, canceling the display of the virtual scene image and displaying the virtual scene in an illuminated state comprises: When the virtual light source is moved to the lighting device, the mask layer is removed.

17. An interactive device based on a virtual scene, characterized in that: The device comprises: A scene display module, used to display a virtual scene when a scene entry condition is met, wherein the virtual scene includes a virtual light source and a lighting device; an illumination display module, configured to display a light source area in the virtual scene as being illuminated, and a non-light source area in the virtual scene as being unilluminated, wherein the light source area refers to an area in the virtual scene where the virtual light source is located, and the non-light source area refers to an area in the virtual scene other than the light source area; The lighting display module is further configured to display all areas in the virtual scene as being illuminated when the virtual light source is moved to the lighting device.

18. A terminal, characterized in that: The terminal includes a processor and a memory, wherein at least one computer program is stored in the memory, and the at least one computer program is loaded and executed by the processor to implement the operations performed by the virtual scene-based interaction method according to any one of claims 1 to 16.

19. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores at least one computer program, and the at least one computer program is loaded and executed by a processor to implement the operations performed by the virtual scene-based interaction method according to any one of claims 1 to 16.

20. A computer program product comprising a computer program, characterized in that The computer program is loaded and executed by a processor to implement the operations performed by the virtual scene-based interaction method according to any one of claims 1 to 16.

Images