Scene image display method, device, terminal and storage medium

Abstract

The present application relates to a method, device, terminal and storage medium for displaying a scene screen, and relates to the field of media interaction technology. The method includes: displaying a target interface, which includes a virtual scene display area; displaying a scene screen of a virtual scene in the virtual scene display area; the virtual scene is generated based on the first audio parameter of the target song at each playback time point, and the virtual scene includes a virtual object and a passable area corresponding to the first audio parameter; in response to a vocal data stream, the scene screen is updated; the updated scene screen is a screen in which the virtual object performs an action in the virtual scene based on the second audio parameter of the vocal data stream. Through the above method, in the process of evaluating the singing behavior of the target user, while evaluating the singing level of the target user, the effect of visualizing the singing evaluation process is improved, thereby improving the display effect of the singing evaluation interface.

Description

Technical Field

[0001] The present application relates to the field of media interaction technology, and in particular to a scene image display method, device, terminal and storage medium. Background Art

[0002] With the development of the Internet and technology, users can enjoy online singing entertainment through applications, which has led to the need for users to evaluate their own singing skills.

[0003] In the related art, in the process of evaluating the user's singing level, the rendering effect of the reference pitch line is changed by displaying the position of the reference pitch line in the terminal interface based on whether the pitch of the user's vocal data reaches the standard pitch.

[0004] However, in the above method, the evaluation performance method of the rendering effect by changing the reference pitch line is relatively simple, resulting in a poor display effect of the evaluation performance. Summary of the invention

[0005] The embodiment of the present application provides a scene screen display method, device, terminal and storage medium, which can improve the visualization effect of the process of evaluating singing behavior, thereby improving the display effect of the interface. The technical solution is as follows:

[0006] On the one hand, a scene picture display method is provided, the method comprising:

[0007] Displaying a target interface, wherein the target interface includes a virtual scene display area;

[0008] A scene picture of a virtual scene is displayed in the virtual scene display area; the virtual scene is generated based on the first audio parameter of the target song at each playback time point, and the virtual scene includes a virtual object and a passable area corresponding to the first audio parameter;

[0009] In response to the human voice data stream, the scene picture is updated; the updated scene picture is a picture of the virtual object performing an action in the virtual scene based on the second audio parameter of the human voice data stream; the human voice data stream is obtained by collecting the sound emitted by the target user in real time during the display of the scene picture.

[0010] In a possible implementation, the first audio parameter includes at least one reference pitch line corresponding to a singing time period of the target song;

[0011] The virtual scene includes at least one pitch obstacle pair corresponding to at least one reference pitch line, and one pitch obstacle pair constitutes a passable area in the virtual scene;

[0012] The updating of the scene picture in response to the human voice data stream comprises:

[0013] In response to the vocal data stream, the scene picture in which the virtual object moves in the virtual scene based on the pitch of the vocal data stream is updated.

[0014] In a possible implementation manner, before displaying the scene picture of the virtual scene in the virtual scene display area, the method further includes:

[0015] Based on at least one of the reference pitch lines, generating at least one of the pitch obstacle pairs;

[0016] Based on at least one of the pitch obstacle pairs, the virtual scene is generated.

[0017] In a possible implementation, generating at least one pitch barrier pair based on at least one reference pitch line includes:

[0018] Acquire the pitch of a target reference pitch line and the starting and ending positions of the target reference pitch line; the target reference pitch line is any one of at least one of the reference pitch lines;

[0019] Based on the pitch of the target reference pitch line, determining the height of a target pitch obstacle pair; the target pitch obstacle pair is a pitch obstacle pair corresponding to the target reference pitch line;

[0020] Determining the length of the target pitch obstacle pair based on the start and end positions of the target reference pitch line;

[0021] The target pitch obstacle pair is generated based on the height of the target pitch obstacle pair and the length of the target pitch obstacle pair.

[0022] In a possible implementation, the target pitch obstacle pair includes a first pitch obstacle and a second pitch obstacle;

[0023] Determining the height of the target pitch obstacle pair based on the pitch of the target reference pitch line includes:

[0024] determining the passable area between the first pitch obstacle and the second pitch obstacle based on the pitch of the target reference pitch line and a specified offset difference;

[0025] Determining the height of the first pitch obstacle based on the upper limit of the height of the passable area;

[0026] Based on the lower limit of the height of the passable area, the height of the second pitch obstacle is determined.

[0027] In a possible implementation, before determining the passable area between the first pitch obstacle and the second pitch obstacle based on the pitch of the target reference pitch line and a specified offset difference, the method further includes:

[0028] In response to receiving a difficulty coefficient adjustment operation, obtaining a difficulty coefficient of the target song;

[0029] The specified offset difference is determined based on the difficulty factor.

[0030] In a possible implementation, updating the scene picture in response to the human voice data stream includes:

[0031] Converting the human voice data stream into a pitch data stream, wherein the pitch data stream is used to indicate the pitch of the sound of the human voice data stream at each moment;

[0032] Determining a target position of the virtual object in the virtual scene based on the pitch data stream;

[0033] The scene picture in which the virtual object moves to the target position in the virtual scene is updated.

[0034] In a possible implementation, the virtual object corresponds to first data, the first data is used to indicate a maximum number of times the state of the virtual object is reset to a first state in the virtual scene, and the first state is used to indicate a movable state of the virtual object in the virtual scene;

[0035] The method further comprises:

[0036] In response to the target position being located in an area outside the passable area, configuring the state of the virtual object to be a second state, and reducing the value of the first data by one; the second state is used to indicate that the virtual object is immovable in the scene screen;

[0037] In response to the value of the first data being greater than 0, the state of the virtual object is reset from the second state to the first state, so as to control the virtual object to continue moving in the scene screen based on the human voice data stream.

[0038] In a possible implementation, the scene screen includes a virtual prop, and the virtual prop is used to change the value of the first data; the first data is used to indicate the maximum number of times the state of the virtual object is reset to the first state in the virtual scene, and the first state is used to indicate the movable state of the virtual object in the virtual scene; the method further includes:

[0039] In response to the target position being within the effective range of the virtual item, the value of the first data is changed based on the virtual item.

[0040] In a possible implementation, in response to the target position being within the effective range of the virtual prop, changing the value of the first data based on the virtual prop includes:

[0041] In response to the target position being within the effective range of the virtual item, increasing the value of the second data based on the virtual item;

[0042] In response to the value of the second data reaching a specified value threshold, the value of the first data is increased by one.

[0043] In a possible implementation, the method further includes:

[0044] In response to the audience user in the virtual screen performing an operation of giving a virtual gift to the target user, a virtual prop is added to the passable area in the virtual scene based on the value of the virtual resources corresponding to the virtual gift, and the virtual prop is used to change the value of the first data; the first data is used to indicate the maximum number of times the state of the virtual object is reset to the first state in the virtual scene, and the first state is used to indicate the movable state of the virtual object in the virtual scene.

[0045] In a possible implementation, in response to the audience user on the virtual screen performing an operation of giving a virtual gift to the target user, adding a virtual prop to the passable area in the virtual scene based on the virtual resource value corresponding to the virtual gift includes:

[0046] In response to the viewer user on the virtual screen performing an operation of giving a virtual gift to the target user, determining a display size of the virtual prop and a prop type of the virtual prop based on the virtual resource value;

[0047] Based on the display size and the prop type, the virtual prop is added to the passable area in the scene screen.

[0048] In a possible implementation, the target interface further includes a live broadcast area, and the method further includes:

[0049] The live broadcast screen corresponding to the target user is displayed in the live broadcast area.

[0050] In a possible implementation, the first audio parameter includes voice part information corresponding to the target song; the method further includes:

[0051] In response to the part information indicating that the target song includes at least two parts, the virtual scene includes the passable areas corresponding to the at least two parts respectively.

[0052] In another aspect, a scene image display device is provided, the device comprising:

[0053] An interface display module, used to display a target interface, wherein the target interface includes a virtual scene display area;

[0054] A screen display module, used to display a scene screen of a virtual scene in the virtual scene display area; the virtual scene is generated based on the first audio parameter of the target song at each playback time point, and the virtual scene includes a virtual object and a passable area corresponding to the first audio parameter;

[0055] A picture update module is used to update the scene picture in response to a human voice data stream; the updated scene picture is a picture of the virtual object performing an action in the virtual scene based on the second audio parameter of the human voice data stream; the human voice data stream is obtained by collecting the sound emitted by the target user in real time during the display of the scene picture.

[0056] In a possible implementation, the first audio parameter includes at least one reference pitch line corresponding to a singing time period of the target song;

[0057] The virtual scene includes at least one pitch obstacle pair corresponding to at least one reference pitch line, and one pitch obstacle pair constitutes a passable area in the virtual scene;

[0058] The picture updating module is used to update the scene picture of the virtual object moving in the virtual scene based on the pitch of the human voice data stream in response to the human voice data stream.

[0059] In a possible implementation manner, the device further includes:

[0060] A pitch barrier pair generating module, used for generating at least one of the pitch barrier pairs based on at least one of the reference pitch lines;

[0061] A picture generation module is used to generate the virtual scene based on at least one of the pitch obstacle pairs.

[0062] In a possible implementation, the pitch barrier pair generation module includes:

[0063] An acquisition submodule, used to acquire the pitch of a target reference pitch line and the starting and ending positions of the target reference pitch line; the target reference pitch line is any one of at least one of the reference pitch lines;

[0064] A height determination submodule, configured to determine a height of a target pitch obstacle pair based on the pitch of the target reference pitch line; the target pitch obstacle pair is a pitch obstacle pair corresponding to the target reference pitch line;

[0065] A length determination submodule, used to determine the length of the target pitch obstacle pair based on the start and end positions of the target reference pitch line;

[0066] The pitch obstacle pair generation submodule is used to generate the target pitch obstacle pair based on the height of the target pitch obstacle pair and the length of the target pitch obstacle pair.

[0067] In a possible implementation, the target pitch obstacle pair includes a first pitch obstacle and a second pitch obstacle;

[0068] The height determination submodule is used to determine the passable area between the first pitch obstacle and the second pitch obstacle based on the pitch of the target reference pitch line and a specified offset difference;

[0069] Determining the height of the first pitch obstacle based on the upper limit of the height of the passable area;

[0070] Based on the lower limit of the height of the passable area, the height of the second pitch obstacle is determined.

[0071] In a possible implementation manner, the device further includes:

[0072] A difficulty coefficient acquisition module, configured to acquire the difficulty coefficient of the target song in response to receiving a difficulty coefficient adjustment operation;

[0073] A specified offset difference determination module is used to determine the specified offset difference based on the difficulty coefficient.

[0074] In a possible implementation, the screen update module includes:

[0075] A conversion submodule, used for converting the human voice data stream into a pitch data stream, wherein the pitch data stream is used for indicating the pitch of the sound of the human voice data stream at each moment;

[0076] A control submodule, used for controlling the movement of the virtual object in the scene picture based on the pitch data stream;

[0077] The screen update submodule is used to update the scene screen based on the movement control result.

[0078] In a possible implementation, the virtual object corresponds to first data, the first data is used to indicate a maximum number of times the state of the virtual object is reset to a first state in the virtual scene, and the first state is used to indicate a movable state of the virtual object in the virtual scene;

[0079] The control submodule is configured to configure the state of the virtual object to a second state in response to the target position being located outside the passable area, and to reduce the value of the first data by one; the second state is used to indicate that the virtual object is immovable in the scene picture;

[0080] In response to the value of the first data being greater than 0, the state of the virtual object is reset from the second state to the first state, so as to control the virtual object to continue moving in the scene screen based on the human voice data stream.

[0081] In a possible implementation, the scene screen includes a virtual prop, and the virtual prop is used to change the value of the first data; the first data is used to indicate the maximum number of times the state of the virtual object is reset to the first state in the virtual scene, and the first state is used to indicate the movable state of the virtual object in the virtual scene; the device also includes:

[0082] The value modification module is used for modifying the value of the first data based on the virtual prop in response to the target position being within the effective range of the virtual prop.

[0083] In a possible implementation, the value changing module is used to increase the value of the second data based on the virtual prop in response to the target position being within the effective range of the virtual prop;

[0084] In response to the value of the second data reaching a specified value threshold, the value of the first data is increased by one.

[0085] In a possible implementation manner, the device further includes:

[0086] A virtual props adding module is used to respond to the viewer user of the virtual screen performing an operation of giving a virtual gift to the target user, and based on the virtual resource value corresponding to the virtual gift, add virtual props at the passable area in the virtual scene, wherein the virtual props are used to change the value of first data; the first data is used to indicate the maximum number of times the state of the virtual object is reset to the first state in the virtual scene, and the first state is used to indicate the movable state of the virtual object in the virtual scene.

[0087] In a possible implementation, the virtual prop adding module includes:

[0088] A virtual prop determination submodule, configured to determine the display size of the virtual prop and the prop type of the virtual prop based on the virtual resource value in response to the viewer user on the virtual screen performing an operation of giving a virtual gift to the target user;

[0089] The virtual prop adding submodule is used to add the virtual prop to the passable area in the scene screen based on the display size and the prop type.

[0090] In a possible implementation, the target interface further includes a live broadcast area, and the screen display module is further used to display the live broadcast screen corresponding to the target user in the live broadcast area.

[0091] In a possible implementation, the first audio parameter includes voice part information corresponding to the target song; the method further includes:

[0092] In response to the part information indicating that the target song includes at least two parts, the virtual scene includes the passable areas corresponding to the at least two parts respectively.

[0093] On the other hand, a computer device is provided, which includes a processor and a memory, wherein the memory stores at least one instruction, at least one program, a code set or an instruction set, and the at least one instruction, the at least one program, the code set or the instruction set are loaded and executed by the processor to implement the above-mentioned scene screen display method.

[0094] On the other hand, a computer-readable storage medium is provided, in which at least one instruction, at least one program, a code set or an instruction set is stored, and the at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by a processor to implement the above-mentioned scene screen display method.

[0095] On the other hand, a computer program product or a computer program is provided, the computer program product or the computer program includes computer instructions, the computer instructions are stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the scene screen display method provided in the above various optional implementations.

[0096] The technical solution provided by this application may have the following beneficial effects:

[0097] The virtual objects in the scene screen are constructed by the first audio parameters of the target song at each playback time point and can pass through the area. The virtual objects are controlled to move in the scene screen according to the second audio parameters of the real-time vocal data stream of the target user. In the process of evaluating the singing behavior of the target user, not only the singing level of the target user can be evaluated, but also the singing evaluation process can be enriched, the concretization effect of the singing evaluation process is improved, and then the display effect of the singing evaluation interface is improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0098] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0099] Figure 1 A schematic diagram of a system structure corresponding to a scene screen display method in a live broadcast scene shown in an exemplary embodiment of the present application is shown;

[0100] Figure 2 A flow chart of a scene screen display method shown in an exemplary embodiment of the present application is shown;

[0101] Figure 3 A flow chart of a scene image display method provided by an exemplary embodiment of the present application is shown;

[0102] Figure 4 A schematic diagram of a display interface shown in an exemplary embodiment of the present application is shown;

[0103] Figure 5 A schematic diagram of a passable area shown in an exemplary embodiment of the present application is shown;

[0104] Figures 6 to 8 A schematic diagram showing a scene screen of a virtual scene provided by an exemplary embodiment of the present application is shown;

[0105] Fig. 9 A schematic diagram showing the movement of a virtual object according to an exemplary embodiment of the present application is shown;

[0106] Fig.10 A schematic diagram of the movement of a virtual object shown in an exemplary embodiment of the present application is shown;

[0107] Fig.11 A schematic diagram showing a virtual prop according to an exemplary embodiment of the present application is shown;

[0108] Fig.12 A block diagram of a scene image display device shown in an exemplary embodiment of the present application is shown;

[0109] Fig.13is a structural block diagram of a computer device according to an exemplary embodiment;

[0110] Fig.14 A structural block diagram of a computer device shown in an exemplary embodiment of the present application is shown. DETAILED DESCRIPTION

[0111] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0112] It should be understood that the "plurality" mentioned in this article refers to two or more. "And / or" describes the association relationship of the associated objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects are in an "or" relationship.

[0113] In an application with a singing evaluation function, in order to visualize the singing evaluation process and make the obtained singing evaluation results explainable, the reference pitch line of the target song is often displayed in the terminal display interface, and different display effects are rendered on the reference pitch line based on the correspondence between the vocal data stream generated when the target user sings the song in real time and the reference pitch line; for example, the original reference pitch line is displayed in white, and when the vocal data stream corresponds to the reference pitch line, the corresponding reference pitch line is rendered into other colors different from white, such as black; the presentation of the singing evaluation process in the above method is relatively simple and the display effect is poor. In order to improve the visualization effect of the singing evaluation process and improve the display effect of the terminal interface, the embodiment of the present application provides a scene screen display method to improve the visualization effect of the singing evaluation process and improve the display effect of the singing evaluation interface.

[0114] Among them, the scene screen display method provided by this application can be applied to the live broadcast scene of singing evaluation. Figure 1 FIG. 1 shows a schematic diagram of a system structure corresponding to a scene screen display method in a live broadcast scene shown in an exemplary embodiment of the present application, such as Figure 1 As shown, the system includes: a first terminal 110 , a server cluster 120 and a second terminal 130 .

[0115] Among them, the server 120 can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), as well as big data and artificial intelligence platforms.

[0116] The terminal 110 can be implemented as a terminal used by a user who is performing live broadcasting. An application with a live broadcasting function is installed in the terminal. The user can perform live broadcasting through the application and interact with users who are watching the live broadcasting. The terminal 110 can be a terminal device with a network connection function and an interface display function. For example, the terminal 110 can be a smart phone, a tablet computer, an e-book reader, smart glasses, a smart watch, a smart TV, a laptop computer, a desktop computer, etc.

[0117] The terminal 130 can be implemented as a terminal used by users who watch live broadcasts. An application with a live broadcast viewing function is installed in the terminal. Users can watch the live broadcast content through the application and interact with the users who are broadcasting the live broadcast. The terminal 130 can be a terminal device with a network connection function and an interface display function. For example, the terminal 130 can be a smart phone, a tablet computer, an e-book reader, smart glasses, a smart watch, a smart TV, a laptop portable computer, a desktop computer, etc.

[0118] Among them, the application with a live broadcast function and the application with a live broadcast viewing function can be the same application or different applications, and this application does not impose any restrictions on this.

[0119] Optionally, the above system includes one or more terminals and one or more servers. The embodiment of the present application does not limit the number of terminals and servers;

[0120] In a possible implementation, the terminal and the server are connected via a communication network. Optionally, the communication network is a wired network or a wireless network.

[0121] Optionally, the above-mentioned wireless network or wired network uses standard communication technology and / or protocol. The network is usually the Internet, but it can also be any network, including but not limited to any combination of local area network (LAN), metropolitan area network (MAN), wide area network (WAN), mobile, wired or wireless network, private network or virtual private network. In some embodiments, the data exchanged through the network is represented by technology and / or format including Hyper Text Mark-up Language (HTML), Extensible Markup Language (XML), etc. In addition, conventional encryption technologies such as Secure Socket Layer (SSL), Transport Layer Security (TLS), Virtual Private Network (VPN), Internet Protocol Security (IPsec) can also be used to encrypt all or some links. In other embodiments, customized and / or dedicated data communication technology can also be used to replace or supplement the above-mentioned data communication technology. This application is not limited here.

[0122] Figure 2 A flowchart of a scene screen display method shown in an exemplary embodiment of the present application is shown. The scene screen display method can be executed by a terminal, or the method can be executed by a server, or the method can be executed interactively by a terminal and a server, wherein the terminal and the server can be implemented as follows Figure 1 The terminals and servers shown are as follows Figure 2 As shown, the scene picture display method may include the following steps:

[0123] Step 210: display a target interface, which includes a virtual scene display area.

[0124] In a possible implementation, the virtual scene display area is an area for displaying a scene image of a virtual scene. The size of the virtual scene display area may be the same as the size of the target interface, or the size of the virtual scene display area may be smaller than the size of the target interface.

[0125] Step 220, displaying a scene picture of a virtual scene in a virtual scene display area; the virtual scene is generated based on a first audio parameter of the target song at each playback time point, and the virtual scene includes a virtual object and a passable area corresponding to the first audio parameter.

[0126] In a possible implementation, the virtual scene can be any one of a two-dimensional virtual scene, a 2.5-dimensional virtual scene, and a three-dimensional virtual scene; the virtual object refers to an active object in the scene screen. In the embodiment of the present application, the active object can be implemented as any one of a virtual character, a virtual animal, a virtual vehicle, a virtual icon, etc. In the embodiment of the present application, the scene screen display method provided by the present application is described by taking the virtual scene as a two-dimensional virtual scene and the virtual object as a virtual icon as an example.

[0127] The scene screen includes a passable area corresponding to the first audio parameter of the target song at each playback time point, and the passable area is used to indicate the movable area of ​​the virtual object in the virtual scene. The first audio parameter includes the pitch data of the target song at each playback time point.

[0128] Among them, the first audio parameter is determined based on the pitch data of the singer of the target song; different creative versions of the same target song correspond to different first audio parameters. Schematically, the same target song may correspond to a first singer and a second singer, and the pitch data of the version corresponding to the first singer is different from the pitch data of the version corresponding to the second singer. In the two versions, the first audio parameters correspond to the pitch data of the singers in the corresponding versions respectively.

[0129] Step 230, in response to the human voice data stream, update the scene picture; the updated scene picture is a picture of the virtual object performing an action in the virtual scene based on the second audio parameter of the human voice data stream; the human voice data stream is obtained by collecting the sound emitted by the target user in real time during the scene picture display process.

[0130] The human voice data stream may be an audio signal acquired in real time by the terminal through its own sound collection device; the sound collection device may be implemented as a microphone or a microphone array.

[0131] In one possible implementation, the vocal data stream may be generated when the target user sings a song, or the vocal data stream may be generated when the target user performs other sound activities, for example, the vocal data stream may be generated when the target user hums or speaks.

[0132] The action performed by the virtual object in the virtual scene based on the second audio parameter may be represented by the virtual object moving in the virtual scene based on the human voice data stream;

[0133] In an embodiment of the present application, the position movement can be expressed as the up and down movement and forward movement of the virtual object; since the movement is mutual, in one possible implementation method, the virtual object moves in the virtual scene based on the second audio parameter, and the virtual object moves up and down in the virtual scene based on the second audio parameter, while the left and right position remains unchanged. At the same time, the scene picture moves toward the direction of the virtual object as time changes.

[0134] Alternatively, in another possible implementation, the scene picture is kept stationary, and while the virtual object moves up and down based on the second audio parameter, the virtual object moves in a specified direction as time changes. The passable area in the specified direction is an area that the virtual object has not passed through. For example, the initial position of the virtual object is at the starting point of the scene picture, and as time goes by, the virtual object moves toward the end point of the scene picture.

[0135] The scene screen involved in the embodiment of the present application can be displayed in the terminal of the target user, and can also be displayed in the terminal of other users (such as viewers) other than the target user.

[0136] The display of the above-mentioned scene pictures may be controlled and executed by the terminal, or by the server, or may be controlled and executed by the terminal and the server interactively.

[0137] Among them, when the display of the scene picture is controlled and executed by the server, the above steps can be implemented as follows: the server displays the target interface through the terminal, displays the scene picture of the virtual scene in the virtual scene display area through the terminal, and updates the scene picture in response to the human voice data stream.

[0138] To sum up, the scene screen display method provided by the embodiment of the present application, in the scenario of evaluating singing behavior, constructs a virtual object in the scene screen through the first audio parameters of the target song at each playback time point, and controls the movement of the virtual object in the scene screen according to the second audio parameters of the real-time vocal data stream of the target user. In this way, in the process of evaluating the singing behavior of the target user, not only the singing level of the target user can be evaluated, but also the singing evaluation process can be enriched, the effect of concretizing the singing evaluation process is improved, and then the display effect of the singing evaluation interface is improved.

[0139] It should be noted that the scene screen display method provided by the present application can be applied to live broadcast scenarios of song evaluation, and can also be applied to scenarios where users themselves evaluate songs. The present application does not limit the application scenarios.

[0140] Take the scene picture as a two-dimensional scene picture as an example. Figure 3A flow chart of a scene screen display method provided by an exemplary embodiment of the present application is shown. The scene screen display method can be executed by a terminal, or the method can be executed by a server, or the method can be executed interactively by a terminal and a server, wherein the terminal and the server can be implemented as follows Figure 1 The terminal and server shown in the figure, this application takes the method executed by the terminal as an example for explanation, such as Figure 3 As shown, the scene picture display method may include the following steps:

[0141] Step 310: display a target interface, which includes a virtual scene display area.

[0142] The virtual scene display screen is used to display a scene screen of a virtual scene generated based on the first audio parameter of the target song at each playing time point; wherein the first audio parameter includes at least one reference pitch line corresponding to the singing time period of the target song;

[0143] The virtual scene includes at least one reference pitch line and at least one pitch obstacle pair corresponding to each other, and a pitch obstacle pair constitutes a passable area in the virtual scene.

[0144] The scene screen display method provided by the present application can be applied to the live broadcast field. In a possible implementation, when the anchor is in the song evaluation state, the live broadcast screen and the scene screen of the virtual scene are synchronously displayed in the target interface, that is, the target interface also includes a live broadcast area;

[0145] Display the live broadcast screen corresponding to the target user in the live broadcast area.

[0146] In one possible implementation, in response to the target user being in a song evaluation state, the terminal divides the display area in the display interface into a virtual scene display area and a live broadcast area; the virtual scene display area is used to display the scene picture of the virtual scene, and the live broadcast area is used to display the live broadcast picture.

[0147] In one possible implementation, the terminal divides the display interface into display areas by automatically displaying the screen in different areas when the terminal detects that the target user is in a song evaluation state; or, the terminal divides the display areas by obtaining the target user's area display operation and then displays the screen in different areas based on the area display operation.

[0148] Figure 4 A schematic diagram of a display interface shown in an exemplary embodiment of the present application is shown. Figure 4As shown, the live broadcast screen includes a virtual scene display area 410 and a live broadcast area 420. The virtual scene display area 410 corresponds to the live broadcast screen, that is, the image screen obtained by the target user in real time through the image acquisition device of the terminal, or it can also be the image screen obtained by the target user based on the screen capture software, etc. The live broadcast area 420 corresponds to the scene screen, which is used to display the scene in which the terminal controls the virtual object to move in the scene screen based on the target user's vocal data stream during the song evaluation process. Among them, the size of the virtual scene display area and the live broadcast area can be enlarged and reduced based on the user's adjustment operation. The user can be the target user of the live broadcast or the audience watching the live broadcast.

[0149] Step 320: Generate at least one pitch obstacle pair based on at least one reference pitch line; one pitch obstacle pair corresponds to one passable area.

[0150] In one possible implementation, the target song may be a song sung by one singer and corresponding to one part, that is, a solo song; or, the target song may be a song sung by at least two singers and at least two singers correspond to different parts, that is, a chorus song.

[0151] In response to the target song being a solo song, the first audio parameter may be a set of pitch data corresponding to the solo singer; in response to the target song being a chorus song, the first audio parameter may include at least two sets of pitch data, each set of pitch data corresponding to a singer of a different part. For example, the chorus song contains three parts, namely, a pitch part, an alto part, and a bass part. Then the first audio parameter corresponding to the chorus song contains three sets of pitch data, corresponding to the three parts respectively.

[0152] In a possible implementation, the first audio parameter includes at least one reference pitch line, and the reference pitch line is used to indicate the start and end points and the pitch height of the corresponding standard pitch.

[0153] When the target song is a chorus song, the first audio parameter includes at least two groups of pitch data, and each group of pitch data corresponds to at least one reference pitch line.

[0154] In the embodiment of the present application, a reference pitch line corresponds to a pitch obstacle pair, that is, a reference pitch line corresponds to a passable area, and the position and length of the passable area are related to the pitch and the start and end positions of the reference pitch line; taking any one of at least one reference pitch line as an example, the process of generating at least one pitch obstacle pair based on at least one reference pitch line can be implemented as follows:

[0155] Obtaining the pitch of a target reference pitch line and the start and end positions of the target reference pitch line; the target reference pitch line is any one of at least one reference pitch line;

[0156] Based on the pitch of the target reference pitch line, determining the height of the target pitch obstacle pair; the target pitch obstacle pair is the pitch obstacle pair corresponding to the target reference pitch line;

[0157] Determine the length of the target pitch obstacle pair based on the start and end positions of the target reference pitch line;

[0158] A target pitch obstacle pair is generated based on the height of the target pitch obstacle pair and the length of the target pitch obstacle pair.

[0159] Among them, a target pitch obstacle pair includes a first pitch obstacle and a second pitch obstacle. When constructing a passable area, the first pitch obstacle is set above the target reference pitch line, and the second pitch obstacle is set below the target reference pitch line. The empty area formed between the first pitch obstacle and the second pitch obstacle is obtained as the passable area corresponding to the target reference pitch line.

[0160] The distance between the lower limit of the first pitch obstacle and the target reference pitch line, and the distance between the upper limit of the second pitch obstacle and the target reference pitch line are determined based on the specified offset difference, that is, the height difference of the pass area is determined by the value of the specified offset difference.

[0161] Based on the pitch of the target reference pitch line, the process of determining the height of the target pitch obstacle pair can be implemented as:

[0162] determining a passable area between a first pitch obstacle and a second pitch obstacle based on the pitch of the target reference pitch line and a specified offset difference;

[0163] Determining the height of the first pitch obstacle based on the upper limit of the height of the passable area;

[0164] Based on the lower limit of the height of the passable area, the height of the second pitch barrier is determined.

[0165] When determining the passable area, the position of the center line of the passable area is determined based on the pitch of the target reference pitch line, and the height of the center line position is the same as the pitch height. The upper and lower height limits of the passable area are determined based on the specified offset difference, that is, the height difference of the passable area is determined.

[0166] Figure 5 A schematic diagram of a passable area is shown in an exemplary embodiment of the present application. Figure 5As shown, the passable area 510 corresponds to the empty area between the first pitch barrier 520 and the second pitch barrier 530, and the height difference between the upper and lower limits of the empty area is determined by a specified offset difference, which acts on the upper and lower sides of the reference pitch line to indicate the tolerance range of the second audio parameter. That is, the pitch tolerance range of the reference pitch line on the upper and lower sides is the same.

[0167] The specified offset difference is determined by the difficulty coefficient of the song selected by the target user: in response to receiving the difficulty coefficient adjustment operation, obtaining the difficulty coefficient of the target song;

[0168] The specified offset difference is determined based on the difficulty factor.

[0169] Generally speaking, the higher the difficulty coefficient of the target song, the higher the requirement for the target user to sing accurately, the smaller the distance between the upper and lower limits of the height of the passable area, and the smaller the specified offset difference; the lower the difficulty coefficient of the target song, the lower the requirement for the target user to sing accurately, the larger the distance between the upper and lower limits of the height of the passable area, and the larger the specified offset difference. It should be noted that the corresponding relationship between the specified offset difference and the difficulty coefficient of the target song can be set by relevant personnel according to actual needs, and this application does not limit this.

[0170] Step 330: Generate a virtual scene based on at least one pitch obstacle pair.

[0171] In a possible implementation, the reference pitch line may be displayed in a scene picture corresponding to a virtual scene generated based on the at least one pair of pitch barrier pairs, or the reference pitch line may not be displayed in the scene picture.

[0172] Figures 6 to 8 A schematic diagram of a scene screen of a virtual scene provided by an exemplary embodiment of the present application is shown. When the target song is a solo song, the target song may have an original version and a cover version. Different versions of the target songs correspond to different first audio parameters, so that different scene screens are generated. Schematically, the same target song corresponds to a first version and a second version, such as Figure 6 As shown, the pitch indicated by the first audio parameter of the first version is higher, and the position height of the passable area 620 formed by the generated pitch obstacle pair 610 is higher; Figure 7 As shown, the pitch indicated by the first audio parameter of the second version is lower, and the position height of the passable area 720 formed by the generated pitch obstacle pair 710 is higher. It should be noted that in the setting interface of the singing evaluation, the target user can lower or raise the pitch of the target song of the current version by performing the pitch adjustment operation. The terminal is based on the pitch obstacle pair in the first audio parameter scene screen of the target song after the target user's pitch adjustment operation. Schematically, the Figure 6It can also indicate the scene image corresponding to the specified version of the target song before the key is lowered. Figure 7 Indicates the scene image corresponding to the specified version of the target song after the key is lowered.

[0173] In a possible implementation, the first audio parameter includes voice part information corresponding to the target song; the method further includes:

[0174] In response to the part information indicating that the target song includes at least two parts, the virtual scene includes passable areas corresponding to the at least two parts respectively.

[0175] That is to say, when the target song is a chorus song, the target song may correspond to multiple parts, and the pitch data corresponding to different parts are different, so that the generated scene screen contains passable areas corresponding to different parts, such as Figure 8 As shown, taking the target song containing high and low parts as an example, the high part can be corresponded to by area 810, and the low part can be corresponded to by area 820. When the user sings solo, the target song of the chorus type can be selected. At this time, the user can sing the high part or the low part, or sing the two in turn. The terminal determines the pitch based on the acquired user's human voice data stream to control the movement of the virtual object in the virtual scene.

[0176] When the voice part information included in the first audio parameter indicates that the target song is a multi-part song, at each playback time point of the target song, there are at least two groups of reference pitch lines corresponding to at least two voice parts of the target song respectively.

[0177] Step 340 , in response to the vocal data stream, updating the scene picture of the virtual object moving in the virtual scene based on the pitch of the vocal data stream.

[0178] In a possible implementation, the scene picture of the movement of the virtual object in the virtual scene based on the pitch of the human voice data stream can be expressed as a scene picture of the virtual object moving in the virtual scene to a position corresponding to the pitch of the human voice data stream.

[0179] In a possible implementation, the vocal data stream is a vocal data stream emitted by at least one target user, that is, the target user who sings the target song may be one or more; because in the singing evaluation scenario, the singing level of the target user is evaluated based on the matching degree between the pitch at each time point corresponding to the vocal data stream and the pitch data of the target song at each playback time point, the terminal needs to convert the acquired vocal data stream into a pitch data stream to match it with the standard pitch data. Therefore, before updating the scene picture of the virtual object moving in the virtual scene based on the pitch of the vocal data stream in response to the vocal data stream, the method also includes:

[0180] Converting a human voice data stream into a pitch data stream, the pitch data stream being used to indicate the pitch of the sound of the human voice data stream at each moment;

[0181] Controlling the movement of virtual objects in the scene based on the pitch data stream;

[0182] Update the scene screen based on the movement control results.

[0183] In a possible implementation, the terminal controls the virtual object to move in a direction perpendicular to the reference pitch line in the virtual scene based on the pitch data stream. Schematically, when the scene screen is displayed as follows Figures 6 to 8 When the scene picture shown is displayed, the terminal controls the virtual object to move up and down in the virtual scene based on the pitch data stream.

[0184] Because the motion is mutual, virtual objects can move forward in time while moving up and down. Fig. 9 A schematic diagram showing the movement of a virtual object shown in an exemplary embodiment of the present application is shown in FIG. Fig. 9 As shown, the terminal controls the virtual object 910 to move up and down based on the pitch data stream, and also controls the virtual object 910 to move forward as time changes, and as the virtual object 910 moves forward, the picture content of the scene picture changes.

[0185] Alternatively, the virtual object moves only in the up and down directions without moving forward, and at the same time, the pitch obstacle in the scene image moves toward the virtual object, that is, moves backward, thereby achieving the effect that the virtual object moves in the virtual scene. Fig.10 FIG. 4 shows a schematic diagram of the movement of a virtual object shown in an exemplary embodiment of the present application. Fig.10 As shown, the terminal controls the virtual object 1010 to move up and down based on the pitch data stream, and at the same time, controls the scene screen to move in the direction of the virtual object.

[0186] In a possible implementation, the virtual object corresponds to first data, and the first data is used to indicate the maximum number of times the state of the virtual object is reset to a first state in the virtual scene, and the first state is used to indicate a movable state of the virtual object in the virtual scene.

[0187] The method of controlling the movement of virtual objects in the scene based on the pitch data stream includes:

[0188] In response to the target position being located outside the passable area, configuring the state of the virtual object to be a second state, and reducing the value of the first data by one; the second state is used to indicate that the virtual object is immovable in the scene screen;

[0189] In response to the value of the first data being greater than 0, the state of the virtual object is reset from the second state to the first state, so as to control the virtual object to continue moving in the scene screen based on the human voice data stream.

[0190] In one possible implementation, the passable area in the scene screen includes vacant areas between pitch barrier pairs and areas without pitch barrier pairs, wherein the areas without pitch barrier pairs may correspond to the prelude, interlude, outro, and other parts of the target song that do not require the target user to sing.

[0191] That is to say, when the virtual object touches the pitch obstacle in the scene screen during movement, it is confirmed that the virtual object is in the second state, and the value of the virtual corresponding first data is reduced by one. Taking the game process as an example, when the virtual object touches the pitch obstacle, the life value of the virtual object is reduced by one.

[0192] When the first data of the virtual object is not 0, the virtual object can be revived, that is, the state of the virtual object is changed from the second state to the first state, and the terminal can continue to control the movement of the virtual object in the scene screen based on the pitch data stream converted from the human voice data stream. When the first data of the virtual object is 0, it is determined that the state of the virtual object remains in the second state, and the virtual object cannot be moved in the scene screen, that is, the game is over.

[0193] In a possible implementation, the scene image includes a virtual prop, and the virtual prop is used to change the value of the first data; the method further includes:

[0194] In response to the target position being within the effective range of the virtual prop, the value of the first data is changed based on the virtual prop. In a possible implementation, the virtual prop is randomly set at a position corresponding to the reference pitch line, that is, when the vocal data stream generated by the target user singing the song causes the terminal to control the virtual object to be within the effective range of the virtual prop set on the reference pitch line, it is confirmed that the virtual object has acquired the virtual prop, and the value of the first data is changed based on the virtual prop.

[0195] In a possible implementation, the virtual scene may include different virtual props, and different virtual props have different effects on the value of the first data, wherein the effect of the virtual props on the value of the first data is an increase in the value of the second data related to the first data, thereby affecting the increase of the first data, that is, in response to the target position being within the effective range of the virtual props, the value of the second data is increased based on the virtual props;

[0196] In response to the value of the second data reaching a specified value threshold, the value of the first data is increased by one.

[0197] Illustratively, the second data can be expressed as an integral value, and different virtual props have corresponding different integral values. After the virtual object obtains the virtual object, the corresponding integral value is added on the basis of the integral value corresponding to the virtual object (the second data). When the value of the second data reaches a specified numerical threshold, the second data of the specified numerical threshold is converted into a first data. For example, the specified numerical threshold is 50, and the target user sings so that the accumulated integral value of the virtual props obtained by the terminal controlling the virtual object reaches 50, then these 50 points are converted into a life value of the virtual object, and the value of the first data is increased by one.

[0198] In a live broadcast scenario, the audience can interact with the target user who is conducting the live broadcast. For example, the audience can give a virtual gift to the target user. In one possible implementation, in response to the virtual screen, the audience user gives the target user a virtual gift. In order to enrich the interaction between the target user and the audience during the live song evaluation process, in one possible implementation, the audience user gives the target user a virtual gift in response to the virtual screen. Based on the virtual resource value corresponding to the virtual gift, virtual props are added to the passable area in the virtual scene.

[0199] In a possible implementation, in response to a viewer user on a virtual screen performing an operation of giving a virtual gift to a target user, a display size of a virtual prop and a prop type of the virtual prop are determined based on a virtual resource value; the prop type is used to indicate an added value effect of the virtual prop on the second data;

[0200] Based on the display size and prop type, virtual props are added to the passable areas in the scene screen.

[0201] In the embodiment of the present application, the higher the virtual resource value of the virtual gift, the larger the display size of the corresponding virtual prop, the higher the probability that the target user obtains the virtual prop, and the stronger the value-added effect of the virtual prop on the second data; the lower the virtual resource value corresponding to the virtual gift, the smaller the display size of the corresponding virtual prop, the lower the probability that the target user obtains the virtual prop, and the stronger the value-added effect of the virtual prop on the second data. The virtual resource value information of the virtual gift and the display size of the virtual prop, as well as the value-added effect on the second data can be set by relevant personnel according to actual needs. Schematically, the display size and value-added effect can be set based on the virtual resource value range in which the virtual resource value is located. For example, when the virtual resource value of the virtual gift is in the first virtual resource value range, the display size of the corresponding virtual prop is the first size, and the value-added effect is the first value, etc.

[0202] Fig.11 FIG. 1 shows a schematic diagram of an exemplary embodiment of the present application showing a virtual prop, such as Fig.11 As shown, the amount of virtual gifts corresponding to virtual props 1110 is relatively high, and the display size of the virtual props is relatively large, which is shown as a must-win prop in the figure. The amount of virtual gifts corresponding to virtual props 1120 is relatively low, and the display size of the virtual props is relatively small, which is shown as randomly displayed in the passable area of ​​the scene screen in the figure, that is, a hit prop. Among them, virtual props corresponding to different value-added effects can be set to different skins, such as displayed in different shapes, colors, sizes, etc., and this application does not limit the display method of virtual props.

[0203] In a possible implementation, the virtual props in the scene screen may also be virtual props added by the terminal based on the target user's target user portrait. In an illustrative example, the terminal obtains the historical song evaluation data of the target user, and obtains the game clearance probability of the target user based on the historical song evaluation data; and sets the virtual props in the scene screen corresponding to the target user based on the game clearance probability.

[0204] Generally speaking, the target user has a high singing level and a high historical song evaluation, and the target user has a high probability of passing the game during the song evaluation process. Therefore, the terminal sets fewer virtual props in the scene screen, or the terminal sets fewer must-hit props and more accurate props in the virtual scene. However, the target user has a low singing level and a low historical song evaluation, and the target user has a low probability of passing the game during the song evaluation process. Therefore, the terminal sets more virtual props in the virtual scene, or the terminal sets more must-hit props and fewer accurate props in the virtual scene.

[0205] In one possible implementation, in order to enrich the operational experience of the target user during the song evaluation process, the terminal can add virtual props in the scene screen of the virtual scene corresponding to the non-singing time period (such as the prelude, interlude and outro of the target song). The virtual props can be virtual props randomly added by the terminal, or the virtual props can also be virtual props added based on the audience user's operation of giving virtual gifts.

[0206] In one possible implementation, in response to the first value of the virtual object being 0, a game end prompt message is displayed in the scene screen; or, in response to the first value of the virtual object being 0, the scene screen is closed and the live broadcast screen is restored to the original display state.

[0207] In one possible implementation, in response to the target user completing the singing of the target song, the first value of the virtual object is not 0, and the current first value of the virtual object is converted to a second value; the popularity ranking of the target user is determined based on the current second value of the virtual object to evaluate the target user's singing level and audience enthusiasm during the singing of the target song.

[0208] To sum up, the scene screen display method provided by the embodiment of the present application, in the singing evaluation scene, constructs the virtual objects in the scene screen through the first audio parameters of the target song at each playback time point, and controls the movement of the virtual objects in the scene screen according to the second audio parameters of the real-time vocal data stream of the target user. In this way, in the process of evaluating the singing behavior of the target user, not only the singing level of the target user can be evaluated, but also the singing evaluation process can be enriched, the effect of concretizing the singing evaluation process is improved, and then the display effect of the singing evaluation interface is improved.

[0209] It should be noted that the terminal in the embodiment of the present application can be implemented as a terminal corresponding to a user performing live broadcast, and can also be implemented as a terminal corresponding to a user watching live broadcast. When the terminal is a terminal corresponding to a user watching live broadcast, the display content in the display interface of the terminal is the interface content on the terminal interface corresponding to the user performing live broadcast obtained through the server. The user watching live broadcast can also adjust the size of the live broadcast area and the virtual scene display area.

[0210] Fig.12 A block diagram of a scene image display device shown in an exemplary embodiment of the present application is shown. Fig.12 As shown, the scene picture display device includes:

[0211] The interface display module 1210 is used to display a target interface, wherein the target interface includes a virtual scene display area;

[0212] The screen display module 1220 is used to display a scene screen of a virtual scene in the virtual scene display area; the virtual scene is generated based on the first audio parameter of the target song at each playback time point, and the virtual scene includes a virtual object and a passable area corresponding to the first audio parameter;

[0213] The screen update module 1230 is used to update the scene screen in response to the human voice data stream; the updated scene screen is a screen in which the virtual object performs an action in the virtual scene based on the second audio parameter of the human voice data stream; the human voice data stream is obtained by collecting the sound emitted by the target user in real time during the display of the scene screen.

[0214] In a possible implementation, the first audio parameter includes at least one reference pitch line corresponding to a singing time period of the target song;

[0215] The virtual scene includes at least one pitch obstacle pair corresponding to at least one reference pitch line, and one pitch obstacle pair constitutes a passable area in the virtual scene;

[0216] The picture updating module 1230 is used to update the scene picture of the virtual object moving in the virtual scene based on the pitch of the human voice data stream in response to the human voice data stream.

[0217] In a possible implementation manner, the device further includes:

[0218] A pitch barrier pair generating module, used for generating at least one of the pitch barrier pairs based on at least one of the reference pitch lines;

[0219] A picture generation module is used to generate the virtual scene based on at least one of the pitch obstacle pairs.

[0220] In a possible implementation, the pitch barrier pair generation module includes:

[0221] An acquisition submodule, used to acquire the pitch of a target reference pitch line and the starting and ending positions of the target reference pitch line; the target reference pitch line is any one of at least one of the reference pitch lines;

[0222] A height determination submodule, configured to determine a height of a target pitch obstacle pair based on the pitch of the target reference pitch line; the target pitch obstacle pair is a pitch obstacle pair corresponding to the target reference pitch line;

[0223] A length determination submodule, used to determine the length of the target pitch obstacle pair based on the start and end positions of the target reference pitch line;

[0224] The pitch obstacle pair generation submodule is used to generate the target pitch obstacle pair based on the height of the target pitch obstacle pair and the length of the target pitch obstacle pair.

[0225] In a possible implementation, the target pitch obstacle pair includes a first pitch obstacle and a second pitch obstacle;

[0226] The height determination submodule is used to determine the passable area between the first pitch obstacle and the second pitch obstacle based on the pitch of the target reference pitch line and a specified offset difference;

[0227] Determining the height of the first pitch obstacle based on the upper limit of the height of the passable area;

[0228] Based on the lower limit of the height of the passable area, the height of the second pitch obstacle is determined.

[0229] In a possible implementation manner, the device further includes:

[0230] A difficulty coefficient acquisition module, configured to acquire the difficulty coefficient of the target song in response to receiving a difficulty coefficient adjustment operation;

[0231] A specified offset difference determination module is used to determine the specified offset difference based on the difficulty coefficient.

[0232] In a possible implementation, the screen update module 1230 includes:

[0233] A conversion submodule, used for converting the human voice data stream into a pitch data stream, wherein the pitch data stream is used for indicating the pitch of the sound of the human voice data stream at each moment;

[0234] A control submodule, used for controlling the movement of the virtual object in the scene picture based on the pitch data stream;

[0235] The screen update submodule is used to update the scene screen based on the movement control result.

[0236] In a possible implementation, the virtual object corresponds to first data, the first data is used to indicate a maximum number of times the state of the virtual object is reset to a first state in the virtual scene, and the first state is used to indicate a movable state of the virtual object in the virtual scene;

[0237] The control submodule is configured to configure the state of the virtual object to a second state in response to the target position being located outside the passable area, and to reduce the value of the first data by one; the second state is used to indicate that the virtual object is immovable in the scene picture;

[0238] In response to the value of the first data being greater than 0, the state of the virtual object is reset from the second state to the first state, so as to control the virtual object to continue moving in the scene screen based on the human voice data stream.

[0239] In a possible implementation, the scene screen includes a virtual prop, and the virtual prop is used to change the value of the first data; the first data is used to indicate the maximum number of times the state of the virtual object is reset to the first state in the virtual scene, and the first state is used to indicate the movable state of the virtual object in the virtual scene; the device also includes:

[0240] The value modification module is used for modifying the value of the first data based on the virtual prop in response to the target position being within the effective range of the virtual prop.

[0241] In a possible implementation, the value changing module is used to increase the value of the second data based on the virtual prop in response to the target position being within the effective range of the virtual prop;

[0242] In response to the value of the second data reaching a specified value threshold, the value of the first data is increased by one.

[0243] In a possible implementation manner, the device further includes:

[0244] A virtual props adding module is used to respond to the viewer user of the virtual screen performing an operation of giving a virtual gift to the target user, and based on the virtual resource value corresponding to the virtual gift, add virtual props at the passable area in the virtual scene, wherein the virtual props are used to change the value of first data; the first data is used to indicate the maximum number of times the state of the virtual object is reset to the first state in the virtual scene, and the first state is used to indicate the movable state of the virtual object in the virtual scene.

[0245] In a possible implementation, the virtual prop adding module includes:

[0246] A virtual prop determination submodule, configured to determine the display size of the virtual prop and the prop type of the virtual prop based on the virtual resource value in response to the viewer user on the virtual screen performing an operation of giving a virtual gift to the target user;

[0247] The virtual prop adding submodule is used to add the virtual prop to the passable area in the scene screen based on the display size and the prop type.

[0248] In a possible implementation, the target interface further includes a live broadcast area, and the screen display module 1220 is further used to display the live broadcast screen corresponding to the target user in the live broadcast area.

[0249] In a possible implementation, the first audio parameter includes voice part information corresponding to the target song; the method further includes:

[0250] In response to the part information indicating that the target song includes at least two parts, the virtual scene includes the passable areas corresponding to the at least two parts respectively.

[0251] To sum up, the scene screen display device provided by the embodiment of the present application, in the singing evaluation scene, constructs a virtual object in the scene screen through the first audio parameters of the target song at each playback time point, and controls the movement of the virtual object in the scene screen according to the second audio parameters of the real-time vocal data stream of the target user. In this way, in the process of evaluating the singing behavior of the target user, not only the singing level of the target user can be evaluated, but also the singing evaluation process can be enriched, the effect of concretizing the singing evaluation process is improved, and then the display effect of the singing evaluation interface is improved.

[0252] Fig.13 is a block diagram of a computer device 1300 according to an exemplary embodiment. The computer device 1300 may be Figure 1 The terminal shown is, for example, a smart phone, a tablet computer, or a desktop computer. The computer device 1300 may also be called a target user device, a portable terminal, a laptop terminal, a desktop terminal, or other names.

[0253] Typically, the computer device 1300 includes a processor 1301 and a memory 1302 .

[0254] The processor 1301 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 1301 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). The processor 1301 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 1301 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 1301 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.

[0255] The memory 1302 may include one or more computer-readable storage media, which may be non-transitory. The memory 1302 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 1302 is used to store at least one instruction, which is used to be executed by the processor 1301 to implement the method provided in the method embodiment of the present application.

[0256] In some embodiments, the computer device 1300 may also optionally include: a peripheral device interface 1303 and at least one peripheral device. The processor 1301, the memory 1302 and the peripheral device interface 1303 may be connected via a bus or a signal line. Each peripheral device may be connected to the peripheral device interface 1303 via a bus, a signal line or a circuit board. Specifically, the peripheral device includes: at least one of a radio frequency circuit 1304, a display screen 1305, a camera assembly 1306, an audio circuit 1307, a positioning assembly 1308 and a power supply 1309.

[0257] In some embodiments, the computer device 1300 further includes one or more sensors 1310 , including but not limited to: an acceleration sensor 1311 , a gyroscope sensor 1312 , a pressure sensor 1313 , a fingerprint sensor 1314 , an optical sensor 1315 , and a proximity sensor 1316 .

[0258] Those skilled in the art will understand that Fig.13 The structure shown in the figure does not constitute a limitation on the computer device 1300, and the computer device 1300 may include more or less components than shown in the figure, or combine some components, or adopt a different component arrangement.

[0259] Fig.14 The structural block diagram of a computer device 1400 shown in an exemplary embodiment of the present application is shown. The computer device can be implemented as a server in the above-mentioned solution of the present application. The computer device 1400 includes a central processing unit (CPU) 1401, a system memory 1404 including a random access memory (RAM) 1402 and a read-only memory (ROM) 1403, and a system bus 1405 connecting the system memory 1404 and the central processing unit 1401. The computer device 1400 also includes a mass storage device 1406 for storing an operating system 1409, an application program 1410 and other program modules 1411.

[0260] The mass storage device 1406 is connected to the central processing unit 1401 through a mass storage controller (not shown) connected to the system bus 1405. The mass storage device 1406 and its associated computer readable medium provide non-volatile storage for the computer device 1400. That is, the mass storage device 1406 may include a computer readable medium (not shown) such as a hard disk or a compact disc read-only memory (CD-ROM) drive.

[0261] Without loss of generality, the computer-readable medium may include computer storage media and communication media. Computer storage media include volatile and non-volatile, removable and non-removable media implemented by any method or technology for storing information such as computer-readable instructions, data structures, program modules or other data. Computer storage media include RAM, ROM, Erasable Programmable Read Only Memory (EPROM), Electronically-Erasable Programmable Read-Only Memory (EEPROM) flash memory or other solid-state storage devices, CD-ROM, Digital Versatile Disc (DVD) or other optical storage, cassettes, tapes, disk storage or other magnetic storage devices. Of course, those skilled in the art will appreciate that the computer storage media is not limited to the above. The above-mentioned system memory 1404 and mass storage device 1406 can be collectively referred to as memory.

[0262] According to various embodiments of the present disclosure, the computer device 1400 can also be connected to a remote computer on the network through a network such as the Internet. That is, the computer device 1400 can be connected to the network 1408 through the network interface unit 1407 connected to the system bus 1405, or the network interface unit 1407 can be used to connect to other types of networks or remote computer systems (not shown).

[0263] The memory also includes at least one instruction, at least one program, code set or instruction set, and the at least one instruction, at least one program, code set or instruction set is stored in the memory. The central processing unit 1401 implements all or part of the steps in the scene screen display method shown in the above-mentioned embodiments by executing the at least one instruction, at least one program, code set or instruction set.

[0264] Those skilled in the art will appreciate that in one or more of the above examples, the functions described in the embodiments of the present application can be implemented with hardware, software, firmware, or any combination thereof. When implemented using software, these functions can be stored in a computer-readable medium or transmitted as one or more instructions or codes on a computer-readable medium. Computer-readable media include computer storage media and communication media, wherein the communication media include any media that facilitates the transmission of a computer program from one place to another. The storage medium can be any available medium that a general or special-purpose computer can access.

[0265] In an exemplary embodiment, a computer-readable storage medium is also provided, which is used to store at least one instruction, at least one program, code set or instruction set, and the at least one instruction, the at least one program, the code set or instruction set is loaded and executed by a processor to implement all or part of the steps in the above-mentioned scene screen display method. For example, the computer-readable storage medium can be a read-only memory (ROM), a random access memory (RAM), a compact disc read-only memory (CD-ROM), a magnetic tape, a floppy disk, an optical data storage device, etc.

[0266] In an exemplary embodiment, a computer program product or a computer program is also provided, the computer program product or the computer program comprising computer instructions, the computer instructions being stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device performs the above-mentioned Figure 2 or Figure 3 All or part of the steps of the method shown in any embodiment.

[0267] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the invention disclosed herein. The present application is intended to cover any modification, use or adaptation of the present application, which follows the general principles of the present application and includes common knowledge or customary techniques in the art that are not disclosed in the present application. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present application are indicated by the following claims.

[0268] It should be understood that the present application is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.

Claims

1. A scene picture display method, characterized in that: The method comprises: Displaying a target interface, wherein the target interface includes a virtual scene display area; A scene screen of a virtual scene is displayed in the virtual scene display area; the virtual scene is generated based on a first audio parameter of the target song at each playback time point, the first audio parameter includes at least one reference pitch line corresponding to the singing time period of the target song, the virtual scene includes a virtual object and at least one pitch barrier pair corresponding to at least one of the reference pitch lines, an empty area between the pitch barrier pairs constitutes a passable area in the virtual scene, the passable area also includes an area without a pitch barrier pair, the area without a pitch barrier pair corresponds to at least one of the prelude, interlude and outro of the target song; the virtual object is an active object in the virtual scene, and the passable area is used to indicate a movable area of ​​the virtual object in the virtual scene; Virtual props are randomly added in the area without pitch barrier pairs; based on the target user portrait of the target user, the virtual props are added in the scene screen, the virtual props are randomly set in the passable area, the target user portrait is used to reflect the game clearance probability of the target user, the game clearance probability is determined based on the historical song evaluation data of the target user, the historical song evaluation data is positively correlated with the game clearance probability, the virtual props include at least one of a must-hit prop and an accurate singing prop, the display size of the must-hit prop is larger than the accurate singing prop, the game clearance probability is negatively correlated with the number of the must-hit props and positively correlated with the number of the accurate props; in response to the audience user on the virtual screen performing the operation of giving a virtual gift to the target user, based on the virtual resource value corresponding to the virtual gift, determining the display size of the virtual prop and the prop type of the virtual prop, the display size is positively correlated with the virtual resource value, the prop type is used to indicate the value-added effect of the virtual prop on the second data corresponding to the first data, the value-added effect is positively correlated with the virtual resource value, and virtual props of different prop types are provided with different skins; based on the display size and the prop type, adding the virtual prop at the passable area; In response to a human voice data stream, the human voice data stream is converted into a pitch data stream, the pitch data stream is used to indicate the pitch of the sound of the human voice data stream at each moment; based on the pitch data stream, the target position of the virtual object in the virtual scene is determined; the scene screen in which the virtual object moves to the target position in the virtual scene is updated; the area outside the passable area is used to trigger the state that the virtual object cannot be moved in the scene screen, and the human voice data stream is obtained by collecting the sound emitted by the target user in real time during the display of the scene screen; In response to the target position being within the effective range of the virtual prop, the value of the second data is increased based on the virtual prop; in response to the value of the second data reaching a specified value threshold, the value of the first data is increased by one, the first data is used to indicate the maximum number of times the state of the virtual object is reset to a first state in the virtual scene, and the first state is used to indicate a movable state of the virtual object in the virtual scene.

2. The method according to claim 1, characterized in that Before displaying the scene picture of the virtual scene in the virtual scene display area, the method further includes: Based on at least one of the reference pitch lines, generating at least one of the pitch obstacle pairs; Based on at least one of the pitch obstacle pairs, the virtual scene is generated.

3. The method according to claim 2, characterized in that The step of generating at least one of the pitch obstacle pairs based on at least one of the reference pitch lines comprises: Acquire the pitch of a target reference pitch line and the starting and ending positions of the target reference pitch line; the target reference pitch line is any one of at least one of the reference pitch lines; Based on the pitch of the target reference pitch line, determining the height of a target pitch obstacle pair; the target pitch obstacle pair is a pitch obstacle pair corresponding to the target reference pitch line; Determining the length of the target pitch obstacle pair based on the start and end positions of the target reference pitch line; The target pitch obstacle pair is generated based on the height of the target pitch obstacle pair and the length of the target pitch obstacle pair.

4. The method according to claim 3, characterized in that The target pitch obstacle pair includes a first pitch obstacle and a second pitch obstacle; Determining the height of the target pitch obstacle pair based on the pitch of the target reference pitch line includes: determining the passable area between the first pitch obstacle and the second pitch obstacle based on the pitch of the target reference pitch line and a specified offset difference; Determining the height of the first pitch obstacle based on the upper limit of the height of the passable area; Based on the lower limit of the height of the passable area, the height of the second pitch obstacle is determined.

5. The method according to claim 4, characterized in that Before determining the passable area between the first pitch obstacle and the second pitch obstacle based on the pitch of the target reference pitch line and a specified offset difference, the method further includes: In response to receiving a difficulty coefficient adjustment operation, obtaining a difficulty coefficient of the target song; The specified offset difference is determined based on the difficulty factor.

6. The method according to claim 1, characterized in that The method further comprises: In response to the target position being located in an area outside the passable area, configuring the state of the virtual object to be a second state, and reducing the value of the first data by one; the second state is used to indicate that the virtual object is immovable in the scene screen; In response to the value of the first data being greater than 0, the state of the virtual object is reset from the second state to the first state, so as to control the virtual object to continue moving in the scene screen based on the human voice data stream.

7. The method according to any one of claims 1 to 6, characterized in that: The target interface also includes a live broadcast area, and the method further includes: The live broadcast screen corresponding to the target user is displayed in the live broadcast area.

8. The method according to claim 1, characterized in that The first audio parameter includes voice part information corresponding to the target song; in response to the voice part information indicating that the target song includes at least two voice parts, the virtual scene includes the passable areas corresponding to the at least two voice parts respectively.

9. A scene image display device, characterized in that: The device comprises: An interface display module, used to display a target interface, wherein the target interface includes a virtual scene display area; A screen display module, used for displaying a scene screen of a virtual scene in the virtual scene display area; the virtual scene is generated based on a first audio parameter of a target song at each playback time point, the first audio parameter includes at least one reference pitch line corresponding to a singing time period of the target song, the virtual scene includes a virtual object and at least one pitch barrier pair corresponding to at least one of the reference pitch lines, an empty area between the pitch barrier pairs constitutes a passable area in the virtual scene, the passable area also includes an area without a pitch barrier pair, the area without a pitch barrier pair corresponds to at least one of the prelude, interlude and outro of the target song; the virtual object is an active object in the virtual scene, and the passable area is used to indicate a movable area of ​​the virtual object in the virtual scene; A virtual prop adding module is used to randomly add virtual props in the area without pitch barrier pairs; based on the target user portrait of the target user, the virtual props are added in the scene screen, and the virtual props are randomly set in the passable area. The target user portrait is used to reflect the game clearance probability of the target user, and the game clearance probability is determined based on the historical song evaluation data of the target user, and the historical song evaluation data is positively correlated with the game clearance probability. The virtual props include at least one of a must-hit prop and an accurate singing prop, the display size of the must-hit prop is larger than the accurate singing prop, and the game clearance probability is related to the number of the must-hit props. The virtual props are negatively correlated with the amount and positively correlated with the number of the target props; in response to the audience user on the virtual screen performing the operation of giving a virtual gift to the target user, based on the virtual resource value corresponding to the virtual gift, the display size of the virtual props and the prop type of the virtual props are determined, the display size is positively correlated with the virtual resource value, the prop type is used to indicate the value-added effect of the virtual props on the second data corresponding to the first data, the value-added effect is positively correlated with the virtual resource value, and virtual props of different prop types are provided with different skins; based on the display size and the prop type, the virtual props are added at the passable area; A screen update module is used to respond to a human voice data stream and convert the human voice data stream into a pitch data stream, wherein the pitch data stream is used to indicate the pitch of the sound of the human voice data stream at each moment; based on the pitch data stream, determine the target position of the virtual object in the virtual scene; update the scene screen in which the virtual object moves to the target position in the virtual scene; the area outside the passable area is used to trigger the state in which the virtual object cannot be moved in the scene screen, and the human voice data stream is obtained by collecting the sound emitted by the target user in real time during the display of the scene screen; A value changing module is used for increasing the value of the second data based on the virtual prop in response to the target position being within the effective range of the virtual prop; and increasing the value of the first data by one in response to the value of the second data reaching a specified value threshold, wherein the first data is used to indicate the maximum number of times the state of the virtual object is reset to a first state in the virtual scene, and the first state is used to indicate the movable state of the virtual object in the virtual scene.

10. A computer device, characterized in that: The computer device includes a processor and a memory, the memory stores at least one program, and the at least one program is loaded and executed by the processor to implement the scene screen display method as described in any one of claims 1 to 8.

11. A computer-readable storage medium, characterized in that: The storage medium stores at least one program, and the at least one program is loaded and executed by the processor to implement the scene screen display method as described in any one of claims 1 to 8.

Images