Performance recording method and device in virtual scene, equipment and storage medium

CN116764240BActive Publication Date: 2026-09-22TENCENT TECHNOLOGY (SHENZHEN) CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202210231332.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-03-10
Publication Date
2026-09-22
Estimated Expiration
2042-03-10

AI Technical Summary

Technical Problem

相关技术中,在表演录制过程中更换虚拟对象装备的表演服饰时,需要先搭配好多套表演服饰,再手动更换装备的表演服饰,更换的效率较低

Benefits of technology

应用本申请实施例,在虚拟场景的表演录制过程中,由于所选择的表演录制的背景音频包括多种播放节奏,不同的播放节奏关联有不同的表演服饰,故随着表演录制的背景音频的播放节奏的变化,自动更换虚拟对象装配的表演服饰,使得虚拟对象的表演服饰与背景音频的播放节奏相对应,如此,在表演录制过程中,虚拟对象装备的表演服饰随着背景音频的播放节奏的变化而变化,使得虚拟对象装备的表演服饰与背景音频的播放节奏达到很好的呼应,提高了彼此之间的适配度;而且这种表演服饰的更换方式相较于手动切换所要更换的表演服饰而言,大大提高了表演服饰的更换效率。

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116764240B_ABST
    Figure CN116764240B_ABST
Patent Text Reader

Abstract

The application provides a performance recording method and device in a virtual scene, equipment, a computer readable storage medium and a computer program product; the method comprises the following steps: in a performance recording interface of a virtual scene, a virtual object equipped with performance costumes and an audio control for selecting background audio are displayed; in response to an audio selection operation triggered based on the audio control, the selected target audio is used as the background audio of the performance recording; wherein the target audio comprises at least two playing rhythms, and different playing rhythms are associated with different performance costumes; in the process of performing recording based on the performance recording interface, the background audio is played, and the performance action of the virtual object following the background audio is displayed; when the playing rhythm of the background audio changes, the performance costumes equipped by the virtual object are automatically replaced, so that the performance costumes of the virtual object correspond to the playing rhythm of the background audio. Through the application, the replacement efficiency of the performance costumes can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to human-computer interaction technology, and more particularly to a method, apparatus, device, computer-readable storage medium, and computer program product for recording performances in a virtual scene. Background Technology

[0002] In virtual scene (such as game) performance recording applications, users can control virtual objects to change their performance costumes (such as clothes or accessories) during the performance recording process. In related technologies, changing the performance costumes of virtual objects during performance recording requires first matching multiple sets of performance costumes and then manually changing the costumes, which is inefficient. Summary of the Invention

[0003] This application provides a method, apparatus, device, computer-readable storage medium, and computer program product for recording performances in a virtual scene, which can improve the efficiency of changing performance costumes.

[0004] The technical solution of this application embodiment is implemented as follows: This application provides a method for recording a performance in a virtual scene, including: The virtual scene performance recording interface displays a virtual object equipped with performance costumes, as well as audio controls for selecting background audio. In response to an audio selection operation triggered by the audio control, the selected target audio is used as the background audio for the performance recording; wherein, the target audio includes at least two playback rhythms, and different playback rhythms are associated with different performance costumes; During the performance recording process based on the performance recording interface, the background audio is played, and the performance actions performed by the virtual object in response to the background audio are displayed. When the playback rhythm of the background audio changes, the performance costume of the virtual object is automatically changed so that the performance costume of the virtual object corresponds to the playback rhythm of the background audio.

[0005] This application provides a performance recording device in a virtual scene, including: The display module is used to display virtual objects equipped with performance costumes and audio controls for selecting background audio in the performance recording interface of the virtual scene. The selection module is used to respond to an audio selection operation triggered by the audio control and use the selected target audio as the background audio for the performance recording; wherein, the target audio includes at least two playback rhythms, and different playback rhythms are associated with different performance costumes; The recording module is used to play the background audio and display the performance actions performed by the virtual object in response to the background audio during the performance recording process based on the performance recording interface. The replacement module is used to automatically change the performance costume of the virtual object when the playback rhythm of the background audio changes, so that the performance costume of the virtual object corresponds to the playback rhythm of the background audio.

[0006] In the above scheme, before using the selected target audio as background audio for performance recording, the device further includes: an association establishment module, used to display an association setting interface for the target audio in response to an association setting operation for the target audio; in the association setting interface for the target audio, displaying at least two performance costumes for associating the target audio and rhythm indication information of the target audio, the rhythm indication information being used to indicate the playback rhythm of the target audio; and in response to a performance costume association operation triggered based on the rhythm indication information, establishing an association relationship between the target performance costume indicated by the performance costume association operation and the target playback rhythm.

[0007] In the above scheme, before displaying at least two performance costumes for associating the target audio in the association settings interface of the target audio, the device further includes: a first costume determination module, used to display a performance costume setting interface for setting the performance costumes equipped by the virtual object; the performance costume setting interface displays at least two candidate performance costumes that can be selected; in response to a selection operation for a target number of candidate performance costumes among the at least two candidate performance costumes, the target number of candidate performance costumes are determined as performance costumes for associating the target audio.

[0008] In the above scheme, before displaying at least two performance costumes for associating the target audio in the association settings interface of the target audio, the device further includes: a second costume determination module, used to display a performance costume setting interface for setting the performance costumes equipped by the virtual object; when the performance costumes are displayed in the form of a performance costume set, at least two types of selectable costume accessories are displayed in the performance costume setting interface; in response to the selection operation of the target type costume accessory among the at least two types of costume accessories, the selected target type costume accessories are combined; and the combined performance costume set is determined as the performance costume for associating the target audio.

[0009] In the above scheme, before displaying at least two performance costumes for associating the target audio in the association settings interface of the target audio, the device further includes: a third costume determination module, used to display a performance costume setting interface for setting the performance costumes equipped by the virtual object; when the performance costume is displayed in the form of a performance costume set, at least two accessory controls corresponding to the performance costume set are displayed in the performance costume setting interface, and different accessory controls correspond to different types of costume accessories; the following operations are performed for each accessory control: in response to a trigger operation on the accessory control, at least one candidate costume accessory of the corresponding type is displayed; in response to a selection operation on a target accessory among the at least one candidate accessory, the target accessory is determined as the accessory selected by the accessory control; the accessories selected by each accessory control are combined to obtain a corresponding performance costume set, and the performance costume set is determined as the performance costume for associating the target audio.

[0010] In the above scheme, the association establishment module is further configured to display the playback timeline of the target audio, display at least two rhythm point slots corresponding to the playback rhythm of the target audio in the playback timeline, and use the rhythm point slots as the rhythm indication information; wherein, the rhythm point slots are used to carry the performance costumes to be associated; upon receiving a drag operation for the target performance costume among the at least two performance costumes, when the drag operation indicates that the target performance costume is dragged to the target rhythm point slot, the drag operation is determined as the performance costume association operation; in response to the performance costume association operation, an association relationship is established between the target performance costume and the target playback rhythm corresponding to the target rhythm point slot.

[0011] In the above scheme, the association establishment module is further configured to display at least two change moments indicating a change in the playback rhythm of the target audio, and display the rhythm indication information in the association area of ​​the change moments; in response to a selection operation of the target rhythm indication information corresponding to the target change moment among the at least two change moments, display at least two performance costume options corresponding to the target rhythm indication information, wherein each performance costume option corresponds to one performance costume; in response to a selection operation of the target performance costume option among the at least two performance costume options, control the target performance costume corresponding to the target performance costume option to be in a selected state; in response to a confirmation operation of the target performance costume, receive the performance costume association operation; and in response to the performance costume association operation, establish an association relationship between the target performance costume and the target playback rhythm corresponding to the target change moment.

[0012] In the above scheme, the association establishment module is further configured to, in response to a selection operation of a target performance costume among the at least two performance costumes, display at least one playback rhythm option corresponding to the target performance costume, and use each playback rhythm option as the rhythm indication information; in response to a selection operation of a target playback rhythm option among the at least one playback rhythm option, control the target playback rhythm corresponding to the target playback rhythm option to be in a selected state; in response to a determination operation of the target playback rhythm, receive the performance costume association operation; and in response to the performance costume association operation, establish an association relationship between the target performance costume and the target playback rhythm.

[0013] In the above scheme, the association establishment module is further configured to display at least two playback rhythms included in the target audio, and use the at least two playback rhythms as the rhythm indication information; in response to a selection operation for a target playback rhythm among the at least two playback rhythms, display recommendation information for recommending performance costumes associated with the target playback rhythm, the recommendation information including recommended target performance costumes; in response to a confirmation operation for the recommendation information, receive the performance costume association operation; and in response to the performance costume association operation, establish an association relationship between the target performance costume and the target playback rhythm.

[0014] In the above scheme, before displaying the rhythm indication information of the target audio, the device further includes: a generation module, used to perform rhythm point detection on the target audio to obtain at least two rhythm points included in the target audio; and to generate rhythm indication information of the target audio based on each of the rhythm points.

[0015] In the above scheme, before using the selected target audio as the background audio for performance recording, the association establishment module is further used to perform rhythm recognition on the target audio to obtain at least two playback rhythms corresponding to the target audio; obtain at least two performance costumes for associating the background audio, and match each performance costume with each playback rhythm to obtain the corresponding matching degree; obtain at least two costume rhythm pairs corresponding to when the matching degree reaches the matching degree threshold, wherein each costume rhythm pair includes a performance costume and a playback rhythm; and establish the association relationship between the performance costume and the playback rhythm in each costume rhythm pair.

[0016] In the above scheme, the recording module is further configured to display the performance actions performed by the virtual object equipped with the first performance costume in response to the background audio; the switching module is further configured to, when the playback rhythm of the background audio changes, acquire the second performance costume associated with the playback rhythm of the background audio after the change in playback rhythm; automatically switch the performance costume equipped by the virtual object from the first performance costume to the second performance costume, and display the performance actions performed by the virtual object equipped with the second performance costume in response to the background audio.

[0017] In the above scheme, the replacement module is further configured to display the playback timeline of the background audio during playback, and display the target performance costume associated with the changed playback rhythm at the change point in the playback timeline; when the background audio plays to the change point, the performance costume equipped by the virtual object is automatically replaced with the target performance costume, and the performance actions performed by the virtual object equipped with the target performance costume following the background audio are displayed until the background audio plays to the next change point.

[0018] In the above scheme, the device further includes: a scaling module, used to determine the scaling ratio of the recorded performance footage that matches the playback rhythm of the background audio when automatically changing the performance costumes of the virtual object; and to display the recorded performance footage according to the corresponding scaling ratio as the playback rhythm of the background audio changes, so that the scaling ratio of the performance footage corresponds to the playback rhythm.

[0019] This application provides an electronic device, including: Memory, used to store executable instructions; The processor, when executing executable instructions stored in the memory, implements the performance recording method in the virtual scene provided in the embodiments of this application.

[0020] This application provides a computer-readable storage medium storing executable instructions for implementing the performance recording method in a virtual scene provided in this application when executed by a processor.

[0021] This application provides a computer program product, including a computer program or instructions, which, when executed by a processor, implements the performance recording method in a virtual scene provided in this application.

[0022] The embodiments of this application have the following beneficial effects: By applying the embodiments of this application, during the performance recording process in a virtual scene, since the selected background audio for performance recording includes multiple playback rhythms, and different playback rhythms are associated with different performance costumes, the performance costumes equipped by the virtual object are automatically changed as the playback rhythm of the background audio changes, so that the performance costumes of the virtual object correspond to the playback rhythm of the background audio. In this way, during the performance recording process, the performance costumes equipped by the virtual object change with the playback rhythm of the background audio, so that the performance costumes equipped by the virtual object and the playback rhythm of the background audio achieve a good correspondence, improving the compatibility between them; moreover, this method of changing performance costumes greatly improves the efficiency of changing performance costumes compared to manually switching the performance costumes to be changed. Attached Figure Description

[0023] Figure 1A This is a schematic diagram illustrating the application mode of the performance recording method in a virtual scene provided in the embodiments of this application; Figure 1B This is a schematic diagram illustrating the application mode of the performance recording method in a virtual scene provided in the embodiments of this application; Figure 2 This is a schematic diagram of the structure of the terminal device 400 provided in the embodiments of this application; Figure 3 A flowchart illustrating the performance recording method in a virtual scene provided in this application embodiment; Figure 4 A schematic diagram illustrating the determination of performance costumes provided in an embodiment of this application; Figure 5 This is a schematic diagram illustrating the association settings of background audio provided in an embodiment of this application; Figure 6 A schematic diagram showing the performance recording provided in an embodiment of this application; Figure 7 This is a schematic diagram of a performance recording provided in an embodiment of this application; Figure 8 A schematic diagram illustrating the setup of performance costumes provided in an embodiment of this application; Figure 9 A schematic diagram illustrating the setup of performance costumes provided in an embodiment of this application; Figure 10 This is a schematic diagram illustrating the association settings of background audio provided in an embodiment of this application; Figure 11 This is a schematic diagram showing a performance recording provided in an embodiment of this application. Detailed Implementation

[0024] To make the objectives, technical solutions, and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings. The described embodiments should not be regarded as limitations on this application. All other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0025] In the following description, references are made to “some embodiments,” which describe a subset of all possible embodiments. However, it is understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0026] In the following description, the terms “first, second…” are used merely to distinguish similar objects and do not represent a specific ordering of objects. It is understood that “first, second…” may be interchanged in a specific order or sequence where permitted, so that the embodiments of this application described herein can be implemented in an order other than that illustrated or described herein.

[0027] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of this application only and is not intended to limit this application.

[0028] Before providing a further detailed description of the embodiments of this application, the nouns and terms involved in the embodiments of this application will be explained, and the nouns and terms involved in the embodiments of this application shall be interpreted as follows.

[0029] 1) Client: An application that runs on a terminal and provides various services, such as a video playback client or a game client.

[0030] 2) In response, used to indicate the conditions or states on which the operation performed depends. When the conditions or states on which it depends are met, one or more operations performed may be performed in real time or with a set delay. Unless otherwise specified, there is no restriction on the order in which the multiple operations are performed.

[0031] 3) A virtual scene is a virtual scene displayed (or provided) by an application when it runs on a terminal. This virtual scene can be a simulation of the real world, a semi-simulated / semi-fictional virtual environment, or a purely fictional virtual environment. A virtual scene can be any of a two-dimensional, 2.5-dimensional, or three-dimensional virtual scene; this application does not limit the dimension of the virtual scene. For example, the virtual scene may include sky, land, ocean, etc., and the land may include environmental elements such as deserts and cities. Users can control virtual objects to move within the virtual scene.

[0032] 4) Virtual objects: These are interactive images of people and things within a virtual scene, or movable objects within the virtual scene. These movable objects can be virtual characters, virtual animals, anime characters, etc., such as people and animals displayed in a virtual scene. A virtual object can be a virtual avatar representing the user within the virtual scene. A virtual scene can include multiple virtual objects, each with its own shape and volume, occupying a portion of the virtual scene's space. Virtual objects can be game characters controlled by the user (or player), meaning they are controlled by the real user and will move in response to the real user's actions on controllers (including touchscreens, voice-activated switches, keyboards, mice, and joysticks). For example, when the real user moves the joystick to the left, the virtual object will move to the left in the virtual scene. It can also remain stationary, jump, and use various functions (such as skills and items).

[0033] This application provides a method, apparatus, electronic device, computer-readable storage medium, and computer program product for recording performances in a virtual scene, which can improve the efficiency of changing performance costumes. To facilitate a clearer understanding of the method for recording performances in a virtual scene provided in this application, exemplary implementation scenarios are first described. The virtual scene in the method can be entirely output based on an electronic device, or based on a combination of an electronic device and a server. In some embodiments, the virtual scene can be an environment for game characters to interact, such as a space for game characters to battle. By controlling the actions of the game characters, interaction can occur between the two characters in the virtual scene, allowing users to relieve stress during gameplay.

[0034] In one implementation scenario, see Figure 1A , Figure 1A This diagram illustrates the application mode of the performance recording method in a virtual scene provided in this application embodiment. It is applicable to application modes where the computational power of the graphics processing hardware of the terminal device 400 is sufficient to complete the relevant data calculations of the virtual scene 100, such as stand-alone / offline games, where the output of the virtual scene is completed through various types of terminal devices 400, such as smartphones, tablets, and virtual reality / augmented reality devices. As an example, the types of graphics processing hardware include central processing units (CPUs) and graphics processing units (GPUs).

[0035] When visual perception of virtual scene 100 is formed, terminal device 400 calculates the data required for display through graphics computing hardware, and completes the loading, parsing and rendering of display data. The graphics output hardware outputs video frames that can form visual perception of virtual scene. For example, two-dimensional video frames are presented on the display screen of a smartphone, or video frames that achieve three-dimensional display effect are projected on the lenses of augmented reality / virtual reality glasses. In addition, in order to enrich the perception effect, terminal device 400 can also use different hardware to form one or more of auditory perception, tactile perception, motion perception and taste perception.

[0036] As an example, a client 410 (e.g., a standalone game application) runs on the terminal device 400. During the operation of the client 410, the output includes a virtual scene 100 for role-playing. The virtual scene 100 can be an environment for game characters to interact with, such as a plain, street, valley, etc., for game characters to fight. The virtual scene 100 includes virtual objects 110 for performance recording.

[0037] As an example, in a performance recording interface of a virtual scene, an electronic device displays a virtual object equipped with performance costumes and an audio control for selecting background audio. In response to an audio selection operation triggered by the audio control, the selected target audio is used as the background audio for performance recording. The target audio includes at least two playback rhythms, with different playback rhythms associated with different performance costumes. During performance recording based on the performance recording interface, the background audio is played, and the performance actions performed by the virtual object following the background audio are displayed. When the playback rhythm of the background audio changes, the performance costume equipped on the virtual object is automatically changed, so that the performance costume of the virtual object corresponds to the playback rhythm of the background audio. Thus, since the selected background audio for performance recording is associated with performance costumes corresponding to the playback rhythm, the automatic change of the performance costume equipped on the virtual object as the playback rhythm of the background audio changes greatly improves the efficiency of costume changing compared to manually switching the performance costume.

[0038] In another implementation scenario, see Figure 1B , Figure 1BThis is a schematic diagram illustrating the application mode of the performance recording method in a virtual scene provided in this application embodiment. It is applied to a terminal device 400 and a server 200, and is suitable for application modes that rely on the computing power of the server 200 to complete virtual scene calculations and output the virtual scene to the terminal device 400. Taking the visual perception of forming a virtual scene 100 as an example, the server 200 calculates relevant display data (e.g., scene data) for the virtual scene and sends it to the terminal device 400 via the network 300. The terminal device 400 relies on graphics computing hardware to load, parse, and render the calculated display data, and relies on graphics output hardware to output the virtual scene to form visual perception. For example, it can present two-dimensional video frames on the display screen of a smartphone, or project video frames to achieve a three-dimensional display effect onto the lenses of augmented reality / virtual reality glasses. Regarding the perception of the form of the virtual scene, it can be understood that it can be achieved through the corresponding hardware output of the terminal device 400, such as using a microphone to form auditory perception, using a vibrator to form tactile perception, etc.

[0039] As an example, a client 410 (e.g., a standalone game application) runs on the terminal device 400. During the operation of the client 410, the output includes a virtual scene 100 for role-playing. The virtual scene 100 can be an environment for game characters to interact with, such as a plain, street, valley, etc., for game characters to fight. The virtual scene 100 includes virtual objects 110 for performance recording.

[0040] As an example, in a performance recording interface of a virtual scene, an electronic device displays a virtual object equipped with performance costumes and an audio control for selecting background audio. In response to an audio selection operation triggered by the audio control, the selected target audio is used as the background audio for performance recording. The target audio includes at least two playback rhythms, with different playback rhythms associated with different performance costumes. During performance recording based on the performance recording interface, the background audio is played, and the performance actions performed by the virtual object following the background audio are displayed. When the playback rhythm of the background audio changes, the performance costume equipped on the virtual object is automatically changed, so that the performance costume of the virtual object corresponds to the playback rhythm of the background audio. Thus, since the selected background audio for performance recording is associated with performance costumes corresponding to the playback rhythm, the automatic change of the performance costume equipped on the virtual object as the playback rhythm of the background audio changes greatly improves the efficiency of costume changing compared to manually switching the performance costume.

[0041] In some embodiments, the terminal device 400 can implement the performance recording method in the virtual scene provided in this application embodiment by running a computer program. For example, the computer program can be a native program or software module in the operating system; it can be a native application (APP), that is, a program that needs to be installed in the operating system to run, such as a shooting game APP (i.e., the client 410 mentioned above); it can also be a mini-program, that is, a program that only needs to be downloaded into the browser environment to run; or it can be a game mini-program that can be embedded in any APP. In short, the above-mentioned computer program can be any form of application, module or plugin.

[0042] Taking a computer program as an example, in actual implementation, the terminal device 400 has an application that supports virtual scenes installed and running. This application can be any of the following: a first-person shooter (FPS) game, a third-person shooter game, a virtual reality application, a 3D map program, a simulation program, or a multiplayer shooting survival game. Users use the terminal device 400 to manipulate virtual objects located in the virtual scene, and these activities include, but are not limited to: adjusting body posture, crawling, walking, running, riding, jumping, driving, picking up items, shooting, attacking, throwing, and constructing virtual buildings—at least one of these. Illustratively, the virtual object can be a virtual character, such as a realistic or anime character.

[0043] In other embodiments, the embodiments of this application can also be implemented with the aid of cloud technology, which refers to a hosting technology that unifies a series of resources such as hardware, software, and networks within a wide area network or local area network to realize the computation, storage, processing, and sharing of data.

[0044] Cloud technology is a general term encompassing network technology, information technology, integration technology, management platform technology, and application technology based on the cloud computing business model. It can form resource pools, allowing for on-demand use with flexibility and convenience. Cloud computing technology will become a crucial support. The backend services of cloud computing systems require substantial computing and storage resources.

[0045] Example, Figure 1BThe server 200 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms. The terminal device 400 can be a smartphone, tablet, laptop, desktop computer, smart speaker, smartwatch, etc., but is not limited to these. The terminal device 400 and the server 200 can be directly or indirectly connected via wired or wireless communication, which is not limited in this embodiment.

[0046] The following is about Figure 1A The structure of the terminal device 400 shown in the diagram will be described. See also... Figure 2 , Figure 2 This is a schematic diagram of the structure of the terminal device 400 provided in the embodiments of this application. Figure 2 The terminal device 400 shown includes at least one processor 420, a memory 460, at least one network interface 430, and a user interface 440. The various components in the terminal device 400 are coupled together via a bus system 450. It is understood that the bus system 450 is used to implement communication between these components. In addition to a data bus, the bus system 450 also includes a power bus, a control bus, and a status signal bus. However, for clarity, ... Figure 2 The general labeled all buses as Bus System 450.

[0047] Processor 420 can be an integrated circuit chip with signal processing capabilities, such as a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor can be a microprocessor or any conventional processor.

[0048] User interface 440 includes one or more output devices 441 that enable the presentation of media content, including one or more speakers and / or one or more visual displays. User interface 440 also includes one or more input devices 442, including user interface components that facilitate user input, such as a keyboard, mouse, microphone, touch screen display, camera, other input buttons and controls.

[0049] The memory 460 may be removable, non-removable, or a combination thereof. Exemplary hardware devices include solid-state storage, hard disk drives, optical disk drives, etc. The memory 460 may optionally include one or more storage devices physically located away from the processor 420.

[0050] The memory 460 may include volatile memory or non-volatile memory, or both. The non-volatile memory may be read-only memory (ROM), and the volatile memory may be random access memory (RAM). The memory 460 described in this application embodiment is intended to include any suitable type of memory.

[0051] In some embodiments, memory 460 is capable of storing data to support various operations, examples of which include programs, modules, and data structures or subsets or supersets thereof, as illustrated below.

[0052] Operating system 461 includes system programs for handling various basic system services and performing hardware-related tasks, such as the framework layer, core library layer, driver layer, etc., for implementing various basic business functions and handling hardware-based tasks; The network communication module 462 is used to reach other computing devices via one or more (wired or wireless) network interfaces 430, exemplary network interfaces 430 including: Bluetooth, WiFi, and Universal Serial Bus (USB), etc. Presentation module 463 is configured to enable the presentation of information (e.g., a user interface for operating peripheral devices and displaying content and information) via one or more output devices 441 (e.g., a display screen, a speaker, etc.) associated with user interface 440. The input processing module 464 is used to detect and translate one or more user inputs or interactions from one or more input devices 442.

[0053] In some embodiments, the performance recording device in the virtual scene provided in this application can be implemented in software. Figure 2 A performance recording device 465 in a virtual scene stored in memory 460 is shown. It can be software in the form of programs and plug-ins, including the following software modules: display module 4651, selection module 4652, recording module 4653 and replacement module 4654. These modules are logical and can therefore be arbitrarily combined or further divided according to the functions they implement. The functions of each module will be described below.

[0054] In other embodiments, the performance recording device in the virtual scene provided in this application can be implemented in hardware. As an example, the performance recording device in the virtual scene provided in this application can be a processor in the form of a hardware decoding processor, which is programmed to execute the performance recording method in the virtual scene provided in this application. For example, the processor in the form of a hardware decoding processor can be one or more application-specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), complex programmable logic devices (CPLDs), field-programmable gate arrays (FPGAs), or other electronic components.

[0055] The performance recording method in a virtual scene provided in this application embodiment will now be described in detail with reference to the accompanying drawings. Figure 1A The terminal device 400 can be executed independently, or it can be... Figure 1B The terminal device 400 and server 200 work together to execute the command. Next, the command will be executed by… Figure 1A The following description uses the example of a terminal device 400 executing the performance recording method in a virtual scene provided in this application embodiment. See also... Figure 3 , Figure 3 This is a flowchart illustrating the performance recording method in a virtual scene provided in the embodiments of this application, which will be combined with... Figure 3 The steps shown are explained.

[0056] It should be noted that, Figure 3 The method shown can be executed by various forms of computer programs running on the terminal device 400, and is not limited to the client 410 described above. It can also be the operating system 461, software modules and scripts described above. Therefore, the client should not be regarded as a limitation on the embodiments of this application.

[0057] Step 101: The terminal device displays a virtual object equipped with performance costumes and an audio control for selecting background audio in the performance recording interface of the virtual scene.

[0058] In the context of virtual scenarios (such as games), virtual object costumes refer to the model of the costume being superimposed on the corresponding position of the virtual object model.

[0059] Before starting the performance recording, users can configure the performance attire worn by the virtual object during the virtual scene recording. At the start of the recording, the performance attire worn by the virtual object can be the clothing or accessories initially equipped (default equipment) of the virtual object. Performance attire can be attached to or detached from the virtual object; for example, it can be clothing worn by the virtual object (such as a shirt, shoes, etc.), accessories worn by the virtual object (such as glasses, necklaces, helmets, etc.), or even the virtual object's skin color, hair color, and hairstyle. In practical applications, the performance attire equipped by the virtual object can exist as a single clothing accessory (such as one of clothes, shoes, or hairstyle), or it can exist as a set of clothing (such as a combination of clothes, shoes, and hairstyle).

[0060] Step 102: In response to the audio selection operation triggered by the audio control, use the selected target audio as the background audio for the performance recording.

[0061] The target audio includes at least two playback rhythms, with different playback rhythms associated with different performance costumes.

[0062] Here, during performance recording, the background audio for the performance recording is selected through the audio control. When the user clicks the audio control, the terminal device responds to the click operation, displays the background audio selection interface, and displays at least one audio to choose from. The user can select an audio as the background audio through the background audio selection interface. If the user selects a target audio, the target audio will be used as the background audio for the performance recording.

[0063] It should be noted that in practical applications, background audio can be not only audio outside the scene (such as the locally stored audio or network-stored audio selected above), but also audio within the scene, such as audio in a virtual scene during performance recording. This audio within the scene is part of the performance content being recorded. For example, during the performance recording, if a virtual object is singing or shouting in the recorded performance content, or other audio in the virtual scene besides the audio emitted by the virtual object, such as the sound of a virtual object using virtual props to attack enemies or other special effects audio, then this type of audio within the virtual scene is considered background audio. For this type, during the performance recording process, the terminal device can intelligently determine the performance costume that matches the playback rhythm of the background audio, and automatically change the performance costume equipped by the virtual object when the playback rhythm of the background audio changes, so that the performance costume equipped by the virtual object corresponds to the playback rhythm of the background audio.

[0064] In some embodiments, before performance recording or before using the selected target audio as background audio for performance recording, the terminal device may establish an association between the playback rhythm of the target audio and the corresponding performance costume in the following manner: in response to an association setting operation for the target audio, displaying an association setting interface for the target audio; in the association setting interface for the target audio, displaying at least two performance costumes for associating the target audio and rhythm indication information for the target audio, the rhythm indication information indicating the playback rhythm of the target audio; in response to a performance costume association operation triggered based on the rhythm indication information, establishing an association between the target performance costume indicated by the performance costume association operation and the target playback rhythm.

[0065] Here, before using the target audio as background audio, it is necessary to associate the target audio with performance costumes. For example, when a user clicks the audio association control, the terminal device responds to the click operation, receives the association setting operation for the target audio, and responds to the association setting operation, displays the rhythm indication information of the target audio and at least two pre-set performance costumes equipped for recording the performance of the virtual object. Based on the rhythm indication information of the target audio and the candidate at least two performance costumes, the corresponding performance costume association operation can be triggered, and then the association relationship between the playback rhythm and the performance costume can be established based on the performance costume association operation. For example, the performance costume association operation indicates that the playback rhythm 1 is associated with performance costume 1, that is, the association relationship between playback rhythm 1 and performance costume 1 is established. In this way, during the performance recording process, when the playback rhythm of the target audio (background audio) changes to playback rhythm 1, the performance costume originally equipped by the virtual object (the performance costume equipped before the playback rhythm changes to playback rhythm 1) is automatically replaced with performance costume 1.

[0066] In some embodiments, before the terminal device displays the rhythm indication information of the target audio, it may perform rhythm point detection on the target audio to obtain at least two rhythm points included in the target audio; and generate rhythm indication information of the target audio based on each rhythm point.

[0067] Here, after the terminal device acquires the target audio, it performs rhythm point detection on the target audio to obtain multiple rhythm points included in the target audio. For example, it performs sampling processing on the target audio based on sampling windows to obtain audio data corresponding to multiple sampling windows. Based on the audio data corresponding to each sampling window, it determines the energy spectrum corresponding to each sampling window. Based on the energy spectrum corresponding to each sampling window, it determines multiple rhythm points of the target audio. Then, it generates corresponding rhythm indication information based on each rhythm point. For example, the rhythm indication information corresponding to rhythm point 1 is that the rhythm is strong, the rhythm indication information corresponding to rhythm point 2 is that the rhythm is weak, and so on.

[0068] When performing rhythm detection, the terminal device can perform rhythm detection on the audio data based on signal processing. In practical applications, music is generally sampled 44,100 times per second, resulting in 44,100 samples per second. If 1,024 samples are used as a window, there will be approximately 44 windows per second. Therefore, a 3-minute audio file would have approximately 7,920 windows. The energy spectrum of the sampling window is used to determine whether the sampling window is a rhythm point. During the rhythm detection process, the density of the rhythm can also be adjusted by limiting a threshold, thus detecting stronger rhythms and ignoring weaker rhythms.

[0069] In some embodiments, the terminal device may determine the rhythm point by: performing a Fourier transform on the audio data corresponding to each sampling window to obtain the audio spectrum of each sampling window; determining the difference in the audio spectrum of adjacent sampling windows in the audio data of the target video; determining the energy spectrum of each sampling window based on the difference; obtaining the energy spectrum of a preset number of sampling windows from multiple sampling windows; performing a weighted average on the energy spectra of the preset number of sampling windows to obtain the corresponding energy spectrum mean; multiplying the energy spectrum mean by a scaling factor to obtain the corresponding energy spectrum threshold; and determining the sampling window whose energy spectrum is greater than the energy spectrum threshold as the rhythm point.

[0070] In practical applications, audio data is a chaotic waveform signal in the time domain. To facilitate analysis, the audio data in the time domain can be converted to the frequency domain through a fast Fourier transform to obtain the audio spectrum of the corresponding audio data. Then, based on the obtained audio spectrum, the difference between the audio spectra corresponding to adjacent sampling windows can be calculated. Based on the multiple differences obtained, the energy spectrum corresponding to each sampling window can be determined. For example, the difference obtained by subtracting the audio spectrum corresponding to the previous adjacent sampling window from the audio spectrum corresponding to the current sampling window can be used to determine the energy spectrum corresponding to the current sampling window.

[0071] In some embodiments, before displaying at least two performance costumes for associating with the target audio in the association settings interface of the target audio, the terminal device may determine the performance costumes for associating with the target audio in the following manner: displaying a performance costume settings interface for setting performance costumes for virtual object equipment; displaying at least two candidate performance costumes available for selection in the performance costume settings interface; and determining the target number of candidate performance costumes as performance costumes for associating with the target audio in response to a selection operation for a target number of candidate performance costumes among the at least two candidate performance costumes.

[0072] See Figure 4 , Figure 4This is a schematic diagram illustrating the determination of performance costumes provided in an embodiment of this application. The terminal device displays a costume control 401 in the performance recording interface for setting performance costumes equipped by virtual objects. In response to a trigger operation on the costume control 401, the terminal device displays a performance costume setting interface 402, and displays multiple candidate performance costumes, such as candidate performance costume 1 to candidate performance costume 5, in the performance costume setting interface 402. In response to a selection operation on a target number of candidate performance costumes (such as candidate performance costume 2 to candidate performance costume 4), candidate performance costume 2 to candidate performance costume 4 are determined as performance costumes used to associate with the target audio.

[0073] In some embodiments, before displaying at least two performance costumes for associating with the target audio in the association settings interface of the target audio, the terminal device may determine the performance costumes for associating with the target audio in the following manner: displaying a performance costume settings interface for setting performance costumes for virtual object equipment; when the performance costumes are displayed in the form of a performance costume set, displaying at least two types of selectable clothing accessories in the performance costume settings interface; in response to a selection operation for a clothing accessory of a target type among the at least two types of clothing accessories, combining the selected clothing accessories of the target type; and determining the combined performance costume set as the performance costume for associating with the target audio.

[0074] Here, when the performance costumes are displayed as performance costume sets, the performance costume settings interface displays at least two types of costume accessories to choose from, such as clothing accessories, shoe accessories, sock accessories, hairstyle accessories, etc. You can select the target type of costume accessories to combine to obtain multiple performance costume sets. For example, you can select clothing accessories and shoe accessories to combine to obtain performance costume set 1, and select shoe accessories, sock accessories, and hairstyle accessories to combine to obtain performance costume set 2. The combined performance costume set 1 and performance costume set 2 are then designated as the performance costumes used to associate with the target audio.

[0075] In some embodiments, before displaying at least two performance costumes for associating with the target audio in the association settings interface of the target audio, the terminal device may determine the performance costumes for associating with the target audio in the following manner: displaying a performance costume settings interface for setting performance costumes for virtual object equipment; when the performance costumes are displayed in the form of a performance costume set, displaying at least two accessory controls corresponding to the performance costume set in the performance costume settings interface, with different accessory controls corresponding to different types of clothing accessories; performing the following operations for each accessory control: in response to a trigger operation on the accessory control, displaying at least one candidate clothing accessory of the corresponding type; in response to a selection operation on a target accessory among the at least one candidate accessory, determining the target accessory as the accessory selected by the accessory control; combining the accessories selected by each accessory control to obtain the corresponding performance costume set, and determining the obtained performance costume set as the performance costume for associating with the target audio.

[0076] Here, when the performance costumes are displayed as a set, the performance costume settings interface displays at least two accessory controls corresponding to the set. Different accessory controls correspond to different types of costume accessories, such as a hairstyle control corresponding to hairstyle accessories, and a clothing control corresponding to clothing accessories. When setting up each performance costume set, a corresponding setting method can be used. For example, each performance costume set includes four costume accessories (corresponding to hairstyle, clothing, socks, and shoes). When setting up performance costume set 1, when the user clicks the hairstyle control, the terminal responds to the click operation and displays multiple hairstyles to choose from. For example, hairstyles 1, 2, and 3. When the user selects hairstyle 3, it becomes the hairstyle accessory in performance costume set 1. When the user clicks the clothing control, the terminal responds to the click operation and displays multiple selectable clothing items, such as clothing 1, clothing 2, clothing 3, and clothing 4. When the user selects clothing 2, it becomes the clothing accessory in performance costume set 1. Similarly, assuming socks 2 are selected as the sock accessory in performance costume set 1, and performance shoes 1 are selected as the shoe accessory in set 1, then hairstyle 3, clothing 2, socks 2, and shoes 1 are combined to obtain performance costume set 1. In this way, performance costume sets 2, ..., and N (N>2, which can be set according to the actual application) can be obtained. Ultimately, the combined performance costume sets 1, ..., and N are used as performance costumes for recording performances of virtual objects in a virtual scene.

[0077] It should be noted that, in setting up performance costume sets, in some embodiments, the number of accessories included in different performance costume sets can be different. For example, performance costume set 1 has 3 accessories (corresponding to hairstyle, clothes, and socks), while performance costume set 2 has 4 accessories (corresponding to hairstyle, clothes, socks, and shoes). Thus, the types of accessories included in performance costume set 1 and performance costume set 2 can not be completely the same. In other embodiments, although different performance costume sets include the same number of accessories, the types of accessories included can be different. There are four accessories corresponding to costume set 1 (hairstyle, clothes, socks, and glasses), and four accessories corresponding to performance costume set 2 (hairstyle, clothes, socks, and shoes). Thus, the types of accessories included in performance costume set 1 and performance costume set 2 may not be exactly the same. In some other embodiments, if a certain accessory control is not clicked, the accessory indicated by that accessory control is set to empty by default. For example, when setting performance costume set 1, if the user does not click the hairstyle accessory, the hairstyle in performance costume set 1 is not set by default. In this case, the hairstyle in performance costume set 1 can be the default hairstyle of the virtual object.

[0078] In some embodiments, the terminal device may display rhythm indication information of the target audio in the following manner: displaying a playback timeline of the target audio, displaying at least two rhythm point slots corresponding to the playback rhythm of the target audio in the playback timeline, and using the rhythm point slots as rhythm indication information; wherein, the rhythm point slots are used to carry the performance costume to be associated; correspondingly, the terminal device may establish an association between the target performance costume indicated by the performance costume association operation and the target playback rhythm in response to a performance costume association operation triggered based on the rhythm indication information in the following manner: receiving a drag operation for the target performance costume among at least two performance costumes, and when the drag operation indicates that the target performance costume is dragged to the target rhythm point slot, determining the drag operation as a performance costume association operation; in response to the performance costume association operation, establishing an association between the target performance costume and the target playback rhythm corresponding to the target rhythm point slot.

[0079] Here, in the playback timeline of the target audio association settings interface, at least two rhythm point slots corresponding to the playback rhythm of the target audio are displayed (used to hold the performance costumes to be associated; the position of the rhythm point slot is the location of the beat, drumbeat, or rhythm point of the target audio, and the playback rhythm corresponding to this position will change, i.e., this position is the position for changing performance costumes); at the same time, in the target audio association settings interface, the performance costumes equipped when recording performances of virtual objects in the game are displayed, such as performance costume set 1, performance costume set 2, performance costume set 3, and performance costume set 4; when the user drags the target performance costume to the target rhythm point slot, the terminal device responds to the drag operation and establishes an association relationship between the target performance costume and the target playback rhythm corresponding to the target rhythm point slot. For example, when the user drags performance costume set 1 to rhythm point slot 1, an association relationship is established between performance costume set 1 and the playback rhythm corresponding to rhythm point slot 1. By using the above method, the relationship between the playback rhythm corresponding to each rhythm slot and the corresponding performance costume can be established. After the target audio is associated and set, it can be used as background audio in the performance recording of virtual objects in the game.

[0080] In some embodiments, the terminal device may display at least two performance costumes for associating with target audio and rhythm indication information of the target audio in the following manner: displaying at least two change moments indicating a change in the playback rhythm of the target audio, and displaying rhythm indication information in the associated area of ​​the change moments; in response to a selection operation for the target rhythm indication information corresponding to the target change moment among the at least two change moments, displaying at least one performance costume option corresponding to the target rhythm indication information, wherein each performance costume option corresponds to one performance costume; correspondingly, the terminal device may establish an association between the target performance costume indicated by the performance costume association operation and the target playback rhythm in response to a performance costume association operation triggered based on the rhythm indication information in the following manner: in response to a selection operation for the target performance costume option among the at least two performance costume options, controlling the target performance costume corresponding to the target performance costume option to be in a selected state; in response to a confirmation operation for the target performance costume, receiving the performance costume association operation; in response to the performance costume association operation, establishing an association between the target performance costume and the target playback rhythm corresponding to the target change moment.

[0081] See Figure 5 , Figure 5This is a schematic diagram of the background audio association settings provided in this application embodiment. The target audio association settings interface displays three points indicating changes in the playback rhythm of the target audio, such as the 10th, 40th, and 70th seconds. The association area for the 10th second displays a "strong" rhythm indicator, the association area for the 40th second displays a "weak" rhythm indicator, and the association area for the 70th second displays a "medium" rhythm indicator. If the user needs to associate the playback rhythm at the 10th second with performance attire, the terminal device responds to the trigger operation of the rhythm indicator information by displaying at least one performance attire option corresponding to the "strong" rhythm indicator. Each performance attire option corresponds to one performance attire; for example, performance attire option 1 corresponds to a performance attire set. Option 1 and Option 2 correspond to Performance Costume Set 2. When the user selects Performance Costume Option 1, a relationship is established between Performance Costume Set 1 and the playback rhythm (strong) at the 10th second of the target audio. Thus, when the target audio is played as background audio to the 10th second, the equipment of the target virtual object is changed to Performance Costume Set 1. In the same way, a relationship can also be established between the playback rhythm (weak) at the 40th second of the target audio and the selected performance costume (such as Performance Costume Set 3), and between the playback rhythm (weak-medium) at the 70th second and the selected performance costume (such as Performance Costume Set 2). After the target audio is associated, it can be used as background audio in the performance recording of virtual objects in the game.

[0082] In some embodiments, the terminal device may display rhythm indication information of the target audio in the following manner: in response to a selection operation of a target performance costume among at least two performance costumes, display at least one playback rhythm option corresponding to the target performance costume, and use each playback rhythm option as rhythm indication information; correspondingly, the terminal device may establish an association between the target performance costume indicated by the performance costume association operation and the target playback rhythm in the following manner in response to a performance costume association operation triggered based on the rhythm indication information: in response to a selection operation of a target playback rhythm option among at least one playback rhythm option, control the target playback rhythm corresponding to the target playback rhythm option to be in a selected state; in response to a determination operation of the target playback rhythm, receive the performance costume association operation; in response to the performance costume association operation, establish an association between the target performance costume and the target playback rhythm.

[0083] Here, the target audio association settings interface displays at least two performance outfits used to associate with the target audio, such as performance outfit set 1, performance outfit set 2, and performance outfit set 4. When the user selects the target performance outfit (such as performance outfit set 2), at least one playback rhythm option that matches the target performance outfit is displayed, and each playback rhythm option serves as rhythm indication information. For example, playback rhythm option 1 indicates a strong playback rhythm, playback rhythm option 2 indicates a moderate playback rhythm, and playback rhythm option 3 indicates a weak playback rhythm. When the user selects playback rhythm option 3, an association is created between performance outfit set 2 and a strong playback rhythm in the target audio (the corresponding playback time is known, such as the 10th second of the target audio, i.e., when the target audio is played as background audio to the 10th second, the equipment of the target virtual object is changed to performance outfit set 2). In the above way, associations between other performance outfits and playback rhythms that match the target audio can be created. After the target audio is associated, it can be used as background audio in the performance recording of virtual objects in the game.

[0084] In some embodiments, the terminal device may display at least two performance costumes for associating with a target audio and rhythm indication information of the target audio in the following manner: displaying at least two playback rhythms included in the target audio, and using the at least two playback rhythms as rhythm indication information; in response to a selection operation for a target playback rhythm among the at least two playback rhythms, displaying recommendation information for recommending performance costumes associated with the target playback rhythm, wherein the recommendation information includes recommended target performance costumes; correspondingly, the terminal device may establish an association between the target performance costume indicated by the performance costume association operation and the target playback rhythm in response to a performance costume association operation triggered based on the rhythm indication information in the following manner: receiving a performance costume association operation in response to a confirmation operation for the recommendation information; and establishing an association between the target performance costume and the target playback rhythm in response to the performance costume association operation.

[0085] Here, the target audio's associated settings interface displays at least two playback rhythms, which are used as rhythm indication information. For example, playback rhythm 1 (with a known playback time, such as the 10th second of the target audio) indicates a strong playback rhythm, playback rhythm 2 (with a known playback time, such as the 40th second of the target audio) indicates a moderate playback rhythm, and playback rhythm 3 (with a known playback time, such as the 70th second of the target audio) indicates a weak playback rhythm. When the user selects a target playback rhythm (such as playback rhythm 1), recommended information including a target performance costume (such as performance costume set 2) is displayed, such as "It is recommended to choose performance costume set 2". The target performance costume is recommended based on the compatibility between the performance costumes (such as performance costume set 1, ..., performance costume set N) worn when recording performances of virtual objects in a virtual scene and the target playback rhythm (such as playback rhythm 1). Performance costumes with a compatibility exceeding the compatibility threshold (such as performance costume set 2) are selected as the target performance costumes included in the recommended information. In practical applications, while presenting recommended information, a "Confirm" button and a "Change" button can also be displayed. When the user triggers the "Confirm" button, the terminal device receives the confirmation operation for the recommended information, which is also the performance costume association operation. In response to this operation, it establishes an association between the target playback rhythm (e.g., playback rhythm 1) and the target performance costume (e.g., performance costume set 2) included in the recommended information. When the user triggers the "Change" button, the terminal device responds by updating and displaying a new recommended information. The target performance costume in the new recommended information is different from the target performance costume in the original recommended information (e.g., performance costume set 3). The user can use the target performance costume in the new recommended information as the performance costume associated with the target playback rhythm. Of course, if the user is still not satisfied with the target performance costume in the new recommended information, they can still trigger the corresponding "Change" button to select a new target performance costume until they are satisfied. Through the above method, an association between other playback rhythms in the target audio and suitable performance costumes can be created. After the target audio is associated, it can be used as background audio for recording the performances of virtual objects in the game.

[0086] In some embodiments, before using the selected target audio as background audio for performance recording, the terminal device may establish the association between the playback rhythms included in the target audio and the corresponding performance costumes in the following manner: performing rhythm recognition on the target audio to obtain at least two playback rhythms corresponding to the target audio; obtaining at least two performance costumes for associating with the background audio, and matching each performance costume with each playback rhythm to obtain the corresponding matching degree; obtaining at least two costume rhythm pairs corresponding to when the matching degree reaches the matching degree threshold, wherein each costume rhythm pair includes a performance costume and a playback rhythm; and establishing the association between the performance costume and the playback rhythm in each costume rhythm pair.

[0087] Here, when setting performance costume associations for the target audio, after the terminal device obtains the selected target audio, it automatically performs rhythm recognition on the target audio to obtain at least two playback rhythms corresponding to the target audio. Each playback rhythm is then matched with the performance costumes (such as performance costume set 1, ..., performance costume set 4) that the user has pre-set for recording performances of virtual objects in a virtual scene. That is, each playback rhythm is paired with each performance costume to obtain multiple costume rhythm pairs, such as costume rhythm pair 1 (playback rhythm 1, performance costume set 1), costume rhythm pair 2 (playback rhythm 1, performance costume set 2), ..., costume rhythm pair 12 (playback rhythm 3, performance costume set 4). The matching degree of each costume rhythm pair is then obtained. For each playback rhythm, the matching degree of each costume rhythm pair containing that playback rhythm is calculated. Select the clothing rhythm pair with the highest matching degree and establish the association between the performance clothing and the playback rhythm in this clothing rhythm pair. For example, for playback rhythm 1 (the corresponding playback time is known, such as the 10th second of the target audio), the clothing rhythm pair with the highest matching degree is clothing rhythm pair 2 (playback rhythm 1, performance clothing set 2). Then, establish the association between playback rhythm 1 and performance clothing set 2 (that is, when the target audio is used as the background audio for performance recording, when the target audio plays to the 10th second, the performance clothing equipped by the virtual object will be automatically changed to performance clothing set 2). In the above way, the association between other playback rhythms in the target audio and the matching performance clothing can be created. After the association settings of the target audio are completed, the target audio can be used as background audio in the performance recording of virtual objects in the game.

[0088] In some embodiments, after the terminal device obtains the selected target audio, it can also input the target audio and the performance costumes (such as the performance costume set 1, ..., performance costume set N mentioned above) that the user has set up for recording performances of virtual objects in a virtual scene into a machine learning model. By using a machine learning model based on artificial intelligence algorithms to associate the target audio with performance costumes, the association setting results can be made more intelligent and accurate, thereby improving the efficiency of associating the target audio with performance costumes and thus improving the efficiency of changing performance costumes.

[0089] Step 103: During the performance recording process based on the performance recording interface, play the background audio and display the performance actions performed by the virtual object in response to the background audio.

[0090] In this application scenario of recording performances of virtual objects in a virtual scene, background audio is played during the recording process, and the performance actions performed by the virtual objects in sync with the background audio are displayed. These performance actions can include at least one action, and the actions within that action are continuous. For example, a single action can be performed continuously and repeatedly, or a sequence of actions can be performed, where the actions are consecutive. As an example, performance actions can be dance movements (including multiple consecutive dance movements), martial arts movements (including multiple consecutive martial arts movements), gymnastics movements (including multiple consecutive gymnastics movements), and so on.

[0091] Step 104: When the playback rhythm of the background audio changes, automatically change the performance costume of the virtual object so that the performance costume of the virtual object corresponds to the playback rhythm of the background audio.

[0092] In some embodiments, before the playback rhythm of the background audio changes, the terminal device can display the performance actions performed by the virtual object following the background audio by displaying the performance actions performed by the virtual object equipped with a first performance costume following the background audio; correspondingly, when the playback rhythm of the background audio changes, the terminal can automatically change the performance costume equipped by the virtual object by obtaining the second performance costume associated with the playback rhythm of the background audio after the playback rhythm changes; automatically switching the performance costume equipped by the virtual object from the first performance costume to the second performance costume, and displaying the performance actions performed by the virtual object equipped with the second performance costume following the background audio.

[0093] In some embodiments, the terminal can also automatically change the performance costume equipped by the virtual object when the playback rhythm of the background audio changes in the following manner: during the playback of the background audio, the playback timeline of the background audio is displayed, and at the moment when the playback rhythm changes in the playback timeline, the target performance costume associated with the changed playback rhythm is displayed; when the background audio plays to the moment of change, the performance costume equipped by the virtual object is automatically changed to the target performance costume, and the performance actions performed by the virtual object equipped with the target performance costume are displayed in accordance with the background audio, until the background audio plays to the next moment of change.

[0094] See Figure 6 , Figure 6 This is a display diagram illustrating the performance recording provided in this application embodiment. At the points where the playback rhythm changes on the background audio playback timeline, the target performance costume associated with the changed playback rhythm is displayed. For example, at playback rhythm 1 (strong), the associated performance costume set 1 is displayed; at playback rhythm 2 (medium), the associated performance costume set 2 is displayed; and at playback rhythm 3 (weak), the associated performance costume set 3 is displayed. During the time period 1 between the background audio playback and playback rhythm 1, the virtual object is equipped with the default costume set. When playback reaches playback rhythm 1, the virtual object's equipped costume is automatically changed from the default set to the performance costume set. 1. The program displays the performance actions of a virtual object equipped with performance costume set 1, following the background audio, until the playback reaches rhythm 2. When the background audio reaches rhythm 2, the virtual object's costume is automatically changed from performance costume set 1 to performance costume set 2, and the performance actions of the virtual object equipped with performance costume set 2 are displayed, following the background audio, until the playback reaches rhythm 3. This process is repeated, achieving the effect of automatically controlling the virtual object to change its performance costume to the corresponding rhythm of the background audio at the corresponding beat points during background audio playback, thus achieving an instantaneous equipment switching effect.

[0095] In some embodiments, when the terminal device automatically changes the performance costumes of the virtual object, it can also determine the scaling ratio of the recorded performance footage that matches the playback rhythm of the background audio; as the playback rhythm of the background audio changes, the recorded performance footage is displayed according to the corresponding scaling ratio, so that the scaling ratio of the performance footage corresponds to the playback rhythm.

[0096] For example, when entering performance recording, the performance recording interface displays rhythm indicators for the background audio, such as the waveform of the selected background audio to indicate its approximate rhythm curve. Before performance recording begins, the performance screen zoom is 1.0, meaning no screen zoom is performed. When the user clicks record, the background audio automatically plays, and the performance screen zooms in or out in real time according to the fluctuations of the waveform indicated by the rhythm indicators. When the rhythm indicators suggest a faster playback pace (e.g., the waveform reaches a peak), it indicates that the background audio is entering a climax, and the performance screen zoom reaches its maximum to match the current playback pace. When the rhythm indicators suggest a slower playback pace, the background audio waveform is also relatively gentle, and the performance screen zoom gradually decreases until it is zoomed back to the default 1.0. In this way, by adjusting the zoom of the performance recording screen, even if the virtual object is equipped with the same performance costume, there will be different display effects between two different playback paces, enriching the display style.

[0097] It is understood that the scene data involving virtual scenes in this application embodiment is essentially user-related data. When this application embodiment is applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions.

[0098] The following will describe an exemplary application of the embodiments of this application in a real-world application scenario. Taking a virtual scene as an example, see [link to example]. Figure 7 , Figure 7 This is a schematic diagram of performance recording provided in an embodiment of this application. In this related technology, before recording a performance in a game, players can first customize their performance attire (such as hairstyle, clothes, pants, backpack, and helmet). For example, they can click on the warehouse to select clothing accessories and customize them. After saving the customization, the latest customized performance attire can be saved to the corresponding slot. Then, during the performance recording process, players can select the customized performance attire on the spawn island (such as by clicking the corresponding performance attire set button) to switch between performance attire within the game. However, this method requires players to manually change their equipped performance attire, which is inefficient.

[0099] Therefore, this application provides a method for recording performances in a virtual scene to improve the efficiency of changing performance costumes. In practical applications, before recording a performance in a virtual scene, the performance costumes equipped by the virtual object (player) can be set first. The following explanation will focus on displaying the performance costumes as a set. See also... Figure 8 , Figure 8This is a schematic diagram of the performance costume settings provided in this application embodiment. After the virtual object enters the game dance room, when the user clicks the costume button 501, the terminal device responds to the click operation and displays the performance costume settings interface. The user can set several performance costume sets through the performance costume settings interface. For example, the user can configure the costume accessories (such as hairstyle, clothes, shoes, socks, accessories, etc.) in the first performance costume set through the performance costume settings interface. After saving the configuration, the setting of the first performance costume set is completed. Afterwards, by clicking the switch button, the user can sequentially set the second performance costume set, ..., the Nth (N>2, which can be set according to the actual application) performance costume set.

[0100] The following explanation uses (N=4), i.e., setting up 4 sets of performance costumes, as an example. See [link / reference]. Figure 9 , Figure 9 This is a schematic diagram of the performance costume setup provided in this application embodiment. The performance costume setup interface displays four sets of performance costumes to be set, such as Set 1, Set 2, Set 3, and Set 4. Each performance costume set includes four clothing accessories, i.e., four accessory controls corresponding to each performance costume set. Different accessory controls correspond to different types of clothing accessories, such as a hairstyle control corresponding to a hairstyle accessory, and a clothing control corresponding to a clothing accessory. When setting each performance costume set, the following operations are performed on the four accessory controls associated with each performance costume set: In response to a trigger operation on an accessory control, at least one candidate clothing accessory of the corresponding type is displayed; In response to a selection operation on a target accessory among at least one candidate accessory, the target accessory is determined as the accessory selected by the accessory control; The accessories selected by each accessory control are combined to obtain the corresponding performance costume set.

[0101] For example, when setting up Outfit 1, when the user clicks the hairstyle control, the terminal responds to the click operation and displays multiple hairstyles to choose from, such as Hairstyle 1, Hairstyle 2, and Hairstyle 3. When the user selects Hairstyle 3, Hairstyle 3 is used as the hairstyle accessory in Outfit 1. When the user clicks the clothing control, the terminal responds to the click operation and displays multiple clothing options to choose from, such as Clothing 1, Clothing 2, Clothing 3, and Clothing 4. When the user selects Clothing 2, Clothing 2 is used as the clothing accessory in Outfit 1. And so on, assuming Socks 2 is selected as the sock accessory in Outfit 1, and Shoes 1 is selected as the shoe accessory in Outfit 1. Finally, Hairstyle 3, Clothing 2, Socks 2, and Shoes 1 are combined to obtain Outfit 1. In this way, Outfits 2, 3, and 4 can be created, and the combined Outfits 1, 2, 3, and 4 can be used as performance costumes for recording performances of virtual objects in the game.

[0102] It should be noted that when a user sets up a set, if a certain accessory control is not clicked, the accessory indicated by that accessory control will be set to empty by default. For example, when setting up set 1, if the user does not click the hairstyle accessory, the hairstyle in set 1 will not be set by default. In this case, the hairstyle in set 1 can be the default hairstyle of the virtual object.

[0103] In practical applications, before recording a performance in a virtual scene, the background audio used for the recording can be associated with the performance costumes. (See [link to relevant documentation]). Figure 10 , Figure 10 This is a schematic diagram of the background audio association settings provided in the embodiments of this application. After the virtual object enters the game dance room, when the user clicks the audio button, the terminal device responds to the click operation and displays the background audio selection interface. The background audio selection interface displays multiple audios to choose from. The user can select an audio as the background audio through the background audio selection interface. If the user selects the target audio, the target audio will be used as the background audio for the performance recording. The association settings of the target audio with the performance costume will be explained next.

[0104] When a user clicks the "Changing Outfit" button (the aforementioned audio association control), the terminal device responds to the click operation by receiving an association setting operation for the target audio. In response to this operation, it performs rhythm point detection on the target audio, obtaining multiple rhythm points included in the target audio. At least two rhythm point slots corresponding to the playback rhythm of the target audio are displayed in the playback timeline of the target audio's association settings interface (used to hold the performance costume to be associated; the location of this slot corresponds to the beat, drumbeat, or rhythm point of the target audio, and the playback rhythm at this location will change, i.e., this location is where the performance costume is changed). Simultaneously, the target audio's association settings interface displays the pre-set performance costumes equipped for recording performances of virtual objects in the game, such as Set 1, Set 2, Set 3, and Set 4 obtained above. When the user drags the target performance costume to the target rhythm point slot, the terminal device responds to the drag operation by establishing an association between the target performance costume and the target playback rhythm corresponding to the target rhythm point slot. For example, if the user drags Set 1 to the slot for Beat 1, an association between Set 1 and Beat 1 is established.

[0105] By using the above method, the relationship between the playback rhythm corresponding to each rhythm slot and the corresponding performance costume can be established. After the target audio is associated and set, it can be used as background audio in the performance recording of virtual objects in the game.

[0106] When returning to the main interface to start recording a performance, if the target audio is selected as the background audio, the background audio will be played, and the performance actions of the virtual object following the background audio will be displayed. When the playback rhythm of the background audio changes, the performance costume equipped by the virtual object will be automatically changed so that the performance costume of the virtual object corresponds to the playback rhythm of the background audio. For example, during the playback of the target audio, the playback timeline of the background audio will be displayed, and at the moment when the playback rhythm changes, the target performance costume associated with the changed playback rhythm will be displayed. When the background audio plays to the moment of change, the performance costume equipped by the virtual object will be automatically changed to the target performance costume, and the performance actions of the virtual object equipped with the target performance costume will be displayed, following the background audio, until the background audio plays to the next moment of change.

[0107] See Figure 11 , Figure 11 This is a display diagram of the performance recording provided in this application embodiment. At the points where the playback rhythm changes on the background audio playback timeline, the target performance costume associated with the changed playback rhythm is displayed. For example, at beat 1, the associated costume 1 is displayed; at beat 2, the associated costume 2 is displayed; at beat 3, the associated costume 3 is displayed; and at beat 4, the associated costume 4 is displayed. During the time period 1 between the background audio playback and beat 1, the costume equipped by the virtual object is the default costume. When playback reaches beat 1, the costume equipped by the virtual object is automatically changed from the default costume to costume 1. The program displays the performance actions of a virtual object equipped with Outfit 1, following the background audio, until beat 2. When the background audio reaches beat 2, the virtual object's outfit is automatically changed from Outfit 1 to Outfit 2, and the performance actions of the virtual object equipped with Outfit 2 are displayed, following the background audio, until beat 3. This process is repeated, achieving the effect of automatically controlling the virtual object to change its performance outfit to match the playback rhythm of the background audio at corresponding beat points during the playback of the background audio, thus achieving an instantaneous equipment switching effect.

[0108] By applying the embodiments of this application, during the performance recording process in a virtual scene, since the selected background audio for performance recording includes multiple playback rhythms, and different playback rhythms are associated with different performance costumes, the performance costumes equipped by the virtual object are automatically changed as the playback rhythm of the background audio changes, so that the performance costumes of the virtual object correspond to the playback rhythm of the background audio. In this way, during the performance recording process, the performance costumes equipped by the virtual object change with the playback rhythm of the background audio, so that the performance costumes equipped by the virtual object and the playback rhythm of the background audio achieve a good correspondence, improving the compatibility between them; moreover, this method of changing performance costumes greatly improves the efficiency of changing performance costumes compared to manually switching the performance costumes to be changed.

[0109] The following description continues to illustrate the exemplary structure of the performance recording device 465 in the virtual scene provided in the embodiments of this application as a software module. In some embodiments, the storage... Figure 2 The software modules in the performance recording device 465 in the virtual scene of the memory 460 may include: Display module 4651 is used to display a virtual object equipped with performance costumes and an audio control for selecting background audio in the performance recording interface of the virtual scene. Selection module 4652 is used to select the target audio as background audio for performance recording in response to an audio selection operation triggered by the audio control. The target audio includes at least two playback rhythms, and different playback rhythms are associated with different performance costumes; The recording module 4653 is used to play the background audio and display the performance actions performed by the virtual object following the background audio during the performance recording process based on the performance recording interface. The replacement module 4654 is used to automatically change the performance costume of the virtual object when the playback rhythm of the background audio changes, so that the performance costume of the virtual object corresponds to the playback rhythm of the background audio.

[0110] In some embodiments, before using the selected target audio as background audio for performance recording, the device further includes: an association establishment module, configured to display an association setting interface for the target audio in response to an association setting operation for the target audio; display at least two performance costumes for associating the target audio and rhythm indication information of the target audio in the association setting interface, the rhythm indication information indicating the playback rhythm of the target audio; and establish an association relationship between the target performance costume indicated by the performance costume association operation and the target playback rhythm in response to a performance costume association operation triggered based on the rhythm indication information.

[0111] In some embodiments, before displaying at least two performance costumes for associating the target audio in the association settings interface of the target audio, the device further includes: a first costume determination module, configured to display a performance costume setting interface for setting performance costumes for equipping the virtual object; display at least two candidate performance costumes available for selection in the performance costume setting interface; and, in response to a selection operation for a target number of candidate performance costumes among the at least two candidate performance costumes, determine the target number of candidate performance costumes as performance costumes for associating the target audio.

[0112] In some embodiments, before displaying at least two performance costumes for associating the target audio in the association settings interface of the target audio, the device further includes: a second costume determination module, configured to display a performance costume setting interface for setting the performance costumes equipped by the virtual object; when the performance costumes are displayed in the form of a performance costume set, displaying at least two types of selectable costume accessories in the performance costume setting interface; in response to a selection operation of a target type costume accessory among the at least two types of costume accessories, combining the selected target type costume accessories; and determining the combined performance costume set as the performance costume for associating the target audio.

[0113] In some embodiments, before displaying at least two performance costumes for associating the target audio in the association settings interface of the target audio, the device further includes: a third costume determination module, configured to display a performance costume setting interface for setting the performance costumes equipped by the virtual object; when the performance costumes are displayed in the form of a performance costume set, at least two accessory controls corresponding to the performance costume set are displayed in the performance costume setting interface, with different accessory controls corresponding to different types of costume accessories; and the following operations are performed for each accessory control: in response to a trigger operation on the accessory control, at least one candidate costume accessory of the corresponding type is displayed; in response to a selection operation on a target accessory among the at least one candidate accessory, the target accessory is determined as the accessory selected by the accessory control; the accessories selected by each accessory control are combined to obtain a corresponding performance costume set, and the performance costume set is determined as the performance costume for associating the target audio.

[0114] In some embodiments, the association establishment module is further configured to display a playback timeline of the target audio, display at least two rhythm point slots corresponding to the playback rhythm of the target audio in the playback timeline, and use the rhythm point slots as rhythm indication information; wherein, the rhythm point slots are used to carry performance costumes to be associated; upon receiving a drag operation for a target performance costume among the at least two performance costumes, when the drag operation indicates that the target performance costume is dragged to the target rhythm point slot, the drag operation is determined as the performance costume association operation; in response to the performance costume association operation, an association relationship is established between the target performance costume and the target playback rhythm corresponding to the target rhythm point slot.

[0115] In some embodiments, the association establishment module is further configured to display at least two change moments indicating a change in the playback rhythm of the target audio, and display the rhythm indication information in the association area of ​​the change moments; in response to a selection operation for the target rhythm indication information corresponding to the target change moment among the at least two change moments, display at least one performance costume option corresponding to the target rhythm indication information, wherein each performance costume option corresponds to one performance costume; in response to a selection operation for the target performance costume option among the at least one performance costume options, control the target performance costume corresponding to the target performance costume option to be in a selected state; in response to a confirmation operation for the target performance costume, receive the performance costume association operation; and in response to the performance costume association operation, establish an association relationship between the target performance costume and the target playback rhythm corresponding to the target change moment.

[0116] In some embodiments, the association establishment module is further configured to, in response to a selection operation for a target performance costume among the at least two performance costumes, display at least one playback rhythm option corresponding to the target performance costume, and use each of the playback rhythm options as the rhythm indication information; in response to a selection operation for a target playback rhythm option among the at least one playback rhythm option, control the target playback rhythm corresponding to the target playback rhythm option to be in a selected state; in response to a determination operation for the target playback rhythm, receive the performance costume association operation; and in response to the performance costume association operation, establish an association relationship between the target performance costume and the target playback rhythm.

[0117] In some embodiments, the association establishment module is further configured to: display at least two playback rhythms included in the target audio, and use the at least two playback rhythms as rhythm indication information; in response to a selection operation for a target playback rhythm among the at least two playback rhythms, display recommendation information for recommending performance costumes associated with the target playback rhythm, the recommendation information including recommended target performance costumes; in response to a confirmation operation for the recommendation information, receive a performance costume association operation; and in response to the performance costume association operation, establish an association between the target performance costume and the target playback rhythm.

[0118] In some embodiments, before displaying the rhythm indication information of the target audio, the device further includes: a first generation module, configured to perform rhythm point detection on the target audio to obtain at least two rhythm points included in the target audio; and generate rhythm indication information of the target audio based on each of the rhythm points.

[0119] In some embodiments, before displaying the rhythm indication information of the target audio, the device further includes: a second generation module, which samples the target audio based on a preset sampling frequency to obtain the frequency of each audio frame in a plurality of audio frames included in the target audio; performs Fourier transform on the frequency of each audio frame to obtain a spectrum diagram of each audio frame; and generates the rhythm indication information of the target audio based on the spectrum diagram of each audio frame.

[0120] In some embodiments, before using the selected target audio as background audio for performance recording, the association establishment module is further configured to perform rhythm recognition on the target audio to obtain at least two playback rhythms corresponding to the target audio; obtain at least two performance costumes for associating the background audio, and match each performance costume with each playback rhythm to obtain a corresponding matching degree; obtain at least two costume rhythm pairs corresponding to when the matching degree reaches a matching degree threshold, wherein each costume rhythm pair includes a performance costume and a playback rhythm; and establish the association relationship between the performance costume and the playback rhythm in each costume rhythm pair.

[0121] In some embodiments, the recording module is further configured to display the performance actions performed by the virtual object equipped with the first performance costume in response to the background audio; the switching module is further configured to, when the playback rhythm of the background audio changes, acquire the second performance costume associated with the playback rhythm of the background audio after the change in playback rhythm; automatically switch the performance costume equipped by the virtual object from the first performance costume to the second performance costume, and display the performance actions performed by the virtual object equipped with the second performance costume in response to the background audio.

[0122] In some embodiments, the replacement module is further configured to display a playback timeline of the background audio during playback, and at the point in the playback timeline where the playback rhythm changes, display the target performance costume associated with the changed playback rhythm; when the background audio plays to the point of change, automatically replace the performance costume equipped by the virtual object with the target performance costume, and display the performance actions performed by the virtual object equipped with the target performance costume following the background audio, until the background audio plays to the next point of change.

[0123] In some embodiments, the apparatus further includes: a scaling module, configured to determine a scaling ratio of the recorded performance footage that is adapted to the playback rhythm of the background audio when automatically changing the performance costumes fitted by the virtual object; and to display the recorded performance footage according to the corresponding scaling ratio as the playback rhythm of the background audio changes, so that the scaling ratio of the performance footage corresponds to the playback rhythm.

[0124] This application provides a computer program product or computer program that includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the performance recording method in the virtual scene described above in this application embodiment.

[0125] This application provides a computer-readable storage medium storing executable instructions. When these executable instructions are executed by a processor, they cause the processor to execute the performance recording method in a virtual scene provided in this application. For example... Figure 3 The method shown.

[0126] In some embodiments, the computer-readable storage medium may be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, flash memory, magnetic surface memory, optical disk, or CD-ROM; or it may be a variety of devices including one or any combination of the above-mentioned memories.

[0127] In some embodiments, executable instructions may take the form of a program, software, software module, script, or code, written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and may be deployed in any form, including as a standalone program or as a module, component, subroutine, or other unit suitable for use in a computing environment.

[0128] As an example, executable instructions may, but do not necessarily, correspond to files in a file system. They may be stored as part of a file that holds other programs or data, for example, in one or more scripts in a Hyper Text Markup Language (HTML) document, in a single file dedicated to the program in question, or in multiple collaborating files (e.g., a file that stores one or more modules, subroutines, or code sections).

[0129] As an example, executable instructions can be deployed to execute on a single computing device, or on multiple computing devices located in one location, or on multiple computing devices distributed across multiple locations and interconnected via a communication network.

[0130] The above description is merely an embodiment of this application and is not intended to limit the scope of protection of this application. Any modifications, equivalent substitutions, and improvements made within the spirit and scope of this application are included within the scope of protection of this application.

Claims

1. A method for recording performances in a virtual scene, characterized in that, The method includes: The virtual scene performance recording interface displays a virtual object equipped with performance costumes, as well as audio controls for selecting background audio. In response to an audio selection operation triggered by the audio control, the selected target audio is used as the background audio for performance recording; wherein, the target audio includes at least two playback rhythms, and different playback rhythms are associated with different performance costumes; when a performance costume is associated with any of the at least two target playback rhythms, multiple preset performance costumes are displayed in the association settings interface of the target audio, and rhythm point slots corresponding to each playback rhythm are displayed in the playback timeline; in response to a drag operation that instructs the target performance costume to be dragged to the target rhythm point slot, an association relationship is established between the target performance costume and the target playback rhythm corresponding to the target rhythm point slot; During the performance recording process based on the performance recording interface, the background audio is played, and the performance actions performed by the virtual object in response to the background audio are displayed. When the playback rhythm of the background audio changes, the performance costume of the virtual object is automatically changed so that the performance costume of the virtual object corresponds to the playback rhythm of the background audio.

2. The method as described in claim 1, characterized in that, Before using the selected target audio as background audio for the performance recording, the method further includes: In response to an association setting operation for the target audio, the association setting interface for the target audio is displayed; In the association settings interface of the target audio, at least two performance costumes for associating with the target audio and the rhythm indication information of the target audio are displayed. The rhythm indication information is used to indicate the playback rhythm of the target audio. In response to a performance costume association operation triggered based on the rhythm indication information, an association relationship is established between the target performance costume indicated by the performance costume association operation and the target playback rhythm.

3. The method as described in claim 2, characterized in that, Before displaying at least two performance costumes for associating the target audio in the association settings interface of the target audio, the method further includes: Displays a performance costume settings interface for setting the performance costumes equipped by the virtual object; The performance costume settings interface displays at least two candidate performance costumes to choose from; In response to a selection operation for a target number of candidate performance costumes from the at least two candidate performance costumes, the target number of candidate performance costumes are determined as performance costumes for associating the target audio.

4. The method as described in claim 2, characterized in that, Before displaying at least two performance costumes for associating the target audio in the association settings interface of the target audio, the method further includes: Displays a performance costume settings interface for setting the performance costumes equipped by the virtual object; When the performance costume is displayed as a performance costume set, at least two types of costume accessories are displayed in the performance costume settings interface for selection. In response to the selection operation of clothing accessories of a target type among the at least two types of clothing accessories, the selected clothing accessories of the target type are combined; The resulting performance costume set is determined as the performance costume used to associate the target audio.

5. The method as described in claim 2, characterized in that, Before displaying at least two performance costumes for associating the target audio in the association settings interface of the target audio, the method further includes: Displays a performance costume settings interface for setting the performance costumes equipped by the virtual object; When the performance costume is displayed as a performance costume set, at least two accessory controls corresponding to the performance costume set are displayed in the performance costume settings interface, and different accessory controls correspond to different types of costume accessories; Perform the following operations for each of the aforementioned accessory controls: In response to a trigger operation on the accessory control, at least one candidate clothing accessory of the corresponding type is displayed; In response to a selection operation for a target accessory among the at least one candidate accessories, the target accessory is determined as the accessory selected by the accessory control; The accessories selected by each accessory control are combined to obtain a corresponding performance costume set, and the performance costume set is determined as the performance costume used to associate with the target audio.

6. The method as described in claim 2, characterized in that, The rhythm indication information displayed for the target audio includes: The playback timeline of the target audio is displayed, and at least two rhythm point slots corresponding to the playback rhythm of the target audio are displayed in the playback timeline, and the rhythm point slots are used as rhythm indication information; wherein, the rhythm point slots are used to carry the performance costumes to be associated. The step of establishing an association between the target performance costume indicated by the performance costume association operation and the target playback rhythm in response to the performance costume association operation triggered based on the rhythm indication information includes: Upon receiving a drag operation for a target performance costume among the at least two performance costumes, when the drag operation indicates that the target performance costume should be dragged to the target rhythm point slot, the drag operation is determined as an associated operation of the performance costume. In response to the performance costume association operation, an association relationship is established between the target performance costume and the target playback rhythm corresponding to the target rhythm point slot.

7. The method as described in claim 2, characterized in that, The display of at least two performance costumes associated with the target audio and the rhythm indication information of the target audio includes: Display at least two moments of change that indicate a change in the playback rhythm of the target audio, and display the rhythm indication information in the associated area of ​​the moments of change; In response to a selection operation for target rhythm indication information corresponding to the target change time among the at least two change times, at least one performance costume option corresponding to the target rhythm indication information is displayed, wherein each performance costume option corresponds to a performance costume; The step of establishing an association between the target performance costume indicated by the performance costume association operation and the target playback rhythm in response to the performance costume association operation triggered based on the rhythm indication information includes: In response to a selection operation for a target performance costume option among the at least two performance costume options, the target performance costume corresponding to the target performance costume option is controlled to be in a selected state; In response to the determination operation for the target performance costume, the performance costume association operation is received; In response to the performance costume association operation, an association relationship is established between the target performance costume and the target playback rhythm corresponding to the target change time.

8. The method as described in claim 2, characterized in that, The rhythm indication information displayed for the target audio includes: In response to a selection operation for a target performance costume among the at least two performance costumes, at least one playback rhythm option corresponding to the target performance costume is displayed, and each of the playback rhythm options is used as the rhythm indication information; The step of establishing an association between the target performance costume indicated by the performance costume association operation and the target playback rhythm in response to the performance costume association operation triggered based on the rhythm indication information includes: In response to a selection operation for a target playback rhythm option among the at least one playback rhythm options, the target playback rhythm corresponding to the target playback rhythm option is controlled to be in a selected state; In response to the operation of determining the target playback rhythm, the operation of associating the performance costume is received; In response to the performance costume association operation, an association relationship is established between the target performance costume and the target playback rhythm.

9. The method as described in claim 2, characterized in that, The display of at least two performance costumes associated with the target audio and the rhythm indication information of the target audio includes: The target audio is displayed to include at least two playback rhythms, and the at least two playback rhythms are used as rhythm indication information; In response to a selection operation for a target playback rhythm among the at least two playback rhythms, recommendation information is displayed for recommending performance costumes associated with the target playback rhythm, the recommendation information including recommended target performance costumes; The step of establishing an association between the target performance costume indicated by the performance costume association operation and the target playback rhythm in response to the performance costume association operation triggered based on the rhythm indication information includes: In response to the confirmation operation for the recommended information, the performance costume association operation is received; In response to the performance costume association operation, an association relationship is established between the target performance costume and the target playback rhythm.

10. The method as described in claim 2, characterized in that, Before displaying the rhythm indication information of the target audio, the method further includes: The target audio is subjected to rhythm point detection to obtain at least two rhythm points included in the target audio; Based on each of the aforementioned rhythm points, rhythm indication information for the target audio is generated.

11. The method as described in claim 1, characterized in that, Before using the selected target audio as background audio for the performance recording, the method further includes: Perform rhythm recognition on the target audio to obtain at least two playback rhythms corresponding to the target audio; Obtain at least two performance costumes for associating with the background audio, and match each performance costume with each playback rhythm to obtain the corresponding matching degree; Obtain at least two costume rhythm pairs corresponding to when the matching degree reaches the matching degree threshold, wherein the costume rhythm pair includes a performance costume and a playback rhythm; Establish the relationship between the performance costumes and the playback rhythm in each of the costume rhythm pairs.

12. The method as described in claim 1, characterized in that, The demonstration of the performance actions performed by the virtual object in response to the background audio includes: The virtual object, equipped with a first performance costume, performs performance actions in sync with the background audio. The step of automatically changing the performance costume of the virtual object when the playback rhythm of the background audio changes includes: When the playback rhythm of the background audio changes, obtain the second performance costume associated with the playback rhythm of the background audio after the change in playback rhythm; The virtual object's performance costume is automatically switched from the first performance costume to the second performance costume, and the performance actions performed by the virtual object equipped with the second performance costume are displayed in sync with the background audio.

13. The method as described in claim 1, characterized in that, The step of automatically changing the performance costume of the virtual object when the playback rhythm of the background audio changes includes: During the playback of the background audio, a playback timeline of the background audio is displayed, and at the points in the playback timeline where the playback rhythm changes, the target performance costume associated with the changed playback rhythm is displayed. When the background audio plays to the change moment, the performance costume equipped by the virtual object is automatically changed to the target performance costume, and the performance actions performed by the virtual object equipped with the target performance costume are displayed in accordance with the background audio, until the background audio plays to the next change moment.

14. The method as described in claim 1, characterized in that, The method further includes: When automatically changing the performance costumes of the virtual object, the scaling ratio of the recorded performance footage is determined to match the playback rhythm of the background audio. As the background audio plays at different rhythms, the recorded performance footage is displayed with a corresponding scaling ratio, so that the scaling ratio of the performance footage corresponds to the playback rhythm.

15. A performance recording device in a virtual scene, characterized in that, The device includes: The display module is used to display virtual objects equipped with performance costumes and audio controls for selecting background audio in the performance recording interface of the virtual scene. The selection module is used to respond to an audio selection operation triggered by the audio control and use the selected target audio as the background audio for performance recording; wherein, the target audio includes at least two playback rhythms, and different playback rhythms are associated with different performance costumes; when a performance costume is associated with any of the at least two target playback rhythms, multiple preset performance costumes are displayed in the association settings interface of the target audio, and rhythm point slots corresponding to each playback rhythm are displayed in the playback timeline; in response to a drag operation that instructs the target performance costume to be dragged to the target rhythm point slot, the association relationship between the target performance costume and the target playback rhythm corresponding to the target rhythm point slot is established; The recording module is used to play the background audio and display the performance actions performed by the virtual object in response to the background audio during the performance recording process based on the performance recording interface. The replacement module is used to automatically change the performance costume of the virtual object when the playback rhythm of the background audio changes, so that the performance costume of the virtual object corresponds to the playback rhythm of the background audio.

16. The apparatus according to claim 15, characterized in that, Before using the selected target audio as background audio for performance recording, the device further includes: an association establishment module, configured to display an association setting interface for the target audio in response to an association setting operation for the target audio; display at least two performance costumes for associating the target audio and rhythm indication information of the target audio in the association setting interface, the rhythm indication information indicating the playback rhythm of the target audio; and establish an association relationship between the target performance costume indicated by the performance costume association operation and the target playback rhythm in response to a performance costume association operation triggered based on the rhythm indication information.

17. The apparatus according to claim 16, characterized in that, Before displaying at least two performance costumes for associating the target audio in the association settings interface of the target audio, the device further includes: a first costume determination module, configured to display a performance costume setting interface for setting the performance costumes equipped by the virtual object; displaying at least two candidate performance costumes available for selection in the performance costume setting interface; and determining the target number of candidate performance costumes as performance costumes for associating the target audio in response to a selection operation for a target number of candidate performance costumes among the at least two candidate performance costumes.

18. The apparatus according to claim 16, characterized in that, Before displaying at least two performance costumes for associating the target audio in the association settings interface, the device further includes: a second costume determination module, configured to display a performance costume setting interface for setting the performance costumes equipped by the virtual object; when the performance costumes are displayed in the form of a performance costume set, at least two types of selectable costume accessories are displayed in the performance costume setting interface; in response to a selection operation of a target type costume accessory among the at least two types of costume accessories, the selected target type costume accessories are combined; and the combined performance costume set is determined as the performance costume for associating the target audio.

19. The apparatus according to claim 16, characterized in that, Before displaying at least two performance costumes for associating the target audio in the association settings interface, the device further includes: a third costume determination module, used to display a performance costume setting interface for setting the performance costumes equipped by the virtual object; when the performance costumes are displayed in the form of a performance costume set, at least two accessory controls corresponding to the performance costume set are displayed in the performance costume setting interface, with different accessory controls corresponding to different types of costume accessories; the following operations are performed for each accessory control: in response to a trigger operation on the accessory control, at least one candidate costume accessory of the corresponding type is displayed; in response to a selection operation on a target accessory among the at least one candidate accessory, the target accessory is determined as the accessory selected by the accessory control; the accessories selected by each accessory control are combined to obtain a corresponding performance costume set, and the performance costume set is determined as the performance costume for associating the target audio.

20. The apparatus according to claim 16, characterized in that, The association establishment module is further configured to display the playback timeline of the target audio, display at least two rhythm point slots corresponding to the playback rhythm of the target audio in the playback timeline, and use the rhythm point slots as the rhythm indication information; wherein, the rhythm point slots are used to carry the performance costumes to be associated; upon receiving a drag operation for the target performance costume among the at least two performance costumes, when the drag operation indicates that the target performance costume is dragged to the target rhythm point slot, the drag operation is determined as the performance costume association operation; in response to the performance costume association operation, an association relationship is established between the target performance costume and the target playback rhythm corresponding to the target rhythm point slot.

21. The apparatus according to claim 16, characterized in that, The association establishment module is also used to display at least two change moments that indicate a change in the playback rhythm of the target audio, and to display the rhythm indication information in the association area of ​​the change moments; In response to a selection operation for target rhythm indication information corresponding to a target change time among the at least two change times, at least one performance costume option corresponding to the target rhythm indication information is displayed, wherein each performance costume option corresponds to one performance costume; in response to a selection operation for a target performance costume option among the at least two performance costume options, the target performance costume corresponding to the target performance costume option is controlled to be in a selected state; in response to a confirmation operation for the target performance costume, a performance costume association operation is received; in response to the performance costume association operation, an association relationship is established between the target performance costume and the target playback rhythm corresponding to the target change time.

22. The apparatus according to claim 16, characterized in that, The association establishment module is further configured to, in response to a selection operation for a target performance costume among the at least two performance costumes, display at least one playback rhythm option corresponding to the target performance costume, and use each of the playback rhythm options as the rhythm indication information; In response to a selection operation for a target playback rhythm option among the at least one playback rhythm options, the target playback rhythm corresponding to the target playback rhythm option is controlled to be in a selected state; In response to the determination operation for the target playback rhythm, the performance costume association operation is received; in response to the performance costume association operation, the association relationship between the target performance costume and the target playback rhythm is established.

23. The apparatus according to claim 16, characterized in that, The association establishment module is further configured to display at least two playback rhythms included in the target audio, and use the at least two playback rhythms as the rhythm indication information; in response to a selection operation for a target playback rhythm among the at least two playback rhythms, display recommendation information for recommending performance costumes associated with the target playback rhythm, the recommendation information including recommended target performance costumes; in response to a confirmation operation for the recommendation information, receive a performance costume association operation; and in response to the performance costume association operation, establish an association relationship between the target performance costume and the target playback rhythm.

24. The apparatus according to claim 16, characterized in that, Before displaying the rhythm indication information of the target audio, the device further includes: a generation module, used to perform rhythm point detection on the target audio to obtain at least two rhythm points included in the target audio; and to generate rhythm indication information of the target audio based on each of the rhythm points.

25. The apparatus according to claim 15, characterized in that, Before using the selected target audio as the background audio for performance recording, the association establishment module is further configured to perform rhythm recognition on the target audio to obtain at least two playback rhythms corresponding to the target audio; obtain at least two performance costumes for associating the background audio, and match each performance costume with each playback rhythm to obtain a corresponding matching degree; obtain at least two costume rhythm pairs corresponding to when the matching degree reaches a matching degree threshold, wherein each costume rhythm pair includes a performance costume and a playback rhythm; and establish the association relationship between the performance costume and the playback rhythm in each costume rhythm pair.

26. The apparatus according to claim 15, characterized in that, The recording module is also used to display the performance actions performed by the virtual object equipped with the first performance costume in response to the background audio. The switching module is further configured to, when the playback rhythm of the background audio changes, acquire the second performance costume associated with the playback rhythm of the background audio after the change in playback rhythm; automatically switch the performance costume equipped by the virtual object from the first performance costume to the second performance costume; and display the performance actions performed by the virtual object equipped with the second performance costume following the background audio.

27. The apparatus according to claim 15, characterized in that, The replacement module is further configured to display the playback timeline of the background audio during playback, and at the points in the playback timeline where the playback rhythm changes, display the target performance costume associated with the changed playback rhythm; when the background audio plays to the point of change, automatically replace the performance costume equipped by the virtual object with the target performance costume, and display the performance actions performed by the virtual object equipped with the target performance costume following the background audio, until the background audio plays to the next point of change.

28. The apparatus according to claim 15, characterized in that, The device also includes a scaling module, used to determine the scaling ratio of the recorded performance footage that matches the playback rhythm of the background audio when automatically changing the performance costumes of the virtual object; and to display the recorded performance footage according to the corresponding scaling ratio as the playback rhythm of the background audio changes, so that the scaling ratio of the performance footage corresponds to the playback rhythm.

29. An electronic device, characterized in that, include: Memory, used to store executable instructions; A processor, when executing executable instructions stored in the memory, implements the performance recording method in a virtual scene as described in any one of claims 1 to 14.

30. A computer-readable storage medium, characterized in that, It stores executable instructions for implementing the performance recording method in the virtual scene as described in any one of claims 1 to 14 when executed by a processor.

31. A computer program product, comprising a computer program or instructions, characterized in that, When the computer program or instructions are executed by a processor, they implement the method described in any one of claims 1 to 14.

Citation Information

Patent Citations

  • Mood-based game APP optimization method, device and terminal device

    CN109260710A

  • System for providing online music game and method of the same

    JP2010057922A