Interface display method and device, equipment and storage medium

By collecting music rhythm and facial information in real time, the inefficiency and inaccurate special effects caused by manual determination of mirror parameters in the existing technology is solved, and the intuitiveness and efficient human-computer interaction of the live broadcast interface is realized.

CN119211623AActive Publication Date: 2024-12-27BEIJING DAJIA INTERNET INFORMATION TECH CO LTD

Patent Information

Application Number
CN202411171154.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-23
Publication Date
2024-12-27
Estimated Expiration
2044-08-23

AI Technical Summary

Technical Problem

The parameters of the mirror movement during existing live shooting are determined by manual experience, resulting in low human-computer interaction efficiency and the special effects of the mirror movement are not intuitive and inaccurate.

Method used

By collecting the music rhythm and facial information during live broadcast in real time, the parameters of the mirror operation, including the speed, distance and angle of the mirror operation are automatically reasoned, and are used to display the live broadcast interface to improve the accuracy of the mirror operation parameters and human-computer interaction efficiency.

Benefits of technology

The special effects of the mirror on the live broadcast interface are more intuitive and accurate, reducing manual participation, and improving human-computer interaction efficiency and display effect of the live broadcast interface.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119211623A_ABST
    Figure CN119211623A_ABST
Patent Text Reader

Abstract

The invention relates to an interface display method and device, equipment and a storage medium, and relates to the technical field of multimedia. The method comprises the steps of collecting music in a target space; acquiring mirror moving parameters based on at least one of rhythm features of the music and facial information, wherein the facial information comprises at least one of facial expressions and facial actions of an object in the target space; and displaying a live broadcast interface of the target space based on the mirror operation parameter, the live broadcast interface including a mirror operation effect corresponding to the mirror operation parameter. The mirror moving parameters are not artificially determined based on experience, but are obtained through real-time reasoning based on the music rhythm and the face information of the object during live broadcasting, so that the accuracy of the mirror moving parameters is obviously high, and the mirror moving special effect displayed by the live broadcasting interface is more visual and accurate. Moreover, according to the method, manual participation is not needed, a machine can automatically determine the accurate mirror operation parameters and display the live broadcast interface based on the determined mirror operation parameters, and the man-machine interaction efficiency is further improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of multimedia technology, and in particular to an interface display method, device, equipment and storage medium. Background Art

[0002] At present, in order to improve the live broadcast effect, the camera movement method is used for live broadcast shooting. However, this method is generally implemented by manual camera movement, in which the camera movement parameters are manually determined through experience, and then the machine is manually controlled to shoot based on the camera movement parameters, such as manually moving the distance between the machine and the object to be shot during shooting. Obviously, this method makes the human-computer interaction efficiency low. Summary of the invention

[0003] The present disclosure provides an interface display method, device, equipment and storage medium. Since the camera movement parameters are not determined artificially based on experience, but are inferred in real time based on the music rhythm and facial information of the object during live broadcast, the camera movement parameters are obviously highly accurate. In this way, when the live broadcast interface is displayed based on the camera movement parameters, the camera movement special effects displayed by the live broadcast interface are more intuitive and accurate. In addition, the method does not require human participation. The machine can automatically determine the accurate camera movement parameters and display the live broadcast interface based on the determined camera movement parameters, thereby improving the efficiency of human-computer interaction. The technical solution of the present disclosure is as follows:

[0004] According to one aspect of an embodiment of the present disclosure, there is provided an interface display method, the method comprising:

[0005] Collect music in the target space;

[0006] Acquire camera movement parameters based on at least one of the rhythm feature of the music and facial information, wherein the facial information includes at least one of facial expression and facial action of the object in the target space, and the camera movement parameters include at least one of camera movement speed, camera movement distance, and camera movement angle;

[0007] Based on the camera movement parameters, a live broadcast interface of the target space is displayed, and the live broadcast interface includes the camera movement effects corresponding to the camera movement parameters.

[0008] According to another aspect of an embodiment of the present disclosure, there is provided an interface display device, the device comprising:

[0009] A collection unit, configured to collect music in a target space;

[0010] an acquisition unit configured to acquire camera movement parameters based on at least one of the rhythm feature of the music and facial information, wherein the facial information includes at least one of facial expression and facial action of the object in the target space, and the camera movement parameters include at least one of camera movement speed, camera movement distance and camera movement angle;

[0011] The display unit is configured to display a live broadcast interface of the target space based on the camera movement parameters, wherein the live broadcast interface includes camera movement effects corresponding to the camera movement parameters.

[0012] In some embodiments, the acquisition unit is configured to perform at least one of the following:

[0013] In the case where no music in the target space is collected, acquiring the camera movement parameter based on the facial information;

[0014] When music in the target space is collected, the camera movement parameters are obtained based on the rhythm features; or, when music in the target space is collected, the camera movement parameters are obtained based on the rhythm features and the facial information.

[0015] In some embodiments, the display unit is configured to perform:

[0016] Acquire a video stream shot based on the camera movement parameters, and display the live broadcast interface based on the video stream; or,

[0017] The video picture of the target space is adjusted based on the camera movement parameters, and the live broadcast interface is displayed based on the adjusted video picture.

[0018] In some embodiments, the acquisition unit is configured to execute:

[0019] When the rhythm feature indicates that the rhythm of the music is less than a rhythm threshold, outputting the first camera movement parameter as the camera movement parameter;

[0020] When the rhythm feature indicates that the rhythm of the music is not less than a rhythm threshold, a second camera movement parameter is output as the camera movement parameter, wherein the second camera movement parameter is a camera movement parameter corresponding to the rhythm in a camera movement parameter library, and the camera movement parameter library includes multiple rhythms and camera movement parameters that are positively correlated with the multiple rhythms.

[0021] In some embodiments, the first camera movement parameter includes at least one of a first camera movement speed and a second camera movement speed, and the display unit is configured to perform at least one of the following:

[0022] Displaying the camera movement effect of the live broadcast interface adjusting the camera movement distance according to the first camera movement speed;

[0023] The live broadcast interface is displayed with the camera angle adjusted according to the second camera speed.

[0024] In some embodiments, the display unit is configured to perform:

[0025] When the rhythm feature indicates that the rhythm of the music is not less than the rhythm threshold, the first camera movement effect is displayed at the heavy beat points of the music on the live broadcast interface.

[0026] In some embodiments, the display unit is configured to perform:

[0027] When the rhythm characteristics indicate that two different rhythms appear alternately in the music according to a preset rule, a second camera movement effect is displayed on the live broadcast interface, and the first camera movement node and the second camera movement node of the second camera movement effect appear according to the preset rule to be respectively displayed on the beat points corresponding to the two rhythms.

[0028] In some embodiments, the second camera movement special effect includes a first sub-special effect and a second sub-special effect, and the display unit is configured to execute:

[0029] When the difference between the two rhythms is greater than the difference threshold, the first sub-special effect is displayed on the live broadcast interface, the camera movement parameters of the first sub-special effect include a closest camera movement distance and a farthest camera movement distance, and the first camera movement node and the second camera movement node correspond to the closest camera movement distance and the farthest camera movement distance, respectively;

[0030] When the difference between the two rhythms is not greater than the difference threshold, the second sub-effect is displayed on the live broadcast interface, and the camera movement parameters of the second sub-effect include a minimum camera movement angle and a maximum camera movement angle, and the first camera movement node and the second camera movement node correspond to the minimum camera movement angle and the maximum camera movement angle, respectively.

[0031] In some embodiments, the acquisition unit is configured to execute:

[0032] When the rhythm feature indicates that the rhythm of the music is reduced, outputting the camera movement parameter corresponding to the reduced rhythm as the camera movement parameter;

[0033] When the rhythm feature indicates that the rhythm of the music increases, the camera movement parameter corresponding to the increased rhythm is output as the camera movement parameter.

[0034] In some embodiments, the display unit is further configured to perform:

[0035] If the music in the target space is not collected, the camera movement effect will not be displayed on the live broadcast interface.

[0036] In some embodiments, the acquisition unit is further configured to acquire lighting parameters based on at least one of the rhythm feature of the music and the facial information;

[0037] The display unit is further configured to display virtual lights on the live broadcast interface based on the lighting parameters.

[0038] In some embodiments, the display unit is configured to perform at least one of the following:

[0039] In the case where the object in the target space receives the virtual resource, displaying a third camera movement special effect on the live broadcast interface, wherein the third camera movement special effect is used to magnify the face of the object on the live broadcast interface;

[0040] When the value of the virtual resources received by the object in the target space reaches the resource threshold, a third camera movement effect is displayed on the live broadcast interface, and the third camera movement effect is used to enlarge the face of the object on the live broadcast interface.

[0041] In some embodiments, the acquisition unit is configured to execute:

[0042] The music and the facial information are sent to a server, wherein the server is used to extract a rhythm feature of the music and determine a camera movement parameter corresponding to at least one of the rhythm feature and the facial information; or

[0043] The rhythm feature of the music is extracted, and the rhythm feature and the facial information are sent to a server, where the server is used to determine a camera movement parameter corresponding to at least one of the rhythm feature and the facial information.

[0044] According to another aspect of an embodiment of the present disclosure, a terminal is provided, the terminal including:

[0045] one or more processors;

[0046] A memory for storing program codes executable by the processor;

[0047] The processor is configured to execute the program code to implement the above-mentioned interface display method.

[0048] According to another aspect of an embodiment of the present disclosure, a computer-readable storage medium is provided. When a program code in the computer-readable storage medium is executed by a processor of a terminal, the terminal is enabled to execute the above-mentioned interface display method.

[0049] According to another aspect of an embodiment of the present disclosure, a computer program product is provided, including a computer program, and when the computer program is executed by a processor, the above-mentioned interface display method is implemented.

[0050] The disclosed embodiment provides an interface display method. When displaying the live broadcast interface of the target space, the method collects the music in the target space, then obtains the camera movement parameters based on at least one of the rhythm characteristics of the music and the facial information, and then displays the live broadcast interface based on the camera movement parameters, so that the live broadcast interface includes the camera movement effect corresponding to the camera movement parameters. Since the camera movement parameters are not determined artificially based on experience, but are obtained by real-time reasoning based on the music rhythm and the facial information of the object during the live broadcast, it is obvious that the camera movement parameters are highly accurate. In this way, when the live broadcast interface is displayed based on the camera movement parameters, the camera movement special effects displayed by the live broadcast interface are more intuitive and accurate. In addition, the method does not require human participation, and the machine can automatically determine the accurate camera movement parameters and display the live broadcast interface based on the determined camera movement parameters, thereby improving the efficiency of human-computer interaction.

[0051] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] The drawings herein are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the description are used to explain the principles of the present disclosure, and do not constitute improper limitations on the present disclosure.

[0053] Figure 1 It is a schematic diagram showing an implementation environment according to an exemplary embodiment.

[0054] Figure 2 The figure is a flow chart of an interface display method according to an exemplary embodiment.

[0055] Figure 3 The figure is a flowchart of another interface display method according to an exemplary embodiment.

[0056] Figure 4 is a schematic diagram showing a third camera movement special effect according to an exemplary embodiment.

[0057] Figure 5 The figure is a flow chart of an interface display method according to an exemplary embodiment.

[0058] Figure 6 The figure is a block diagram of an interface display device according to an exemplary embodiment.

[0059] Figure 7 It is a block diagram of a terminal according to an exemplary embodiment. DETAILED DESCRIPTION

[0060] In order to enable ordinary persons in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings.

[0061] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0062] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.) and signals involved in this disclosure are all authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions. For example, the music, facial information, camera movement parameters, etc. involved in this disclosure are all obtained with full authorization.

[0063] The interface display method provided by the embodiment of the present disclosure can be executed by a terminal. Figure 1 This is a schematic diagram of an implementation environment provided by the embodiment of the present disclosure, see Figure 1 , the implementation environment includes: a terminal 101 and a server 102. In the embodiment of the present disclosure, the terminal 101 is used to display the live broadcast interface. In some embodiments, a target application is installed on the terminal 101, and the terminal 101 is an application that can display the live broadcast interface. The target application can be any application that can broadcast live, such as a shopping application, a news application, a search application, a video application, and a social application, which is not specifically limited here. The server 102 is the background server of the target application.

[0064] The terminal 101 may be at least one of a smart phone, a smart watch, a desktop computer, a laptop, a virtual reality terminal, an augmented reality terminal, a wireless terminal, and a laptop computer. The terminal 101 has a communication function and can access a wired network or a wireless network. The terminal 101 may generally refer to one of a plurality of terminals, and those skilled in the art may know that the number of the above terminals may be more or less. The server 102 may be an independent physical server, or a server cluster or a distributed file system composed of a plurality of physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms. In some embodiments, the server 102 is directly or indirectly connected to the terminal 101 via a wired or wireless communication method, which is not limited in the embodiments of the present disclosure. Optionally, the number of the above servers 102 may be more or less, which is not limited in the embodiments of the present disclosure. Of course, the server 102 may also include other functional servers to provide more comprehensive and diversified services. Among them, the server 102 undertakes the main computing work, and the terminal 101 undertakes the secondary computing work; or, the server 102 undertakes the secondary computing work, and the terminal 101 undertakes the main computing work; or, the server 102 or the terminal 101 can each independently undertake the computing work, which is not limited in the embodiments of the present disclosure.

[0065] Figure 2 is a flow chart of an interface display method according to an exemplary embodiment. Figure 2 As shown, the method is executed by a terminal, and the method includes the following steps.

[0066] In step S201, the terminal collects music in the target space.

[0067] In the embodiment of the present disclosure, the target space is a real space. The target space includes at least one of a live object, a live object, etc. The terminal is used to display a live interface of the target space.

[0068] In some embodiments, the terminal obtains the music in the target space from the server, that is, the shooting terminal of the target space uploads both the music in the target space and the shot video stream to the server, so that the server generates a video stream of the live interface. Accordingly, the terminal can obtain the music in the target space from the server.

[0069] In other embodiments, the terminal is located in the target space to collect music in the target space. Optionally, the music in the target space is music played in the target space by an audio device, and the terminal collects the music played by the audio device. Alternatively, the music in the target space is music played by the terminal, and the terminal collects the music played in the target space or directly obtains the music in the target space from itself.

[0070] In step S202, the terminal obtains camera movement parameters based on at least one of the rhythm characteristics of the music and facial information, where the facial information includes at least one of the facial expression and facial movement of the object in the target space, and the camera movement parameters include at least one of the camera movement speed, camera movement distance and camera movement angle.

[0071] In the disclosed embodiment, the rhythm feature indicates the rhythm of the music, which may be the real-time rhythm of the music. Further, the rhythm feature also indicates the beat points in the music, and further indicates the heavy beat points and the weak beat points.

[0072] In the disclosed embodiment, the camera distance refers to the distance between the terminal lens and the photographed object in the shooting picture. The camera angle refers to the left-right deflection angle or the up-down deflection angle of the shooting picture based on the photographed object.

[0073] In the disclosed embodiment, the camera movement speed includes at least one of a first type of speed and a second type of speed. The first type of speed is used to adjust the camera movement distance, such as a unit of seconds / meter. The second type of speed is used to adjust the camera movement angle, such as a unit of seconds / degree.

[0074] In step S203, the terminal displays a live broadcast interface of the target space based on the camera movement parameters, where the live broadcast interface includes camera movement effects corresponding to the camera movement parameters.

[0075] In the embodiment of the present disclosure, the terminal may be a terminal used by a host or a terminal used by an audience.

[0076] In the disclosed embodiment, the target space can be photographed by a shooting terminal based on the camera movement parameters to obtain a video stream of the target space, and then after the terminal obtains the video stream, the live broadcast interface displayed based on the video stream includes the camera movement effect corresponding to the camera movement parameter. Alternatively, the target space is photographed by a shooting terminal to obtain a video screen of the target space, and then when the terminal obtains the video screen for display, the live broadcast interface obtained after adjusting the video screen based on the camera movement parameters includes the camera movement effect corresponding to the camera movement parameter.

[0077] In the disclosed embodiment, when the shooting terminal shoots the target space based on the camera movement parameters, the shooting terminal can be located at a fixed position to shoot the target space, and the shooting terminal adjusts the camera movement parameters by automatically adjusting its focal length and other shooting parameters. For example, the camera movement distance is adjusted by adjusting the focal length of the shooting terminal, and the adjustment speed of the focal length is also the camera movement speed corresponding to the camera movement distance.

[0078] Among them, if the terminal is a terminal used by the anchor, then the terminal and the shooting terminal can be the same terminal, that is, the same terminal is used for both live shooting and displaying the live interface.

[0079] The video stream includes the music in the target space and the picture data of the target space. The terminal sends the captured video stream to the server, which processes the live video stream. The server sends the live video stream to multiple terminals participating in the live broadcast, and the multiple terminals include terminals used by the anchor and terminals used by the audience. The multiple terminals display the live broadcast interface based on the video stream. The live broadcast interface displays a camera movement special effect, which corresponds to at least one of the rhythm characteristics of the music and the facial information.

[0080] The disclosed embodiment provides an interface display method. When displaying the live broadcast interface of the target space, the method collects the music in the target space, then obtains the camera movement parameters based on at least one of the rhythm characteristics of the music and the facial information, and then displays the live broadcast interface based on the camera movement parameters, so that the live broadcast interface includes the camera movement effect corresponding to the camera movement parameters. Since the camera movement parameters are not determined artificially based on experience, but are obtained by real-time reasoning based on the music rhythm and the facial information of the object during the live broadcast, it is obvious that the camera movement parameters are highly accurate. In this way, when the live broadcast interface is displayed based on the camera movement parameters, the camera movement special effects displayed by the live broadcast interface are more intuitive and accurate. In addition, the method does not require human participation, and the machine can automatically determine the accurate camera movement parameters and display the live broadcast interface based on the determined camera movement parameters, thereby improving the efficiency of human-computer interaction.

[0081] In some embodiments, obtaining the camera movement parameter based on at least one of the rhythm feature of the music and the facial information includes at least one of the following:

[0082] When no music in the target space is collected, camera movement parameters are obtained based on facial information;

[0083] When music in the target space is collected, camera movement parameters are obtained based on rhythm features; or, when music in the target space is collected, camera movement parameters are obtained based on rhythm features and facial information.

[0084] In the disclosed embodiment, when the music in the target space is not collected, that is, the camera movement parameters cannot be determined based on the music rhythm at this time, and then the camera movement parameters are obtained based on the facial information at this time, so that the camera movement parameters are obtained by real-time reasoning based on the facial information of the object during the live broadcast, thereby ensuring the accuracy of the camera movement parameters. When the music in the target space is collected, the camera movement parameters are obtained by real-time reasoning based on the music rhythm during the live broadcast. Obviously, the accuracy of the camera movement parameters is high. In this way, when the live broadcast interface is displayed based on the camera movement parameters, the camera movement special effects displayed by the live broadcast interface are more intuitive and accurate. The camera movement parameters are obtained based on the rhythm characteristics and facial information. In this way, the camera movement parameters are obtained based on a variety of real-time information during the live broadcast, which obviously further improves the accuracy of the camera movement parameters. In this way, when the live broadcast interface is displayed based on the camera movement parameters, the camera movement special effects displayed by the live broadcast interface not only match the rhythm characteristics, but also match the facial information of the object, thereby making the camera movement characteristics more intuitive and accurate.

[0085] In some embodiments, based on the camera movement parameters, displaying the live broadcast interface of the target space includes:

[0086] Obtain a video stream shot based on the camera movement parameters, and display a live broadcast interface based on the video stream; or,

[0087] The video picture of the target space is adjusted based on the camera movement parameters, and the live broadcast interface is displayed based on the adjusted video picture.

[0088] In the disclosed embodiment, when shooting the target space, the camera movement parameters are obtained based on at least one of the music rhythm and facial information, and then the target space is shot based on the camera movement parameters. Since the camera movement parameters are not determined artificially based on experience, but are obtained by real-time reasoning based on at least one of the music rhythm and facial information during live broadcast, it is obvious that the camera movement parameters are highly accurate. In this way, when the video stream shot based on the camera movement parameters displays the live broadcast interface, the camera movement special effects displayed on the live broadcast interface are more intuitive and accurate. In addition, this method does not require manual participation when shooting. The machine can automatically determine the accurate camera movement parameters and automatically shoot based on the determined camera movement parameters, thereby improving the efficiency of human-computer interaction.

[0089] In the disclosed embodiment, the video image of the target space is adjusted based on the camera movement parameters. Since the camera movement parameters are not determined artificially based on experience, but are obtained by real-time reasoning based on at least one of the music rhythm and facial information during live broadcast, it is obvious that the camera movement parameters have high accuracy, and then the video image is adjusted based on the camera movement parameters. When the live broadcast interface is displayed based on the adjusted video image, the camera movement special effects displayed by the live broadcast interface are more intuitive and accurate. In addition, the method does not require manual camera movement during shooting, but automatically adjusts the video image based on the camera movement parameters after shooting, thereby improving the efficiency of human-computer interaction.

[0090] In some embodiments, obtaining the camera movement parameter based on at least one of the rhythm feature of the music and the facial information includes:

[0091] When the rhythm feature indicates that the rhythm of the music is less than the rhythm threshold, outputting the first camera movement parameter as the camera movement parameter;

[0092] When the rhythm feature indicates that the rhythm of the music is not less than the rhythm threshold, the second camera movement parameter is output as the camera movement parameter, and the second camera movement parameter is the camera movement parameter corresponding to the rhythm in the camera movement parameter library, and the camera movement parameter library includes multiple rhythms and multiple camera movement parameters that are positively correlated with each other.

[0093] In the disclosed embodiment, when the rhythm of the music is less than the rhythm threshold, it means that the rhythm is slow. When the rhythm is slow, the rhythm changes relatively slowly. In this way, the rhythm less than the rhythm threshold is uniformly corresponded to a fixed camera movement parameter, which ensures that the camera movement effect can match the rhythm of the music while improving the processing efficiency of the camera movement. When the rhythm of the music is greater than the rhythm threshold, it means that the rhythm is fast. When the rhythm is fast, the rhythm changes relatively quickly. Then, the camera movement is performed based on the camera movement parameters that are positively correlated with the rhythm, so that the camera movement can change significantly with the rhythm, that is, the strong effect of camera movement when the music is dynamic is achieved, making the camera movement more accurate.

[0094] In some embodiments, the first camera movement parameter includes at least one of a first camera movement speed and a second camera movement speed. Based on the camera movement parameter, displaying the live broadcast interface of the target space includes at least one of the following:

[0095] Display the camera movement effect of adjusting the camera movement distance according to the first camera movement speed on the live broadcast interface;

[0096] The live broadcast interface shows the camera effect of adjusting the camera angle according to the second camera speed.

[0097] In the disclosed embodiment, when the rhythm of the music is less than the rhythm threshold, it indicates that the rhythm is slow, and thus the rhythm changes are also relatively gentle. At this time, at least one of the camera movement distance and the camera movement angle is adjusted at a fixed speed, so that the terminal lens is gently enlarged or slightly shaken with the rhythm of the music, that is, synchronized with the rhythm of the music in the form of rhythm. In this way, through accurate analysis of the music and delicate control of the lens movement, it is ensured that the camera movement speed matches the rhythm changes of the music.

[0098] In some embodiments, based on the camera movement parameters, displaying the live broadcast interface of the target space includes:

[0099] When the rhythm feature indicates that the rhythm of the music is not less than the rhythm threshold, the first camera movement effect is displayed at the heavy beat points of the music on the live broadcast interface.

[0100] In this embodiment, when the rhythm is not less than the rhythm threshold, it means that the rhythm is fast, and a stronger camera movement effect is needed at this time, and then the first camera movement special effect is displayed at this time, so that the camera movement effect is stronger, and the first camera movement special effect is applied at the heavy beat point, that is, the camera movement special effect is achieved. The card point appearance, and then the camera movement special effect is more matched with the rhythmic characteristics of the music, that is, this scheme makes the camera movement effect better and can further improve the camera movement effect.

[0101] In some embodiments, based on the camera movement parameters, displaying the live broadcast interface of the target space includes:

[0102] When two rhythms indicated by different rhythm characteristics appear alternately in the music according to a preset rule, a second camera movement effect is displayed on the live broadcast interface, and the first camera movement node and the second camera movement node of the second camera movement effect appear according to the preset rule to be respectively displayed on the beat points corresponding to the two rhythms.

[0103] In the disclosed embodiment, when two different rhythms in the music appear alternately according to a regular pattern, a second camera movement effect having this regular pattern is displayed, so that the camera movement effect is more closely matched with the rhythm of the music, thereby further improving the camera movement effect and making the camera movement accurate.

[0104] In some embodiments, the second camera movement special effect includes a first sub-special effect and a second sub-special effect, and the second camera movement special effect is displayed on the live broadcast interface, including:

[0105] When the difference between the two rhythms is greater than the difference threshold, the first sub-effect is displayed on the live broadcast interface, and the camera parameters of the first sub-effect include the closest camera distance and the farthest camera distance, and the first camera node and the second camera node correspond to the closest camera distance and the farthest camera distance respectively;

[0106] When the difference between the two rhythms is not greater than the difference threshold, the second sub-effect is displayed on the live broadcast interface. The camera parameters of the second sub-effect include the minimum camera angle and the maximum camera angle. The first camera node and the second camera node correspond to the minimum camera angle and the maximum camera angle, respectively.

[0107] In the disclosed embodiment, when the difference between the two rhythms is greater than the difference threshold, it means that the rhythm changes quickly, and then based on the first sub-effect, the camera movement distance is quickly shortened or extended, so that the camera movement effect matches the change of the fast rhythm at this time, highlighting the effect of the drastic change, thereby improving the camera movement effect. When the difference between the two rhythms is not greater than the difference threshold, it means that the rhythm changes slowly, and then based on the second sub-effect, the effect of the live broadcast interface shaking slowly is achieved, so that the camera movement effect matches the change of the slow rhythm at this time, highlighting the effect of the slow change, thereby improving the camera movement effect. That is, the method uses different camera movement effects based on the difference between the two rhythms, further improving the camera movement effect, that is, improving the accuracy of the camera movement.

[0108] In some embodiments, obtaining the camera movement parameter based on at least one of the rhythm feature of the music and the facial information includes:

[0109] When the rhythm feature indicates that the rhythm of the music is reduced, the camera movement parameter corresponding to the reduced rhythm is output as the camera movement parameter;

[0110] When the rhythm feature indicates that the rhythm of the music increases, the camera movement parameters corresponding to the increased rhythm are output as the camera movement parameters.

[0111] In the disclosed embodiment, the camera movement parameters are reduced when the rhythm decreases, and are increased when the rhythm increases, that is, the rhythm is positively correlated with the camera movement parameters. The camera movement parameters decrease as the rhythm decreases, and increase as the rhythm increases, so that the change in the camera movement effect matches the change in the rhythm, thereby making the camera movement more accurate.

[0112] In some embodiments, the method further comprises:

[0113] If the music in the target space is not collected, the camera effect will not be displayed on the live broadcast interface.

[0114] In the disclosed embodiment, the camera movement effect is not displayed on the live broadcast interface when the music disappears, so that the lens can be stably focused on the target object, ensuring that the image of the target object can be clearly displayed, and then presenting a clear image of the target object on the live broadcast interface. At this time, the disappearance of the camera movement effect avoids unnecessary visual interference, making the communication of the target object on the live broadcast interface more direct and powerful, improving the flexibility of the camera movement and improving the interface display effect.

[0115] In some embodiments, the method further comprises:

[0116] Acquiring lighting parameters based on at least one of a rhythm feature of the music and facial information;

[0117] Display virtual lights on the live broadcast interface based on lighting parameters.

[0118] In the disclosed embodiment, the lighting effects on the live broadcast interface also change with at least one of the rhythm of the music and the facial information, so that the virtual lighting on the live broadcast interface is more realistic, further optimizing the display effect of the live broadcast interface, thereby facilitating the interaction of terminal users on the live broadcast interface. In addition, the lighting parameters are automatically adjusted with at least one of the rhythm and the facial information, without manual triggering, thereby improving the efficiency of human-computer interaction.

[0119] In some embodiments, based on the camera movement parameters, displaying the live broadcast interface of the target space includes at least one of the following:

[0120] When the object in the target space receives the virtual resource, a third camera movement special effect is displayed on the live broadcast interface, and the third camera movement special effect is used to magnify the face of the object on the live broadcast interface;

[0121] When the value of the virtual resources received by the object in the target space reaches the resource threshold, a third camera movement effect is displayed on the live broadcast interface, and the third camera movement effect is used to enlarge the face of the object on the live broadcast interface.

[0122] In the disclosed embodiment, after the host receives virtual resources or the value of the received virtual resources reaches a certain value, the host's face is enlarged based on the third camera movement effect, that is, the host's face is brought closer. In this way, the behavior of the terminal user sending virtual resources is fed back through camera movement, which improves the convenience of feedback and realizes the integrity of interaction, thereby promoting terminal users to interact on the live broadcast interface and improving the liveliness of the live broadcast.

[0123] In some embodiments, obtaining the camera movement parameter based on at least one of the rhythm feature of the music and the facial information includes:

[0124] Sending the music and the facial information to a server, the server being used to extract the rhythm features of the music and determine the camera movement parameters corresponding to at least one of the rhythm features and the facial information; or

[0125] The rhythm feature of the music is extracted, and the rhythm feature and the facial information are sent to a server, and the server is used to determine the camera movement parameter corresponding to at least one of the rhythm feature and the facial information.

[0126] In the disclosed embodiment, the camera movement parameters are determined by the server, which not only reduces the service pressure of the terminal, but also improves the efficiency of determining the camera movement parameters and ensures timeliness due to the powerful computing power of the server.

[0127] Above Figure 2 This is the basic process of displaying the live broadcast interface. Figure 3 This section describes the process of displaying the live broadcast interface. Figure 3 , Figure 3 The present invention is a flowchart of an interface display method according to an exemplary embodiment. The method is executed by a terminal and includes the following steps.

[0128] In step S301, the terminal collects music in the target space.

[0129] Wherein, music has certain rhythmic characteristics. If the terminal determines the rhythmic characteristics of the music through the server, the terminal sends the collected music to the server, and the rhythmic characteristics of the music are determined through the server.

[0130] In the disclosed embodiment, if live streaming is performed, that is, the terminal displays a real-time live streaming interface, the terminal shoots the target space in real time through the shooting terminal to perform real-time live streaming.

[0131] In some embodiments, an intelligent camera movement switch is provided on the shooting terminal. Before shooting, in response to turning on the intelligent camera movement switch, the intelligent camera movement is turned on during the shooting process; intelligent camera movement refers to the automatic adjustment of camera movement parameters such as camera movement speed, camera movement distance, camera movement angle, etc. during the shooting process, so that they are closely integrated with the rhythm of the music and at least one of the facial information. When the live broadcast interface is displayed based on the video stream obtained by shooting, the camera movement special effects will change according to the changes in at least one of the music rhythm and facial information, presenting a more vivid live broadcast effect.

[0132] In other embodiments, an intelligent camera movement switch is provided on the terminal. Before executing step S301, in response to turning on the intelligent camera movement switch, during the process of displaying the live broadcast interface, the video picture of the target space is adjusted based on the camera movement parameters, and the live broadcast interface is displayed based on the adjusted video picture.

[0133] In other embodiments, the terminal and the shooting terminal are the same terminal, and in response to turning on the intelligent camera movement switch, the terminal executes step S301.

[0134] In step S302, the terminal obtains camera movement parameters based on at least one of the rhythm characteristics of the music and facial information, where the facial information includes at least one of the facial expression and facial movement of the object in the target space, and the camera movement parameters include at least one of the camera movement speed, camera movement distance and camera movement angle.

[0135] In some embodiments, the terminal itself determines the camera movement parameters, wherein the terminal first extracts the rhythm features of the music or extracts the rhythm features of the music through a server, and then the terminal itself determines the camera movement parameters corresponding to at least one of the rhythm features and the facial information.

[0136] In other embodiments, the terminal determines the camera movement parameters through the server. The terminal sends the music and facial information to the server, and the server is used to extract the rhythm features of the music and determine the camera movement parameters corresponding to at least one of the rhythm features and the facial information; or the terminal extracts the rhythm features of the music and sends the rhythm features and the facial information to the server, and the server is used to determine the camera movement parameters corresponding to at least one of the rhythm features and the facial information.

[0137] It should be noted that if the camera movement parameters are determined only based on rhythmic features, there is no need to send facial information to the server. If the camera movement parameters are determined only based on facial information, there is no need to send music and rhythmic features to the server, and the terminal does not need to determine the rhythmic features of the music.

[0138] In this embodiment, the camera movement parameters are determined by the server, which not only reduces the service pressure of the terminal, but also improves the efficiency of determining the camera movement parameters and ensures timeliness due to the powerful computing power of the server.

[0139] In an embodiment of the present disclosure, the terminal obtains camera movement parameters based on at least one of the rhythm feature and the facial information, and the process includes at least one of the following implementation methods.

[0140] First, when no music in the target space is collected, the terminal obtains camera movement parameters based on facial information.

[0141] In some embodiments, the terminal establishes a correspondence between multiple facial information and camera movement parameters. Each facial information includes at least one of a facial expression and a facial action, and at least one of the facial expressions and facial actions included in the two facial information is different. Accordingly, the terminal obtains the camera movement parameters based on the facial information and the above correspondence, thereby improving the convenience of obtaining the camera movement parameters.

[0142] In this embodiment, when the music in the target space is not collected, that is, the camera movement parameters cannot be determined based on the music rhythm, the camera movement parameters are obtained based on the facial information, so that the camera movement parameters are inferred in real time based on the facial information of the object during the live broadcast, thereby ensuring the accuracy of the camera movement parameters.

[0143] Second, when music in the target space is collected, the terminal obtains camera movement parameters based on rhythm features.

[0144] Among them, taking the terminal itself determining the camera movement parameter based on the rhythm feature as an example, the process of the terminal obtaining the camera movement parameter based on at least one of the rhythm feature of the music and the facial information includes the following situations: when the rhythm feature indicates that the rhythm of the music is less than the rhythm threshold, the first camera movement parameter is output as the camera movement parameter. When the rhythm feature indicates that the rhythm of the music is not less than the rhythm threshold, the second camera movement parameter is output as the camera movement parameter, and the second camera movement parameter is a camera movement parameter corresponding to the rhythm in the camera movement parameter library, and the camera movement parameter library includes multiple rhythms and multiple camera movement parameters that are respectively positively correlated with each other.

[0145] The first camera movement parameter is a fixed camera movement parameter, that is, for any rhythm that is less than the rhythm threshold, the corresponding camera movement parameter is the first camera movement parameter.

[0146] Among them, the rhythm in the camera movement parameter library is positively correlated with the camera movement parameter, that is, the faster the rhythm, the larger the camera movement parameter, and the slower the rhythm, the smaller the camera movement parameter. For example, the camera movement parameter includes the camera movement speed, then the faster the rhythm, the larger the camera movement speed, and the slower the rhythm, the smaller the camera movement speed.

[0147] In the above embodiments, the example of the terminal itself determining the camera movement parameters is used for explanation. In other embodiments, the terminal determines the camera movement parameters through the server. The determination process is the same as the process of the terminal determining the camera movement parameters, which will not be repeated here.

[0148] In the disclosed embodiment, the camera movement parameters are determined based on the correspondence between the rhythm and the camera movement parameters. In other embodiments, the camera movement parameters can also be determined based on a deep learning model. The terminal inputs the rhythm feature into the camera movement parameter model, and outputs the camera movement parameters through the camera movement parameter model. The camera movement parameter module is trained based on multiple sample rhythm features and sample camera movement parameters corresponding to the multiple sample rhythm features.

[0149] In some embodiments, the terminal is provided with a music recognition module, a rhythm tracking module and a camera movement adjustment module. The music recognition module is used to recognize the music in the target space, that is, to collect the music in the target space. The rhythm tracking module is used to analyze the rhythm of the music, that is, to determine the rhythm characteristics. The camera movement adjustment module is used to determine the corresponding camera movement parameters according to the rhythm characteristics.

[0150] In the disclosed embodiment, when music in the target space is collected, the camera movement parameters are inferred in real time based on the music rhythm during the live broadcast. Obviously, the accuracy of the camera movement parameters is high. In this way, when the live broadcast interface is displayed based on the camera movement parameters, the camera movement effects displayed on the live broadcast interface are more intuitive and accurate.

[0151] In the embodiment of the present disclosure, when the rhythm feature indicates that the rhythm of the music is not less than the rhythm threshold, the terminal determines a second camera movement parameter corresponding to the rhythm from the camera movement parameter library.

[0152] In the disclosed embodiment, when the rhythm of the music is greater than the rhythm threshold, it means that the rhythm is fast. When the rhythm is fast, the rhythm changes relatively quickly. At this time, the camera movement is performed based on the camera movement parameters that are positively correlated with the rhythm, so that the camera movement effect can change significantly with the rhythm, that is, the strong camera movement effect is achieved when the music is dynamic, making the camera movement effect more accurate.

[0153] In the above embodiment, the camera movement effect is displayed based on the fixed camera movement parameters when the rhythm is slow, and the camera movement effect is displayed based on the positively correlated camera movement parameters when the rhythm is fast. In other embodiments, regardless of whether the rhythm is less than the rhythm threshold, for any rhythm, the camera movement parameters positively correlated with the rhythm are determined, and then the camera movement effect is displayed based on the positively correlated camera movement parameters, so that the camera movement effect is more matched with the rhythm of the music.

[0154] In other embodiments, the process of the terminal acquiring the camera movement parameters based on at least one of the rhythm characteristics of the music and the facial information includes at least one of the following implementation methods: when the rhythm characteristics indicate that the rhythm of the music is decreasing, the terminal outputs the camera movement parameters corresponding to the decreased rhythm as the camera movement parameters; when the rhythm characteristics indicate that the rhythm of the music is increasing, the terminal outputs the camera movement parameters corresponding to the increased rhythm as the camera movement parameters.

[0155] In this implementation, the camera movement parameters are reduced when the rhythm decreases, and are increased when the rhythm increases. That is, the rhythm is positively correlated with the camera movement parameters. The camera movement parameters decrease as the rhythm decreases, and increase as the rhythm increases, so that the change in the camera movement effect matches the change in the rhythm, thereby making the camera movement more accurate.

[0156] Thirdly, when music in the target space is collected, the terminal obtains camera movement parameters based on rhythm features and facial information.

[0157] In some embodiments, the terminal establishes a plurality of corresponding relationships between rhythm features, facial information, and camera movement parameters. One corresponding relationship includes a rhythm feature, a facial information, and a camera movement parameter. Accordingly, the terminal obtains the camera movement parameter based on the current rhythm feature, facial information, and the above-mentioned corresponding relationship, thereby improving the convenience of obtaining the camera movement parameter.

[0158] In the disclosed embodiment, the camera movement parameters are obtained based on the rhythm characteristics and facial information. In this way, the camera movement parameters are obtained based on a variety of real-time information during live broadcast, which obviously further improves the accuracy of the camera movement parameters. In this way, when the live broadcast interface is displayed based on the camera movement parameters, the camera movement effects displayed on the live broadcast interface not only match the rhythm characteristics, but also match the facial information of the object, thereby making the camera movement characteristics more intuitive and accurate.

[0159] In step S303, the terminal displays a live broadcast interface of the target space based on the camera movement parameters, where the live broadcast interface includes camera movement effects corresponding to the camera movement parameters.

[0160] In some embodiments, the process of the above-mentioned terminal displaying the live broadcast interface of the target space based on the camera movement parameters includes the following implementation methods: the terminal obtains the video stream shot based on the camera movement parameters, and displays the live broadcast interface based on the video stream; or, the terminal adjusts the video picture of the target space based on the camera movement parameters, and displays the live broadcast interface based on the adjusted video picture.

[0161] In the disclosed embodiment, when shooting the target space, the camera movement parameters are obtained based on at least one of the music rhythm and facial information, and then the target space is shot based on the camera movement parameters. Since the camera movement parameters are not determined artificially based on experience, but are obtained by real-time reasoning based on at least one of the music rhythm and facial information during live broadcast, it is obvious that the camera movement parameters are highly accurate. In this way, when the video stream shot based on the camera movement parameters displays the live broadcast interface, the camera movement special effects displayed on the live broadcast interface are more intuitive and accurate. In addition, this method does not require manual participation when shooting. The machine can automatically determine the accurate camera movement parameters and automatically shoot based on the determined camera movement parameters, thereby improving the efficiency of human-computer interaction.

[0162] In the disclosed embodiment, the video image of the target space is adjusted based on the camera movement parameters. Since the camera movement parameters are not determined artificially based on experience, but are obtained by real-time reasoning based on at least one of the music rhythm and facial information during live broadcast, it is obvious that the camera movement parameters have high accuracy, and then the video image is adjusted based on the camera movement parameters. When the live broadcast interface is displayed based on the adjusted video image, the camera movement special effects displayed by the live broadcast interface are more intuitive and accurate. In addition, the method does not require manual camera movement during shooting, but automatically adjusts the video image based on the camera movement parameters after shooting, thereby improving the efficiency of human-computer interaction.

[0163] In some embodiments, the first camera movement parameter includes at least one of a first camera movement speed and a second camera movement speed, the first camera movement speed is used to adjust the camera movement distance, and the second camera movement speed is used to adjust the camera movement angle. Accordingly, the terminal displays the live broadcast interface of the target space based on the camera movement parameter, including at least one of the following implementation methods: the terminal displays the camera movement effect of adjusting the camera movement distance according to the first camera movement speed on the live broadcast interface; the terminal displays the camera movement effect of adjusting the camera movement angle according to the second camera movement speed on the live broadcast interface, that is, the camera movement effect of adjusting at least one of the camera movement distance and the camera movement angle.

[0164] In the disclosed embodiment, when the rhythm of the music is less than the rhythm threshold, it means that the rhythm is slow. At this time, at least one of the camera movement distance and the camera movement angle is adjusted at a fixed speed, so that the terminal lens is gently enlarged or slightly shaken with the rhythm of the music, that is, synchronized with the rhythm of the music in the form of rhythm, so that the speed of the camera movement is matched with the rhythm change of the music through accurate analysis of the music and delicate control of the camera movement. Since the rhythm changes relatively smoothly when the rhythm is slow, the rhythm less than the rhythm threshold is uniformly corresponded to a fixed camera movement parameter, which ensures that the camera movement effect can match the rhythm of the music while improving the processing efficiency of the camera movement.

[0165] In some embodiments, in order to make the camera move smoothly to match the rhythm when the music rhythm is slow, the camera movement speed is controlled, such as the first camera movement speed is less than the first speed threshold, and the second camera movement speed is less than the second speed threshold.

[0166] In some embodiments, the process of the above-mentioned terminal displaying the live broadcast interface of the target space based on the camera movement parameters also includes the following implementation method: when the rhythm characteristics indicate that the rhythm of the music is not less than the rhythm threshold, the terminal displays the first camera movement effect at the heavy beat point of the music on the live broadcast interface.

[0167] The first camera movement effect can be set as needed. Optionally, the terminal determines the first camera movement effect based on the beat of the music. The terminal determines the first camera movement effect corresponding to the beat of the music from a camera movement effect library. The camera movement effect library includes multiple beats and camera movement effects corresponding to the multiple beats.

[0168] In this embodiment, when the rhythm is not less than the rhythm threshold, it means that the rhythm is fast, and a stronger camera movement effect is needed at this time, and then the first camera movement special effect is displayed at this time, so that the camera movement effect is stronger, and the first camera movement special effect is applied at the heavy beat point, that is, the camera movement special effect is achieved. The card point appearance, and then the camera movement special effect is more matched with the rhythmic characteristics of the music, that is, this scheme makes the camera movement effect better and can further improve the camera movement effect.

[0169] In some embodiments, the process of the terminal displaying the live broadcast interface of the target space based on the camera movement parameters also includes the following implementation method: when the rhythm characteristics indicate that two different rhythms appear alternately in the music according to a preset rule, the terminal displays a second camera movement effect on the live broadcast interface, and the first camera movement node and the second camera movement node of the second camera movement effect appear according to the preset rule to be respectively displayed on the beat points corresponding to the two rhythms.

[0170] Optionally, the terminal determines a second camera movement special effect corresponding to a preset rule from a camera movement rule library, where the camera movement rule library includes a plurality of preset rules and second camera movement special effects corresponding to the plurality of preset rules, respectively.

[0171] Among them, the two rhythms appear alternately according to a preset rule, which means that the two rhythms appear alternately periodically.

[0172] Optionally, the first camera movement node and the second camera movement node correspond to the boundary value of the camera movement parameter of the second camera movement special effect. Further, the first camera movement node and the second camera movement node correspond to the same type of boundary value. For example, the first camera movement node and the second camera movement node correspond to the nearest camera movement distance and the farthest camera movement distance, respectively, or the first camera movement node and the second camera movement node correspond to the minimum camera movement angle and the maximum camera movement angle, respectively.

[0173] Optionally, the relatively faster of the two rhythms corresponds to the maximum boundary value, and the relatively slower of the two rhythms corresponds to the minimum boundary value, thereby being able to highlight a strong camera movement effect when the rhythm is dynamic and produce a gentle camera movement effect when the rhythm is slow, further improving the camera movement effect, and making the camera movement accurate.

[0174] The beat point corresponding to the rhythm is also the beat point at which the rhythm appears, and further, may be a heavy beat point.

[0175] In this embodiment, when two different rhythms in the music appear alternately according to a certain pattern, a second camera movement effect having this pattern is displayed, so that the camera movement effect is more matched with the rhythm of the music, further improving the camera movement effect and making the camera movement accurate.

[0176] In some embodiments, the second camera movement effect also includes a first sub-effect and a second sub-effect, and the two sub-effects are used respectively when the difference between the two rhythms is different. Accordingly, the process of the above-mentioned terminal displaying the second camera movement effect on the live broadcast interface includes the following steps: when the difference between the two rhythms is greater than the difference threshold, the terminal displays the first sub-effect on the live broadcast interface, and the camera movement parameters of the first sub-effect include the closest camera movement distance and the farthest camera movement distance, and the first camera movement node and the second camera movement node correspond to the closest camera movement distance and the farthest camera movement distance respectively; when the difference between the two rhythms is not greater than the difference threshold, the terminal displays the second sub-effect on the live broadcast interface, and the camera movement parameters of the second sub-effect include the minimum camera movement angle and the maximum camera movement angle, and the first camera movement node and the second camera movement node correspond to the minimum camera movement angle and the maximum camera movement angle respectively.

[0177] In this embodiment, when the difference between the two rhythms is greater than the difference threshold, it means that the rhythm changes quickly, and then based on the first sub-effect, the camera movement distance is quickly shortened or extended, so that the camera movement effect matches the change of the fast rhythm at this time, highlighting the effect of the drastic change, thereby improving the camera movement effect. When the difference between the two rhythms is not greater than the difference threshold, it means that the rhythm changes slowly, and then based on the second sub-effect, the effect of the live broadcast interface shaking slowly is achieved, so that the camera movement effect matches the change of the slow rhythm at this time, highlighting the effect of the slow change, thereby improving the camera movement effect. That is, this method uses different camera movement effects based on the difference between the two rhythms, further improving the camera movement effect and the accuracy of the camera movement.

[0178] In step S304, when the anchor in the target space receives the virtual resource, the terminal displays a third camera movement effect on the live broadcast interface, where the third camera movement effect is used to magnify the face of the object on the live broadcast interface.

[0179] Among them, the camera movement parameters of the third camera movement special effect include camera movement distance and camera movement speed, and the third camera movement special effect shortens the camera movement distance based on the camera movement speed.

[0180] The third camera movement effect can be set as needed. Optionally, the terminal determines the third camera movement effect based on the value of the virtual resource. The terminal determines the third camera movement effect corresponding to the value of the virtual resource from a camera movement effect library. The camera movement effect library includes multiple values ​​and camera movement effects corresponding to the multiple values.

[0181] Among them, the camera movement distance of the camera movement special effect is negatively correlated with the value, and the camera movement speed of the camera movement special effect is positively correlated with the value. That is, the larger the value, the closer the camera movement distance, and the faster the camera movement speed; the smaller the value, the longer the camera movement distance, and the slower the camera movement speed. Therefore, the larger the value, the greater the degree of magnification of the host's face, and the smaller the value, the smaller the degree of magnification of the host's face.

[0182] In step S304, the third camera movement effect is displayed when the anchor receives the virtual resource. In other embodiments, when the value of the virtual resource received by the object in the target space reaches the resource threshold, the third camera movement effect is displayed on the live broadcast interface, and the third camera movement effect is used to magnify the face of the object on the live broadcast interface.

[0183] In the disclosed embodiment, after the host receives virtual resources or the value of the received virtual resources reaches a certain value, the host's face is enlarged based on the third camera movement effect, that is, the host's face is brought closer. In this way, the behavior of the terminal user sending virtual resources is fed back through camera movement, which improves the convenience of feedback and realizes the integrity of interaction, thereby promoting terminal users to interact on the live broadcast interface.

[0184] In the disclosed embodiment, the third camera movement effect for magnifying the face of the anchor is applied when receiving the virtual resource as an example. In other embodiments, other camera movement effects for achieving other effects can also be applied at this time, such as applying the fourth camera movement effect for shaking the live broadcast interface. Among them, when the anchor in the target space receives the virtual resource or the value of the received virtual resource reaches the resource threshold, the fourth camera movement effect is displayed on the live broadcast interface, and the fourth camera movement effect is used to show that the live broadcast interface is shaking.

[0185] In the above embodiment, the live broadcast interface is displayed based on the camera movement parameters corresponding to the rhythm characteristics of the music after the music is collected. In other embodiments, when the terminal cannot collect the music in the target space, the terminal does not display the camera movement effect on the live broadcast interface.

[0186] In this embodiment, when the music disappears, the camera movement effect is not displayed on the live broadcast interface, so that the lens can be stably focused on the target object, ensuring that the image of the target object can be clearly displayed by the lens, and then presenting a clear image of the target object on the live broadcast interface. At this time, the disappearance of the camera movement effect avoids unnecessary visual interference, making the communication of the target object on the live broadcast interface more direct and powerful.

[0187] For example, see Figure 4 , Figure 4 is a schematic diagram of a third camera movement special effect according to an exemplary embodiment. The left and right interfaces are both live broadcast interfaces, and the right interface is the live broadcast interface before and after the third camera movement special effect is applied. By comparison, it can be seen that on the live broadcast interface showing the third camera movement special effect, the host's face is enlarged on the live broadcast interface, that is, the camera movement distance is shortened.

[0188] In the embodiments of the present disclosure, the first camera movement special effect, the second camera movement special effect, the third camera movement special effect, etc. may be determined by the terminal itself or by the terminal through a server, and no specific limitation is made herein.

[0189] In step S305, the terminal obtains lighting parameters based on at least one of the rhythm characteristics of the music and the facial information; and displays virtual lighting on the live broadcast interface based on the lighting parameters.

[0190] The light parameters include at least one of light brightness, light color, light moving speed, etc. The light moving speed refers to the moving speed of the virtual light on the live broadcast interface. The virtual light can move from one position to another position on the live broadcast interface by scanning the light.

[0191] The terminal itself may obtain the lighting parameters based on at least one of the rhythm feature and the facial information, or the server may obtain the lighting parameters based on at least one of the rhythm feature and the facial information.

[0192] Among them, taking the example of the terminal itself obtaining the lighting parameter through the rhythm feature, the process of the terminal obtaining the lighting parameter includes the following situations: when the rhythm feature indicates that the rhythm of the music is less than the rhythm threshold, the terminal outputs the first lighting parameter as the lighting parameter. When the rhythm feature indicates that the rhythm of the music is not less than the rhythm threshold, the terminal outputs the second lighting parameter as the lighting parameter, and the second lighting parameter is the lighting parameter corresponding to the rhythm in the lighting parameter library, and the lighting parameter library includes multiple rhythms and lighting parameters that are positively correlated with each other.

[0193] The first lighting parameter is a fixed lighting parameter, that is, for any rhythm less than the rhythm threshold, the corresponding lighting parameter is the first lighting parameter.

[0194] Among them, the rhythm is positively correlated with the lighting parameters, that is, the faster the rhythm, the larger the lighting parameters, and the slower the rhythm, the smaller the lighting parameters. For example, the lighting parameters include the light moving speed, then the faster the rhythm, the faster the light moving speed, and the slower the rhythm, the slower the light moving speed.

[0195] In the disclosed embodiment, the lighting effects on the live broadcast interface also change with the rhythm of the music, so that the virtual lighting on the live broadcast interface is more realistic, further optimizing the display effect of the live broadcast interface, and thus promoting the interaction of terminal users on the live broadcast interface. Moreover, the lighting parameters are automatically adjusted with the rhythm, without manual triggering, thereby improving the efficiency of human-computer interaction.

[0196] For example, see Figure 5 , Figure 5It is a flow chart of an interface display method according to an exemplary embodiment. Among them, the terminal and the shooting terminal are the same terminal as an example for explanation, that is, the terminal is the terminal used by the anchor. The anchor shoots live broadcasts through the terminal used by him. Specifically, after the terminal collects the music in the target space, it extracts the rhythm characteristics of the music, and then determines the camera movement parameters corresponding to the rhythm characteristics, that is, the rhythm of the music is synchronized with the camera movement parameters. Then the terminal pulls the picture through the camera movement parameters, that is, shoots the target space, and the server processes the shot video stream to obtain the live video stream. Finally, the terminal participating in the live broadcast renders the picture based on the video stream and presents the live broadcast interface to the audience.

[0197] By the method provided in the embodiment of the present application, when the rhythm of the music in the live broadcast is slow, the camera movement special effect maintains the intensity, speed, and amplitude of the conventional camera movement, and the intensity, speed, and amplitude refer to the camera movement distance, camera movement speed, and camera movement angle, respectively. As the rhythm of the music speeds up, the intensity and speed of the camera movement will also increase accordingly, with a larger amplitude. When the rhythm of the music reaches a climax, the intensity, amplitude, and speed of the camera movement will reach the maximum value, bringing a very impactful visual experience to the audience. When the rhythm of the music slows down, the intensity of the camera movement also weakens, and the amplitude and speed of the camera movement also gradually weaken, returning to the normal live broadcast effect. In the disclosed embodiment, the effect of the camera movement is associated with the rhythm of the music, so as to add more fun to the interaction between the anchor and the audience, enhance the interactivity and attractiveness of the live broadcast room, and then promote the audience to interact in the live broadcast room.

[0198] In the disclosed embodiment, the camera movement effect in the live broadcast changes with the change of the music rhythm. Among them, the intelligent camera movement is turned on before the live broadcast. When the live broadcast interface is displayed, the terminal collects music, and when the music is recognized, the rhythm feature is extracted, and then the camera movement parameters are adjusted according to the correspondence between the preset rhythm feature and the camera movement parameters, and the live broadcast interface is displayed based on the adjusted camera movement parameters. In the absence of music, the camera movement effect disappears, and the camera only follows the host's face, which enables the audience to clearly see the host's expression and action in silence or without background music. After the music starts to play, if the rhythm of the music is slow, the camera movement begins to perform basic magnification or shaking rhythm, and the speed, intensity, etc. of the camera movement are carried out according to the rhythm. When the rhythm becomes faster, such as entering the chorus part of the music, the camera movement effect changes greatly with the rhythm, and some specific camera movement effects may also appear. When the music is dynamic, the camera will undergo significant dynamic changes at this time, such as rapid magnification, rapid switching of perspectives, or use of camera movement effects, etc., to simulate the excitement or tension that the audience may experience when the rhythm is strong. In the disclosed embodiment, the intelligent camera movement effect changes according to the rhythm of the music, making the live broadcast content more vivid and interesting, improving the viewing experience of the terminal users, thereby increasing the viewing rate of the live broadcast room and promoting the interaction of terminal users in the live broadcast room.

[0199] The disclosed embodiment provides an interface display method. When displaying the live broadcast interface of the target space, the method collects the music in the target space, then obtains the camera movement parameters based on at least one of the rhythm characteristics of the music and the facial information, and then displays the live broadcast interface based on the camera movement parameters, so that the live broadcast interface includes the camera movement effect corresponding to the camera movement parameters. Since the camera movement parameters are not determined artificially based on experience, but are obtained by real-time reasoning based on the music rhythm and the facial information of the object during the live broadcast, it is obvious that the camera movement parameters are highly accurate. In this way, when the live broadcast interface is displayed based on the camera movement parameters, the camera movement special effects displayed by the live broadcast interface are more intuitive and accurate. In addition, the method does not require human participation, and the machine can automatically determine the accurate camera movement parameters and display the live broadcast interface based on the determined camera movement parameters, thereby improving the efficiency of human-computer interaction.

[0200] Figure 6 is a block diagram of an interface display device according to an exemplary embodiment. Figure 6 , the device comprises:

[0201] A collection unit 601 is configured to collect music in a target space;

[0202] An acquisition unit 602 is configured to acquire a camera movement parameter based on at least one of a rhythm feature of the music and facial information, the facial information including at least one of a facial expression and a facial action of an object in the target space, and the camera movement parameter including at least one of a camera movement speed, a camera movement distance, and a camera movement angle;

[0203] The display unit is configured to execute a live broadcast interface of a target space based on the camera movement parameters, and the live broadcast interface includes camera movement effects corresponding to the camera movement parameters.

[0204] In some embodiments, the acquisition unit 602 is configured to perform at least one of the following:

[0205] When no music in the target space is collected, camera movement parameters are obtained based on facial information;

[0206] When music in the target space is collected, camera movement parameters are obtained based on rhythm features; or, when music in the target space is collected, camera movement parameters are obtained based on rhythm features and facial information.

[0207] In some embodiments, the display unit is configured to perform:

[0208] Obtain a video stream shot based on the camera movement parameters, and display a live broadcast interface based on the video stream; or,

[0209] The video picture of the target space is adjusted based on the camera movement parameters, and the live broadcast interface is displayed based on the adjusted video picture.

[0210] In some embodiments, the acquisition unit 602 is configured to execute:

[0211] When the rhythm feature indicates that the rhythm of the music is less than the rhythm threshold, outputting the first camera movement parameter as the camera movement parameter;

[0212] When the rhythm feature indicates that the rhythm of the music is not less than the rhythm threshold, the second camera movement parameter is output as the camera movement parameter, and the second camera movement parameter is the camera movement parameter corresponding to the rhythm in the camera movement parameter library, and the camera movement parameter library includes multiple rhythms and multiple camera movement parameters that are positively correlated with each other.

[0213] In some embodiments, the first camera movement parameter includes at least one of a first camera movement speed and a second camera movement speed, and the display unit is configured to perform at least one of the following:

[0214] Display the camera movement effect of adjusting the camera movement distance according to the first camera movement speed on the live broadcast interface;

[0215] The live broadcast interface shows the camera effect of adjusting the camera angle according to the second camera speed.

[0216] In some embodiments, the display unit is configured to perform:

[0217] When the rhythm feature indicates that the rhythm of the music is not less than the rhythm threshold, the first camera movement effect is displayed at the heavy beat points of the music on the live broadcast interface.

[0218] In some embodiments, the display unit is configured to perform:

[0219] When two rhythms indicated by different rhythm characteristics appear alternately in the music according to a preset rule, a second camera movement effect is displayed on the live broadcast interface, and the first camera movement node and the second camera movement node of the second camera movement effect appear according to the preset rule to be respectively displayed on the beat points corresponding to the two rhythms.

[0220] In some embodiments, the second camera movement special effect includes a first sub-special effect and a second sub-special effect, and the display unit is configured to perform:

[0221] When the difference between the two rhythms is greater than the difference threshold, the first sub-effect is displayed on the live broadcast interface, and the camera parameters of the first sub-effect include the closest camera distance and the farthest camera distance, and the first camera node and the second camera node correspond to the closest camera distance and the farthest camera distance respectively;

[0222] When the difference between the two rhythms is not greater than the difference threshold, the second sub-effect is displayed on the live broadcast interface. The camera parameters of the second sub-effect include the minimum camera angle and the maximum camera angle. The first camera node and the second camera node correspond to the minimum camera angle and the maximum camera angle, respectively.

[0223] In some embodiments, the acquisition unit 602 is configured to execute:

[0224] When the rhythm feature indicates that the rhythm of the music is reduced, the camera movement parameter corresponding to the reduced rhythm is output as the camera movement parameter;

[0225] When the rhythm feature indicates that the rhythm of the music increases, the camera movement parameters corresponding to the increased rhythm are output as the camera movement parameters.

[0226] In some embodiments, the display unit is further configured to perform:

[0227] If the music in the target space is not collected, the camera effect will not be displayed on the live broadcast interface.

[0228] In some embodiments, the acquisition unit 602 is further configured to acquire the lighting parameter based on at least one of the rhythm feature of the music and the facial information;

[0229] The display unit is also configured to display virtual lights on the live broadcast interface based on the lighting parameters.

[0230] In some embodiments, the display unit is configured to perform at least one of the following:

[0231] When the object in the target space receives the virtual resource, a third camera movement special effect is displayed on the live broadcast interface, and the third camera movement special effect is used to magnify the face of the object on the live broadcast interface;

[0232] When the value of the virtual resources received by the object in the target space reaches the resource threshold, a third camera movement effect is displayed on the live broadcast interface, and the third camera movement effect is used to enlarge the face of the object on the live broadcast interface.

[0233] In some embodiments, the acquisition unit 602 is configured to execute:

[0234] Sending the music and the facial information to a server, the server being used to extract the rhythm features of the music and determine the camera movement parameters corresponding to at least one of the rhythm features and the facial information; or

[0235] The rhythm feature of the music is extracted, and the rhythm feature and the facial information are sent to a server, and the server is used to determine the camera movement parameter corresponding to at least one of the rhythm feature and the facial information.

[0236] The disclosed embodiment provides a live broadcast device, which collects music in the target space when displaying the live broadcast interface of the target space, then obtains camera movement parameters based on at least one of the rhythm characteristics of the music and facial information, and then displays the live broadcast interface based on the camera movement parameters, so that the live broadcast interface includes the camera movement effect corresponding to the camera movement parameters. Since the camera movement parameters are not determined artificially based on experience, but are obtained by real-time reasoning based on the music rhythm and facial information of the object during the live broadcast, it is obvious that the camera movement parameters are highly accurate. In this way, when the live broadcast interface is displayed based on the camera movement parameters, the camera movement special effects displayed by the live broadcast interface are more intuitive and accurate. In addition, the device does not require human participation, and the machine can automatically determine the accurate camera movement parameters and display the live broadcast interface based on the determined camera movement parameters, thereby improving the efficiency of human-computer interaction.

[0237] Regarding the device in the above embodiment, the specific manner in which each unit performs the operation has been described in detail in the embodiment of the method, and will not be elaborated here.

[0238] Figure 7 The structure block diagram of a terminal 700 provided by an exemplary embodiment of the present disclosure is shown. The terminal 700 may be: a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III), an MP4 player (Moving Picture Experts Group Audio Layer IV), a laptop computer or a desktop computer. The terminal 700 may also be called a user device, a portable terminal, a laptop terminal, a desktop terminal or other names.

[0239] Typically, the terminal 700 includes a processor 701 and a memory 702 .

[0240] The processor 701 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 701 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). The processor 701 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 701 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 701 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.

[0241] The memory 702 may include one or more computer-readable storage media, which may be non-transitory. The memory 702 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 702 is used to store at least one program code, which is used to be executed by the processor 701 to implement the interface display method provided in the method embodiment of the present disclosure.

[0242] In some embodiments, the terminal 700 may further optionally include: a peripheral device interface 703 and at least one peripheral device. The processor 701, the memory 702 and the peripheral device interface 703 may be connected via a bus or a signal line. Each peripheral device may be connected to the peripheral device interface 703 via a bus, a signal line or a circuit board. Specifically, the peripheral device includes: at least one of a radio frequency circuit 704, a display screen 705, a camera assembly 706, an audio circuit 707 and a power supply 708.

[0243] The peripheral device interface 703 may be used to connect at least one peripheral device related to I / O (Input / Output) to the processor 701 and the memory 702. In some embodiments, the processor 701, the memory 702, and the peripheral device interface 703 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 701, the memory 702, and the peripheral device interface 703 may be implemented on a separate chip or circuit board, which is not limited in this embodiment.

[0244] The radio frequency circuit 704 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 704 communicates with communication networks and other communication devices through electromagnetic signals. The radio frequency circuit 704 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals into electrical signals. Optionally, the radio frequency circuit 704 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, and the like. The radio frequency circuit 704 can communicate with other terminals through at least one wireless communication protocol. The wireless communication protocol includes, but is not limited to: a metropolitan area network, various generations of mobile communication networks (2G, 3G, 4G and 5G), a wireless local area network and / or a WiFi (Wireless Fidelity) network. In some embodiments, the radio frequency circuit 704 may also include circuits related to NFC (Near Field Communication), which is not limited in the present disclosure.

[0245] The display screen 705 is used to display the UI (User Interface). The UI may include graphics, text, icons, videos and any combination thereof. When the display screen 705 is a touch display screen, the display screen 705 also has the ability to collect touch signals on the surface or above the surface of the display screen 705. The touch signal can be input to the processor 701 as a control signal for processing. At this time, the display screen 705 can also be used to provide virtual buttons and / or virtual keyboards, also known as soft buttons and / or soft keyboards. In some embodiments, the display screen 705 can be one, and the front panel of the terminal 700 is set; in other embodiments, the display screen 705 can be at least two, which are respectively set on different surfaces of the terminal 700 or are folded; in some other embodiments, the display screen 705 can be a flexible display screen, which is set on the curved surface or folded surface of the terminal 700. Even, the display screen 705 can also be set as a non-rectangular irregular shape, that is, a special-shaped screen. The display screen 705 can be made of materials such as LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode) and the like.

[0246] The camera assembly 706 is used to capture images or videos. Optionally, the camera assembly 706 includes a front camera and a rear camera. Typically, the front camera is arranged on the front panel of the terminal, and the rear camera is arranged on the back of the terminal. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth of field camera, a wide-angle camera, and a telephoto camera, so as to realize the fusion of the main camera and the depth of field camera to realize the background blur function, the fusion of the main camera and the wide-angle camera to realize panoramic shooting and VR (Virtual Reality) shooting function or other fusion shooting functions. In some embodiments, the camera assembly 706 may also include a flash. The flash can be a monochrome temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm light flash and a cold light flash, which can be used for light compensation at different color temperatures.

[0247] The audio circuit 707 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, and convert the sound waves into electrical signals and input them into the processor 701 for processing, or input them into the radio frequency circuit 704 to achieve voice communication. For the purpose of stereo acquisition or noise reduction, there may be multiple microphones, which are respectively arranged at different parts of the terminal 700. The microphone may also be an array microphone or an omnidirectional acquisition microphone. The speaker is used to convert the electrical signal from the processor 701 or the radio frequency circuit 704 into sound waves. The speaker may be a traditional film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert the electrical signal into sound waves audible to humans, but also convert the electrical signal into sound waves inaudible to humans for purposes such as ranging. In some embodiments, the audio circuit 707 may also include a headphone jack.

[0248] The power supply 708 is used to power various components in the terminal 700. The power supply 708 can be an alternating current, a direct current, a disposable battery, or a rechargeable battery. When the power supply 708 includes a rechargeable battery, the rechargeable battery can support wired charging or wireless charging. The rechargeable battery can also be used to support fast charging technology.

[0249] Those skilled in the art will understand that Figure 7 The structure shown in the figure does not constitute a limitation on the terminal 700, and the terminal 700 may include more or less components than those shown in the figure, or combine some components, or adopt a different component arrangement.

[0250] In an exemplary embodiment, a computer-readable storage medium including instructions is also provided, such as a memory including instructions, and the above instructions can be executed by a processor of a terminal to complete the above interface display method. Optionally, the computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0251] In an exemplary embodiment, a computer program product is also provided, including a computer program, which implements the above-mentioned interface display method when executed by a processor. In some embodiments, the computer program product involved in the embodiments of the present disclosure can be deployed on a terminal for execution, or on multiple terminals located at one location, or on multiple terminals distributed at multiple locations and interconnected by a communication network. Multiple terminals distributed at multiple locations and interconnected by a communication network can constitute a blockchain system.

[0252] Those skilled in the art will readily conceive of other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure, which follow the general principles of the present disclosure and include common knowledge or customary technical means in the art that are not disclosed in the present disclosure. The specification and embodiments are to be regarded as exemplary only, and the true scope and spirit of the present disclosure are indicated by the claims. All of the above optional technical solutions can be combined in any way to form optional embodiments of the present application, which will not be described one by one here.

[0253] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. An interface display method, characterized in that: The method comprises: Collect music in the target space; Acquire camera movement parameters based on at least one of the rhythm feature of the music and facial information, wherein the facial information includes at least one of facial expression and facial action of the object in the target space, and the camera movement parameters include at least one of camera movement speed, camera movement distance, and camera movement angle; Based on the camera movement parameters, a live broadcast interface of the target space is displayed, and the live broadcast interface includes the camera movement effects corresponding to the camera movement parameters.

2. The interface display method according to claim 1, characterized in that: The acquiring of the camera movement parameter based on at least one of the rhythm feature of the music and the facial information comprises at least one of the following: In the case where no music in the target space is collected, acquiring the camera movement parameter based on the facial information; When music in the target space is collected, the camera movement parameters are obtained based on the rhythm features; or, when music in the target space is collected, the camera movement parameters are obtained based on the rhythm features and the facial information.

3. The interface display method according to claim 1, characterized in that: The method of displaying the live broadcast interface of the target space based on the camera movement parameters includes: Acquire a video stream shot based on the camera movement parameters, and display the live broadcast interface based on the video stream; or, The video picture of the target space is adjusted based on the camera movement parameters, and the live broadcast interface is displayed based on the adjusted video picture.

4. The interface display method according to claim 1, characterized in that: The acquiring of the camera movement parameter based on at least one of the rhythm feature of the music and the facial information comprises: When the rhythm feature indicates that the rhythm of the music is less than a rhythm threshold, outputting the first camera movement parameter as the camera movement parameter; When the rhythm feature indicates that the rhythm of the music is not less than a rhythm threshold, a second camera movement parameter is output as the camera movement parameter, wherein the second camera movement parameter is a camera movement parameter corresponding to the rhythm in a camera movement parameter library, and the camera movement parameter library includes multiple rhythms and camera movement parameters that are positively correlated with the multiple rhythms.

5. The interface display method according to claim 4, characterized in that: The first camera movement parameter includes at least one of a first camera movement speed and a second camera movement speed, and the displaying of the live broadcast interface of the target space based on the camera movement parameter includes at least one of the following: Displaying the camera movement effect of the live broadcast interface adjusting the camera movement distance according to the first camera movement speed; The live broadcast interface is displayed with the camera angle adjusted according to the second camera speed.

6. The interface display method according to claim 1, characterized in that: The method of displaying the live broadcast interface of the target space based on the camera movement parameters includes: When the rhythm feature indicates that the rhythm of the music is not less than a rhythm threshold, a first camera movement effect is displayed at the heavy beat points of the music on the live broadcast interface.

7. The interface display method according to claim 1, characterized in that: The method of displaying the live broadcast interface of the target space based on the camera movement parameters includes: When the rhythm characteristics indicate that two different rhythms appear alternately in the music according to a preset rule, a second camera movement effect is displayed on the live broadcast interface, and the first camera movement node and the second camera movement node of the second camera movement effect appear according to the preset rule to be respectively displayed on the beat points corresponding to the two rhythms.

8. The interface display method according to claim 7, characterized in that: The second camera movement special effect includes a first sub-special effect and a second sub-special effect, and the second camera movement special effect is displayed on the live broadcast interface, including: When the difference between the two rhythms is greater than the difference threshold, the first sub-special effect is displayed on the live broadcast interface, the camera movement parameters of the first sub-special effect include a closest camera movement distance and a farthest camera movement distance, and the first camera movement node and the second camera movement node correspond to the closest camera movement distance and the farthest camera movement distance, respectively; When the difference between the two rhythms is not greater than the difference threshold, the second sub-effect is displayed on the live broadcast interface, and the camera movement parameters of the second sub-effect include a minimum camera movement angle and a maximum camera movement angle, and the first camera movement node and the second camera movement node correspond to the minimum camera movement angle and the maximum camera movement angle, respectively.

9. The interface display method according to claim 1, characterized in that: The acquiring of the camera movement parameter based on at least one of the rhythm feature of the music and the facial information comprises: When the rhythm feature indicates that the rhythm of the music is reduced, outputting the camera movement parameter corresponding to the reduced rhythm as the camera movement parameter; When the rhythm feature indicates that the rhythm of the music increases, the camera movement parameter corresponding to the increased rhythm is output as the camera movement parameter.

10. The interface display method according to claim 1, characterized in that: The method further comprises: If the music in the target space is not collected, the camera movement effect will not be displayed on the live broadcast interface.

11. The interface display method according to claim 1, characterized in that: The method further comprises: Acquiring lighting parameters based on at least one of the rhythm characteristics of the music and the facial information; Display virtual lights on the live broadcast interface based on the lighting parameters.

12. The interface display method according to claim 1, characterized in that: The step of displaying the live broadcast interface of the target space based on the camera movement parameter includes at least one of the following: In the case where the object in the target space receives the virtual resource, displaying a third camera movement special effect on the live broadcast interface, wherein the third camera movement special effect is used to magnify the face of the object on the live broadcast interface; When the value of the virtual resources received by the object in the target space reaches the resource threshold, a third camera movement effect is displayed on the live broadcast interface, and the third camera movement effect is used to enlarge the face of the object on the live broadcast interface.

13. The interface display method according to claim 1, characterized in that: The acquiring of the camera movement parameter based on at least one of the rhythm feature of the music and the facial information comprises: The music and the facial information are sent to a server, wherein the server is used to extract a rhythm feature of the music and determine a camera movement parameter corresponding to at least one of the rhythm feature and the facial information; or The rhythm feature of the music is extracted, and the rhythm feature and the facial information are sent to a server, where the server is used to determine a camera movement parameter corresponding to at least one of the rhythm feature and the facial information.

14. An interface display device, characterized in that: The device comprises: A collection unit, configured to collect music in a target space; an acquisition unit configured to acquire camera movement parameters based on at least one of the rhythm feature of the music and facial information, wherein the facial information includes at least one of facial expression and facial action of the object in the target space, and the camera movement parameters include at least one of camera movement speed, camera movement distance and camera movement angle; The display unit is configured to display a live broadcast interface of the target space based on the camera movement parameters, wherein the live broadcast interface includes camera movement effects corresponding to the camera movement parameters.

15. A terminal, characterized in that: include: processor; a memory for storing instructions executable by the processor; Wherein, the processor is configured to execute the instructions to implement the interface display method as described in any one of claims 1 to 13.

16. A computer-readable storage medium, characterized in that: When the instructions in the computer-readable storage medium are executed by a processor of a terminal, the terminal is enabled to execute the interface display method described in any one of claims 1 to 13.

17. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is executed by a processor, the interface display method according to any one of claims 1 to 13 is implemented.

Citation Information

Patent Citations

  • Scene picture display control method and device and computer storage medium

    CN114155322A

  • Determination method of mirror moving information and display method and device of scene picture

    CN116489451A

  • Virtual camera control method, apparatus and device, and readable storage medium

    CN117579928A

  • Mirror operation control method, device and equipment and storage medium

    CN118158340A

  • Method for production of amateur musical video film and video camera for its shooting

    RU2145738C1

Cited By

  • Data processing method and device

    CN120935380A

  • Methods for camera movement in panoramic video, and electronic devices

    WO2026156628A1