Interface display method and device, equipment and storage medium

Abstract

The present disclosure relates to an interface display method and device, equipment and a storage medium, and relates to the technical field of multimedia. The method comprises: collecting music in a target space; obtaining a camera movement parameter based on at least one of a rhythm feature of the music and facial information, the facial information comprising at least one of a facial expression and a facial action of an object in the target space; and displaying a live interface of the target space based on the camera movement parameter, the live interface comprising a camera movement effect corresponding to the camera movement parameter. Since the camera movement parameter is not artificially determined based on experience, but is obtained by real-time inference based on the music rhythm and the facial information of the object during live streaming, the accuracy of the camera movement parameter is obviously high, so that the camera movement effect displayed by the live interface is more intuitive and accurate. Furthermore, the method does not require human intervention, and the machine can automatically determine an accurate camera movement parameter and display the live interface based on the determined camera movement parameter, thereby further improving the human-computer interaction efficiency.

Description

Technical Field

[0001] This disclosure relates to the field of multimedia technology, and in particular to an interface display method, apparatus, device and storage medium. Background Technology

[0002] Currently, to improve the live streaming experience, camera movement is often used during filming. However, this method is generally achieved through manual camera movement; where the camera movement parameters are determined manually based on experience, and then the camera is controlled based on these parameters, such as manually moving the distance between the camera and the subject being filmed. Obviously, this method results in low efficiency in human-computer interaction. Summary of the Invention

[0003] This disclosure provides a method, apparatus, device, and storage medium for displaying an interface. Since the camera movement parameters are not determined manually based on experience, but rather derived in real-time from the music rhythm and facial information of the subjects during the live stream, the accuracy of these parameters is obviously high. Therefore, when displaying the live stream interface based on these parameters, the camera movement effects shown on the interface are more intuitive and accurate. Furthermore, this method requires no human intervention; the machine can automatically determine accurate camera movement parameters and display the live stream interface based on these parameters, thereby improving the efficiency of human-computer interaction. The technical solution of this disclosure is as follows:

[0004] According to one aspect of the embodiments of the present disclosure, a method for displaying an interface is provided, the method comprising:

[0005] Collect music within the target space;

[0006] Camera movement parameters are obtained based on at least one of the rhythmic features of the music and facial information, wherein the facial information includes at least one of the facial expressions and facial movements of the object in the target space, and the camera movement parameters include at least one of the camera movement speed, camera movement distance, and camera movement angle.

[0007] Based on the camera movement parameters, a live streaming interface for the target space is displayed, and the live streaming interface includes the camera movement effects corresponding to the camera movement parameters.

[0008] According to another aspect of the present disclosure, a user interface display device is provided, the device comprising:

[0009] The acquisition unit is configured to acquire music within the target space;

[0010] The acquisition unit is configured to acquire camera movement parameters based on at least one of the rhythmic features of the music and facial information, wherein the facial information includes at least one of facial expressions and facial movements of an object in the target space, and the camera movement parameters include at least one of camera movement speed, camera movement distance, and camera movement angle.

[0011] The display unit is configured to perform a live broadcast interface of the target space based on the camera movement parameters, the live broadcast interface including the camera movement effects corresponding to the camera movement parameters.

[0012] In some embodiments, the acquisition unit is configured to perform at least one of the following:

[0013] In the absence of music within the target space, the camera movement parameters are obtained based on the facial information;

[0014] If music within the target space is captured, the camera movement parameters are obtained based on the rhythm features; or, if music within the target space is captured, the camera movement parameters are obtained based on the rhythm features and the facial information.

[0015] In some embodiments, the display unit is configured to perform:

[0016] Acquire a video stream captured based on the camera movement parameters, and display the live streaming interface based on the video stream; or...

[0017] The video frame of the target space is adjusted based on the camera movement parameters, and the live broadcast interface is displayed based on the adjusted video frame.

[0018] In some embodiments, the acquisition unit is configured to perform:

[0019] When the rhythmic feature indicates that the rhythm of the music is less than the rhythm threshold, the first camera movement parameter is output as the camera movement parameter;

[0020] When the rhythmic feature indicates that the rhythm of the music is not less than the rhythm threshold, the second camera movement parameter is output as the camera movement parameter. The second camera movement parameter is the camera movement parameter in the camera movement parameter library that corresponds to the rhythm. The camera movement parameter library includes multiple rhythms and camera movement parameters that are positively correlated with the multiple rhythms.

[0021] In some embodiments, the first camera movement parameter includes at least one of a first camera movement speed and a second camera movement speed, and the display unit is configured to perform at least one of the following:

[0022] The live streaming interface displays the camera movement effect of adjusting the camera distance according to the first camera movement speed;

[0023] The live stream interface displays the camera movement effect as the camera angle is adjusted according to the second camera movement speed.

[0024] In some embodiments, the display unit is configured to perform:

[0025] When the rhythm feature indicates that the rhythm of the music is not less than the rhythm threshold, a first camera movement effect is displayed at the heavy beat point of the music on the live streaming interface.

[0026] In some embodiments, the display unit is configured to perform:

[0027] When two rhythms with different rhythmic characteristics appear alternately in the music according to a preset pattern, a second camera movement effect is displayed on the live streaming interface. The first and second camera movement nodes of the second camera movement effect appear according to the preset pattern and are displayed on the beat points corresponding to the two rhythms respectively.

[0028] In some embodiments, the second camera movement effect includes a first sub-effect and a second sub-effect, and the display unit is configured to execute:

[0029] If the difference between the two rhythms is greater than the difference threshold, the first sub-effect is displayed on the live broadcast interface. The camera movement parameters of the first sub-effect include the closest camera movement distance and the farthest camera movement distance. The first camera movement node and the second camera movement node correspond to the closest camera movement distance and the farthest camera movement distance, respectively.

[0030] If the difference between the two rhythms is not greater than the difference threshold, the second sub-effect is displayed on the live broadcast interface. The camera movement parameters of the second sub-effect include the minimum camera movement angle and the maximum camera movement angle. The first camera movement node and the second camera movement node correspond to the minimum camera movement angle and the maximum camera movement angle, respectively.

[0031] In some embodiments, the acquisition unit is configured to perform:

[0032] When the rhythmic feature indicates that the rhythm of the music is decreasing, the camera movement parameters corresponding to the decreased rhythm are output as the camera movement parameters.

[0033] When the rhythmic feature indicates that the rhythm of the music is increasing, the camera movement parameters corresponding to the increased rhythm are output as the camera movement parameters.

[0034] In some embodiments, the display unit is further configured to perform:

[0035] If no music is captured within the target space, the camera movement effect will not be displayed on the live streaming interface.

[0036] In some embodiments, the acquisition unit is further configured to acquire lighting parameters based on at least one of the rhythmic features of the music and facial information;

[0037] The display unit is also configured to display virtual lights on the live streaming interface based on the lighting parameters.

[0038] In some embodiments, the display unit is configured to perform at least one of the following:

[0039] When an object in the target space receives virtual resources, a third camera movement effect is displayed on the live streaming interface. The third camera movement effect is used to magnify the face of the object on the live streaming interface.

[0040] When the value of the virtual resources received by the object in the target space reaches the resource threshold, a third camera movement effect is displayed on the live streaming interface. The third camera movement effect is used to magnify the face of the object on the live streaming interface.

[0041] In some embodiments, the acquisition unit is configured to perform:

[0042] The music and facial information are sent to a server, which extracts the rhythmic features of the music and determines camera movement parameters corresponding to at least one of the rhythmic features and the facial information; or...

[0043] The rhythmic features of the music are extracted, and the rhythmic features and the facial information are sent to a server. The server is used to determine the camera movement parameters corresponding to at least one of the rhythmic features and the facial information.

[0044] According to another aspect of the embodiments of this disclosure, a terminal is provided, the terminal comprising:

[0045] One or more processors;

[0046] Memory used to store the executable program code of the processor;

[0047] The processor is configured to execute the program code to implement the aforementioned interface display method.

[0048] According to another aspect of the present disclosure, a computer-readable storage medium is provided, which enables the terminal to perform the above-described interface display method when the program code in the computer-readable storage medium is executed by the processor of a terminal.

[0049] According to another aspect of the present disclosure, a computer program product is provided, including a computer program that, when executed by a processor, implements the above-described interface display method.

[0050] This disclosure provides an interface display method. When displaying a live stream interface in a target space, the method collects music from within that space and then obtains camera movement parameters based on at least one of the music's rhythmic features and facial information. The live stream interface is then displayed based on these camera movement parameters, ensuring that the interface includes the corresponding camera movement effects. Since these parameters are not determined manually based on experience but are derived in real-time from the music rhythm and the facial information of the subjects during the live stream, their accuracy is high. Therefore, when the live stream interface is displayed based on these parameters, the camera movement effects are more intuitive and accurate. Furthermore, this method requires no human intervention; the machine can automatically determine accurate camera movement parameters and display the live stream interface based on these parameters, thereby improving human-computer interaction efficiency.

[0051] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0052] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure, and are not intended to unduly limit this disclosure.

[0053] Figure 1 This is a schematic diagram illustrating an implementation environment according to an exemplary embodiment.

[0054] Figure 2 This is a flowchart illustrating an interface display method according to an exemplary embodiment.

[0055] Figure 3 This is a flowchart illustrating another interface display method according to an exemplary embodiment.

[0056] Figure 4 This is a schematic diagram illustrating a third camera movement effect according to an exemplary embodiment.

[0057] Figure 5 This is a flowchart illustrating an interface display method according to an exemplary embodiment.

[0058] Figure 6 This is a block diagram illustrating an interface display device according to an exemplary embodiment.

[0059] Figure 7 This is a block diagram illustrating a terminal according to an exemplary embodiment. Detailed Implementation

[0060] To enable those skilled in the art to better understand the technical solutions of this disclosure, the technical solutions in the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings.

[0061] It should be noted that the terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this disclosure are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this disclosure described herein can be implemented in orders other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.

[0062] It should be noted that all information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.), and signals involved in this disclosure are authorized by the user or fully authorized by all parties, and the collection, use, and processing of related data must comply with the relevant laws, regulations, and standards of the relevant countries and regions. For example, the music, facial information, and camera movement parameters involved in this disclosure were obtained with full authorization.

[0063] The interface display method provided in this embodiment can be executed by a terminal. Figure 1 This is a schematic diagram of an implementation environment provided in this embodiment of the disclosure. See also: Figure 1 The implementation environment includes a terminal 101 and a server 102. In this embodiment, the terminal 101 is used to display a live streaming interface. In some embodiments, a target application is installed on the terminal 101, and the terminal 101 is an application capable of displaying a live streaming interface. The target application can be any application capable of live streaming, such as a shopping application, a news application, a search application, a video application, or a social application, and is not specifically limited here. The server 102 is the backend server of the target application.

[0064] Terminal 101 can be at least one of the following devices: smartphone, smartwatch, desktop computer, laptop, virtual reality terminal, augmented reality terminal, wireless terminal, and laptop computer. Terminal 101 has communication capabilities and can access wired or wireless networks. Terminal 101 can refer to one of multiple terminals; those skilled in the art will understand that the number of terminals can be more or less. Server 102 can be an independent physical server, a server cluster composed of multiple physical servers, or a distributed file system. It can also be a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms. In some embodiments, server 102 and terminal 101 are directly or indirectly connected via wired or wireless communication; this disclosure does not limit this. Optionally, the number of servers 102 can be more or less; this disclosure does not limit this. Of course, server 102 can also include other functional servers to provide more comprehensive and diversified services. In this embodiment, server 102 undertakes the main computing work and terminal 101 undertakes the secondary computing work; or, server 102 undertakes the secondary computing work and terminal 101 undertakes the main computing work; or, server 102 or terminal 101 can each undertake computing work independently, and this embodiment does not limit this.

[0065] Figure 2 This is a flowchart illustrating an interface display method according to an exemplary embodiment, such as... Figure 2 As shown, this method is executed by a terminal and includes the following steps.

[0066] In step S201, the terminal collects music within the target space.

[0067] In this embodiment of the disclosure, the target space is a real space. The target space includes at least one of the following: the object to be live-streamed, the live-streamed object, etc. The terminal is used to display the live-streaming interface of the target space.

[0068] In some embodiments, the terminal obtains music from the target space from the server. That is, the shooting terminal in the target space uploads both the music in the target space and the video stream it captures to the server so that the server can generate a video stream for the live broadcast interface. Accordingly, the terminal can obtain the music from the target space from the server.

[0069] In other embodiments, the terminal is located within the target space to collect music within the target space. Optionally, if the music within the target space is music played by an audio device within the target space, the terminal collects the music played by the audio device. Alternatively, if the music within the target space is music played by the terminal itself, the terminal collects the music it plays within the target space or directly obtains the music within the target space from itself.

[0070] In step S202, the terminal obtains camera movement parameters based on at least one of the rhythmic features of the music and facial information. The facial information includes at least one of the facial expressions and facial movements of the object in the target space, and the camera movement parameters include at least one of the camera movement speed, camera movement distance, and camera movement angle.

[0071] In this embodiment of the disclosure, the rhythmic feature indicates the rhythm of the music, which can be the real-time rhythm of the music. Furthermore, the rhythmic feature also indicates beat points in the music, and further indicates heavy beat points and weak beat points.

[0072] In this embodiment of the disclosure, the camera movement distance refers to the distance between the terminal lens and the object being photographed in the captured image. The camera movement angle refers to the left-right or up-down tilt angle of the captured image relative to the object being photographed.

[0073] In this embodiment of the disclosure, the camera movement speed includes at least one of a first type of speed and a second type of speed. The first type of speed is used to adjust the camera movement distance, such as its unit being seconds per meter. The second type of speed is used to adjust the camera movement angle, such as its unit being seconds per degree.

[0074] In step S203, the terminal displays a live broadcast interface of the target space based on the camera movement parameters. The live broadcast interface includes the camera movement effect corresponding to the camera movement parameters.

[0075] In this embodiment of the disclosure, the terminal can be a terminal used by the broadcaster or a terminal used by the audience.

[0076] In this embodiment, a camera terminal can capture a video stream of the target space based on camera movement parameters. After the terminal acquires the video stream, the live streaming interface displayed based on the video stream includes the camera movement effects corresponding to the camera movement parameters. Alternatively, when the camera terminal captures a video frame of the target space, and the terminal acquires and displays the video frame, the live streaming interface obtained after adjusting the video frame based on the camera movement parameters includes the camera movement effects corresponding to the camera movement parameters.

[0077] In this embodiment of the disclosure, when the shooting terminal captures a target space based on camera movement parameters, the shooting terminal can be positioned at a fixed location to capture the target space. The shooting terminal adjusts its camera movement parameters by automatically adjusting its focal length and other shooting parameters. For example, the camera movement distance can be adjusted by adjusting the focal length of the shooting terminal, and the speed of the focal length adjustment is the camera movement speed corresponding to the camera movement distance.

[0078] If the terminal is used by the broadcaster, then the terminal and the shooting terminal can be the same terminal, that is, the same terminal is used for both live shooting and displaying the live interface.

[0079] The video stream includes music and visual data within the target space. The terminal sends the captured video stream to the server, which processes it to obtain the live video stream. The server distributes the live video stream to multiple terminals participating in the live stream, including terminals used by the broadcaster and terminals used by viewers. These terminals display a live interface based on the video stream. The live interface displays camera movement effects, which correspond to at least one of the rhythmic characteristics of the music and facial information.

[0080] This disclosure provides an interface display method. When displaying a live stream interface in a target space, the method collects music from within that space and then obtains camera movement parameters based on at least one of the music's rhythmic features and facial information. The live stream interface is then displayed based on these camera movement parameters, ensuring that the interface includes the corresponding camera movement effects. Since these parameters are not determined manually based on experience but are derived in real-time from the music rhythm and the facial information of the subjects during the live stream, their accuracy is high. Therefore, when the live stream interface is displayed based on these parameters, the camera movement effects are more intuitive and accurate. Furthermore, this method requires no human intervention; the machine can automatically determine accurate camera movement parameters and display the live stream interface based on these parameters, thereby improving human-computer interaction efficiency.

[0081] In some embodiments, camera movement parameters are obtained based on at least one of the rhythmic features of the music and facial information, including at least one of the following:

[0082] In the absence of music in the target space, camera movement parameters are obtained based on facial information;

[0083] If music within the target space is captured, camera movement parameters are obtained based on rhythmic features; or, if music within the target space is captured, camera movement parameters are obtained based on rhythmic features and facial information.

[0084] In this embodiment, when music within the target space is not captured, meaning the camera movement parameters cannot be determined based on the music rhythm, facial information is used to obtain the camera movement parameters. This ensures the accuracy of the camera movement parameters by inferring them in real-time from the facial information of the subject during the live stream. When music within the target space is captured, camera movement parameters are obtained in real-time based on the music rhythm during the live stream. Clearly, these camera movement parameters are highly accurate, resulting in more intuitive and accurate camera movement effects displayed on the live stream interface. Obtaining camera movement parameters based on rhythm features and facial information, and thus using multiple real-time information from the live stream, further improves the accuracy of the camera movement parameters. When the live stream interface is displayed based on these camera movement parameters, the camera movement effects not only match the rhythm features but also the facial information of the subject, making the camera movement features more intuitive and accurate.

[0085] In some embodiments, a live broadcast interface displaying the target space is generated based on camera movement parameters, including:

[0086] Acquire the video stream captured based on camera movement parameters, and display the live stream interface based on the video stream; or...

[0087] The video frame in the target space is adjusted based on the camera movement parameters, and the live broadcast interface is displayed based on the adjusted video frame.

[0088] In this embodiment, when filming the target space, camera movement parameters are obtained based on at least one of the music rhythm and facial information. The target space is then filmed based on these camera movement parameters. Since these parameters are not determined manually based on experience, but rather inferred in real-time from at least one of the music rhythm and facial information during the live stream, their accuracy is obviously high. Therefore, when the video stream filmed based on these parameters is displayed on the live stream interface, the camera movement effects shown on the interface are more intuitive and accurate. Furthermore, this method eliminates the need for human intervention during filming; the machine can automatically determine accurate camera movement parameters and automatically film based on these parameters, thereby improving the efficiency of human-computer interaction.

[0089] In this embodiment, the video frame of the target space is adjusted based on camera movement parameters. Since these camera movement parameters are not determined manually based on experience, but are inferred in real time based on at least one of the music rhythm and facial information during the live broadcast, their accuracy is obviously high. Therefore, when the video frame is adjusted based on these parameters and the live broadcast interface is displayed based on the adjusted video frame, the camera movement effects displayed on the live broadcast interface are more intuitive and accurate. Furthermore, this method does not require manual camera movement during filming; instead, it automatically adjusts the video frame based on the camera movement parameters directly after filming, thereby improving the efficiency of human-computer interaction.

[0090] In some embodiments, camera movement parameters are obtained based on at least one of the rhythmic features of the music and facial information, including:

[0091] When the rhythm feature indicates that the rhythm of the music is less than the rhythm threshold, the first camera movement parameter is output as the camera movement parameter.

[0092] When the rhythmic feature indicates that the rhythm of the music is not less than the rhythm threshold, the second camera movement parameter is output as a camera movement parameter. The second camera movement parameter is the camera movement parameter corresponding to the rhythm in the camera movement parameter library. The camera movement parameter library includes multiple rhythms and multiple camera movement parameters that are positively correlated with each rhythm.

[0093] In this embodiment, when the music's rhythm is less than a rhythm threshold, it indicates a slow rhythm. Since the rhythm changes relatively smoothly when the rhythm is slow, uniformly corresponding rhythms less than the rhythm threshold to fixed camera movement parameters ensures that the camera movement matches the music rhythm while also improving the efficiency of camera movement processing. When the music's rhythm is greater than the rhythm threshold, it indicates a fast rhythm. Since the rhythm changes relatively quickly when the rhythm is fast, camera movement is performed based on camera movement parameters that are positively correlated with the rhythm. This allows the camera movement to follow the rhythm with significant changes, achieving a strong camera movement effect when the music is dynamic, thus making the camera movement more accurate.

[0094] In some embodiments, the first camera movement parameter includes at least one of a first camera movement speed and a second camera movement speed. Based on the camera movement parameter, the live broadcast interface displaying the target space includes at least one of the following:

[0095] The live stream interface displays the camera movement effect, adjusting the camera distance according to the first camera movement speed;

[0096] The live stream interface displays the camera movement effect as the camera angle is adjusted according to the second camera movement speed.

[0097] In this embodiment of the disclosure, when the rhythm of the music is less than the rhythm threshold, it indicates that the rhythm is slow and the rhythm change is relatively gentle. At this time, at least one of the camera movement distance and camera movement angle is adjusted at a fixed speed so that the terminal lens gently magnifies or slightly shakes with the rhythm of the music, that is, it synchronizes with the rhythm of the music in a rhythmic form. In this way, through precise analysis of the music and delicate control of the camera movement, it is ensured that the speed of the camera movement matches the rhythm change of the music.

[0098] In some embodiments, a live broadcast interface displaying the target space is generated based on camera movement parameters, including:

[0099] When the rhythmic feature indicates that the music's rhythm is not less than the rhythm threshold, the first camera movement effect is displayed at the music's heavy beat point on the live streaming interface.

[0100] In this embodiment, when the rhythm is not less than the rhythm threshold, it indicates that the rhythm is fast. At this time, a stronger camera movement effect is needed. Therefore, the first camera movement effect is displayed to make the camera movement effect stronger. The first camera movement effect is applied at the heavy beat point, which means that the camera movement effect appears at the beat. This makes the camera movement effect more matched with the rhythm characteristics of the music. In other words, this solution makes the camera movement effect better and can further improve the camera movement effect.

[0101] In some embodiments, a live broadcast interface displaying the target space is generated based on camera movement parameters, including:

[0102] When two rhythms with different rhythmic characteristics appear alternately in the music according to a preset pattern, a second camera movement effect is displayed on the live broadcast interface. The first and second camera movement nodes of the second camera movement effect appear according to a preset pattern and are displayed on the beat points corresponding to the two rhythms respectively.

[0103] In this embodiment of the disclosure, when two different rhythms in the music appear in turn according to a pattern, a second camera movement effect with that pattern is displayed, making the camera movement effect more matched with the rhythm of the music, further improving the camera movement effect and making the camera movement accurate.

[0104] In some embodiments, the second camera movement effect includes a first sub-effect and a second sub-effect. Displaying the second camera movement effect on the live streaming interface includes:

[0105] If the difference between two rhythms is greater than the difference threshold, the first sub-effect is displayed on the live broadcast interface. The camera movement parameters of the first sub-effect include the closest camera movement distance and the farthest camera movement distance. The first camera movement node and the second camera movement node correspond to the closest camera movement distance and the farthest camera movement distance, respectively.

[0106] If the difference between two rhythms is no greater than the difference threshold, the second sub-effect is displayed on the live broadcast interface. The camera movement parameters of the second sub-effect include the minimum camera movement angle and the maximum camera movement angle. The first camera movement node and the second camera movement node correspond to the minimum camera movement angle and the maximum camera movement angle, respectively.

[0107] In this embodiment, when the difference between two rhythms is greater than a threshold, it indicates a rapid rhythm change. In this case, a first sub-effect is used to quickly zoom in and out of the camera, matching the camera movement with the rapid rhythm and emphasizing the dramatic change, thus improving the camera movement effect. Conversely, when the difference between two rhythms is less than the threshold, it indicates a gradual rhythm change. In this case, a second sub-effect is used to create a slow, swaying effect on the live stream interface, matching the camera movement with the slow rhythm and emphasizing the gradual change, thus improving the camera movement effect. In other words, this method uses different camera movements based on the difference between two rhythms, further improving the camera movement effect and thus increasing its accuracy.

[0108] In some embodiments, camera movement parameters are obtained based on at least one of the rhythmic features of the music and facial information, including:

[0109] When the rhythmic feature indicates that the rhythm of the music is decreasing, the camera movement parameters corresponding to the decreased rhythm are output as camera movement parameters.

[0110] When the rhythmic feature indicates that the rhythm of the music is increasing, the camera movement parameters corresponding to the increased rhythm are output as camera movement parameters.

[0111] In this embodiment of the disclosure, the camera movement parameters are decreased when the rhythm decreases and increased when the rhythm increases. That is, the rhythm and the camera movement parameters are positively correlated. The camera movement parameters decrease as the rhythm decreases and increase as the rhythm increases, so that the changes in the camera movement effect match the changes in the rhythm, thereby making the camera movement more accurate.

[0112] In some embodiments, the method further includes:

[0113] If the music in the target space is not captured, the camera movement effect will not be displayed on the live broadcast interface.

[0114] In this embodiment of the disclosure, when the music disappears, the camera movement effect is not displayed on the live broadcast interface so that the camera can be stably focused on the target object, ensuring that the image of the target object can be clearly displayed, and thus presenting a clear image of the target object on the live broadcast interface. At this time, the disappearance of the camera movement effect avoids unnecessary visual interference, making the target object more directly and powerfully conveyed on the live broadcast interface, improving the flexibility of camera movement and improving the display effect of the interface.

[0115] In some embodiments, the method further includes:

[0116] Lighting parameters are obtained based on at least one of the rhythmic features of the music and facial information;

[0117] Virtual lights are displayed on the live streaming interface based on lighting parameters.

[0118] In this embodiment, the lighting effects on the live streaming interface change in sync with the rhythm of the music and at least one of facial information. This makes the virtual lighting on the live streaming interface more realistic, further optimizing the display effect and encouraging user interaction. Furthermore, the lighting parameters automatically adjust with the rhythm and at least one of facial information without manual intervention, thus improving human-computer interaction efficiency.

[0119] In some embodiments, a live broadcast interface displaying the target space is generated based on camera movement parameters, including at least one of the following:

[0120] When the object in the target space receives virtual resources, a third camera movement effect is displayed on the live streaming interface. The third camera movement effect is used to zoom in on the object's face on the live streaming interface.

[0121] When the value of the virtual resources received by the object in the target space reaches the resource threshold, a third camera movement effect is displayed on the live broadcast interface. The third camera movement effect is used to zoom in on the object's face on the live broadcast interface.

[0122] In this embodiment of the disclosure, after the streamer receives virtual resources or the value of the received virtual resources reaches a certain value, the streamer's face is magnified based on the third camera movement effect, that is, the streamer's face is brought closer. In this way, the camera movement provides feedback on the end user's behavior of sending virtual resources, which improves the convenience of feedback and realizes the integrity of interaction. This can promote end users to interact on the live broadcast interface and increase the activity of the live broadcast.

[0123] In some embodiments, camera movement parameters are obtained based on at least one of the rhythmic features of the music and facial information, including:

[0124] Music and facial information are sent to a server, which extracts rhythmic features from the music and determines camera movement parameters corresponding to at least one of the rhythmic features and facial information; or,

[0125] The rhythmic features of the music are extracted, and the rhythmic features and facial information are sent to a server. The server is used to determine the camera movement parameters corresponding to at least one of the rhythmic features and facial information.

[0126] In this embodiment of the disclosure, determining the camera movement parameters through a server not only reduces the service pressure on the terminal, but also improves the efficiency of determining the camera movement parameters and ensures timeliness due to the server's powerful computing capabilities.

[0127] The above Figure 2 This is the basic process for displaying the live stream interface. The following is based on... Figure 3 The process of displaying the live stream interface will be explained further. See [link / reference] Figure 3 , Figure 3 This is a flowchart illustrating an interface display method according to an exemplary embodiment. The method is executed by a terminal and includes the following steps.

[0128] In step S301, the terminal collects music within the target space.

[0129] Music possesses certain rhythmic characteristics. If the terminal determines the rhythmic characteristics of the music through the server, the terminal sends the collected music to the server, which then determines the rhythmic characteristics of the music.

[0130] In this embodiment of the disclosure, if live streaming is performed, that is, the terminal displays a real-time live streaming interface, the terminal captures the target space in real time through a camera to perform real-time live streaming.

[0131] In some embodiments, the shooting terminal is equipped with a smart camera movement switch. Before shooting, in response to turning on the smart camera movement switch, smart camera movement is activated during the shooting process. Smart camera movement refers to automatically adjusting camera movement parameters such as camera movement speed, camera movement distance, and camera movement angle during the shooting process, so that they are closely combined with at least one of the music rhythm and facial information. As a result, when the live broadcast interface is displayed based on the video stream obtained from the shooting, the camera movement effects will change according to the changes in the music rhythm and at least one of the facial information, presenting a more vivid live broadcast effect.

[0132] In other embodiments, the terminal is equipped with a smart camera switch. Before executing step S301, in response to turning on the smart camera switch, during the display of the live broadcast interface, the video frame of the target space is adjusted based on the camera movement parameters, and the live broadcast interface is displayed based on the adjusted video frame.

[0133] In some other embodiments, the terminal and the shooting terminal are the same terminal, then in response to turning on the smart camera movement switch, the terminal executes step S301.

[0134] In step S302, the terminal obtains camera movement parameters based on at least one of the rhythmic features of the music and facial information. The facial information includes at least one of the facial expressions and facial movements of the object in the target space, and the camera movement parameters include at least one of the camera movement speed, camera movement distance, and camera movement angle.

[0135] In some embodiments, the terminal itself determines the camera movement parameters. Specifically, the terminal first extracts the rhythm features of the music, or extracts the rhythm features of the music via a server, and then the terminal determines the camera movement parameters corresponding to at least one of the rhythm features and facial information.

[0136] In other embodiments, the terminal determines camera movement parameters through a server. Specifically, the terminal sends music and facial information to the server, which extracts rhythmic features from the music and determines camera movement parameters corresponding to at least one of the rhythmic features and facial information; or, the terminal extracts rhythmic features from the music, sends the rhythmic features and facial information to the server, which determines camera movement parameters corresponding to at least one of the rhythmic features and facial information.

[0137] It should be noted that if the camera movement parameters are determined solely based on rhythmic features, then there is no need to send facial information to the server. If the camera movement parameters are determined solely based on facial information, then there is no need to send music and rhythmic features to the server, and the terminal also does not need to determine the rhythmic features of the music.

[0138] In this embodiment, determining the camera movement parameters through a server not only reduces the service pressure on the terminal, but also improves the efficiency of determining the camera movement parameters and ensures timeliness due to the server's powerful computing capabilities.

[0139] In this embodiment of the disclosure, the terminal obtains camera movement parameters based on at least one of rhythm features and facial information, and the process includes at least one of the following implementation methods.

[0140] The first method involves obtaining camera movement parameters based on facial information when music within the target space is not captured.

[0141] In some embodiments, the terminal establishes a correspondence between various facial information and camera movement parameters. Each type of facial information includes at least one of facial expression and facial movement, and the facial expression and facial movement included in the two types of facial information are different. Accordingly, the terminal obtains camera movement parameters based on the facial information and the above correspondence, improving the convenience of obtaining camera movement parameters.

[0142] In this embodiment, when no music is captured in the target space, that is, when the camera movement parameters cannot be determined based on the music rhythm, the camera movement parameters are obtained based on facial information. This ensures that the camera movement parameters are obtained in real time based on the facial information of the live stream object, thus guaranteeing the accuracy of the camera movement parameters.

[0143] The second method involves acquiring camera movement parameters based on rhythmic features when music is captured within the target space.

[0144] Taking the terminal's determination of camera movement parameters based on rhythm features as an example, the process by which the terminal obtains camera movement parameters based on at least one of the rhythm features of the music and facial information includes the following cases: When the rhythm feature indicates that the music's rhythm is less than a rhythm threshold, the first camera movement parameter is output. When the rhythm feature indicates that the music's rhythm is not less than a rhythm threshold, the second camera movement parameter is output. The second camera movement parameter is a camera movement parameter corresponding to a rhythm from a camera movement parameter library, which includes multiple rhythms and multiple camera movement parameters that are positively correlated with each rhythm.

[0145] The first camera movement parameter is a fixed camera movement parameter, that is, for any rhythm less than the rhythm threshold, the corresponding camera movement parameter is the first camera movement parameter.

[0146] In this camera movement parameter library, the tempo is positively correlated with the camera movement parameters; that is, the faster the tempo, the larger the camera movement parameters, and vice versa. For example, if the camera movement parameters include camera movement speed, then the faster the tempo, the larger the camera movement speed, and vice versa.

[0147] In the above embodiments, the example of the terminal itself determining the camera movement parameters is used for illustration. In other embodiments, the terminal determines the camera movement parameters through the server. The determination process is the same as that of the terminal determining the camera movement parameters, and will not be described again here.

[0148] In this embodiment, the camera movement parameters are determined based on the correspondence between rhythm and camera movement parameters. In other embodiments, the camera movement parameters can also be determined based on a deep learning model. Specifically, the terminal inputs rhythm features into the camera movement parameter model, and the model outputs the camera movement parameters. The camera movement parameter module is trained based on multiple sample rhythm features and the corresponding sample camera movement parameters.

[0149] In some embodiments, the terminal includes a music recognition module, a rhythm tracking module, and a camera movement adjustment module. The music recognition module identifies music within a target space, i.e., it acquires music within the target space. The rhythm tracking module analyzes the rhythm of the music, i.e., it determines the rhythmic characteristics. The camera movement adjustment module determines the corresponding camera movement parameters based on the rhythmic characteristics.

[0150] In this embodiment of the disclosure, when music within the target space is captured, camera movement parameters are obtained in real time based on the music rhythm during the live broadcast. Obviously, the accuracy of these camera movement parameters is high. Thus, when the live broadcast interface is displayed based on these camera movement parameters, the camera movement effects displayed on the live broadcast interface are more intuitive and accurate.

[0151] In this embodiment of the disclosure, when the rhythm feature indicates that the rhythm of the music is not less than the rhythm threshold, the terminal determines the second camera movement parameter corresponding to the rhythm from the camera movement parameter library.

[0152] In this embodiment of the disclosure, when the rhythm of the music is greater than the rhythm threshold, it indicates that the rhythm is fast. Since the rhythm changes relatively quickly when the rhythm is fast, the camera movement is performed based on the camera movement parameters that are positively correlated with the rhythm, so that the camera movement effect can change greatly with the rhythm. That is, the strong camera movement effect is achieved when the music is dynamic, making the camera movement effect more accurate.

[0153] In the above embodiments, the example described is that the camera movement effect is displayed based on fixed camera movement parameters when the rhythm is slow, and based on positively correlated camera movement parameters when the rhythm is fast. In other embodiments, regardless of whether the rhythm is less than a rhythm threshold, for any rhythm, a camera movement parameter positively correlated with that rhythm is determined, and then the camera movement effect is displayed based on the positively correlated camera movement parameter, so that the camera movement effect matches the rhythm of the music more closely.

[0154] In other embodiments, the process by which the terminal obtains camera movement parameters based on at least one of the rhythm features of the music and facial information includes at least one of the following implementation methods: when the rhythm features indicate that the rhythm of the music is decreasing, the terminal outputs the camera movement parameters corresponding to the decreased rhythm as camera movement parameters; when the rhythm features indicate that the rhythm of the music is increasing, the terminal outputs the camera movement parameters corresponding to the increased rhythm as camera movement parameters.

[0155] In this implementation, the camera movement parameters are decreased when the rhythm decreases and increased when the rhythm increases. That is, the rhythm and the camera movement parameters are positively correlated. The camera movement parameters decrease as the rhythm decreases and increase as the rhythm increases, so that the changes in the camera movement effect match the changes in the rhythm, thereby making the camera movement more accurate.

[0156] The third method involves acquiring camera movement parameters based on rhythmic features and facial information when music is captured within the target space.

[0157] In some embodiments, the terminal establishes multiple correspondences between rhythm features, facial information, and camera movement parameters. Each correspondence includes a rhythm feature, a facial information, and a camera movement parameter. Accordingly, the terminal obtains the camera movement parameters based on the current rhythm feature, facial information, and the aforementioned correspondences, improving the convenience of obtaining camera movement parameters.

[0158] In this embodiment of the disclosure, camera movement parameters are obtained based on rhythm features and facial information. By obtaining camera movement parameters based on various real-time information during live streaming, the accuracy of the camera movement parameters is obviously further improved. When the live streaming interface is displayed based on these camera movement parameters, the camera movement effects displayed on the live streaming interface not only match the rhythm features but also match the facial information of the object, thereby making the camera movement features more intuitive and accurate.

[0159] In step S303, the terminal displays a live broadcast interface of the target space based on the camera movement parameters. The live broadcast interface includes the camera movement effect corresponding to the camera movement parameters.

[0160] In some embodiments, the process of the terminal displaying a live broadcast interface of the target space based on camera movement parameters includes the following implementation methods: the terminal acquires a video stream captured based on camera movement parameters and displays a live broadcast interface based on the video stream; or, the terminal adjusts the video frame of the target space based on camera movement parameters and displays a live broadcast interface based on the adjusted video frame.

[0161] In this embodiment, when filming the target space, camera movement parameters are obtained based on at least one of the music rhythm and facial information. The target space is then filmed based on these camera movement parameters. Since these parameters are not determined manually based on experience, but rather inferred in real-time from at least one of the music rhythm and facial information during the live stream, their accuracy is obviously high. Therefore, when the video stream filmed based on these parameters is displayed on the live stream interface, the camera movement effects shown on the interface are more intuitive and accurate. Furthermore, this method requires no human intervention during filming; the machine can automatically determine accurate camera movement parameters and automatically film based on these parameters, thereby improving the efficiency of human-computer interaction.

[0162] In this embodiment, the video frame of the target space is adjusted based on camera movement parameters. Since these camera movement parameters are not determined manually based on experience, but are inferred in real time based on at least one of the music rhythm and facial information during the live broadcast, their accuracy is obviously high. Therefore, when the video frame is adjusted based on these parameters and the live broadcast interface is displayed based on the adjusted video frame, the camera movement effects displayed on the live broadcast interface are more intuitive and accurate. Furthermore, this method does not require manual camera movement during filming; instead, it automatically adjusts the video frame based on the camera movement parameters directly after filming, thereby improving the efficiency of human-computer interaction.

[0163] In some embodiments, the first camera movement parameter includes at least one of a first camera movement speed and a second camera movement speed, wherein the first camera movement speed is used to adjust the camera movement distance, and the second camera movement speed is used to adjust the camera movement angle. Accordingly, the terminal displays a live broadcast interface of the target space based on the camera movement parameters, including at least one of the following implementation methods: the terminal displays a camera movement effect of the live broadcast interface with the camera movement distance adjusted according to the first camera movement speed; the terminal displays a camera movement effect of the live broadcast interface with the camera movement angle adjusted according to the second camera movement speed, that is, displaying a camera movement effect that adjusts at least one of the camera movement distance and camera movement angle.

[0164] In this embodiment, when the music rhythm is less than a rhythm threshold, it indicates a slow rhythm. At this time, at least one of the camera movement distance and camera movement angle is adjusted at a fixed speed, causing the camera to gently zoom in or slightly shake in sync with the music rhythm. This synchronizes the camera movement with the music rhythm through precise music analysis and delicate camera movement control, ensuring that the camera movement speed matches the rhythmic changes of the music. Since the rhythmic changes are relatively gentle when the rhythm is slow, uniformly mapping rhythms less than the rhythm threshold to fixed camera movement parameters ensures that the camera movement effect matches the music rhythm while also improving the efficiency of camera movement processing.

[0165] In some embodiments, in order to make the camera movement smoother to correspond with the rhythm when the music is slow, the camera movement speed is controlled, such as a first camera movement speed being less than a first speed threshold and a second camera movement speed being less than a second speed threshold.

[0166] In some embodiments, the process of the terminal displaying the live broadcast interface of the target space based on the camera movement parameters further includes the following implementation: when the rhythm feature indicates that the rhythm of the music is not less than the rhythm threshold, the terminal displays the first camera movement effect at the heavy beat point of the music on the live broadcast interface.

[0167] The first camera movement effect can be set as needed. Optionally, the terminal determines the first camera movement effect based on the music's beat. Specifically, the terminal selects the first camera movement effect corresponding to the music's beat from a camera movement effect library. The camera movement effect library includes multiple beats and their corresponding camera movement effects.

[0168] In this embodiment, when the rhythm is not less than the rhythm threshold, it indicates that the rhythm is fast. At this time, a stronger camera movement effect is needed. Therefore, the first camera movement effect is displayed to make the camera movement effect stronger. The first camera movement effect is applied at the heavy beat point, which means that the camera movement effect appears at the beat. This makes the camera movement effect more matched with the rhythm characteristics of the music. In other words, this solution makes the camera movement effect better and can further improve the camera movement effect.

[0169] In some embodiments, the process of the terminal displaying the live broadcast interface of the target space based on the camera movement parameters further includes the following implementation: when two rhythms with different rhythmic characteristics appear in turn in the music according to a preset rule, the terminal displays a second camera movement effect on the live broadcast interface, and the first camera movement node and the second camera movement node of the second camera movement effect appear according to a preset rule to be displayed on the beat points corresponding to the two rhythms respectively.

[0170] Optionally, the terminal determines the second camera movement effect corresponding to a preset rule from a camera movement rule library, which includes multiple preset rules and the second camera movement effects corresponding to each preset rule.

[0171] The two rhythms appear alternately according to a preset pattern, which means that the two rhythms appear periodically in turn.

[0172] Optionally, the first camera movement node and the second camera movement node correspond to the boundary values ​​of the camera movement parameters of the second camera movement effect, respectively. Further, the first camera movement node and the second camera movement node correspond to boundary values ​​of the same type. For example, the first camera movement node and the second camera movement node correspond to the closest camera movement distance and the farthest camera movement distance, respectively; or, the first camera movement node and the second camera movement node correspond to the minimum camera movement angle and the maximum camera movement angle, respectively.

[0173] Optionally, the faster rhythm of the two rhythms corresponds to the maximum boundary value, and the slower rhythm of the two rhythms corresponds to the minimum boundary value. This allows for a strong camera movement effect to be highlighted when the rhythm is dynamic, and a gentle camera movement effect to be produced when the rhythm is slow, thus further improving the camera movement effect and achieving accurate camera movement.

[0174] Among them, the beat point corresponding to the rhythm is the beat point where the rhythm appears, and further, it can be the heavy beat point.

[0175] In this embodiment, when two different rhythms in the music appear alternately according to a certain pattern, a second camera movement effect with that pattern is displayed, making the camera movement effect more matched with the rhythm of the music, further improving the camera movement effect and making the camera movement accurate.

[0176] In some embodiments, the second camera movement effect further includes a first sub-effect and a second sub-effect. The two sub-effects are used when the difference between the two rhythms is different. Accordingly, the process of the terminal displaying the second camera movement effect on the live broadcast interface includes the following steps: when the difference between the two rhythms is greater than the difference threshold, the terminal displays the first sub-effect on the live broadcast interface. The camera movement parameters of the first sub-effect include the closest camera movement distance and the farthest camera movement distance. The first camera movement node and the second camera movement node correspond to the closest camera movement distance and the farthest camera movement distance, respectively. When the difference between the two rhythms is not greater than the difference threshold, the terminal displays the second sub-effect on the live broadcast interface. The camera movement parameters of the second sub-effect include the minimum camera movement angle and the maximum camera movement angle. The first camera movement node and the second camera movement node correspond to the minimum camera movement angle and the maximum camera movement angle, respectively.

[0177] In this embodiment, when the difference between two rhythms is greater than a threshold, it indicates a rapid rhythm change. Therefore, a first sub-effect is used to quickly zoom in and out of the camera, matching the camera movement to the rapid rhythm and emphasizing the dramatic change, thus improving the overall camera movement effect. Conversely, when the difference between two rhythms is less than the threshold, it indicates a gradual rhythm change. Therefore, a second sub-effect is used to create a slow, swaying effect on the live stream interface, matching the camera movement to the gradual rhythm and emphasizing the smooth change, thus improving the overall camera movement effect. In other words, this method uses different camera movements based on the difference between two rhythms, further enhancing the camera movement effect and improving its accuracy.

[0178] In step S304, when the anchor in the target space receives the virtual resources, the terminal displays a third camera movement effect on the live broadcast interface. The third camera movement effect is used to zoom in on the face of the object on the live broadcast interface.

[0179] The camera movement parameters for the third camera movement effect include camera movement distance and camera movement speed. The third camera movement effect uses this camera movement speed to shorten the camera movement distance.

[0180] The third camera movement effect can be set as needed. Optionally, the terminal determines the third camera movement effect based on the values ​​of the virtual resources. Specifically, the terminal determines the third camera movement effect corresponding to the values ​​of the virtual resources from a camera movement effect library. The camera movement effect library includes various values ​​and their corresponding camera movement effects.

[0181] Among them, the camera movement distance of the camera movement effect is negatively correlated with the value, while the camera movement speed of the camera movement effect is positively correlated with the value. That is, the larger the value, the closer the camera movement distance and the faster the camera movement speed; the smaller the value, the farther the camera movement distance and the slower the camera movement speed. In addition, the larger the value, the greater the magnification of the anchor's face, and the smaller the value, the less the magnification of the anchor's face.

[0182] In step S304, the example of displaying a third camera movement effect upon the broadcaster receiving virtual resources is given. In other embodiments, when the value of the virtual resources received by the object in the target space reaches a resource threshold, a third camera movement effect is displayed on the live broadcast interface. This third camera movement effect is used to magnify the object's face on the live broadcast interface.

[0183] In this embodiment of the disclosure, after the streamer receives virtual resources or the value of the received virtual resources reaches a certain value, the streamer's face is magnified based on the third camera movement effect, that is, the streamer's face is brought closer. In this way, the camera movement provides feedback on the end user's behavior of sending virtual resources, which improves the convenience of feedback and realizes the integrity of interaction, thereby promoting the end user to interact on the live broadcast interface.

[0184] In this embodiment, the example described is applying a third camera movement effect to magnify the streamer's face when virtual resources are received. In other embodiments, other camera movement effects may be applied at this time to achieve other effects, such as applying a fourth camera movement effect to shake the live stream interface. Specifically, when the streamer in the target space receives virtual resources or the value of the received virtual resources reaches a resource threshold, the fourth camera movement effect is displayed on the live stream interface to indicate that the live stream interface is shaking.

[0185] In the above embodiments, the example described is the acquisition of music within the target space and the display of the live streaming interface based on the camera movement parameters corresponding to the rhythmic characteristics of the music. In other embodiments, if the terminal cannot acquire music from the target space, the terminal does not display camera movement effects on the live streaming interface.

[0186] In this embodiment, when the music stops, the camera movement effect is not displayed on the live broadcast interface so that the camera can focus stably on the target object and ensure that the image of the target object can be clearly displayed by the camera. Thus, a clear image of the target object is presented on the live broadcast interface. At this time, the disappearance of the camera movement effect avoids unnecessary visual interference, making the communication of the target object on the live broadcast interface more direct and powerful.

[0187] For example, see Figure 4 , Figure 4 This is a schematic diagram illustrating a third camera movement effect according to an exemplary embodiment. Both the left and right interfaces are live streaming interfaces. The right interface shows the live streaming interface before and after applying the third camera movement effect. A comparison shows that on the live streaming interface displaying the third camera movement effect, the streamer's face is magnified, effectively bringing the camera closer.

[0188] In this embodiment of the disclosure, the first camera movement effect, the second camera movement effect, the third camera movement effect, etc., can be determined by the terminal itself or by the terminal through the server, and are not specifically limited here.

[0189] In step S305, the terminal obtains lighting parameters based on at least one of the rhythmic features of the music and facial information; and displays virtual lights on the live streaming interface based on the lighting parameters.

[0190] The lighting parameters include at least one of the following: light brightness, light color, and light movement speed. Light movement speed refers to the speed at which the virtual light moves on the live streaming interface. The virtual light can move from one position to another on the live streaming interface by sweeping the light across the screen.

[0191] The terminal itself can obtain lighting parameters based on at least one of rhythm features and facial information, or the server can obtain lighting parameters based on at least one of rhythm features and facial information.

[0192] Taking the terminal's acquisition of lighting parameters through rhythm features as an example, the process includes the following scenarios: When the rhythm feature indicates that the music's rhythm is less than a rhythm threshold, the terminal outputs the first lighting parameter. When the rhythm feature indicates that the music's rhythm is not less than a rhythm threshold, the terminal outputs the second lighting parameter. The second lighting parameter is a lighting parameter corresponding to a rhythm from a lighting parameter library, which includes multiple rhythms and multiple lighting parameters that are positively correlated with each rhythm.

[0193] The first lighting parameter is a fixed lighting parameter, meaning that for any rhythm less than the rhythm threshold, the corresponding lighting parameter is the first lighting parameter.

[0194] The rhythm is positively correlated with the lighting parameters; that is, the faster the rhythm, the larger the lighting parameters, and vice versa. For example, lighting parameters include the speed of light movement. A faster rhythm results in a faster light movement speed, and a slower rhythm results in a slower light movement speed.

[0195] In this embodiment, the lighting effects on the live streaming interface change with the rhythm of the music, making the virtual lighting on the live streaming interface more realistic and further optimizing the display effect of the live streaming interface. This, in turn, encourages end-user interaction on the live streaming interface. Furthermore, the lighting parameters adjust automatically with the rhythm without manual triggering, thereby improving the efficiency of human-computer interaction.

[0196] For example, see Figure 5 , Figure 5This is a flowchart illustrating an interface display method according to an exemplary embodiment. The example described uses a terminal where the terminal and the shooting terminal are the same, i.e., the terminal used by the broadcaster. The broadcaster conducts live shooting through their terminal. Specifically, after the terminal captures music within the target space, it extracts the rhythmic features of the music and then determines the corresponding camera movement parameters, i.e., synchronizing the music rhythm with the camera movement parameters. The terminal then captures the image using the camera movement parameters, i.e., it shoots the target space. The server processes the captured video stream to obtain the live video stream. Finally, the terminal participating in the live broadcast renders the image based on this video stream and presents the live interface to the audience.

[0197] The method provided in this application allows for camera movement effects that maintain the normal intensity, speed, and amplitude of camera movement when the music rhythm is slow during a live stream. Intensity, speed, and amplitude refer to camera distance, speed, and angle, respectively. As the music rhythm speeds up, the intensity and speed of the camera movement also increase accordingly, with a greater amplitude. At the climax of the music, the intensity, amplitude, and speed of the camera movement reach their maximum values, providing viewers with a highly impactful visual experience. Conversely, as the music rhythm slows down, the intensity, amplitude, and speed of the camera movement gradually decrease, returning to a normal live stream effect. In this embodiment, linking camera movement effects to the music rhythm adds more fun to the interaction between the streamer and the audience, enhancing the interactivity and appeal of the live stream, and thus encouraging audience interaction within the live stream.

[0198] In this embodiment, the camera movement effects during live streaming change with the rhythm of the music. Specifically, intelligent camera movement is enabled before the live stream begins. When the live stream interface is displayed, the terminal captures music, extracts rhythmic features, and adjusts these parameters based on a pre-defined relationship between the rhythmic features and camera movement parameters. The live stream interface is then displayed based on these adjusted parameters. In the absence of music, the camera movement effects disappear, and the camera only follows the streamer's face, allowing viewers to clearly see the streamer's expressions and movements even in quiet or background music-free environments. When music starts playing, if the rhythm is slow, the camera begins with basic zooming or swaying movements, with the speed and intensity adjusted according to the rhythm. When the rhythm speeds up, such as during the chorus, the camera movement effects change dramatically with the rhythm, and specific camera movement effects may also appear. When the music is dynamic, the camera undergoes significant dynamic changes, such as rapid zooming, rapid perspective switching, or the use of camera movement effects, to simulate the excitement or tension viewers might experience during intense music. In this embodiment of the disclosure, the intelligent camera movement effect changes according to the rhythm of the music, making the live broadcast content more vivid and interesting, improving the viewing experience of end users, thereby increasing the viewership of the live broadcast room and promoting interaction among end users in the live broadcast room.

[0199] This disclosure provides an interface display method. When displaying a live stream interface in a target space, the method collects music from within that space and then obtains camera movement parameters based on at least one of the music's rhythmic features and facial information. The live stream interface is then displayed based on these camera movement parameters, ensuring that the interface includes the corresponding camera movement effects. Since these parameters are not determined manually based on experience but are derived in real-time from the music rhythm and the facial information of the subjects during the live stream, their accuracy is high. Therefore, when the live stream interface is displayed based on these parameters, the camera movement effects are more intuitive and accurate. Furthermore, this method requires no human intervention; the machine can automatically determine accurate camera movement parameters and display the live stream interface based on these parameters, thereby improving human-computer interaction efficiency.

[0200] Figure 6 This is a block diagram illustrating an interface display device according to an exemplary embodiment. (Refer to...) Figure 6 The device includes:

[0201] Acquisition unit 601 is configured to acquire music within the target space;

[0202] The acquisition unit 602 is configured to acquire camera movement parameters based on at least one of the rhythm features of music and facial information, wherein the facial information includes at least one of the facial expressions and facial movements of an object in the target space, and the camera movement parameters include at least one of the camera movement speed, camera movement distance, and camera movement angle.

[0203] The display unit is configured to execute a live broadcast interface based on camera movement parameters, which displays a live broadcast interface in the target space, including the camera movement effects corresponding to the camera movement parameters.

[0204] In some embodiments, the acquisition unit 602 is configured to perform at least one of the following:

[0205] In the absence of music in the target space, camera movement parameters are obtained based on facial information;

[0206] If music within the target space is captured, camera movement parameters are obtained based on rhythmic features; or, if music within the target space is captured, camera movement parameters are obtained based on rhythmic features and facial information.

[0207] In some embodiments, the display unit is configured to perform:

[0208] Acquire the video stream captured based on camera movement parameters, and display the live stream interface based on the video stream; or...

[0209] The video frame in the target space is adjusted based on the camera movement parameters, and the live broadcast interface is displayed based on the adjusted video frame.

[0210] In some embodiments, the acquisition unit 602 is configured to perform:

[0211] When the rhythm feature indicates that the rhythm of the music is less than the rhythm threshold, the first camera movement parameter is output as the camera movement parameter.

[0212] When the rhythmic feature indicates that the rhythm of the music is not less than the rhythm threshold, the second camera movement parameter is output as a camera movement parameter. The second camera movement parameter is the camera movement parameter corresponding to the rhythm in the camera movement parameter library. The camera movement parameter library includes multiple rhythms and multiple camera movement parameters that are positively correlated with each rhythm.

[0213] In some embodiments, the first camera movement parameter includes at least one of a first camera movement speed and a second camera movement speed, and the display unit is configured to perform at least one of the following:

[0214] The live stream interface displays the camera movement effect, adjusting the camera distance according to the first camera movement speed;

[0215] The live stream interface displays the camera movement effect as the camera angle is adjusted according to the second camera movement speed.

[0216] In some embodiments, the display unit is configured to perform:

[0217] When the rhythmic feature indicates that the music's rhythm is not less than the rhythm threshold, the first camera movement effect is displayed at the music's heavy beat point on the live streaming interface.

[0218] In some embodiments, the display unit is configured to perform:

[0219] When two rhythms with different rhythmic characteristics appear alternately in the music according to a preset pattern, a second camera movement effect is displayed on the live broadcast interface. The first and second camera movement nodes of the second camera movement effect appear according to a preset pattern and are displayed on the beat points corresponding to the two rhythms respectively.

[0220] In some embodiments, the second camera movement effect includes a first sub-effect and a second sub-effect, and the display unit is configured to execute:

[0221] If the difference between two rhythms is greater than the difference threshold, the first sub-effect is displayed on the live broadcast interface. The camera movement parameters of the first sub-effect include the closest camera movement distance and the farthest camera movement distance. The first camera movement node and the second camera movement node correspond to the closest camera movement distance and the farthest camera movement distance, respectively.

[0222] If the difference between two rhythms is no greater than the difference threshold, the second sub-effect is displayed on the live broadcast interface. The camera movement parameters of the second sub-effect include the minimum camera movement angle and the maximum camera movement angle. The first camera movement node and the second camera movement node correspond to the minimum camera movement angle and the maximum camera movement angle, respectively.

[0223] In some embodiments, the acquisition unit 602 is configured to perform:

[0224] When the rhythmic feature indicates that the rhythm of the music is decreasing, the camera movement parameters corresponding to the decreased rhythm are output as camera movement parameters.

[0225] When the rhythmic feature indicates that the rhythm of the music is increasing, the camera movement parameters corresponding to the increased rhythm are output as camera movement parameters.

[0226] In some embodiments, the display unit is further configured to perform:

[0227] If the music in the target space is not captured, the camera movement effect will not be displayed on the live broadcast interface.

[0228] In some embodiments, the acquisition unit 602 is further configured to acquire lighting parameters based on at least one of the rhythmic features of the music and facial information;

[0229] The display unit is also configured to display virtual lights on the live streaming interface based on lighting parameters.

[0230] In some embodiments, the display unit is configured to perform at least one of the following:

[0231] When the object in the target space receives virtual resources, a third camera movement effect is displayed on the live streaming interface. The third camera movement effect is used to zoom in on the object's face on the live streaming interface.

[0232] When the value of the virtual resources received by the object in the target space reaches the resource threshold, a third camera movement effect is displayed on the live broadcast interface. The third camera movement effect is used to zoom in on the object's face on the live broadcast interface.

[0233] In some embodiments, the acquisition unit 602 is configured to perform:

[0234] Music and facial information are sent to a server, which extracts rhythmic features from the music and determines camera movement parameters corresponding to at least one of the rhythmic features and facial information; or,

[0235] The rhythmic features of the music are extracted, and the rhythmic features and facial information are sent to a server. The server is used to determine the camera movement parameters corresponding to at least one of the rhythmic features and facial information.

[0236] This disclosure provides a live streaming device that, when displaying a live streaming interface in a target space, captures music within that space and then obtains camera movement parameters based on at least one of the music's rhythmic characteristics and facial information. The live streaming interface is then displayed based on these parameters, resulting in camera movement effects corresponding to the parameters. Since these camera movement parameters are not determined manually based on experience but are derived in real-time from the music rhythm and the facial information of the subjects during the live stream, their accuracy is obviously high. Therefore, when the live streaming interface is displayed based on these parameters, the camera movement effects are more intuitive and accurate. Furthermore, this device requires no human intervention; the machine can automatically determine accurate camera movement parameters and display the live streaming interface based on these parameters, thereby improving human-computer interaction efficiency.

[0237] Regarding the apparatus in the above embodiments, the specific manner in which each unit performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0238] Figure 7 A structural block diagram of a terminal 700 provided in an exemplary embodiment of this disclosure is shown. The terminal 700 may be a smartphone, tablet computer, MP3 player (Moving Picture Experts Group Audio Layer III), MP4 player (Moving Picture Experts Group Audio Layer IV), laptop computer, or desktop computer. The terminal 700 may also be referred to as a user device, portable terminal, laptop terminal, desktop terminal, or other names.

[0239] Typically, terminal 700 includes a processor 701 and a memory 702.

[0240] Processor 701 may include one or more processing cores, such as a quad-core processor, an octa-core processor, etc. Processor 701 may be implemented using at least one hardware form selected from DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). Processor 701 may also include a main processor and a coprocessor. The main processor, also known as a CPU (Central Processing Unit), is used to process data in the wake-up state; the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, processor 701 may integrate a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the screen. In some embodiments, processor 701 may also include an AI (Artificial Intelligence) processor, which is used to handle computational operations related to machine learning.

[0241] The memory 702 may include one or more computer-readable storage media, which may be non-transitory. The memory 702 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory devices. In some embodiments, the non-transitory computer-readable storage media in the memory 702 are used to store at least one program code, which is executed by the processor 701 to implement the interface display method provided in the method embodiments of this disclosure.

[0242] In some embodiments, the terminal 700 may also optionally include a peripheral device interface 703 and at least one peripheral device. The processor 701, memory 702, and peripheral device interface 703 can be connected via a bus or signal line. Each peripheral device can be connected to the peripheral device interface 703 via a bus, signal line, or circuit board. Specifically, the peripheral device includes at least one of the following: a radio frequency circuit 704, a display screen 705, a camera assembly 706, an audio circuit 707, and a power supply 708.

[0243] Peripheral device interface 703 can be used to connect at least one I / O (Input / Output) related peripheral device to processor 701 and memory 702. In some embodiments, processor 701, memory 702 and peripheral device interface 703 are integrated on the same chip or circuit board; in some other embodiments, any one or two of processor 701, memory 702 and peripheral device interface 703 can be implemented on separate chips or circuit boards, which is not limited in this embodiment.

[0244] The radio frequency (RF) circuit 704 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The RF circuit 704 communicates with communication networks and other communication devices via electromagnetic signals. The RF circuit 704 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals back into electrical signals. Optionally, the RF circuit 704 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, etc. The RF circuit 704 can communicate with other terminals via at least one wireless communication protocol. This wireless communication protocol includes, but is not limited to: metropolitan area networks (MANs), various generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks (WLANs), and / or WiFi (Wireless Fidelity) networks. In some embodiments, the RF circuit 704 may also include circuitry related to NFC (Near Field Communication), which is not limited in this disclosure.

[0245] Display screen 705 is used to display a UI (User Interface). This UI may include graphics, text, icons, videos, and any combination thereof. When display screen 705 is a touch display screen, it also has the ability to collect touch signals on or above its surface. These touch signals can be input as control signals to processor 701 for processing. In this case, display screen 705 can also be used to provide virtual buttons and / or a virtual keyboard, also known as soft buttons and / or a soft keyboard. In some embodiments, there may be one display screen 705, which serves as the front panel of terminal 700; in other embodiments, there may be at least two display screens 705, respectively disposed on different surfaces of terminal 700 or in a folded design; in still other embodiments, display screen 705 may be a flexible display screen, disposed on a curved or folded surface of terminal 700. Furthermore, display screen 705 may be configured as a non-rectangular, irregular shape, i.e., a non-rectangular screen. Display screen 705 may be made of materials such as LCD (Liquid Crystal Display) or OLED (Organic Light-Emitting Diode).

[0246] The camera assembly 706 is used to acquire images or videos. Optionally, the camera assembly 706 includes a front-facing camera and a rear-facing camera. Typically, the front-facing camera is located on the front panel of the terminal, and the rear-facing camera is located on the back of the terminal. In some embodiments, there are at least two rear-facing cameras, which are any one of a main camera, a depth-sensing camera, a wide-angle camera, and a telephoto camera, to achieve background blurring by fusion of the main camera and the depth-sensing camera, panoramic shooting by fusion of the main camera and the wide-angle camera, VR (Virtual Reality) shooting, or other fusion shooting functions. In some embodiments, the camera assembly 706 may also include a flash. The flash can be a single-color temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm-light flash and a cool-light flash, which can be used for light compensation at different color temperatures.

[0247] The audio circuit 707 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, converting the sound waves into electrical signals that are input to the processor 701 for processing, or input to the radio frequency circuit 704 for voice communication. For stereo sound acquisition or noise reduction purposes, multiple microphones may be used, each located at a different part of the terminal 700. The microphone may also be an array microphone or an omnidirectional microphone. The speaker is used to convert the electrical signals from the processor 701 or the radio frequency circuit 704 into sound waves. The speaker may be a conventional diaphragm speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can convert electrical signals not only into audible sound waves but also into inaudible sound waves for purposes such as distance measurement. In some embodiments, the audio circuit 707 may also include a headphone jack.

[0248] Power supply 708 is used to power the various components in terminal 700. Power supply 708 can be AC ​​power, DC power, a disposable battery, or a rechargeable battery. When power supply 708 includes a rechargeable battery, the rechargeable battery can support wired charging or wireless charging. The rechargeable battery can also be used to support fast charging technology.

[0249] Those skilled in the art will understand that Figure 7 The structure shown does not constitute a limitation on terminal 700, and may include more or fewer components than shown, or combine certain components, or use different component arrangements.

[0250] In an exemplary embodiment, a computer-readable storage medium including instructions is also provided, such as a memory including instructions, which can be executed by the processor of a terminal to complete the interface display method described above. Optionally, the computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.

[0251] In an exemplary embodiment, a computer program product is also provided, including a computer program that, when executed by a processor, implements the aforementioned interface display method. In some embodiments, the computer program product involved in this disclosure can be deployed and executed on a single terminal, or on multiple terminals located in one location, or on multiple terminals distributed across multiple locations and interconnected via a communication network. These multiple terminals distributed across multiple locations and interconnected via a communication network can constitute a blockchain system.

[0252] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the claims. All the above-described optional technical solutions can be combined in any way to form optional embodiments of this application, and will not be elaborated upon here.

[0253] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. A method for displaying an interface, characterized in that, The method includes: Collect music within the target space; Camera movement parameters are obtained based on at least one of the rhythmic features of the music and facial information, wherein the facial information includes at least one of the facial expressions and facial movements of the object in the target space, and the camera movement parameters include camera movement speed, camera movement distance, and camera movement angle, wherein the camera movement speed includes a speed for adjusting the camera movement distance and a speed for adjusting the camera movement angle. Based on the camera movement parameters, a live streaming interface for the target space is displayed, and the live streaming interface includes the camera movement effects corresponding to the camera movement parameters. The step of obtaining camera movement parameters based on at least one of the rhythmic features of the music and facial information includes: In the absence of music within the target space, the camera movement parameters are obtained based on the facial information; When music is captured within the target space, the camera movement parameters are obtained based on the rhythm features and the facial information. The live streaming interface for displaying the target space based on the camera movement parameters includes: When two rhythms with different rhythmic characteristics appear in turn in the music according to a preset pattern, a second camera movement effect is displayed on the live broadcast interface. The first camera movement node and the second camera movement node of the second camera movement effect appear according to the preset pattern and are displayed on the beat points corresponding to the two rhythms respectively. The second camera movement effect includes two sub-effects, which are used when the difference between the two rhythms is different. The first camera movement node and the second camera movement node correspond to the minimum and maximum boundary values ​​of the same type of camera movement parameter, respectively.

2. The interface display method according to claim 1, characterized in that, The live streaming interface for displaying the target space based on the camera movement parameters includes: Acquire a video stream captured based on the camera movement parameters, and display the live streaming interface based on the video stream; or... The video frame of the target space is adjusted based on the camera movement parameters, and the live broadcast interface is displayed based on the adjusted video frame.

3. The interface display method according to claim 1, characterized in that, The acquisition of camera movement parameters based on at least one of the rhythmic features of the music and facial information includes: When the rhythmic feature indicates that the rhythm of the music is less than the rhythm threshold, the first camera movement parameter is output as the camera movement parameter; When the rhythmic feature indicates that the rhythm of the music is not less than the rhythm threshold, the second camera movement parameter is output as the camera movement parameter. The second camera movement parameter is the camera movement parameter in the camera movement parameter library that corresponds to the rhythm. The camera movement parameter library includes multiple rhythms and camera movement parameters that are positively correlated with the multiple rhythms.

4. The interface display method according to claim 3, characterized in that, The first camera movement parameter includes at least one of a first camera movement speed and a second camera movement speed, and the step of displaying the live broadcast interface of the target space based on the camera movement parameter includes at least one of the following: The live streaming interface displays the camera movement effect of adjusting the camera distance according to the first camera movement speed; The live stream interface displays the camera movement effect as the camera angle is adjusted according to the second camera movement speed.

5. The interface display method according to claim 1, characterized in that, The live streaming interface for displaying the target space based on the camera movement parameters includes: When the rhythm feature indicates that the rhythm of the music is not less than the rhythm threshold, a first camera movement effect is displayed at the heavy beat point of the music on the live streaming interface.

6. The interface display method according to claim 1, characterized in that, The second camera movement effect includes a first sub-effect and a second sub-effect. Displaying the second camera movement effect on the live streaming interface includes: If the difference between the two rhythms is greater than the difference threshold, the first sub-effect is displayed on the live broadcast interface. The camera movement parameters of the first sub-effect include the closest camera movement distance and the farthest camera movement distance. The first camera movement node and the second camera movement node correspond to the closest camera movement distance and the farthest camera movement distance, respectively. If the difference between the two rhythms is not greater than the difference threshold, the second sub-effect is displayed on the live broadcast interface. The camera movement parameters of the second sub-effect include the minimum camera movement angle and the maximum camera movement angle. The first camera movement node and the second camera movement node correspond to the minimum camera movement angle and the maximum camera movement angle, respectively.

7. The interface display method according to claim 1, characterized in that, The acquisition of camera movement parameters based on at least one of the rhythmic features of the music and facial information includes: When the rhythmic feature indicates that the rhythm of the music is decreasing, the camera movement parameters corresponding to the decreased rhythm are output as the camera movement parameters. When the rhythmic feature indicates that the rhythm of the music is increasing, the camera movement parameters corresponding to the increased rhythm are output as the camera movement parameters.

8. The interface display method according to claim 1, characterized in that, The method further includes: Lighting parameters are obtained based on at least one of the rhythmic features of the music and facial information; Virtual lights are displayed on the live streaming interface based on the aforementioned lighting parameters.

9. The interface display method according to claim 1, characterized in that, The live streaming interface that displays the target space based on the camera movement parameters includes at least one of the following: When an object in the target space receives virtual resources, a third camera movement effect is displayed on the live streaming interface. The third camera movement effect is used to magnify the face of the object on the live streaming interface. When the value of the virtual resources received by the object in the target space reaches the resource threshold, a third camera movement effect is displayed on the live streaming interface. The third camera movement effect is used to magnify the face of the object on the live streaming interface.

10. The interface display method according to claim 1, characterized in that, The acquisition of camera movement parameters based on at least one of the rhythmic features of the music and facial information includes: The music and facial information are sent to a server, which extracts the rhythmic features of the music and determines camera movement parameters corresponding to at least one of the rhythmic features and the facial information; or... The rhythmic features of the music are extracted, and the rhythmic features and the facial information are sent to a server. The server is used to determine the camera movement parameters corresponding to at least one of the rhythmic features and the facial information.

11. An interface display device, characterized in that, The device includes: The acquisition unit is configured to acquire music within the target space; The acquisition unit is configured to acquire camera movement parameters based on at least one of the rhythmic features of the music and facial information, wherein the facial information includes at least one of facial expressions and facial movements of an object within the target space, and the camera movement parameters include camera movement speed, camera movement distance, and camera movement angle, wherein the camera movement speed includes a speed for adjusting the camera movement distance and a speed for adjusting the camera movement angle. The display unit is configured to perform a live broadcast interface of the target space based on the camera movement parameters, the live broadcast interface including the camera movement effect corresponding to the camera movement parameters; The acquisition unit is configured to execute: In the absence of music within the target space, the camera movement parameters are obtained based on the facial information; When music is captured within the target space, the camera movement parameters are obtained based on the rhythm features and the facial information. The display unit is configured to perform: When two rhythms with different rhythmic characteristics appear in turn in the music according to a preset pattern, a second camera movement effect is displayed on the live broadcast interface. The first camera movement node and the second camera movement node of the second camera movement effect appear according to the preset pattern and are displayed on the beat points corresponding to the two rhythms respectively. The second camera movement effect includes two sub-effects, which are used when the difference between the two rhythms is different. The first camera movement node and the second camera movement node correspond to the minimum and maximum boundary values ​​of the same type of camera movement parameter, respectively.

12. A terminal, characterized in that, include: processor; Memory used to store the processor's executable instructions; The processor is configured to execute the instructions to implement the interface display method as described in any one of claims 1 to 10.

13. A computer-readable storage medium, characterized in that, When the instructions in the computer-readable storage medium are executed by the processor of the terminal, the terminal is able to perform the interface display method according to any one of claims 1 to 10.

14. A computer program product, characterized in that, The computer program product includes a computer program that, when executed by a processor, implements the interface display method according to any one of claims 1 to 10.

Images