Display device, server, and music recommendation method
By obtaining the current playback scene information of the display device, requesting and displaying the target recommended song list from the server, the problem of inaccurate song recommendations on the display device is solved, and more intelligent and accurate music recommendations are achieved.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- 青岛聚看云科技有限公司
- Filing Date
- 2022-12-19
- Publication Date
- 2026-06-09
AI Technical Summary
Existing display devices ignore the current playback context after a user uses the music recognition function, resulting in inaccurate song recommendations and a poor user experience.
The display device obtains the target information of the current playback scene, sends a recommendation request to the server to obtain the target recommended song list, and displays the relevant song list on the screen.
By combining information from the current playback context to recommend songs, the intelligence and accuracy of recommendations are improved, thus enhancing the user experience.
Smart Images

Figure CN117271810B_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to the field of music recommendation, and more particularly to a display device, a server, and a music recommendation method. Background Technology
[0002] As the variety and number of songs continue to increase, users may not know the name of a song when they hear it, and may want to know related songs and information.
[0003] The music recognition function in display devices refers to the process of collecting the audio corresponding to a music playback segment and identifying the corresponding song information. However, most display devices currently only display the successfully identified song information or other songs related to the successfully identified song after the user uses the music recognition function, ignoring the current playback scenario of the user's display device. This results in the display device displaying inaccurate songs and a poor user experience. Summary of the Invention
[0004] To address, or at least partially address, the aforementioned technical problems, this disclosure provides a display device, a server, and a music recommendation method. This method can acquire target information corresponding to the current playback scenario of the display device and display a list of recommended songs related to the target information on the monitor. This makes music recommendations more intelligent and accurate, thereby improving the user experience.
[0005] In a first aspect, this disclosure provides a display device, the display device comprising:
[0006] monitor;
[0007] The first controller is configured as follows:
[0008] Receive input to enable the music recognition function;
[0009] In response to the operation of enabling the music recognition function, target information corresponding to the current playback scene of the display device is obtained. The current playback scene includes a movie playback scene or a song playback scene. The target information is different under different current playback scenes. The target information is used to characterize the current playback scene and the song played under the current playback scene.
[0010] A recommendation request is sent to the server, wherein the recommendation request includes the target information, so that the server obtains a target recommended song list based on the target information, and different target information corresponds to different target recommended song lists;
[0011] The system receives a recommendation response from the server, the recommendation response including the target recommended song list, and controls the display to show the target recommended song list.
[0012] Secondly, this disclosure provides a server comprising:
[0013] The second controller is configured as follows:
[0014] The device receives a recommendation request sent by a display device. The recommendation request includes target information, which is obtained by the display device in response to the operation of enabling music recognition function after receiving input. The target information is based on the current playback scenario of the display device. The current playback scenario includes a movie playback scenario or a song playback scenario. The target information is different for different current playback scenarios. The target information is used to characterize the current playback scenario and the song played in the current playback scenario.
[0015] Based on the target information, a target recommended song list is obtained, and a recommendation response is sent to the display device. The recommendation response includes the target recommended song list, so that the display device controls the display device's screen to display the target recommended song list. The target recommended song list is different for different target information.
[0016] Thirdly, this disclosure provides a music recommendation method applied to a display device, the method comprising:
[0017] Receive input to enable the music recognition function;
[0018] In response to the operation of enabling the music recognition function, the target information corresponding to the current playback scene of the display device is obtained. The current playback scene includes a movie playback scene or a song playback scene. The target information is different under different current playback scenes. The target information is used to characterize the current playback scene and the song played under the current playback scene.
[0019] A recommendation request is sent to the server, wherein the recommendation request includes the target information, so that the server obtains a target recommended song list based on the target information, and different target information corresponds to different target recommended song lists;
[0020] The system receives a recommendation response from the server, the recommendation response including the target recommended song list, and controls the display device to display the target recommended song list.
[0021] Fourthly, this disclosure provides a music recommendation method applied to a server, the method comprising:
[0022] The device receives a recommendation request sent by a display device. The recommendation request includes target information, which is obtained by the display device in response to the operation of enabling music recognition function after receiving input. The target information is based on the current playback scenario of the display device. The current playback scenario includes a movie playback scenario or a song playback scenario. The target information is different for different current playback scenarios. The target information is used to characterize the current playback scenario and the song played in the current playback scenario.
[0023] Based on the target information, a target recommended song list is obtained, and a recommendation response is sent to the display device. The recommendation response includes the target recommended song list, so that the display device controls the display device's screen to display the target recommended song list. The target recommended song list is different for different target information.
[0024] Fifthly, this disclosure provides a computer-readable storage medium, including: storing a computer program on the computer-readable storage medium, wherein when the computer program is executed by a processor, it implements the music recommendation method as shown in the third and fourth aspects.
[0025] In a sixth aspect, this disclosure provides a computer program product, characterized in that it includes: when the computer program product is run on a computer, causing the computer to implement the music recommendation method as shown in the third and fourth aspects.
[0026] Compared with the prior art, the technical solutions provided by some embodiments of this disclosure have the following advantages: The first controller of the display device receives an input operation to enable the music recognition function. In response to the operation, it obtains target information corresponding to the current playback scene of the display device. The current playback scene includes a movie playback scene or a song playback scene. The target information differs for different current playback scenes. The target information is used to characterize the current playback scene and the song played in the current playback scene. A recommendation request is sent to the server, whereby the recommendation request includes the target information, enabling the server to obtain a list of target recommended songs based on the target information. Different target information corresponds to different lists of target recommended songs. The controller receives a recommendation response from the server, which includes the list of target recommended songs. The controller then controls the display device's monitor to display the list of target recommended songs. In the above technical solution, by combining the current playback scene of the display device, obtaining the target information corresponding to the current playback scene, and displaying the list of target recommended songs related to the target information on the monitor, music recommendations become more intelligent and accurate, thereby improving the user experience. Attached Figure Description
[0027] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.
[0028] To more clearly illustrate the technical solutions in some embodiments or prior art of this disclosure, the accompanying drawings used in the description of the embodiments or prior art will be briefly introduced below. Obviously, those skilled in the art can obtain other drawings based on these drawings without creative effort.
[0029] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device, a control device, and a server according to one or more embodiments of this disclosure;
[0030] Figure 2 This is a hardware configuration block diagram of a control device according to one or more embodiments of the present disclosure;
[0031] Figure 3A This is a hardware configuration block diagram of a display device according to one or more embodiments of the present disclosure;
[0032] Figure 3B This is a schematic diagram of software configuration in a display device according to one or more embodiments of the present disclosure;
[0033] Figure 3C This is a schematic diagram showing the icon control interface of an application in a display device according to one or more embodiments of the present disclosure;
[0034] Figure 4 This is a system framework diagram for music recommendation according to one or more embodiments of the present disclosure;
[0035] Figure 5A A flowchart illustrating a music recommendation method applied to a display device, provided for some embodiments of this disclosure;
[0036] Figure 5B This is a schematic diagram illustrating the interaction process between a display device and a server, provided for some embodiments of this disclosure.
[0037] Figure 5C A schematic diagram of a first display interface for displaying a target recommended song list, provided for some embodiments of this disclosure;
[0038] Figure 5D This is a schematic diagram of a second display interface for displaying a target recommended song list, provided by some embodiments of this disclosure;
[0039] Figure 6 This is a schematic diagram illustrating the interaction process between a display device and a server in a video playback scenario, provided by some embodiments of this disclosure.
[0040] Figure 7 This is a schematic diagram illustrating the interaction process between a display device and a server in another video playback scenario provided by some embodiments of this disclosure;
[0041] Figure 8 This is a schematic diagram illustrating the interaction process between a display device and a server in a song playback scenario, provided by some embodiments of this disclosure.
[0042] Figure 9 This is a flowchart illustrating a music recommendation method applied to a server, provided for some embodiments of this disclosure. Detailed Implementation
[0043] To better understand the above-mentioned objectives, features, and advantages of this disclosure, the solutions disclosed herein will be further described below. It should be noted that, unless otherwise specified, the embodiments and features described herein can be combined with each other.
[0044] Numerous specific details are set forth in the following description in order to provide a full understanding of this disclosure, but this disclosure may also be implemented in other ways different from those described herein; obviously, the embodiments in the specification are only some, and not all, of the embodiments of this disclosure.
[0045] It should be noted that the brief descriptions of terms in this disclosure are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.
[0046] Music recognition is a function that collects the audio corresponding to a music playback segment and identifies the corresponding song information. This function can then recommend songs to users, satisfying their auditory enjoyment.
[0047] However, most display devices currently only show information about the successfully identified songs or other songs related to the successfully identified songs after the user uses the music recognition function, ignoring the current playback context of the user's display device. This results in inaccurate song display and a poor user experience.
[0048] To address the aforementioned issues, in some embodiments of this disclosure, the first controller of the display device receives an input operation to enable the music recognition function. In response to this operation, it acquires target information corresponding to the current playback scenario of the display device. This current playback scenario includes either a movie / video playback scenario or a song playback scenario. The target information differs for different current playback scenarios and is used to characterize the current playback scenario and the song played within it. The controller then sends a recommendation request to the server, which includes the target information. This allows the server to obtain a list of recommended songs based on the target information. Different target information corresponds to different lists of recommended songs. The controller also receives a recommendation response from the server, which includes the list of recommended songs. Finally, the controller controls the display device's monitor to display the list of recommended songs. In this technical solution, by combining the current playback scenario of the display device with the acquisition of target information corresponding to the current playback scenario and displaying a list of recommended songs related to the target information on the monitor, music recommendations become more intelligent and accurate, thereby improving the user experience.
[0049] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device, a control device, and a server according to one or more embodiments of this disclosure. Figure 1 As shown, users can operate the display device 200 through the smart device 300 or the control device 100. Users can realize the music recommendation process through the interaction between the display device 200 and the server 400. Users can select songs of interest to play based on the target recommended song list displayed on the monitor.
[0050] In some embodiments, the control device 100 may be a remote control, and communication between the remote control and the display device may include infrared protocol communication, Bluetooth protocol communication, wireless or other wired methods to control the display device 200. Users can control the display device 200 by inputting user commands through buttons on the remote control, voice input, and control panel input. In some embodiments, mobile terminals, tablet computers, computers, laptops, and other smart devices may also be used to control the display device 200.
[0051] In some embodiments, the display device 200 may receive instructions not through the aforementioned smart device or control device, but through touch or gestures.
[0052] In some embodiments, the display device 200 can also be controlled in ways other than the control device 100 and the smart device 300. For example, it can be controlled by directly receiving the user's voice commands through a module configured inside the display device 200 for acquiring voice commands, or it can be controlled by receiving the user's voice commands through a voice control device set outside the display device 200.
[0053] In some embodiments, the smart device 300 can connect and communicate with the software application installed on the display device 200 via a network communication protocol to achieve one-to-one control operation and data communication. Audio and video content displayed on the smart device 300 can also be transmitted to the display device 200 to achieve synchronous display. The display device 200 also communicates with the server 400 via various communication methods, allowing the display device 200 to communicate via a local area network (LAN), wireless local area network (WLAN), and other networks. The server 400 can be a cluster or multiple clusters, and may include one or more types of servers. The server 400 can provide various content and interactive features to the display device 200. The display device 200 can be a liquid crystal display, an OLED display, or a projection display device, etc. In addition to providing broadcast television reception functions, the display device 200 can also be equipped with a smart network television function that provides computer support.
[0054] Figure 2 This is a hardware configuration block diagram of a control device according to one or more embodiments of the present disclosure. Figure 2 As shown, the control device 100 includes a third controller 110, a communication interface 130, a user input / output interface 140, a memory, and a power supply. The control device 100 can receive user input commands and convert them into commands that the display device 200 can recognize and respond to, acting as an intermediary for interaction between the user and the display device 200. The communication interface 130 is used for external communication and includes at least one of a Wi-Fi chip, a Bluetooth module, NFC, or a replacement module. The user input / output interface 140 includes at least one of a microphone, a touchpad, a sensor, buttons, or a replacement module.
[0055] Figure 3A This is a hardware configuration block diagram of a display device according to one or more embodiments of the present disclosure. Figure 3AAs shown, the display device 200 includes at least one of a tuner / demodulator 210, a communicator 220, a detector 230, an external device interface 240, a first controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface (i.e., a user input interface) 280. The first controller 250 includes a central processing unit, a video processor, an audio processor, a graphics processor, RAM, ROM, and a first to nth interface for input / output. The display 260 may be at least one of a liquid crystal display, an OLED display, a touch display, and a projection display, and may also be a projection device and a projection screen. The tuner / demodulator 210 receives broadcast television signals via wired or wireless means, and demodulates audio and video signals, such as EPG data signals, from multiple wireless or wired broadcast television signals. The communicator 220 is a component used to communicate with external devices or servers according to various communication protocol types. For example, the communicator may include at least one of a Wi-Fi module, a Bluetooth module, a wired Ethernet module, other network communication protocol chips or near-field communication protocol chips, and an infrared receiver. The display device 200 can establish the transmission and reception of control signals and data signals with the external control device 100 or server 400 via the communicator 220. The detector 230 is used to collect signals from the external environment or to interact with the outside world. The first controller 250 and the tuner / demodulator 210 can be located in different separate devices; that is, the tuner / demodulator 210 can also be located in an external device of the main device where the first controller 250 is located, such as an external set-top box. The user interface 280 can be used to receive control signals from the control device 100 (e.g., an infrared remote control).
[0056] In some embodiments, the first controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The first controller 250 controls the overall operation of the display device 200. The user can input user commands through a graphical user interface (GUI) displayed on the monitor 260, and the user input interface receives the user input commands through the GUI. Alternatively, the user can input user commands by inputting specific sounds or gestures, and the user input interface receives the user input commands by recognizing the sounds or gestures through sensors.
[0057] In some embodiments, a "user interface" is the medium through which an application or operating system interacts and exchanges information with a user, converting information between its internal form and a form acceptable to the user. A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be interface elements such as icons, windows, and controls displayed on the screen of an electronic device. Controls can include at least one of the visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.
[0058] Figure 3B This is a schematic diagram of software configuration in a display device according to one or more embodiments of the present disclosure. Figure 3B As shown, the system is divided into four layers, from top to bottom: the Applications layer (referred to as the "Application Layer"), the Application Framework layer (referred to as the "Framework Layer"), the Android runtime and system library layer (referred to as the "System Runtime Library Layer"), and the kernel layer.
[0059] In some embodiments, at least one application runs in the application layer. These applications may be Windows programs, system settings programs, or clock programs that come with the operating system; they may also be applications developed by third-party developers. In specific implementations, the applications in the application layer include, but are not limited to, the examples above.
[0060] In some embodiments, the system runtime library layer provides support for the upper layer, namely the framework layer. When the framework layer is used, the Android operating system runs the C / C++ libraries contained in the system runtime library layer to implement the functions that the framework layer needs to perform.
[0061] In some embodiments, the kernel layer is a layer between hardware and software, and includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.
[0062] Figure 3C This is a schematic diagram showing the icon control interface of an application in a display device according to one or more embodiments of the present disclosure. Figure 3CAs shown, the application layer contains at least one application whose corresponding icon control can be displayed on the screen, such as: live TV application icon control, video-on-demand application icon control, media center application icon control, application center icon control, game application icon control, etc. Live TV applications can provide live television from different signal sources. Video-on-demand applications can provide video from different storage sources. Unlike live TV applications, video-on-demand provides video display from certain storage sources. Media center applications can provide applications for playing various multimedia content. The application center can provide storage for various applications.
[0063] In some embodiments, the display device described above is a terminal device with display function, such as a television, mobile phone, personal computer, or flat-screen TV.
[0064] In some embodiments of this application, a display device is provided, the display device comprising:
[0065] The output interface (display 260, and / or audio output interface 270) is configured to output user interaction information;
[0066] Communicator 220 is used to communicate with server 400;
[0067] Monitor 260.
[0068] In some embodiments, the first controller 250 can receive user input to enable the music recognition function, and in response to the operation, obtain target information corresponding to the current playback scene of the display device. The current playback scene includes a movie playback scene or a song playback scene. The target information is different under different current playback scenes. The target information is used to characterize the current playback scene and the song played under the current playback scene. Then, it sends a recommendation request including the target information to the server so that the server can obtain a target recommended song list based on the target information in the recommendation request. The target recommended song list is different for different target information. Finally, it receives the recommendation response sent by the server. The recommendation response includes the target recommended song list and controls the display 260 to display the target recommended song list.
[0069] In some embodiments of this application, a server is provided, the server comprising:
[0070] The second controller is configured to: receive a recommendation request sent by the display device, the recommendation request including target information, wherein the target information is obtained by the display device in response to the user's input to enable the music recognition function, based on the current playback scenario of the display device. The current playback scenario includes a movie playback scenario or a song playback scenario. The target information is different for different current playback scenarios. The target information is used to represent the current playback scenario and the song played in the current playback scenario. Then, based on the target information, the controller obtains a target recommended song list and sends a recommendation response to the display device. The recommendation response includes the target recommended song list, so that the display device controls the display device's screen to display the target recommended song list after receiving the target recommended song list. The target recommended song list is different for different target information.
[0071] In some embodiments of this disclosure, the first controller of the display device receives an input operation to enable the music recognition function. In response to the operation, it obtains target information corresponding to the current playback scene of the display device. The current playback scene includes a movie playback scene or a song playback scene. The target information is different for different current playback scenes. The target information is used to characterize the current playback scene and the song played in the current playback scene. The controller sends a recommendation request to the server. The recommendation request includes the target information so that the server can obtain a list of target recommended songs based on the target information. The list of target recommended songs is different for different target information. The controller receives a recommendation response from the server. The recommendation response includes the list of target recommended songs. The controller then controls the display device's monitor to display the list of target recommended songs. In the above technical solution, by combining the current playback scene of the display device, obtaining the target information corresponding to the current playback scene, and displaying the list of target recommended songs related to the target information on the monitor, music recommendation can be made more intelligent and accurate, thereby improving the user experience.
[0072] Figure 4 This is a system framework diagram for music recommendation according to one or more embodiments of this disclosure. Figure 4 As shown, the system is deployed in a display device and may include an operation receiving module 401, an acquisition module 402, a sending module 403, and a display module 404.
[0073] The system includes an operation receiving module 401, which receives an input operation to enable the music recognition function. In some embodiments, the operation receiving module 401 may correspond to the user interface 280. An acquisition module 402, in response to the operation to enable the music recognition function, acquires target information corresponding to the current playback scene on the display device. The current playback scene may include a movie playback scene or a song playback scene; the target information differs for different current playback scenes and is used to characterize the current playback scene and the song played in that scene. A sending module 403, which sends a recommendation request to the server, including the target information, so that the server can obtain a list of target recommended songs based on the target information. Different target information corresponds to different lists of target recommended songs. A display module 404, which receives a recommendation response from the server, including the list of target recommended songs, and controls the display to show the list of target recommended songs. In some embodiments, the acquisition module 402, the sending module 403, and the display module 404 may be functional units in an application executed by the first controller. By combining the above process with the current playback scenario of the display device, obtaining target information corresponding to the current playback scenario, and displaying a list of recommended songs related to the target information on the display screen, music recommendations can be made more intelligent and accurate, thereby improving the user experience.
[0074] To illustrate the music recommendation method provided in this disclosure in more detail, the following will use an exemplary approach. Figure 5A To explain, it is understandable that Figure 5A The steps involved may include more or fewer steps in actual implementation, and the order of these steps may also be different, as long as they can achieve the music recommendation method provided in some embodiments of this disclosure. Some embodiments of this disclosure are not limited.
[0075] Figure 5A This is a flowchart illustrating a music recommendation method applied to a display device, provided by some embodiments of this disclosure. This embodiment is applicable to describing the music recommendation process on the display device side, and this process can be executed on the display device. Figure 5A As shown, the method specifically includes the following steps:
[0076] S510 receives input indicating that the music recognition function is enabled.
[0077] In some embodiments, the operation of activating the music recognition function can be triggered by the user pressing a button on the remote control, or by the user issuing a voice control command, or by other methods. This embodiment does not limit the specific methods used.
[0078] After the user triggers the operation to enable the music recognition function of the display device, the first controller of the display device can receive the user's input to enable the music recognition function.
[0079] S520, in response to the operation of enabling the music recognition function, obtains the target information corresponding to the current playback scene of the display device.
[0080] In some embodiments, the current playback scenario includes a video playback scenario or a song playback scenario, and the target information is different in different current playback scenarios.
[0081] In some embodiments, target information is used to characterize the current playback scenario and the song played in the current playback scenario. In some embodiments, target information may include acquired audio segments or song identifiers. The audio segments are pre-defined by the server and display device to simultaneously characterize the currently acquired sound data for song identification and to characterize the current first scenario (movie playback scenario). The song identifiers are pre-defined by the server and display device to simultaneously characterize the song corresponding to the currently acquired sound data and to characterize the current second scenario (song playback scenario). In some embodiments, the target information may include both audio segments and movie / video identifiers. The audio segments are pre-defined by the server and display device to simultaneously characterize the currently acquired sound data for song identification and to characterize the current first scenario (movie / video playback scenario). The movie / video identifiers are used to filter recommendations related to the movie / video identifiers. The target information may include audio clips and media asset identifiers. The audio clips are agreed upon by the server and the display device to simultaneously characterize the currently acquired sound data for song identification. The media asset identifiers are used to determine the current scene (exemplarily, a film / video identifier is used to characterize the current scene and / or is also used to filter recommendations related to the film / video identifier, and a song identifier is used to characterize the current scene and / or is also used to filter recommendations related to the song identifier). In some embodiments, the film / video identifier is not used to characterize the current scene but is used to filter recommendations related to the film / video identifier, and the song identifier is not used to characterize the current scene but is used to filter recommendations related to the song identifier.
[0082] The video playback scenario can be understood as a scenario where a display device plays video programs. Video programs can include TV series, movies, variety shows, cartoons, etc., but this embodiment does not limit this. The song playback scenario can be understood as a scenario where a display device plays songs.
[0083] After receiving the user's input to enable the music recognition function, the first controller of the display device responds to the operation by obtaining the program information, playback history, or other information corresponding to the display device. It can determine the current playback scene of the display device and the target information corresponding to the current playback scene. Through the target information, it can determine whether the current playback scene is a movie playback scene or a song playback scene, and it can determine the song being played in the current playback scene.
[0084] S530, a recommendation request is sent to the server, wherein the recommendation request includes target information, so that the server can obtain a target recommended song list based on the target information, and different target recommended song lists correspond to different target information.
[0085] The target recommended song list contains information related to at least one recommended song. This information may include details related to the recommended song, such as the song's name, artist, poster information, release date, and composer information. This embodiment does not impose specific limitations on this.
[0086] The first controller of the display device sends a recommendation request to the server. This recommendation request includes target information and instructs the server to obtain a target list of recommended songs based on the target information. After receiving the recommendation request from the display device, the server obtains the song information corresponding to the target information, and then determines the target list of recommended songs by calculating and querying the song relevance based on the song information corresponding to the target information.
[0087] Understandably, the list of recommended songs determined by the server will differ depending on the target information.
[0088] S540 receives the recommendation response sent by the server, which includes a target recommended song list, and controls the display device to display the target recommended song list.
[0089] After obtaining the target recommended song list, the server sends a recommendation response to the display device. Correspondingly, the first controller of the display device receives the recommendation response from the server, which includes the target recommended song list. Simultaneously, the controller controls the display device's monitor to show the target recommended song list, allowing the user to select and play songs of interest from the displayed list.
[0090] The music recommendation method for display devices provided in some embodiments of this disclosure, by combining the current playback scene of the display device, obtaining target information corresponding to the current playback scene, and displaying a list of target recommended songs related to the target information on the display screen, can make music recommendation more intelligent and accurate, thereby improving the user experience.
[0091] For example, Figure 5B This is a schematic diagram illustrating the interaction process between a display device and a server, provided for some embodiments of this disclosure. For example... Figure 5B As shown, the interaction process between the display device and the server specifically includes the following steps:
[0092] S500 1, the first controller receives the input to enable the music recognition function. See the explanation in S5 1 0 above, which will not be repeated here.
[0093] S5002, the first controller responds to the operation of enabling the music recognition function and obtains the target information corresponding to the current playback scene of the display device.
[0094] See the explanation in S520 above; it will not be repeated here.
[0095] S5003, the first controller sends a recommendation request to the server, which includes target information.
[0096] See the explanation in S530 above; it will not be repeated here.
[0097] S5004, the second controller receives a recommendation request sent by the display device, which includes target information.
[0098] After the first controller of the display device sends a recommendation request to the server, the second controller of the server can then receive the recommendation request sent by the display device.
[0099] S5005, the second controller obtains the target recommended song list based on the target information.
[0100] After receiving the recommendation request sent by the display device, the second controller obtains the song information corresponding to the target information based on the target information in the recommendation request. Then, based on the song information corresponding to the target information, it can determine the target recommended song list through song relevance calculation and query.
[0101] S5006, the second controller sends a recommendation response to the display device, which includes a list of target recommended songs.
[0102] After obtaining the target list of recommended songs, the second controller sends a recommendation response to the display device.
[0103] S5007, the first controller receives the recommendation response sent by the server, which includes a target recommended song list, and controls the display to show the target recommended song list.
[0104] See the explanation in S540 above; it will not be repeated here.
[0105] In some embodiments, optionally, the method further includes:
[0106] When the target song corresponding to the target information is stored in the target recommended song list, the target song has a separate tag, which is used to indicate that the target song is the song being played in the current playback scenario.
[0107] In some embodiments, the target song is stored in a target recommended song list, and then the target recommended song list is sent to a display device for subsequent display.
[0108] In some embodiments, optionally, the method further includes:
[0109] When the target song corresponding to the target information is not stored in the target recommended song list, the target song corresponding to the target information is used as the recognition result, and the recognition result and the target recommended song list are sent to the display device.
[0110] The identification result may include the target song or no target song matched.
[0111] In some embodiments, the target song is used as the identification result, and the identification result and the list of target recommended songs are sent together to the display device for subsequent display.
[0112] It should be noted that by using the two methods described above—storing the target song in the target recommended song list and not storing the target song in the target recommended song list—the server's method of obtaining the target recommended song list becomes more flexible.
[0113] In some embodiments, optionally, the display shows the target recommended song list including a first area and a second area;
[0114] When the target song corresponding to the target information is stored in the target recommended song list, controlling the display to show the target recommended song list includes:
[0115] When there is a target song in the target recommended song list that corresponds to the target information, the first area is controlled to display the information corresponding to the target song, and the second area is controlled to display the information corresponding to the other recommended songs in the target recommended song list besides the target song;
[0116] or,
[0117] When there is no target song corresponding to the target information in the target recommended song list, the first area is controlled to display a prompt message indicating that no target song was matched, and the second area is controlled to display information corresponding to the recommended songs in the target recommended song list.
[0118] In some embodiments, when the target song corresponding to the target information is stored in the target recommended song list, the target recommended song list is displayed through the different display methods described above when the target recommended song list contains a target song corresponding to the target information, or when the target recommended song list does not contain a target song corresponding to the target information. This makes the display page clearer and easier for users to view.
[0119] For example, Figure 5C This is a schematic diagram of a first display interface for displaying a target recommended song list, provided for some embodiments of this disclosure. Figure 5C As shown, the first area displays the target song corresponding to the target information in the target recommended song list, and the second area displays the information corresponding to the other recommended songs in the target recommended song list besides the target song.
[0120] For example, Figure 5D This is a schematic diagram of a second display interface for displaying a target recommended song list, provided for some embodiments of this disclosure. For example... Figure 5D As shown, the first area displays the message indicating that no target song was found, and the second area displays the information corresponding to the recommended songs in the target recommended song list.
[0121] It should be noted that: Figure 5C and Figure 5D The number of songs displayed in the second area is for illustrative purposes only and is not intended to limit the number of songs.
[0122] In some embodiments, optionally, obtaining target information corresponding to the current playback scene of the display device includes:
[0123] When the current playback scenario is a movie playback scenario, based on the movie playback scenario, obtain the audio segment information and video identification information corresponding to the movie playback scenario, wherein the video identification information is the identification information corresponding to the target video played in the movie playback scenario;
[0124] The step of sending a recommendation request to the server, the recommendation request including the target information, so that the server can obtain a target recommended song list based on the target information, including:
[0125] The server sends the recommendation request, which includes the audio segment information and video identifier information, so that the server can obtain the target recommended song list based on the audio segment information and video identifier information.
[0126] The video identification information can be media asset identification information, such as the number information corresponding to the media asset content played in a film or television playback scenario, or other information, etc., which is not limited in this embodiment. The media asset identification information can be understood as the identification information of the media asset content (i.e., the target video) played in a film or television playback scenario. The preset duration can be predetermined or determined according to specific circumstances, which is not limited in this embodiment.
[0127] In some embodiments, when the current playback scenario is a video playback scenario, the first controller of the display device can obtain audio segment information corresponding to the video playback scenario. For example, it can extract a preset duration from the sound data played in the video playback scenario as audio segment information, or it can record the sound data played in the video playback scenario to obtain audio segment information, or it can obtain audio segment information through other means, which are not limited in this embodiment. After obtaining the audio segment information, the first controller sends a recommendation request to the server. The recommendation request includes: audio segment information and video identification information. The recommendation request is used to instruct the server to obtain a target recommended song list based on the audio segment information and video identification information. After receiving audio segment information and video identifier information, the server determines a first list of recommended songs based on the video identifier information using a corresponding recommendation algorithm. It then determines a second list of recommended songs based on the audio segment information using a corresponding recognition algorithm. Finally, it deduplicates the first and second lists by retaining only one song for each song with identical information, and then retrieving the duplicates. The deduplicated recommended songs are then sorted and their information is combined to obtain the target recommended song list. The sorting can be based on song popularity, release date, or other information, but is not specifically limited here.
[0128] In some embodiments, sending a recommendation request, including audio segment information and video identifier information, to the server during a video playback scenario helps to make the target recommended song list obtained by the server more accurate and better suited to the user's needs.
[0129] In some embodiments, the display device is product A, and the currently playing video is a song from the movie / TV show A: XX Legend (movie title). Display device A obtains the audio segment information 1 and video identifier information 1 (i.e., the media asset identifier information of XX Legend) corresponding to the movie / TV show playback scene, and sends a recommendation request containing the audio segment information 1 and video identifier information 1 to the server. Correspondingly, after receiving the recommendation request from display device A, the server can determine that the display device is currently playing XX Legend based on the video identifier information 1 in the recommendation request. Based on the movie / TV show songs associated with XX Legend, it can obtain a first recommended song list. Based on the audio segment information 1, it can determine the target audio identifier information corresponding to that audio segment information 1 (i.e., the identifier information of the song corresponding to audio segment information 1), then determine the name of the target audio, and perform relevance calculation based on the name of the target audio to obtain a second recommended song list. The first and second recommended song lists are deduplicated, the deduplicated recommended songs are sorted, and the relevant information of each recommended song is concatenated to obtain the target recommended song list 1, so that the song recommendation list prioritizes displaying songs related to the movie / TV show.
[0130] In some embodiments, after the server determines the list of songs to be recommended based on the audio segment information 1, it can filter and sort songs related to the film and television identifiers from the list of songs to be recommended, so that the generated target recommended song list will prioritize the display of songs related to the film and television identifiers.
[0131] In some embodiments, the display device is product B (product B is different from product A; it may be different in terms of manufacturer, brand, or version, etc., which is not limited in this embodiment). The currently playing video program A: The Legend of XX is the same song (the same video program and song currently played by display device A in the first case). Display device B obtains the audio segment information 2 and video identifier information 2 (i.e., the media asset identifier information of The Legend of XX) corresponding to the video playback scene, and sends a recommendation request containing the audio segment information 2 and video identifier information 2 to the server. Correspondingly, after receiving the recommendation request sent by display device B, the server can obtain the target recommended song list 2 based on the video identifier information 2 and audio segment information 2 in the recommendation request. The method of determining the target recommended song list 2 is the same as the method of determining the target recommended song list 1. However, since product B is different from product A, the target recommended song list 1 and the target recommended song list 2 are also different.
[0132] In some embodiments, when the same film and television program and songs are played in the same video playback scenario, the determined target recommended song list will be different when the display device is different.
[0133] In some embodiments, the display device is product A, and the currently playing video is a song from the movie program B: XX Sea (movie title). Display device A obtains the corresponding audio segment information 3 and video identifier information 3 (i.e., the media asset identifier information of XX Sea) for the video playback scene, and sends a recommendation request containing the audio segment information 3 and video identifier information 3 to the server. Correspondingly, after receiving the recommendation request sent by display device A, the server can obtain the target recommended song list 3 based on the video identifier information 3 and audio segment information 3 in the recommendation request. The method for determining the target recommended song list 3 is the same as the method for determining the target recommended song lists 1 and 2.
[0134] In some embodiments, the display device is product A, and the currently playing video is a song from movie / TV show C: XX era (movie title) (this song is the same as the song in the third case, but the corresponding movie / TV show is different). Display device A obtains the audio segment information 4 and video identifier information 4 (i.e., the media asset identifier information of XX era) corresponding to the movie / TV show playback scene, and sends a recommendation request containing the audio segment information 4 and video identifier information 4 to the server. Correspondingly, after receiving the recommendation request sent by display device A, the server can obtain the target recommended song list 4 based on the video identifier information 4 and audio segment information 4 in the recommendation request. The method for determining the target recommended song list 4 is the same as the method for determining the target recommended song lists 1, 2, and 3. However, since movie / TV show B and movie / TV show C are different, the target recommended song list 3 is also different from the target recommended song list 4.
[0135] In some embodiments, when different film and television programs are played in a film and television playback scenario, but the audio information of the songs played is the same, the determined target recommended song list is different.
[0136] In some embodiments, after receiving the audio clip and media asset identifier, the server determines whether the media asset identifier is a video / movie identifier or a song identifier. If it is a video / movie identifier, after identifying the songs to be recommended based on the audio clip, further filtering based on the video / movie identifier is required to generate a recommendation list and provide feedback. If it is a song identifier, after identifying the songs to be recommended based on the audio clip, further filtering based on the song identifier is not required to directly generate a recommendation list and provide feedback.
[0137] In some embodiments, the server determines a second list of recommended songs associated with the target audio identifier information based on the target audio identifier information, including:
[0138] The server determines the reference information corresponding to the target audio based on the target audio identifier information. The reference information includes at least one of the following: the song name, the artist name, the song theme, and historical playback data corresponding to the target audio identifier information. Based on the target information, the server can determine the second recommended song list by calculating and querying the song relevance.
[0139] In some embodiments, the method described above is used to determine the second recommendation list, which is simple, efficient and fast.
[0140] In some embodiments, optionally, when the current playback scenario is a video playback scenario, sending the recommendation request to the server includes:
[0141] Send an identification request to the server, the identification request including: the audio segment information;
[0142] The system receives an identification response from the server, the identification response including: target audio identifier information corresponding to the audio segment information;
[0143] A song recommendation request is sent to the server, the song recommendation request including: video identification information and target audio identification information, so that the server can obtain the target recommended song list based on the video identification information and target audio identification information.
[0144] The song recommendation request can be understood as a sub-request contained within the recommendation request.
[0145] In some embodiments, when the current playback scenario is a video playback scenario, the first controller of the display device sends a recognition request to the server. The recognition request includes audio segment information. After receiving the recognition request, the server identifies the audio segment information included in the recognition request using a recognition algorithm. After obtaining the recognition result, the server sends a recognition response to the display device. The recognition response includes the target audio identifier information (i.e., the recognition result) corresponding to the audio segment information. Accordingly, the first controller can receive the recognition response sent by the server and then send a song recommendation request to the server. The song recommendation request includes video identifier information and target audio identifier information. After receiving the song recommendation request, the server can obtain a list of target recommended songs based on the video identifier information and target audio identifier information included in the song recommendation request.
[0146] In some embodiments, the first controller of the display device sends an identification request to the server first, and then sends a song recommendation request to the server. This facilitates the first controller to obtain the target audio identifier information corresponding to the audio segment information included in the identification response in a timely manner, and also facilitates the server to obtain the target recommended song list subsequently.
[0147] In some embodiments, optionally, when the current playback scenario is a video playback scenario, sending the recommendation request to the server includes:
[0148] Send an identification request to the server, the identification request including: the audio segment information;
[0149] The system receives an identification response from the server, which includes: target audio identifier information corresponding to the audio segment information that was not identified.
[0150] A song recommendation request is sent to the server, the song recommendation request including video identification information, so that the server can obtain the target recommended song list based on the video identification information.
[0151] In some embodiments, when the current playback scenario is a video playback scenario, the first controller of the display device sends a recognition request to the server. The recognition request includes audio segment information. After receiving the recognition request, the server performs recognition based on the audio segment information included in the recognition request. If no recognition result is obtained, the server sends a recognition response to the display device. The recognition response includes target audio identifier information corresponding to the unrecognized audio segment information. Correspondingly, the first controller can receive the recognition response sent by the server and then send a song recommendation request to the server. The song recommendation request includes video identifier information. After receiving the song recommendation request, the server can obtain a list of target recommended songs based on the video identifier information included in the song recommendation request.
[0152] In some embodiments, the first controller of the display device sends an identification request to the server first, and then sends a song recommendation request to the server. This allows the first controller to obtain the target audio identifier information corresponding to the unidentified audio segment information in a timely manner, and facilitates the server to obtain the target recommended song list based on the video identifier information.
[0153] In some embodiments, optionally, obtaining the target information corresponding to the current playback scene of the display device includes:
[0154] When the current playback scenario is a song playback scenario, the audio identification information corresponding to the song playback scenario is obtained based on the song playback scenario;
[0155] The step of sending a recommendation request to the server, the recommendation request including the target information, so that the server can obtain a target recommended song list based on the target information, including:
[0156] The server is sent a recommendation request, which includes the audio identification information, so that the server can obtain the target recommended song list based on the audio identification information.
[0157] The song playback scenario can include either a music player playing music or a karaoke scenario corresponding to a karaoke player; this embodiment does not impose any limitations. In the music player playback scenario, the audio identifier information can be the identifier information of the currently playing song. In the karaoke scenario, the audio identifier information can be the accompaniment identifier information of the current song or the original audio identifier information of the current song, depending on the actual situation; this embodiment does not impose any limitations.
[0158] It is understandable that when the current playback scenario is a song playback scenario, the target information is: audio identification information.
[0159] In some embodiments, when the current playback scenario is a song playback scenario, the first controller of the display device can directly obtain the audio identification information of the corresponding song in that playback scenario by acquiring program information or playback records. After obtaining the audio identification information, the first controller sends a recommendation request to the server. The recommendation request includes the audio identification information and instructs the server to obtain a target recommended song list based on the audio identification information. After receiving the audio identification information, the server can determine the songs associated with the audio identification information. Specifically, it can sort the associated songs and concatenate the relevant information of each associated song to obtain the target recommended song list.
[0160] In some embodiments, since the audio identifier information corresponding to the song scenario does not need to be identified and can be directly obtained by the display device, in the song playback scenario, sending a recommendation request including audio identifier information to the server can improve the server's efficiency in obtaining the target recommended song and save time.
[0161] In some embodiments, the server determines the song associated with the audio identification information based on the audio identification information, including:
[0162] The server determines the corresponding reference information based on the audio identification information. The reference information includes at least one of the following: the song name, the artist name, the song theme, and historical playback data corresponding to the audio identification information. Based on the target information, the server can determine the song associated with the audio identification information by calculating and querying the song relevance.
[0163] For example, in a karaoke scenario, the first controller of the display device obtains the audio identification information corresponding to the karaoke scenario, such as the identification information of XX accompaniment, and then sends a recommendation request to the server. The recommendation request includes the identification information of XX accompaniment, so that the server can obtain the corresponding target recommended song list based on the identification information of XX accompaniment.
[0164] In the above embodiments, the current playback scene is determined by the display device, and the target information corresponding to the current playback scene is obtained. Specifically, when the current playback scene is a video playback scene, the target information is audio segment information and video identifier information; when the current playback scene is a song playback scene, the target information is audio identifier information. In both cases, after receiving a recommendation request, the server determines the target recommended song list based on the target information included in the recommendation request. If the target information includes audio segment information, the target recommended song list is determined based on the audio segment information and video identifier information; if the target information does not include audio segment information, the target recommended song list is determined based on the video identifier information. Therefore, the server does not need to determine whether the current playback scene is a video playback scene or a song playback scene, which facilitates the server to obtain the target recommended song list and send a recommendation response based on the target information. The server uses different methods to determine the target recommended song list based on different target information, making the determination of the target recommended song list more flexible and accurate, and avoiding errors.
[0165] In some embodiments, optionally, obtaining the target information corresponding to the current playback scene of the display device may further include:
[0166] When the current playback scenario is a movie playback scenario, based on the movie playback scenario, obtain the audio segment information, video identification information and first channel identification information corresponding to the movie playback scenario, wherein the first channel identification information is the channel identification information corresponding to the movie playback scenario;
[0167] The step of sending a recommendation request to the server, wherein the recommendation request includes the target information, so that the server obtains a target recommended song list based on the target information, may further include:
[0168] The server sends the recommendation request, which includes the audio segment information, video identifier information, and the first channel identifier information, so that the server can obtain the target recommended song list based on the audio segment information, the video identifier information, and the first channel identifier information.
[0169] In some embodiments, when the current playback scenario is a video playback scenario, the target information can be: audio segment information, video identifier information, and first channel identifier information. The display device, based on the target video played in the video playback scenario, can obtain the audio segment information, video identifier information, and first channel identifier information, and send a recommendation request containing the audio segment information, video identifier information, and first channel identifier information to the server. Correspondingly, after receiving the recommendation request containing the audio segment information, video identifier information, and first channel identifier information, the server can determine that the current playback scenario is a video playback scenario based on the first channel identifier information, and determine the target recommended song list based on the audio segment information, video identifier information, and first channel identifier information using a corresponding recommendation algorithm.
[0170] In some embodiments, in a video playback scenario, the target information is: in addition to audio segment information and video identifier information, first channel identifier information is added. Using audio segment information, video identifier information and first channel identifier information as target information helps the server distinguish the current playback scenario and determine the target recommended song list.
[0171] In some embodiments, optionally, obtaining the target information corresponding to the current playback scene of the display device may further include:
[0172] When the current playback scenario is a song playback scenario, based on the song playback scenario, obtain the audio identifier information and the second channel identifier information corresponding to the song playback scenario, wherein the second channel identifier information is the channel identifier information corresponding to the song playback scenario;
[0173] The step of sending a recommendation request to the server, wherein the recommendation request includes the target information, so that the server obtains a target recommended song list based on the target information, may further include:
[0174] The server sends the recommendation request, which includes the audio identifier information and the second channel identifier information, so that the server can obtain the target recommended song list based on the audio identifier information and the second channel identifier information.
[0175] In some embodiments, when the current playback scenario is a song playback scenario, the target information can be: audio identifier information and second channel identifier information. The display device, based on the song being played in the song playback scenario, can obtain the audio identifier information and second channel identifier information, and send a recommendation request containing the audio identifier information and second channel identifier information to the server. Correspondingly, after receiving the recommendation request containing the audio identifier information and second channel identifier information, the server can determine that the current playback scenario is a song playback scenario based on the second channel identifier information, and determine the target recommended song list based on the audio identifier information and second channel identifier information using a corresponding recommendation algorithm.
[0176] In some embodiments, in a song playback scenario, the target information is: based on the audio identifier information, a second channel identifier information is added. Using the audio identifier information and the second channel identifier information as target information helps the server distinguish the current playback scenario and determine the target recommended song list.
[0177] In some embodiments, optionally, obtaining the target information corresponding to the current playback scene of the display device may specifically include:
[0178] When the current playback scenario is a movie playback scenario, based on the movie playback scenario, obtain the first target audio segment information and the first channel identifier information corresponding to the movie playback scenario, wherein the first channel identifier information is the channel identifier information corresponding to the movie playback scenario;
[0179] Sending a recommendation request to the server, wherein the recommendation request includes the target information, so that the server obtains a target recommended song list based on the target information, may specifically include:
[0180] The server sends the recommendation request, which includes the first target audio segment information and the first channel identifier information, so that the server can obtain the target recommended song list based on the first target audio segment information and the first channel identifier information.
[0181] or,
[0182] The acquisition of target information corresponding to the current playback scene on the display device may specifically include:
[0183] When the current playback scenario is a song playback scenario, based on the song playback scenario, the second target audio segment information and the second channel identifier information corresponding to the song playback scenario are obtained, wherein the second channel identifier information is the channel identifier information corresponding to the song playback scenario;
[0184] Sending a recommendation request to the server, wherein the recommendation request includes the target information, so that the server obtains a target recommended song list based on the target information, may specifically include:
[0185] The server sends the recommendation request, which includes the second target audio segment information and the second channel identifier information, so that the server can obtain the target recommended song list based on the second target audio segment information and the second channel identifier information.
[0186] The method for obtaining the first target audio segment information is the same as the method for obtaining audio segment information, and is not limited here. The second target audio segment information can be extracted from the song data played in the song playback scenario, or obtained by recording the song data played in the song playback scenario, or it can be obtained through other methods, which are not limited in this embodiment.
[0187] In some embodiments, when the current playback scenario is a video playback scenario, the target information can be: first target audio segment information and first channel identifier information. The display device, based on the target video played in the video playback scenario, can obtain the first target audio segment information and the first channel identifier information (the display device only obtains the target information and is unsure of the current scenario), and send a recommendation request containing the first target audio segment information and the first channel identifier information to the server. Correspondingly, after receiving the recommendation request containing the first target audio segment information and the first channel identifier information, the server can determine that the current playback scenario is a video playback scenario based on the first channel identifier information, and determine the target recommended song list based on the first target audio segment information and the first channel identifier information using a corresponding recommendation algorithm. When the current playback scenario is a song playback scenario, the target information can be: second target audio segment information and second channel identifier information. Based on the song being played in the current playback scenario, the display device can obtain the second target audio segment information and the second channel identifier information (the display device only obtains the target information and is unaware of the current playback scenario). It then sends a recommendation request containing the second target audio segment information and the second channel identifier information to the server. Correspondingly, after receiving the recommendation request containing the second target audio segment information and the second channel identifier information, the server can determine that the current playback scenario is a song playback scenario based on the second channel identifier information. Based on the second target audio segment information and the second channel identifier information, the server determines the target recommended song list through the corresponding recommendation algorithm.
[0188] In some embodiments, in a video playback scenario, the target information may also be first target audio segment information and first channel identifier information; in a song playback scenario, the target information may also be second target audio segment information and second channel identifier information. In both cases, the controller of the display device does not need to determine the current playback scenario. After receiving the recommendation request, the server determines the current playback scenario based on the specific information included in the recommendation request. In some embodiments, if the recommendation request includes first target audio segment information and first channel identifier information, the server determines the current playback scenario as a video playback scenario based on the first channel identifier information and obtains the target recommended song list based on the first target audio segment information and the first channel identifier information. If the recommendation request includes second target audio segment information and second channel identifier information, the server determines the current playback scenario as a song playback scenario based on the second channel identifier information and obtains the target recommended song list based on the second target audio segment information and the second channel identifier information. By receiving recommendation requests containing target information, determining the current playback scenario based on the target information, and taking corresponding methods to determine the target recommended song list, the server makes the target recommended song list more accurate and better meets user needs, thereby improving the user experience.
[0189] In some embodiments, during the period between the user inputting the operation to enable the music recognition function and the display device controlling the display showing the target recommended song list, the same music recognition interface is displayed on the display device controlling the display. This music recognition interface may include the following prompt: Music recognition is in progress, please wait.
[0190] In some embodiments, the above process enables users to remain unaware of changes in the current playback scenario.
[0191] In some embodiments, optionally, the method further includes:
[0192] In response to the operation of playing a target recommended song in the target recommended song list, the display device is controlled to switch from the interface corresponding to the target recommended song list to the playback interface of the player corresponding to the target recommended song, wherein the target recommended song is any one of the recommended songs in the target recommended song list;
[0193] In response to a user-triggered return operation, the display device is controlled to switch from the playback interface to the interface corresponding to the target recommended song list.
[0194] In some embodiments, the first controller of the display device, in response to the operation of playing a target recommended song in the target recommended song list, can control the display device to switch from the interface corresponding to the target recommended song list to the playback interface of the player corresponding to the target recommended song, and in response to the user-triggered return operation, can control the display device to switch from the playback interface to the interface corresponding to the target recommended song list, which can facilitate user operation.
[0195] For example, when the current playback scenario is a movie / TV show playback scenario, when a user clicks on a target recommended song in the target recommended song list (which can be displayed in the corresponding playback interface of the movie / TV show playback scenario) to play it, the first controller of the display device, in response to the operation of playing the target recommended song, controls the display device to switch from the interface corresponding to the target recommended song list to the playback interface of the player corresponding to the target recommended song, and the playlist in the playback interface is the target recommended song list; if the user clicks the back button, the second controller, in response to the user-triggered back operation, controls the display device to switch from the playback interface to the interface corresponding to the target recommended song list. At this time, the display device can resume playback from the playback time point corresponding to the movie / TV show playback scenario before the switch, avoiding manual operation by the user.
[0196] For example, in a scenario where the current playback scenario is a music player playing music, the display device runs the music player and records the address of the last page that is not the music player. When the user clicks on a target recommended song in the target recommended song list (which can be displayed in the playback interface of the music player), the first controller of the display device, in response to the operation of playing the target recommended song, controls the display device to switch from the interface corresponding to the target recommended song list to the playback interface of the player corresponding to the target recommended song (at this time, the player is still the music player before the switch), and the playlist in the music player is updated to the target recommended song list; if the user clicks the back button, the first controller, in response to the user-triggered back operation, controls the display device to switch from the playback interface to the interface corresponding to the target recommended song list; if the user clicks the back button again, the first controller controls the display device to return to the interface corresponding to the last page address that is not the music player.
[0197] For example, when the current playback scenario is a karaoke scenario, the display device runs a karaoke player and records the address of the last page that is not the karaoke player. When the user clicks on a target recommended song in the target recommended song list (which can be displayed in the playback interface corresponding to the song player), if the target recommended song is a non-accompanied song, the first controller of the display device, in response to the operation of playing the target recommended song, controls the display device to switch from the interface corresponding to the target recommended song list to the playback interface of the player corresponding to the target recommended song (i.e., switch from the interface corresponding to the karaoke player to the interface corresponding to the song player). In this case, if the user clicks the back button, the first controller, in response to the user-triggered back operation, controls the display device to switch from the playback interface to the interface corresponding to the target recommended song list, i.e., switch to the karaoke player's interface. The corresponding interface; if the target recommended song is an instrumental song, the first controller of the display device, in response to the operation of playing the target recommended song, controls the display device to switch from the interface corresponding to the target recommended song list to the playback interface of the player corresponding to the target recommended song (i.e., the player corresponding to the target recommended song is still the karaoke player). In this case, if the user clicks the back button, the first controller, in response to the user-triggered back operation, controls the display device to switch from the playback interface to the interface corresponding to the target recommended song list, that is, to the interface previously corresponding to the karaoke player. If the user clicks the back button again, the first controller controls the display device to return to the interface corresponding to the last page address that is not the karaoke player.
[0198] In some embodiments, the switching interface and the return interface may be different depending on the current playback scenario. Through the above process, the user experience can be improved and manual operation by the user can be reduced.
[0199] For example, Figure 6 This is a schematic diagram illustrating the interaction process between a display device and a server in a video playback scenario, provided by some embodiments of this disclosure. This embodiment mainly describes the process by which the server identifies target audio identifier information and performs music recommendation through interaction between the display device and the server in a video playback scenario. Figure 6 As shown, the interaction process specifically includes the following steps:
[0200] S6001, the first controller receives the input to enable the music recognition function.
[0201] See the explanation in S510 above; it will not be repeated here.
[0202] S6002, when the current playback scenario is a movie playback scenario, the first controller responds to the operation of enabling the music recognition function and obtains the audio segment information and video identification information corresponding to the movie playback scenario.
[0203] S6003, the first controller sends a recognition request to the music recognition service, which includes audio segment information.
[0204] The music recognition service can be understood as a module in the server used to identify audio segment information.
[0205] After acquiring the audio segment information and video identifier information corresponding to the video playback scene, the first controller sends a recognition request containing the audio segment information to the music recognition service.
[0206] S6004, the music recognition service receives the recognition request sent by the display device and determines the corresponding target audio identifier information based on the audio segment information.
[0207] After receiving the recognition request from the display device, the music recognition service identifies the audio segment information included in the recognition request and can determine the corresponding target audio identifier information.
[0208] S6005, the music recognition service sends a recognition response to the display device, which includes: target audio identification information.
[0209] After the music recognition service determines the target audio identification information, it sends a recognition response to the display device, which includes the target audio identification information.
[0210] S6006, the first controller sends a song recommendation request to the recommendation service. The song recommendation request includes: video identification information and target audio identification information.
[0211] The recommendation service can be understood as a module in the server used for recommending songs.
[0212] After receiving the recognition response from the recommendation service, the first controller sends a song recommendation request to the recommendation service.
[0213] S6007 receives a song recommendation request sent by the display device and obtains a target recommended song list based on the video identifier information and the target audio identifier information.
[0214] After receiving a song recommendation request from the display device, the recommendation service can obtain a list of target recommended songs based on the video identifier information and the target audio identifier information.
[0215] S6008, the recommendation service sends a song recommendation response to the display device, which includes a target list of recommended songs.
[0216] After obtaining the target list of recommended songs, the recommendation service sends a song recommendation response to the display device.
[0217] S6009, the first controller receives the song recommendation response sent by the recommendation service, which includes a target recommended song list, and controls the display to show the target recommended song list.
[0218] For example, Figure 7 This is a schematic diagram illustrating the interaction process between a display device and a server in another video playback scenario provided by some embodiments of this disclosure. This embodiment mainly describes the process of music recommendation through interaction between the display device and the server when the server fails to recognize target audio identifier information in a video playback scenario. Figure 7 As shown, the interaction process specifically includes the following steps:
[0219] S700 1, The first controller receives the input to enable the music recognition function.
[0220] S7002, when the current playback scenario is a movie playback scenario, the first controller responds to the operation of enabling the music recognition function and obtains the audio segment information and video identification information corresponding to the movie playback scenario.
[0221] S7003, the first controller sends a recognition request to the music recognition service, which includes audio segment information.
[0222] S7004, the music recognition service receives the recognition request sent by the display device and determines the corresponding target audio identifier information based on the audio segment information.
[0223] For S7001-S7004, please refer to the explanations of S6001-S6004, which will not be repeated here.
[0224] S7005, the music recognition service sends a recognition response to the display device, which includes: target audio identifier information corresponding to the audio segment information that was not recognized.
[0225] If the music recognition service fails to identify the target audio identifier information corresponding to the audio segment information, it sends a recognition response to the display device. The recognition response includes the target audio identifier information corresponding to the unidentified audio segment information.
[0226] S7006, the first controller sends a song recommendation request to the recommendation service, which includes video identification information.
[0227] The first controller receives the recognition response sent by the music recognition service. Since the recognition response includes the target audio identifier information corresponding to the audio segment information that was not identified, the first controller sends a song recommendation request to the recommendation service. The song recommendation request includes video identifier information.
[0228] S7007, the recommendation service receives a song recommendation request sent by the display device and obtains a list of target recommended songs based on the video identification information.
[0229] After receiving a song recommendation request from the display device, the recommendation service obtains the target recommended song list based on the video identifier information in the song recommendation request.
[0230] S7008, the recommendation service sends a song recommendation response to the display device, which includes a target list of recommended songs.
[0231] S7009, the first controller receives the song recommendation response sent by the recommendation service, which includes a target recommended song list, and controls the display to show the target recommended song list.
[0232] For example, Figure 8 This diagram illustrates the interaction process between a display device and a server in a song playback scenario, as provided in some embodiments of this disclosure. This embodiment primarily describes the process of music recommendation achieved through the interaction between the display device and the server in a song playback scenario. Figure 8 As shown, the interaction process specifically includes the following steps:
[0233] S8001 receives input indicating that the music recognition function is enabled.
[0234] See the explanation in S510 above; it will not be repeated here.
[0235] S8002, when the current playback scenario is a song playback scenario, responds to the operation of enabling the music recognition function and obtains the audio identification information corresponding to the song playback scenario.
[0236] S8003, the first controller sends a recommendation request to the recommendation service, which includes audio identification information.
[0237] After obtaining the audio identifier information, the first controller sends a recommendation request to the recommendation service.
[0238] S8004, the recommendation service receives a recommendation request sent by the display device and obtains a list of target recommended songs based on the audio identification information.
[0239] After receiving a recommendation request from the display device, the recommendation service can obtain a list of target recommended songs based on the audio identifier information.
[0240] S8005, the recommendation service sends a recommendation response to the display device, which includes a target list of recommended songs.
[0241] After obtaining the target list of recommended songs, the recommendation service sends a recommendation response to the display device.
[0242] S8006, the first controller receives the recommendation response sent by the recommendation service, which includes a target recommended song list, and controls the display to show the target recommended song list.
[0243] For example, Figure 9 This is a flowchart illustrating a music recommendation method applied to a server, provided by some embodiments of this disclosure. This embodiment can be applied to the server side to describe the music recommendation process.
[0244] like Figure 9 As shown, the method specifically includes the following steps:
[0245] S9 1 0, Receive recommendation request sent by display device, the recommendation request includes: target information.
[0246] The target information is obtained by the display device in response to the operation of enabling the music recognition function after receiving input. The target information is based on the current playback scenario of the display device. The current playback scenario includes a movie playback scenario or a song playback scenario. The target information is different under different current playback scenarios. The target information is used to represent the current playback scenario and the song played in the current playback scenario.
[0247] When a user triggers the music recognition function on the display device, the first controller of the display device receives the operation and responds by obtaining the target information corresponding to the current playback scene. Simultaneously, the first controller sends a recommendation request containing the target information to the server. Correspondingly, the server's second controller receives the recommendation request sent by the display device.
[0248] S920: Based on the target information, obtain the target recommended song list and send a recommendation response to the display device. The recommendation response includes the target recommended song list, so that the display device controls the display device's monitor to display the target recommended song list.
[0249] The recommended song list differs depending on the specific target information.
[0250] After receiving the recommendation request from the display device, the server's second controller obtains the song information corresponding to the target information based on the target information in the recommendation request. Then, based on the song information corresponding to the target information, it determines the target recommended song list through song relevance calculation and query.
[0251] In some embodiments, the music recommendation method applied to the server determines a target recommended song list based on target information obtained by the display device in the current playback scenario. This makes music recommendation more intelligent and accurate, facilitates the display device in displaying the target recommended song list, and thus improves the user experience.
[0252] This disclosure provides a computer-readable storage medium storing a computer program. When executed by a processor, the computer program implements the various processes of the music recommendation method described above and achieves the same technical effect. To avoid repetition, further details are omitted here.
[0253] The computer-readable storage medium can be a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, etc.
[0254] This disclosure provides a computer program product, characterized in that it includes: when the computer program product is run on a computer, causing the computer to implement the above-described music recommendation method.
[0255] For ease of explanation, the above description has been provided in conjunction with embodiments. However, the discussion of some embodiments above is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the embodiments and various different variations of the embodiments suitable for specific application considerations.
Claims
1. A display device, characterized in that, include: monitor; The first controller is configured as follows: Receive input to enable the music recognition function; In response to the operation of enabling the music recognition function, target information corresponding to the current playback scene of the display device is obtained. The target information includes an audio segment and a media asset identifier. The media asset identifier is used to determine the current playback scene. The current playback scene includes a movie playback scene or a song playback scene. The movie playback scene is the scene where the display device plays a movie program, and the song playback scene is the scene where the display device plays a song. The target information is different under different current playback scenes. The target information is used to characterize the current playback scene and the song played under the current playback scene. A recommendation request is sent to the server, wherein the recommendation request includes the target information, so that the server obtains a target recommended song list based on the target information, and different target information corresponds to different target recommended song lists; The system receives a recommendation response from the server, the recommendation response including the target recommended song list, and controls the display to show the target recommended song list.
2. The display device according to claim 1, characterized in that, The first controller is specifically configured as follows: When the current playback scenario is a movie playback scenario, based on the movie playback scenario, obtain the audio segment information and video identification information corresponding to the movie playback scenario, wherein the video identification information is the identification information corresponding to the target video played in the movie playback scenario; The server sends a recommendation request, which includes the audio segment information and the video identifier information, so that the server can obtain the target recommended song list based on the audio segment information and the video identifier information; when the audio segment information is the same but the video identifier information is different, the obtained target recommended song list is different.
3. The display device according to claim 2, characterized in that, The first controller is specifically configured as follows: Send an identification request to the server, the identification request including: the audio segment information; The system receives an identification response from the server, the identification response including: target audio identifier information corresponding to the audio segment information; A song recommendation request is sent to the server, the song recommendation request including: video identification information and target audio identification information, so that the server can obtain the target recommended song list based on the video identification information and target audio identification information.
4. The display device according to claim 3, characterized in that, The first controller is also configured to: Send an identification request to the server, the identification request including: the audio segment information; The system receives an identification response from the server, which includes: target audio identifier information corresponding to the audio segment information that was not identified. A song recommendation request is sent to the server, the song recommendation request including video identification information, so that the server can obtain the target recommended song list based on the video identification information.
5. The display device according to claim 1, characterized in that, The first controller is also configured to: When the current playback scenario is a song playback scenario, the audio identification information corresponding to the song playback scenario is obtained based on the song playback scenario; The server is sent a recommendation request, which includes the audio identification information, so that the server can obtain the target recommended song list based on the audio identification information.
6. The display device according to claim 1, characterized in that, The first controller is also configured to: When the current playback scenario is a movie playback scenario, based on the movie playback scenario, obtain the first target audio segment information and the first channel identifier information corresponding to the movie playback scenario, wherein the first channel identifier information is the channel identifier information corresponding to the movie playback scenario; The server sends the recommendation request, which includes the first target audio segment information and the first channel identifier information, so that the server can obtain the target recommended song list based on the first target audio segment information and the first channel identifier information. or, When the current playback scenario is a song playback scenario, based on the song playback scenario, the second target audio segment information and the second channel identifier information corresponding to the song playback scenario are obtained, wherein the second channel identifier information is the channel identifier information corresponding to the song playback scenario; The server sends the recommendation request, which includes the second target audio segment information and the second channel identifier information, so that the server can obtain the target recommended song list based on the second target audio segment information and the second channel identifier information.
7. The display device according to claim 1, characterized in that, The display shows the target recommended song list, including a first area and a second area; The first controller is specifically configured as follows: When there is a target song in the target recommended song list that corresponds to the target information, the first area is controlled to display the information corresponding to the target song, and the second area is controlled to display the information corresponding to the other recommended songs in the target recommended song list besides the target song; or, When there is no target song corresponding to the target information in the target recommended song list, the first area is controlled to display a prompt message indicating that no target song was matched, and the second area is controlled to display information corresponding to the recommended songs in the target recommended song list.
8. A server, characterized in that, include: The second controller is configured as follows: The system receives a recommendation request sent by a display device. The recommendation request includes target information, which is obtained by the display device in response to the input operation of enabling music recognition function after receiving the input operation. The target information is based on the current playback scenario of the display device. The target information includes an audio segment and a media asset identifier. The media asset identifier is used to determine the current playback scenario. The current playback scenario includes a movie playback scenario or a song playback scenario. The movie playback scenario is the scenario in which the display device plays a movie program, and the song playback scenario is the scenario in which the display device plays a song. The target information is different under different current playback scenarios. The target information is used to characterize the current playback scenario and the song played under the current playback scenario. Based on the target information, a target recommended song list is obtained, and a recommendation response is sent to the display device. The recommendation response includes the target recommended song list, so that the display device controls the display device's screen to display the target recommended song list. The target recommended song list is different for different target information.
9. A music recommendation method, characterized in that, Applied to a display device, the method includes: Receive input to enable the music recognition function; In response to the operation of enabling the music recognition function, target information corresponding to the current playback scene of the display device is obtained. The target information includes an audio segment and a media asset identifier. The media asset identifier is used to determine the current playback scene. The current playback scene includes a movie playback scene or a song playback scene. The movie playback scene is the scene where the display device plays a movie program, and the song playback scene is the scene where the display device plays a song. The target information is different under different current playback scenes. The target information is used to characterize the current playback scene and the song played under the current playback scene. A recommendation request is sent to the server, wherein the recommendation request includes the target information, so that the server obtains a target recommended song list based on the target information, and different target information corresponds to different target recommended song lists; The system receives a recommendation response from the server, the recommendation response including the target recommended song list, and controls the display device to display the target recommended song list.
10. A music recommendation method, characterized in that, Applied to a server, the method includes: The system receives a recommendation request sent by a display device. The recommendation request includes target information, which is obtained by the display device in response to the input operation of enabling music recognition function after receiving the input operation. The target information is based on the current playback scenario of the display device. The target information includes an audio segment and a media asset identifier. The media asset identifier is used to determine the current playback scenario. The current playback scenario includes a movie playback scenario or a song playback scenario. The movie playback scenario is the scenario in which the display device plays a movie program, and the song playback scenario is the scenario in which the display device plays a song. The target information is different under different current playback scenarios. The target information is used to characterize the current playback scenario and the song played under the current playback scenario. Based on the target information, a target recommended song list is obtained, and a recommendation response is sent to the display device. The recommendation response includes the target recommended song list, so that the display device controls the display device's screen to display the target recommended song list. The target recommended song list is different for different target information.