Audio node-based user interaction method, user interaction device and electronic device
By obtaining and presenting audio nodes and receiving user operations, providing feedback, the high threshold and copyright issues of music interactive products are solved, user experience and interactivity are improved, and low-cost and low-advertising music interaction methods are realized.
Patent Information
- Application Number
- CN202010006016.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-01-03
- Publication Date
- 2024-11-12
- Estimated Expiration
- 2040-01-03
AI Technical Summary
The existing music interactive products have a high threshold for mass users and lack freshness. User consumption is boring and fatigued, and there are copyright licensing problems, resulting in poor user experience.
By obtaining the audio and its audio nodes that the user is currently listening to, and presenting and providing interactive operations on the screen, receiving user operations and providing feedback based on the degree of matching, avoiding copyright issues, reducing user interaction costs, and improving user experience.
Achieving a low-threshold and simple operational music interaction method, improving the interactivity of users to listen to audio, improving user experience, and providing new audio and high-quality audio through the score system, reducing advertising implantation and improving user satisfaction .
Smart Images

Figure CN113076036B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of interactive technology, and more specifically, to a user interaction method, a user interaction device and an electronic device based on an audio node. Background Art
[0002] Music consumption is a rigid demand at the user level, but currently users are becoming bored and tired of music consumption, from regular music playback to music short videos, and there is a lack of freshness.
[0003] Music-related interactive products (such as karaoke and singing apps) can increase users' interest in music consumption. However, most of the current music interactive products have too high a consumption threshold for users and are also niche.
[0004] Therefore, in response to the urgent needs of the general public, we hope to provide a music interaction solution with low threshold and simple operation. Summary of the invention
[0005] In order to solve the above technical problems, the present application is proposed. The embodiments of the present application provide a user interaction method, a user interaction device and an electronic device based on audio nodes, which present the audio nodes when the user listens to the audio, receive the user's operation in response to the presented audio nodes and provide feedback to the user, thereby improving the interactivity of the user when listening to the audio and improving the user experience.
[0006] According to one aspect of the present application, a user interaction method based on audio nodes is provided, including: obtaining the audio currently being listened to by a user and its audio node; presenting the audio node; receiving the user's operation in response to the presented audio node; and providing feedback to the user based on the matching of the operation with the presented audio node.
[0007] In the above-mentioned user interaction method based on audio nodes, the audio node includes one of a beat node, an instrument node, a melody node, a high-pitched and low-pitched switching node, and a male-female voice switching node of the audio.
[0008] In the above-mentioned user interaction method based on audio nodes, obtaining the audio currently being listened to by the user and its audio nodes includes: determining whether the user has selected an interaction mode; in response to the user selecting the interaction mode, obtaining the audio currently being listened to by the user, the audio containing pre-marked audio nodes; and, in response to the user not selecting the interaction mode, only obtaining the audio currently being listened to by the user.
[0009] In the above-mentioned user interaction method based on audio nodes, presenting the audio node includes: displaying the audio track of the audio on the screen; and displaying an icon corresponding to the audio node at a position corresponding to the audio node on the audio track.
[0010] In the above-mentioned user interaction method based on audio nodes, receiving the user's operation in response to the presented audio node includes: receiving the user's click operation on the displayed icon in response to the icon.
[0011] In the above-mentioned user interaction method based on audio nodes, providing feedback to the user based on the matching of the operation with the presented audio node includes: displaying the interaction effect of the operation graphic operated by the user and the icon to the user based on the user's click operation on the icon.
[0012] In the above-mentioned user interaction method based on audio nodes, at least one of the icon and the operation graphic is displayed with a predetermined identification image.
[0013] In the above-mentioned user interaction method based on audio nodes, providing feedback to the user based on the matching of the operation with the presented audio node includes: determining the matching degree of the operation with the presented audio node based on the degree of overlap between the operation graphic operated by the user and the icon; and giving the user a corresponding score based on the matching degree.
[0014] In the above-mentioned user interaction method based on audio nodes, after giving the user a corresponding score based on the matching degree, it further includes: matching the user with other users who perform interactive operations on the same audio and its audio nodes based on the score.
[0015] In the above-mentioned user interaction method based on audio nodes, after giving the user a corresponding score based on the matching degree, it further includes: providing the user with new audio and / or its audio nodes based on the score.
[0016] In the above-mentioned user interaction method based on audio nodes, after giving the user a corresponding score based on the matching degree, it further includes: providing high-quality audio to the user based on the score.
[0017] In the above-mentioned user interaction method based on audio nodes, after giving the user a corresponding score based on the degree of matching, it further includes: displaying the score to the user together with a predetermined identification image. According to another aspect of the present application, a user interaction device based on audio nodes is provided, including: an audio acquisition unit for acquiring the audio and its audio nodes currently listened to by the user; a node presentation unit for presenting the audio nodes acquired by the audio acquisition unit; an operation receiving unit for receiving the user's operation in response to the audio nodes presented by the node presentation unit; and a feedback providing unit for providing feedback to the user based on the match between the operation received by the operation receiving unit and the presented audio node.
[0018] In the above-mentioned user interaction device based on audio nodes, the audio node includes one of a beat node, an instrument node, a melody node, a high-pitched and low-pitched switching node, and a male-female voice switching node of the audio.
[0019] In the above-mentioned user interaction device based on audio nodes, the audio acquisition unit includes: a mode determination subunit, used to determine whether the user has selected an interaction mode; a node acquisition subunit, used to acquire the audio currently being listened to by the user in response to the mode determination subunit determining that the user has selected the interaction mode, wherein the audio includes pre-marked audio nodes; and, an audio acquisition subunit, used to acquire only the audio currently being listened to by the user in response to the mode determination subunit determining that the user has not selected the interaction mode.
[0020] In the above-mentioned user interaction device based on audio nodes, the node presentation unit includes: a track display subunit, used to display the track of the audio acquired by the audio acquisition unit on the screen; and an icon display subunit, used to display an icon corresponding to the audio node at a position corresponding to the audio node acquired by the audio acquisition unit on the track displayed by the track display subunit.
[0021] In the above-mentioned user interaction device based on audio nodes, the operation receiving unit is used to: receive a click operation of the user on the displayed icon in response to the icon.
[0022] In the above-mentioned user interaction device based on audio nodes, the feedback providing unit is used to: display to the user the interaction effect between the operation graphic operated by the user and the icon based on the user's click operation on the icon.
[0023] In the above-mentioned user interaction device based on audio nodes, at least one of the icon and the operation graphic is displayed with a predetermined identification image.
[0024] In the above-mentioned user interaction device based on audio nodes, the feedback providing unit includes: a matching determination subunit, which is used to determine the matching degree between the operation and the presented audio node based on the overlapping degree between the operation graphic operated by the user and the icon; and a score determination subunit, which is used to give the user a corresponding score based on the matching degree determined by the matching determination subunit.
[0025] In the above-mentioned user interaction device based on audio nodes, it further includes: a user matching unit, which is used to match the user with other users who perform interactive operations on the same audio and its audio nodes based on the score determined by the score determination subunit after the score determination subunit gives the user a corresponding score based on the matching degree.
[0026] In the above-mentioned user interaction device based on audio nodes, it further includes: an audio unlocking unit, which is used to provide the user with new audio and / or its audio nodes based on the score determined by the score determination subunit after the score determination subunit gives the user a corresponding score based on the degree of matching.
[0027] In the above-mentioned user interaction device based on audio nodes, it further includes: an audio unlocking unit, which is used to provide high-quality audio to the user based on the score.
[0028] In the above-mentioned user interaction device based on audio nodes, it further includes: a score presentation unit, which is used to display the score to the user together with the predetermined identification image.
[0029] According to another aspect of the present application, an electronic device is provided, comprising: a processor; and a memory, in which computer program instructions are stored, and when the computer program instructions are executed by the processor, the processor executes the user interaction method based on audio nodes as described above.
[0030] According to another aspect of the present application, a computer-readable medium is provided, on which computer program instructions are stored. When the computer program instructions are executed by a processor, the processor executes the user interaction method based on audio nodes as described above.
[0031] The audio node-based user interaction method, user interaction device and electronic device provided in the present application can present the audio nodes when the user listens to the audio, receive the user's operations in response to the presented audio nodes and provide feedback to the user, thereby improving the interactivity of the user when listening to the audio and improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0032] By describing the embodiments of the present application in more detail in conjunction with the accompanying drawings, the above and other purposes, features and advantages of the present application will become more apparent. The accompanying drawings are used to provide a further understanding of the embodiments of the present application and constitute a part of the specification. Together with the embodiments of the present application, they are used to explain the present application and do not constitute a limitation of the present application. In the accompanying drawings, the same reference numerals generally represent the same components or steps.
[0033] Figure 1 The figure illustrates a flow chart of a user interaction method based on audio nodes according to an embodiment of the present application.
[0034] Figure 2 A schematic diagram of application example 1 of the user interaction method based on audio nodes according to an embodiment of the present application is illustrated.
[0035] Figures 3A to 3CA schematic diagram of interaction example 1 of a user interaction method based on audio nodes according to an embodiment of the present application is illustrated.
[0036] FIG. 4A to FIG. 4C A schematic diagram of interaction example 2 of the user interaction method based on audio nodes according to an embodiment of the present application is illustrated.
[0037] Figure 5 A block diagram of a user interaction device based on an audio node according to an embodiment of the present application is illustrated.
[0038] Figure 6 A block diagram of an electronic device according to an embodiment of the present application is illustrated. DETAILED DESCRIPTION
[0039] Below, the exemplary embodiments according to the present application will be described in detail with reference to the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments of the present application, and it should be understood that the present application is not limited to the exemplary embodiments described here.
[0040] Application Overview
[0041] As mentioned above, the current interactive methods of music are mainly karaoke or singing, such as Pineapple Bolo, Kugou, Xigua Video karaoke, Yinyue, etc.
[0042] These karaoke or singing apps or mini-programs, whether they are automatic pitch correction or automatic accompaniment synthesis, will make users use their eyes, hands, and mouth. For example, the piano singing app Yinyue will make users operate in a hurry when creating a work, greatly increasing the cost of music consumption for users, which is obviously not in line with the common rigid demand of listening to music for the public.
[0043] In addition, all karaoke or singing music applications have an issue of copyright authorization that cannot be avoided. That is, whether using the original accompaniment, or taking music clips from the chorus (climax), or using lyrics and music covered or adapted by the target users, they all need to obtain separate authorization from the copyright holder. Having the copyright to the original music does not mean that they can use it at will.
[0044] Therefore, there are barriers to implementation for karaoke or singing applications. To resolve copyright issues, some applications purchase copyrights by inserting 30 to 60 seconds of video ads, which in turn creates a poor user experience.
[0045] In response to the above technical problems, the basic concept of the present application is to obtain and present the audio nodes of the audio currently being listened to by the user, and the user operates in response to the presented audio nodes and feedback is provided to the user based on the degree of match between the operation and the audio nodes, thereby providing a novel form of interaction for audio.
[0046] Specifically, the user interaction method based on audio nodes provided in the present application, the user interaction device and the electronic device first obtain the audio currently listened to by the user and its audio node, then present the audio node, and then receive the user's operation in response to the presented audio node, and finally provide feedback to the user based on the match between the operation and the presented audio node.
[0047] In this way, the user interaction method based on audio nodes provided by the present application, the user interaction device and the electronic device avoid the copyright issues that may be caused by using the original music part in the current music interactive applications by acquiring and presenting the audio nodes of the currently listened audio, and reduce the cost of providing user interaction. Therefore, there is no need to force users to watch unnecessary advertisements, thereby improving the user experience.
[0048] In addition, the user interaction method based on audio nodes provided by the present application, the user interaction device and the electronic device receive the user's operations in response to the presented audio nodes, and the user only needs to operate the presented audio nodes. The user's operation is simple, thereby improving the interactivity of the user when listening to audio and improving the user experience.
[0049] It is worth noting that in the audio node-based user interaction method, user interaction device and electronic device provided in the present application, the audio is not limited to music, but may also include other audio, such as speeches, situational conversations, etc.
[0050] In addition, in the audio node-based user interaction method, user interaction device and electronic device provided in the present application, the audio can also be audio in the video, for example, it can be audio in a concert, or a film or television video, thereby providing interactivity to the user without affecting the user's viewing of the video or the user not wanting to watch the video.
[0051] After introducing the basic principles of the present application, various non-limiting embodiments of the present application will be described in detail with reference to the accompanying drawings.
[0052] Exemplary Methods
[0053] Figure 1 The figure illustrates a flow chart of a user interaction method based on audio nodes according to an embodiment of the present application.
[0054] like Figure 1 As shown, the user interaction method based on audio nodes according to an embodiment of the present application includes the following steps.
[0055] Step S110, obtaining the audio currently listened by the user and its audio node. As described above, the audio currently listened by the user can be a song, pure music or other music, or other audio, such as speech audio, etc. Accordingly, the audio node corresponds to the audio type and can include multiple forms.
[0056] Specifically, the audio node can be a beat node of the audio, where the beat refers to the combination rule of strong beats and weak beats, specifically the total length of the notes in each measure in the score, commonly 1 / 4, 2 / 4, 3 / 4, 4 / 4, 3 / 8, 6 / 8 beats, etc., the length of each measure is fixed. The beat of a piece of music is fixed when it is composed and will not change, and a piece of music can be composed of a combination of several beats. In addition, the audio node can also include instrument nodes, melody nodes, treble and bass switching nodes, and male and female voice switching nodes of the audio.
[0057] It is worth noting that in the embodiment of the present application, if the audio currently listened to by the user includes multiple types of audio nodes, the multiple types of audio nodes can be obtained at the same time. In addition, in the process of presenting the audio nodes below, the obtained multiple types of audio nodes can also be presented at the same time, or a certain type of audio node can be selected for presentation, or the obtained multiple types of audio nodes can be presented in time division.
[0058] The audio nodes may be pre-labeled based on the audio, for example, various types of audio nodes may be pre-labeled for the audio in the audio library. For example, for the music in the music library, beat nodes may be pre-labeled based on the music beat, instrument nodes may be pre-labeled based on the time points when different instruments appear in the music, switching nodes may be pre-labeled based on the switching between high and low notes or between male and female voices in the music, etc.
[0059] In addition, in an embodiment of the present application, when listening to audio, the user can choose to interact or not to interact, that is, a selectable interaction mode can be provided to the user. When the user selects the interaction mode, the currently listened audio and its audio nodes are obtained, and if the user does not select the interaction mode, only the audio currently listened to by the user is obtained. Of course, if the user does not select the interaction mode, the audio currently listened to by the user and its audio nodes can also be obtained, but the audio nodes are not presented.
[0060] Therefore, in the user interaction method based on audio nodes according to the embodiment of the present application, obtaining the audio currently being listened to by the user and its audio nodes includes: determining whether the user has selected an interaction mode; in response to the user selecting the interaction mode, obtaining the audio currently being listened to by the user, the audio containing pre-marked audio nodes; and, in response to the user not selecting the interaction mode, only obtaining the audio currently being listened to by the user.
[0061] Step S120, presenting the audio node. As described above, for the acquired audio node, user interaction is performed by presenting the audio node. Here, because the user is currently listening to the audio, the use of a visual presentation method can not affect the user's normal listening to the audio. Of course, those skilled in the art can understand that other presentation methods such as hearing and touch can also be used.
[0062] When the audio node is presented in a visual manner, it can be presented along with the audio track of the audio. Here, the audio track refers to the parallel "tracks" seen in the sequencer software, each of which defines the musical attributes of the audio track, such as the timbre, volume, timeline, etc. of the audio track. When the audio track is displayed on the screen, an icon corresponding to the audio node can be displayed at the position corresponding to the audio node on the audio track.
[0063] For example, if instrument A is presented at one minute of the audio, an icon corresponding to instrument A can be presented at the 1-minute time node on the audio track to facilitate user operation.
[0064] Therefore, in the user interaction method based on audio nodes according to an embodiment of the present application, presenting the audio node includes: displaying the audio track of the audio on the screen; and displaying an icon corresponding to the audio node at a position on the audio track corresponding to the audio node.
[0065] It is worth noting that, for the audio track of the audio, if the entire audio track is displayed on the screen, each time node may be too close to each other, which is not conducive to user operation. Therefore, during the audio playback process, a scrolling audio track can be displayed on the screen, such as an audio track that scrolls from top to bottom or from left to right. In this way, the icon corresponding to the audio node displayed at the corresponding position on the audio track will also scroll on the screen with the audio track, thereby providing interactivity for user operation.
[0066] Step S130, receiving the user's operation in response to the presented audio node. In the embodiment of the present application, in order to improve the user's interaction convenience, the user only needs to perform a relatively simple operation in response to the presented audio node. For example, for the icon corresponding to the audio node displayed as described above, the user can click the icon by clicking, or slide over the icon by sliding, etc.
[0067] That is, in the embodiment of the present application, the user only needs to respond to the presented audio node to perform operations, thus avoiding the complex operations performed in common karaoke or singing games. For example, the user only needs to perform a single-handed click operation, and does not need to sing with the mouth.
[0068] Of course, in the embodiment of the present application, if two different types of audio nodes are presented as described above, the user can use both hands to click on the two audio nodes that appear along with the audio track.
[0069] Therefore, in the audio node-based user interaction method according to an embodiment of the present application, receiving a user's operation in response to a presented audio node includes: receiving a user's click operation on a displayed icon in response to the icon.
[0070] Step S140, providing feedback to the user based on the matching of the operation with the presented audio node. Here, the feedback provided to the user may also include various types of feedback such as visual, auditory, and tactile, but due to the intuitiveness of visual feedback, providing visual feedback to the user is better.
[0071] In order to improve the intuitiveness of user operations, an operation graphic may be displayed corresponding to the user operation. For example, when the user clicks on the screen, an operation graphic corresponding to the click operation appears on the screen, such as a circle or square graphic. In this way, when the user clicks on the icon corresponding to the audio node on the screen, the operation graphic will interact with the icon.
[0072] That is, in the user interaction method based on audio nodes according to an embodiment of the present application, providing feedback to the user based on the matching of the operation with the presented audio node includes: displaying to the user the interaction effect of the operation graphic operated by the user and the icon based on the user's click operation on the icon.
[0073] In the embodiment of the present application, the icon corresponding to the audio node and / or the operation graphic operated by the user can be displayed in any graphic form. For example, the icon and / or the operation graphic can actually be used as an advertising space for the implantation of any advertising image.
[0074] Specifically, the icon may display the advertiser's brand logo, or any logo image that the advertiser wants to show to the user and can be associated with the advertiser. In addition, the operation graphic may also display the advertiser's brand logo image.
[0075] In a specific implementation, the advertiser's brand logo image can be directly used as the icon and / or the operation graphic, or the advertiser's brand logo image can be superimposed on the icon and / or the operation graphic. In either way, the advertiser's brand logo image can be presented to the user during the interaction process, thereby leaving a deep impression on the user, which can bring good promotion effects to the advertiser.
[0076] It is worth noting that in the embodiments of the present application, the logo image is not limited to the advertiser's brand logo image, but may also be other predetermined logo images that are intended to be presented to the user, such as a logo image of a game maker, or a notification logo image that is intended to be presented to the user, and so on.
[0077] Therefore, in the audio node-based user interaction method according to an embodiment of the present application, at least one of the icon and the operation graphic is displayed with a predetermined identification image.
[0078] To further improve interactivity, different scores can be provided to users based on the degree of match between the user's operation and the presented audio node. For example, when the user's operation completely matches the presented audio node, it is represented by the user completely clicking and hitting the center of the icon corresponding to the audio node, which is a "Perfect" score of 5 points. When the user clicks but does not hit the center of the icon, but is within the range before and after, it is a "Good" score of 3 points. If it does not hit, it is a "Miss" score of 0 or 1 point.
[0079] Corresponding to the score, an icon corresponding to the audio node and / or a specific effect of an operation graphic operated by the user may be further displayed. For example, at least one of the icon and the operation graphic may be enlarged or reduced corresponding to the score. For example, when the score is 5 points, at least one of the icon and the operation graphic is enlarged, and when the score is 0 or 1 point, at least one of the icon and the operation graphic is reduced. In this way, a more intuitive interactive experience may be provided to the user.
[0080] In this way, according to the user's operation score, further ranking statistics can be calculated, so that the score can be used to exchange for unlocking, such as unlocking new audio and / or audio nodes. That is, only new audio can be unlocked, or new audio nodes of the current audio can be unlocked, or new audio and its audio nodes can be unlocked at the same time. In addition, according to the user's score, the ranking can be statistically calculated, and random battle matches with other users with similar scores can be performed.
[0081] Therefore, in the user interaction method based on audio nodes according to an embodiment of the present application, providing feedback to the user based on the matching of the operation with the presented audio node includes: determining the matching degree of the operation with the presented audio node based on the degree of overlap between the operation graphic operated by the user and the icon; and giving the user a corresponding score based on the matching degree.
[0082] Furthermore, in the user interaction method based on audio nodes according to an embodiment of the present application, after giving the user a corresponding score based on the degree of matching, it further includes: matching the user with other users who perform interactive operations on the same audio and its audio nodes based on the score.
[0083] In addition, in the user interaction method based on audio nodes according to the embodiment of the present application, after giving the user a corresponding score based on the degree of matching, it further includes: providing new audio and / or its audio nodes to the user based on the score.
[0084] In the embodiment of the present application, other operations can also be performed based on the user's score. For example, the user may initially only be able to listen to lower-quality audio, but after obtaining a certain score, the score can be exchanged for high-quality audio. In this way, the user can choose high-quality audio for interaction in the next interaction process.
[0085] That is, in the user interaction method based on audio nodes according to the embodiment of the present application, after giving the user a corresponding score based on the degree of matching, it further includes: providing high-quality audio to the user based on the score.
[0086] In order to increase the intuitive feeling of the user's score, in the embodiment of the present application, the obtained score can be displayed to the user. For example, in addition to simply displaying the score in digital form, the score can also be displayed in other more intuitive graphical forms such as gold coins.
[0087] Furthermore, when displaying the score, the image of the score can also be used to embed a predetermined identification image like the above-mentioned icon and / or operation graphic. That is, in the user interaction method based on audio nodes according to the embodiment of the present application, after giving the user a corresponding score based on the matching degree, it further includes: displaying the score to the user together with the predetermined identification image.
[0088] Application Example 1
[0089] Figure 2 A schematic diagram of application example 1 of the user interaction method based on audio nodes according to an embodiment of the present application is illustrated.
[0090] like Figure 2 As shown, the audio node-based user interaction method according to the embodiment of the present application can be applied to a music game interactive product, which can include two parts: recommended music and interactive games.
[0091] In the music recommendation section, users log in through their accounts and associate other accounts, such as other music playback accounts, etc. After that, the user's historical music behavior data is obtained, and then a personalized music content recommendation model is generated based on the user's music preference behavior and transferred to the new game interactive product.
[0092] Users can choose to consume music content by default, such as playing games or listening to music (radio) by default. The interface can choose to switch between listening to music or playing games. The music is selected from the existing copyrighted music library, and points can be manually marked on the timeline of the audio track, such as marking instrument, rhythm point and other attribute marks on the music timeline, which will be used in the subsequent interaction between music game users.
[0093] As mentioned above, users can click according to the music and screen prompts with one hand. The clicked nodes can appear from top to bottom or from left to right. When the user completely clicks and hits the center of the corresponding timeline rhythm, it is "Perfect" with a score of 5 points. When the user clicks and misses the center time point, but is within the range before and after, it is "Good" with a score of 3 points. If it does not hit, it is "Miss" with a score of 0 or 1 point. The ranking statistics are then calculated based on the scores, and the corresponding gold coins are allocated based on the scores for redemption and unlocking. At the same time, the ranking is performed based on the score statistics, and the battle matching relationship of similar rankings is randomly performed.
[0094] In addition, you can set up all games to have gold coin rewards for clearing levels. The gold coins can be exchanged for resurrection cards, which means that the resurrection cards will take effect after a miss, and you don't have to start over.
[0095] As you can see, the music game in the application example 1 is easy to play, and users can easily get started without training. The game operation is simple and can be operated with one hand. In addition, one-handed clicking is easy to operate and understand, freeing both hands and mouths. Users can play music without opening their mouths to sing. Users only need to click to the rhythm, and the threshold is very low.
[0096] At the same time, because the music playback format has not changed, there is no adaptation, no separate lyrics or music, no cover, and no fragment application, the existing copyright content of the music library can be fully applied, and there is no need to specifically look for popular songs like singing applications (otherwise users will not sing), and only limited songs can be applied. In this way, corresponding music recommendations can be made based on user music preferences, perfectly meeting user demands from music content to game interaction.
[0097] In addition, there is no threshold for users to consume music. If they don't want to play games, they can just treat it as a music radio station that recommends music content that suits their music preferences. There are no advertisements, it is pure music entertainment, and users can unlock more music and scenes by simply clicking to get points.
[0098] Interaction Example 1
[0099] Figures 3A to 3C A schematic diagram of interaction example 1 of a user interaction method based on audio nodes according to an embodiment of the present application is illustrated.
[0100] like Figures 3A to 3C As shown, the interaction example 1 uses the rhythm node as the audio node, which may include the following: Figure 3A , Figure 3B and Figure 3C The three scene modes are shown.
[0101] In such Figure 3A In the scene mode shown, the user clicks to control the butterfly (it can also be other icons, such as a character icon, such as a specific character image of a brand advertiser, or a brand image icon, such as a cow icon in a milk advertisement), clicks on the corresponding music rhythm node, and quickly crosses the downward rhythm block. If it completely passes through the center of the rhythm block, it is "Perfect" with a score of 5 points. If it does not pass through the center point but is within the front and back range, it is "Good" with a score of 3 points. Otherwise, if it does not touch the rhythm block, it is "Miss" with a score of 0 or 1 point.
[0102] In such Figure 3B In the scene mode shown, the user clicks to control the butterfly and clicks on the corresponding music rhythm node to quickly jump from one rhythm block to another. If the click completely hits the center of the corresponding timeline rhythm, it is "Perfect" and scored 5 points. When the user clicks but does not hit the center time point, but is within the front and back range, it is "Good" and scored 3 points. If it does not hit, it is "Miss" and scored 0 or 1 point.
[0103] In such Figure 3C In the scene mode shown, the user clicks to control the butterfly to click at the corresponding music rhythm node to quickly burst each bubble. If the click completely hits the center of the corresponding timeline rhythm, the bubble is burst, which is a "Perfect" score of 5 points. If the user clicks but does not hit the center time point, but is within the range before and after, the bubble is hit but not burst, which is a "Good" score of 3 points. If it does not completely miss, it is a "Miss" score of 0 or 1 point.
[0104] And, as mentioned above, in Figures 3A to 3C In the scene mode shown, in addition to the icons controlled by the user clicking, the rhythm blocks or bubbles can also be replaced with a predetermined logo image that is intended to be presented to the user, such as a cow logo image in the case of a milk advertisement.
[0105] Interaction Example 2
[0106] FIG. 4A to FIG. 4C A schematic diagram of interaction example 2 of the user interaction method based on audio nodes according to an embodiment of the present application is illustrated.
[0107] like FIG. 4A to FIG. 4CAs shown, the second interaction example uses the instrument node as the audio node, which may include the following: Figure 4A , Figure 4B and Figure 4C The three scene modes are shown.
[0108] In such Figure 4A In the scene mode shown, the user clicks to control the "baton", which corresponds to the click of the music instrument node, that is, clicks to wave the baton when the drum beats, and the drum feedback hits when the instrument name (word) or instrument shape falls from top to bottom and hits.
[0109] In such Figure 4B In the scene mode shown, the user clicks the "conductor baton" to click on the corresponding music instrument node, which is similar to the following Figure 4A The scene modes shown differ only in that the instrument names (letters) or instrument shapes scroll from left to right.
[0110] In such Figure 4C In the scene mode shown, the user clicks to control the "baton", and the corresponding music instrument node is clicked. The bubble form of the instrument name (word) falls from top to bottom and is broken when it hits.
[0111] Here, in FIG. 4A to FIG. 4C In the scenario shown, a predetermined identification image may also be superimposed on the instrument name (words) or instrument shape falling from top to bottom, such as a cow identification image in a milk advertisement.
[0112] Exemplary Devices
[0113] Figure 5 A block diagram of a user interaction device based on an audio node according to an embodiment of the present application is illustrated.
[0114] like Figure 5 As shown, according to an embodiment of the present application, an audio node-based user interaction device 200 includes: an audio acquisition unit 210, for acquiring the audio and its audio nodes currently listened to by the user; a node presentation unit 220, for presenting the audio nodes acquired by the audio acquisition unit 210; an operation receiving unit 230, for receiving the user's operation in response to the audio nodes presented by the node presentation unit 220; and a feedback providing unit 240, for providing feedback to the user based on the matching of the operation received by the operation receiving unit 230 and the presented audio nodes.
[0115] In one example, in the above-mentioned audio node-based user interaction device 200, the audio node includes one of a beat node, an instrument node, a melody node, a high-pitched and low-pitched switching node, and a male-female voice switching node of the audio.
[0116] In one example, in the above-mentioned audio node-based user interaction device 200, the audio acquisition unit 210 includes: a mode determination subunit, used to determine whether the user has selected an interaction mode; a node acquisition subunit, used to obtain the audio currently being listened to by the user in response to the mode determination subunit determining that the user has selected the interaction mode, the audio containing pre-marked audio nodes; and, an audio acquisition subunit, used to obtain only the audio currently being listened to by the user in response to the mode determination subunit determining that the user has not selected the interaction mode.
[0117] In one example, in the above-mentioned audio node-based user interaction device 200, the node presentation unit 220 includes: a track display subunit, used to display the track of the audio acquired by the audio acquisition unit 210 on the screen; and an icon display subunit, used to display an icon corresponding to the audio node at a position corresponding to the audio node acquired by the audio acquisition unit 210 on the track displayed by the track display subunit.
[0118] In one example, in the above-mentioned audio node-based user interaction device 200, the operation receiving unit 230 is used to: receive a user's click operation on the displayed icon in response to the icon.
[0119] In one example, in the above-mentioned audio node-based user interaction device 200, the feedback providing unit 240 is used to: display to the user the interaction effect between the operation graphic operated by the user and the icon based on the user's click operation on the icon.
[0120] In one example, in the above-mentioned audio node-based user interaction device 200, at least one of the icon and the operation graphic is displayed with a predetermined identification image.
[0121] In one example, in the above-mentioned audio node-based user interaction device 200, the feedback providing unit 240 includes: a matching determination subunit, which is used to determine the matching degree between the operation and the presented audio node based on the degree of overlap between the operation graphic operated by the user and the icon; and a score determination subunit, which is used to give the user a corresponding score based on the matching degree determined by the matching determination subunit.
[0122] In one example, the above-mentioned audio node-based user interaction device 200 further includes: a user matching unit, which is used to match the user with other users who perform interactive operations on the same audio and its audio node based on the score determined by the score determination subunit after the score determination subunit gives the user a corresponding score based on the degree of matching.
[0123] In one example, in the above-mentioned audio node-based user interaction device 200, it further includes: an audio unlocking unit, which is used to provide the user with new audio and / or its audio nodes based on the score determined by the score determination subunit after the score determination subunit gives the user a corresponding score based on the degree of matching.
[0124] In one example, the above-mentioned audio node-based user interaction device 200 further includes: an audio unlocking unit, configured to provide high-quality audio to the user based on the score.
[0125] In one example, the above-mentioned audio node-based user interaction device 200 further includes: a score presentation unit, configured to display the score to the user together with a predetermined identification image.
[0126] Here, those skilled in the art will appreciate that the specific functions and operations of the various units and modules in the above-mentioned audio node-based user interaction device 200 have been described in detail above. Figure 1 The description of the audio node-based user interaction method has been described in detail, and therefore, its repeated description will be omitted.
[0127] As described above, the user interaction device 200 based on audio nodes according to the embodiment of the present application can be implemented in various terminal devices, such as a user's smart phone, tablet computer, etc. In one example, the user interaction device 200 based on audio nodes according to the embodiment of the present application can be integrated into the terminal device as a software module and / or a hardware module. For example, the user interaction device 200 based on audio nodes can be a software module in the operating system of the terminal device, or can be an application developed for the terminal device; of course, the user interaction device 200 based on audio nodes can also be one of the many hardware modules of the terminal device.
[0128] Alternatively, in another example, the audio node-based user interaction apparatus 200 and the terminal device may also be separate devices, and the audio node-based user interaction apparatus 200 may be connected to the terminal device via a wired and / or wireless network and transmit interaction information in accordance with an agreed data format.
[0129] Exemplary Electronic Devices
[0130] Below, reference Figure 6 To describe an electronic device according to an embodiment of the present application.
[0131] Figure 6 A block diagram of an electronic device according to an embodiment of the present application is illustrated.
[0132] like Figure 6As shown, the electronic device 10 includes one or more processors 11 and a memory 12 .
[0133] The processor 13 may be a central processing unit (CPU) or other forms of processing units having data processing capabilities and / or instruction execution capabilities, and may control other components in the electronic device 10 to perform desired functions.
[0134] The memory 12 may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory may include, for example, random access memory (RAM) and / or cache memory (cache), etc. The non-volatile memory may include, for example, read-only memory (ROM), hard disk, flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 11 may run the program instructions to implement the user interaction method based on audio nodes and / or other desired functions of the various embodiments of the present application described above. Various contents such as audio, audio nodes, etc. may also be stored in the computer-readable storage medium.
[0135] In one example, the electronic device 10 may further include: an input device 13 and an output device 14, and these components are interconnected via a bus system and / or other forms of connection mechanisms (not shown).
[0136] The input device 13 may include, for example, a keyboard, a mouse, etc.
[0137] The output device 14 can output various information to the outside, including feedback results of user operations, etc. The output device 14 can include, for example, a display, a speaker, a printer, a communication network and a remote output device connected thereto, and the like.
[0138] Of course, to simplify, Figure 6 Only some of the components related to the present application in the electronic device 10 are shown, and components such as a bus, an input / output interface, etc. are omitted. In addition, according to specific application situations, the electronic device 10 may also include any other appropriate components.
[0139] Exemplary computer program products and computer-readable storage media
[0140] In addition to the above-mentioned methods and devices, an embodiment of the present application may also be a computer program product, which includes computer program instructions, which, when executed by a processor, enable the processor to execute the steps of the audio node-based user interaction method according to various embodiments of the present application described in the above-mentioned "Exemplary Method" section of this specification.
[0141] The computer program product may be written in any combination of one or more programming languages to write program codes for performing the operations of the embodiments of the present application, including object-oriented programming languages, such as Java, C++, etc., and conventional procedural programming languages, such as "C" language or similar programming languages. The program code may be executed entirely on the first user computing device, partially on the first user computing device, as an independent software package, partially on the first user computing device and partially on a remote computing device, or entirely on a remote computing device or server.
[0142] In addition, an embodiment of the present application may also be a computer-readable storage medium on which computer program instructions are stored. When the computer program instructions are executed by a processor, the processor executes the steps of the audio node-based user interaction method according to various embodiments of the present application described in the above “Exemplary Method” section of this specification.
[0143] The computer readable storage medium can adopt any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can include, for example, but is not limited to, a system, device or device of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.
[0144] The basic principles of the present application are described above in conjunction with specific embodiments. However, it should be noted that the advantages, strengths, effects, etc. mentioned in the present application are only examples and not limitations, and it cannot be considered that these advantages, strengths, effects, etc. are required by each embodiment of the present application. In addition, the specific details disclosed above are only for the purpose of illustration and ease of understanding, not for limitation, and the above details do not limit the present application to being implemented by adopting the above specific details.
[0145] The block diagrams of the devices, apparatuses, equipment, and systems involved in this application are only illustrative examples and are not intended to require or imply that they must be connected, arranged, and configured in the manner shown in the block diagram. As will be appreciated by those skilled in the art, these devices, apparatuses, equipment, and systems can be connected, arranged, and configured in any manner. Words such as "including", "comprising", "having", etc. are open words, referring to "including but not limited to", and can be used interchangeably with them. The words "or" and "and" used here refer to the words "and / or" and can be used interchangeably with them, unless the context clearly indicates otherwise. The words "such as" used here refer to the phrase "such as but not limited to", and can be used interchangeably with them.
[0146] It should also be noted that in the apparatus, device and method of the present application, each component or each step can be decomposed and / or recombined. Such decomposition and / or recombination should be regarded as equivalent solutions of the present application.
[0147] The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present application. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects without departing from the scope of the present application. Therefore, the present application is not intended to be limited to the aspects shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.
[0148] The above description has been given for the purpose of illustration and description. In addition, this description is not intended to limit the embodiments of the present application to the forms disclosed herein. Although multiple example aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, changes, additions and sub-combinations thereof.
Claims
1. A user interaction method based on audio nodes, characterized in that: include: Get the audio currently being listened to by the user and its audio node; The audio node includes at least one of a beat node, an instrument node, a melody node, a high-pitched and low-pitched switching node, and a male-female voice switching node of the audio; presenting the audio node; receiving a user operation in response to the presented audio node; as well as providing feedback to the user based on the matching of the operation with the presented audio node; If the audio includes multiple types of audio nodes, obtaining the multiple types of audio nodes; The multiple types of audio nodes are presented in a time-sharing manner.
2. The user interaction method based on audio nodes according to claim 1, characterized in that: Get the audio currently being listened to by the user and its audio node: Determine whether the user has selected interactive mode; In response to the user selecting the interaction mode, obtaining audio currently listened to by the user, wherein the audio includes pre-marked audio nodes; and In response to the user not selecting the interaction mode, only the audio currently listened to by the user is obtained.
3. The user interaction method based on audio nodes according to claim 1, characterized in that: Presenting the audio node comprises: Displaying the audio track of the audio on the screen; and An icon corresponding to the audio node is displayed at a position corresponding to the audio node on the audio track.
4. The user interaction method based on audio nodes according to claim 3 is characterized in that: Receiving a user operation in response to the presented audio node includes: A click operation of the displayed icon by the user is received in response to the click operation of the displayed icon.
5. The user interaction method based on audio nodes according to claim 4, characterized in that: Providing feedback to the user based on the matching of the operation with the presented audio node includes: Based on the user's click operation on the icon, the interaction effect between the operation graphic operated by the user and the icon is displayed to the user.
6. The user interaction method based on audio nodes according to claim 5, characterized in that: At least one of the icon and the operation graphic is displayed with a predetermined logo image.
7. The user interaction method based on audio nodes according to claim 5, characterized in that: Providing feedback to the user based on the matching of the operation with the presented audio node includes: Determining a matching degree between the operation graphic operated by the user and the presented audio node based on a degree of overlap between the operation graphic operated by the user and the icon; and The user is given a corresponding score based on the degree of matching.
8. The user interaction method based on audio nodes according to claim 7, characterized in that: After giving the user a corresponding score based on the matching degree, the method further includes: The user is matched with other users who interact with the same audio and its audio nodes based on the score.
9. The user interaction method based on audio nodes according to claim 7, characterized in that: After giving the user a corresponding score based on the matching degree, the method further includes: New audio and / or audio nodes thereof are provided to the user based on the score.
10. The user interaction method based on audio nodes according to claim 7, characterized in that: After giving the user a corresponding score based on the matching degree, the method further includes: High quality audio is provided to the user based on the score.
11. The user interaction method based on audio nodes according to claim 7, characterized in that: After giving the user a corresponding score based on the matching degree, the method further includes: The score is displayed to the user together with a predetermined logo image.
12. A user interaction device based on audio nodes, characterized in that: include: An audio acquisition unit, used to acquire the audio currently listened to by the user and its audio node; The audio node includes at least one of a beat node, an instrument node, a melody node, a high-pitched and low-pitched switching node, and a male-female voice switching node of the audio; A node presenting unit, used for presenting the audio node acquired by the audio acquiring unit; An operation receiving unit, used to receive a user's operation in response to the audio node presented by the node presenting unit; as well as A feedback providing unit, configured to provide feedback to a user based on a match between the operation received by the operation receiving unit and the presented audio node; The audio acquisition unit is further configured to acquire the multiple types of audio nodes if the audio includes multiple types of audio nodes; The node presentation unit is further used to present the multiple types of audio nodes in a time-sharing manner.
13. An electronic device, comprising: processor; as well as A memory, wherein computer program instructions are stored in the memory, and when the computer program instructions are executed by the processor, the processor executes the user interaction method based on audio nodes according to any one of claims 1 to 11.
