A music interaction method based on a smart pillow, a terminal device and a storage medium

Through interactive detection and control between terminal devices and smart pillows, the problem of low intelligence of smart pillows is solved, convenient interaction between users' music learning and smart home control is realized, and the intelligence level and learning efficiency of smart pillows are improved.

CN115440176BActive Publication Date: 2025-10-10DONGGUAN DERUCCI BEDDING CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202211064967.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-08-31
Publication Date
2025-10-10
Estimated Expiration
2042-08-31

Smart Images

  • Figure CN115440176B_ABST
    Figure CN115440176B_ABST
Patent Text Reader

Abstract

The embodiment of the application relates to the technical field of smart home, and discloses a music interaction method based on a smart pillow, a terminal device and a storage medium, and the method has the characteristics that the terminal device determines the pronunciation order of each target note contained in a certain music segment; after the pronunciation of a certain target note is played according to the pronunciation order of each target note, the terminal device detects the note presented by a target smart pillow sent by the target smart pillow under the condition of being hit; the target smart pillow is any one of a plurality of smart pillows; the terminal device compares the note presented by the target smart pillow with the certain target note to obtain a comparison result corresponding to the certain target note; and the terminal device outputs the comparison result corresponding to the certain target note in the form of an audio signal. The embodiment of the application can realize music interaction of a user using a smart pillow, can help the user to learn different notes and even music segments, and improves the intelligent degree of the smart pillow.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of smart home technology, and in particular to a music interaction method based on a smart pillow, a terminal device, and a storage medium. Background Art

[0002] Smart pillows are designed based on human sleeping habits and integrate a variety of high-quality and healthy sleeping materials. They are scientifically combined to create pillows that can adjust to different heights and hardnesses.

[0003] Smart pillows can generally provide support for the user's head and neck, and some can even provide massage services. However, their level of intelligence is still relatively low. Summary of the Invention

[0004] The embodiments of the present application disclose a music interaction method, terminal device, and storage medium based on a smart pillow, which can improve the intelligence level of the smart pillow.

[0005] In a first aspect, an embodiment of the present application discloses a music interaction method based on a smart pillow. A terminal device is communicatively connected to a plurality of smart pillows. Each smart pillow displays a musical note, and the musical notes displayed on any two smart pillows are different. The method includes:

[0006] The terminal device determines the pronunciation order of each target note contained in a certain music segment; the target notes are part or all of all the notes presented on the plurality of smart pillows;

[0007] After the terminal device finishes playing a target note in the order of the target notes, it detects that a target smart pillow is struck and transmits the note presented by the target smart pillow; the target smart pillow is any one of the multiple smart pillows;

[0008] The terminal device compares the note presented by the target smart pillow with the target note to obtain a comparison result corresponding to the target note;

[0009] The terminal device outputs the comparison result corresponding to the target note in the form of an audio signal.

[0010] A second aspect of an embodiment of the present application discloses a terminal device, wherein the terminal device is communicatively connected to a plurality of smart pillows, each of which displays a musical note, and the musical notes displayed on any two smart pillows are different. The terminal device includes:

[0011] a note determination unit, configured to determine the pronunciation order of target notes contained in a music segment; the target notes being some or all of the notes presented on the plurality of smart pillows;

[0012] a note detection unit, configured to detect, after playing a target note in the order of the target notes, the note presented by the target smart pillow when the target smart pillow is struck; the target smart pillow being any one of the plurality of smart pillows;

[0013] a note comparison unit, configured to compare the note presented by the target smart pillow with the target note, and obtain a comparison result corresponding to the target note;

[0014] The result output unit is used to output the comparison result corresponding to the target note in the form of an audio signal.

[0015] A third aspect of an embodiment of the present application discloses another terminal device, wherein the terminal device is communicatively connected to a plurality of smart pillows, each of which displays a musical note, and the musical notes displayed on any two smart pillows are different. The terminal device includes:

[0016] a memory storing executable program code;

[0017] a processor coupled to the memory;

[0018] The processor calls the executable program code stored in the memory and performs the following steps:

[0019] Determining the pronunciation order of target notes contained in a certain music segment; the target notes are part or all of the notes presented on the plurality of smart pillows;

[0020] After playing a target note in the order of the target notes, detecting that a target smart pillow is struck and sending the note presented by the target smart pillow; the target smart pillow is any one of the multiple smart pillows;

[0021] Comparing the musical note presented by the target smart pillow with the target musical note to obtain a comparison result corresponding to the target musical note;

[0022] The comparison result corresponding to the target note is output in the form of an audio signal.

[0023] The fourth aspect of the embodiment of the present application discloses a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps of the music interaction method based on the smart pillow disclosed in the first aspect of the embodiment of the present application are implemented.

[0024] Compared with the prior art, the embodiments of the present application have the following beneficial effects:

[0025] In an embodiment of the present application, the terminal device determines the pronunciation order of each target note contained in a certain music segment. After playing the pronunciation of a certain target note according to the pronunciation order of each target note, the terminal device detects the note presented by the target smart pillow sent by the target smart pillow in the communication connection due to being hit. The terminal device compares the note presented by the target smart pillow with a certain target note that has been played, obtains the comparison result corresponding to a certain target note, and outputs the comparison result corresponding to a certain target note in audio form, so that the user can use the smart pillow to interact with music, and the smart pillow that is hit by the user during the interaction can send the presented note to the terminal device, so that the terminal device can judge whether the note input by the user interaction is correct, and can help the user learn different notes or even music segments, thereby improving the intelligence level of the smart pillow. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0027] Figure 1 This is a flowchart of a music interaction method based on a smart pillow disclosed in an embodiment of the present application;

[0028] Figure 2 This is a schematic diagram of a terminal device and a smart pillow that are communicatively connected to each other disclosed in an embodiment of the present application;

[0029] Figure 3 1 is a flow chart of another music interaction method based on a smart pillow disclosed in an embodiment of the present application;

[0030] Figure 4 This is a schematic structural diagram of a first embodiment of a terminal device disclosed in an embodiment of the present application;

[0031] Figure 5 It is a structural diagram of the second embodiment of the terminal device disclosed in the embodiments of this application. Specific embodiments

[0032] The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the present application, all the other embodiments obtained by a person of ordinary skill in the art without creative work fall within the protection scope of the present application.

[0033] It should be noted that the terms "comprising" and "having" and any variations thereof in the embodiments of the present application are intended to cover the inclusions that are not exclusive, for example, a process, method, system, product or device comprising a series of steps or units does not have to be limited to the clearly listed steps or units, but can include other steps or units that are not clearly listed or inherent to the process, method, product or device.

[0034] The embodiments of the present application disclose a music interaction method based on a smart pillow, a terminal device and a storage medium, which can at least improve the intelligent degree of the smart pillow. The following will be described in detail with reference to the drawings.

[0035] Please refer to Figures 1 and 2 , Figure 1 is a flowchart of a music interaction method based on a smart pillow disclosed by the embodiments of the present application, Figure 2 is a schematic diagram of terminal devices and smart pillows in communication connection disclosed by the embodiments of the present application. As Figure 2 shown, in the embodiments of the present application, the terminal device is in communication connection with four smart pillows, each of which presents a musical note. The smart pillow 1 presents a musical note a, the smart pillow 2 presents a musical note b, the smart pillow 3 presents a musical note c, and the smart pillow 4 presents a musical note d. It can be understood that the relative positions between the terminal device and each smart pillow can not be fixed. As Figure 1 shown, the music interaction method based on the smart pillow can include the following steps:

[0036] 110, the terminal device determines the pronunciation order of each target musical note contained in a certain music segment; each target musical note is part or all of the musical notes presented on the smart pillows.

[0037] In an embodiment of the present application, a terminal device or other device may store multiple music segments, each of which contains one or more target notes. The terminal device may select and obtain a music segment from multiple music segments based on user selection. The terminal device determines the target notes contained in the obtained music segment and determines the pronunciation order of the target notes. The target notes contained in a music segment need to be part of or all of the notes presented on several smart pillows that are communicatively connected to the terminal device. In other words, the target notes contained in a music segment need to be able to be presented by the smart pillow.

[0038] For example, there are three music segments: Music Segment 1, Music Segment 2, and Music Segment 3. Music Segment 1 contains target notes abcd, Music Segment 2 contains target notes bacd, and Music Segment 3 contains target notes dcba. When a terminal device selects Music Segment 1, the terminal device can determine that each target note in Music Segment 1 is abcd, and that the pronunciation order of each target note is abcd.

[0039] 120. After the terminal device finishes playing a target note in the order of pronunciation of each target note, it detects the note presented by the target smart pillow when the target smart pillow is hit; the target smart pillow is any one of the multiple smart pillows.

[0040] For example, after the terminal device determines the target notes of music segment 1 and the pronunciation order is abcd, it plays the pronunciation of target note a, target note b, target note c and target note d in the pronunciation order of abcd. After the terminal device finishes playing the pronunciation of target note a, the user can now select the target note a played by the terminal device. Figure 2 The user taps any of the four smart pillows in the game. For example, if the user taps Smart Pillow 1, Smart Pillow 1 becomes the target smart pillow. After being tapped, Smart Pillow 1 transmits the note a it plays to the terminal device. After playing the target note a, the terminal device continues to test each smart pillow. Upon detecting that Smart Pillow 1 has transmitted note a, the terminal device stops testing each smart pillow and proceeds to the next step.

[0041] In some embodiments, after the terminal device plays a target note in the order in which the target notes are pronounced, if a preset time period passes without detecting the target smart pillow being struck and the note being presented by the target smart pillow, a blank note is generated. The blank note is different from the notes presented on each smart pillow. This avoids situations where the detection time is too long or the target smart pillow fails to detect the note, thereby ensuring the user's experience during the music interaction process.

[0042] 130. The terminal device compares the musical note presented by the target smart pillow with a target musical note to obtain a comparison result corresponding to the target musical note.

[0043] For example, the terminal device compares the received note a sent by smart pillow 1 with the target note a played in the pronunciation order, and obtains a comparison result corresponding to the target note a. Here, since note a is the same as the target note a, the comparison result is the first comparison result, that is, the target smart pillow sends the same note as the target note. If the terminal device receives note b sent by smart pillow 2, then since note b is different from the target note a, the comparison result is the second comparison result, that is, the target smart pillow sends the same note as the target note.

[0044] 140. The terminal device outputs the comparison result corresponding to a target note in the form of an audio signal.

[0045] In an embodiment of the present application, the terminal device can output the comparison result corresponding to a certain target note in the form of an audio signal, wherein, in the process of outputting the comparison result corresponding to the target note in the form of an audio signal, when the comparison result is the first comparison result mentioned above and when the comparison result is the second comparison result mentioned above, the comparison result output in the form of an audio signal can be different. Exemplarily, the terminal device can output the comparison result corresponding to a certain target note in the form of music output. When the comparison result is the first comparison result mentioned above, the terminal device can output relatively cheerful music to let the user know that the note presented by the hit smart pillow is the same as the target note that has been played, that is, the hit is correct; when the comparison result is the second comparison result mentioned above, the terminal device can output relatively low-pitched music to let the user know that the note presented by the hit smart pillow is different from the target note that has been played, that is, the hit is wrong.

[0046] By implementing the above embodiments, users can use smart pillows to interact with music, and the smart pillow hit by the user during the interaction can send the presented notes to the terminal device, so that the terminal device can determine whether the notes input by the user interaction are correct, and can help users learn different notes or even music segments, thereby improving the intelligence level of the smart pillow.

[0047] In one embodiment, see Figure 3 , Figure 3This is a flow chart of another music interaction method based on smart pillows disclosed in an embodiment of the present application. In the embodiment of the present application, the terminal device is connected to several smart pillows for communication, and each smart pillow has a musical note, and the musical notes displayed on any two smart pillows are different. Figure 3 As shown, the method may include the following steps:

[0048] 310. The terminal device determines the pronunciation order of target notes contained in a certain music segment; the target notes are part or all of all notes presented on several smart pillows.

[0049] In some embodiments, several smart pillows include airbags.

[0050] After determining the pronunciation order of each target note contained in a certain music segment and before playing the pronunciation of the first target note according to the pronunciation order of each target note, the terminal device may further perform the following steps:

[0051] The terminal device sends an airbag adjustment instruction to the smart pillow that presents each target note to control the smart pillow to adjust the total amount of gas in the included airbags according to the airbag adjustment instruction so that the total amount of gas in each airbag meets the total amount of gas range.

[0052] In an embodiment of the present application, after the terminal device determines the pronunciation order of each target note contained in a certain music segment, that is, after the terminal device determines the each target note contained in a certain music segment, and before playing the pronunciation of the first target note in the pronunciation order of each target note, that is, before playing the pronunciation of the target note so that the user hits the smart pillow according to the pronunciation of the played target note, in order to avoid damage to the airbags of the smart pillow caused by subsequent users hitting the smart pillow, the terminal device needs to control the smart pillow to adjust the total amount of gas of each airbag contained therein, so that the total amount of gas of each airbag can reach a preset total amount of gas range. This total amount of gas area can be set by the user himself or by the terminal device based on experience, so that in the process of interacting with music by hitting the smart pillow, the hitting action will not cause discomfort, nor will the smart pillow be damaged due to the user's hitting action, further improving the intelligence level of the smart pillow.

[0053] In some embodiments, a smart pillow may include a smart pillow control module, which may specifically include an air pressure detector, an air pump, and an air valve. The smart pillow detects the real-time air pressure of the included airbags via the air pressure detector to determine the current total amount of gas in the airbags. After determining the current total amount of gas in the airbags based on the detected real-time air pressure, the smart pillow control module may control one or more air valves on the airbags to open and control the air pump to adjust the total amount of gas in the airbags via the opened air valves. During the adjustment of the total amount of gas in the airbags, the smart pillow may detect the real-time air pressure of the airbags via the air pressure detector to determine the real-time total amount of gas in the airbags. When the total amount of gas in the airbags is adjusted to a preset range or preset value, the smart pillow control module may control one or more air valves on the airbags to close and stop the air pump. The smart pillow may also open the air valves on the airbags included in the area and control the air pump to deflate the airbags to reduce the total amount of gas in the airbags, thereby reducing the volume of the airbags and, in turn, the volume of the area where the airbags are located. The smart pillow can open the air valves on the airbags included in the area and control the air pump to inflate the airbags to increase the total amount of gas in the airbags, thereby increasing the volume of the airbags and then increasing the volume of the area where the airbags are located.

[0054] 320. After the terminal device completes playing a target note in the order of the target notes, it controls the smart pillow presenting the target note to output a prompt message. Furthermore, the terminal device detects a striking signal transmitted by the target smart pillow and the note presented by the target smart pillow. The target smart pillow is any one of the plurality of smart pillows.

[0055] Exemplarily, after the terminal device determines the target notes of music segment 1 and the pronunciation order is abcd, it plays the pronunciation of target note a, target note b, target note c and target note d in sequence according to the pronunciation order of abcd. After the terminal device finishes playing the pronunciation of target note a, the terminal device can determine the smart pillow that can present the same note as the target note a that has been played based on the pre-stored smart pillows and the notes they present. Here, it is smart pillow 1 that presents note a. At this time, after the terminal device determines smart pillow 1, it can send a control message to smart pillow 1. After receiving the control message sent by the terminal device, smart pillow 1 can output a prompt message to prompt the user. The prompt message can be playing a voice such as "hit here" or turning on a light, which is not specifically limited here. Here, smart pillow 1 outputs prompt information by turning on a light.

[0056] The user can make a selection based on the target note a played by the terminal device and the prompt information output by a smart pillow. Figure 2Any of the four smart pillows in the game can be hit. For example, if the user hits smart pillow 1, then smart pillow 1 is the target smart pillow. Each smart pillow can be equipped with a pressure sensor or other components to measure the force with which the user hits the smart pillow. After being hit by the user, smart pillow 1 sends the note a presented by itself and the force with which the user hits smart pillow 1 detected by the pressure sensor, that is, the hitting signal, to the terminal device. After playing the target note a, the terminal device can continue to detect each smart pillow. After detecting the note a and the hitting signal sent by smart pillow 1, the terminal device stops detecting each smart pillow and executes the next step.

[0057] By implementing the above embodiment, corresponding prompts can be output according to the target notes that have been played, thereby further improving the intelligence level of the smart pillow.

[0058] 330. The terminal device determines the striking force value according to the striking signal, and determines whether the striking force value is within a preset force value range.

[0059] In an embodiment of the present application, the terminal device can pre-set a preset force value interval. After detecting the note and the hitting signal sent by the target smart pillow, the terminal device determines the hitting force value based on the received hitting signal, that is, the pressure value of the target smart pillow when the user hits the target smart pillow. The terminal device then determines whether this hitting force value is within the preset force value interval. If the hitting force value is within the preset force value interval, the terminal device can execute the following step 340; if the hitting force value is not within the preset force value interval, the terminal device can output the next target note in sequence according to the pronunciation order of each target note in a certain music segment. For example, the preset force value interval is [5N, 20N]. The terminal device determines that the hitting force value when the user hits the smart pillow 1 is 10N based on the hitting signal sent by the smart pillow 1. Therefore, the terminal device can determine that the hitting force value of the smart pillow 1 is within the preset force value interval. At this time, the terminal device can execute the following step 340.

[0060] By implementing the above embodiment, the terminal device can determine whether the user is inputting a note based on the strength of the user's hitting, thereby avoiding the wrong input of notes caused by accidentally touching the smart pillow, further improving the intelligence level of the smart pillow.

[0061] 340. The terminal device compares the note presented by the target smart pillow with a target note to obtain a comparison result corresponding to the target note, where the comparison result is a first comparison result or a second comparison result.

[0062] 350. If the comparison result corresponding to a target note is the first comparison result, the terminal device records a correct strike count.

[0063] Exemplarily, the terminal device compares the received note a sent by smart pillow 1 with the target note a played in the order of pronunciation to obtain the comparison result corresponding to the target note a. Here, since note a is the same as target note a, the comparison result is the first comparison result, that is, the target smart pillow receives a hit and sends the target smart note that is the same as a certain target note. At this time, the terminal device records the number of correct hits. If the terminal device receives note b sent by smart pillow 2, then since note b is different from target note a, the comparison result is the second comparison result, that is, the target smart pillow receives a hit and sends the target smart note that is different from a certain target note. At this time, the terminal device does not record the number of correct hits, that is, the terminal device can set a parameter for the number of correct hits, the initial value of this parameter is 0, each time a target note corresponding to the comparison result is the first comparison result, the parameter of the number of correct hits is increased by 1, and each time a target note corresponding to the comparison result is the second comparison result, the parameter of the number of correct hits is increased by 0.

[0064] In some embodiments, after the terminal device compares the note presented by the target smart pillow with a target note and obtains a comparison result corresponding to the target note, it may further perform the following steps:

[0065] If the comparison result corresponding to a certain target note is the second comparison result, the terminal device sends the certain target note to the parent's mobile phone and plays the pronunciation of the certain target note.

[0066] In an embodiment of the present application, after obtaining a comparison result corresponding to each target note, the terminal device determines whether the comparison result is the second comparison result. If the comparison result is the second comparison result, that is, the target note sent by the target smart pillow when it is struck is different from a target note, then the terminal device can send the target note that has been played to the parent's mobile phone and play the pronunciation of the target note on the parent's mobile phone. This can provide feedback to parents if users, especially children, strike the wrong note during music interaction, thereby improving the efficiency of note learning during music interaction and further enhancing the level of intelligence.

[0067] 360. The terminal device outputs the comparison result corresponding to a target note in the form of an audio signal.

[0068] 370. After recording the correct number of strikes according to the comparison results corresponding to each target note, the terminal device counts the number of correct strikes recorded.

[0069] In the embodiments of the present application, the terminal device records the correct hitting number continuously by using the above-mentioned recording method of the correct hitting number according to the comparison result corresponding to each target note, stops recording the correct hitting number after recording the correct hitting number according to the comparison result corresponding to all target notes contained in a certain music section, and counts the recording times of the correct hitting number. For example, the music section 1 contains 4 target notes, wherein the comparison result corresponding to the target note a, the target note b and the target note d is the first comparison result, and the comparison result corresponding to the target note c is the second comparison result. Therefore, according to the comparison result corresponding to the 4 target notes contained in the music section 1, the terminal device can know that the terminal device records the correct hitting number for three times, and the final count of the correct hitting number is 3.

[0070] 380、If the recording times are greater than the preset number threshold, the terminal device starts a certain smart home corresponding to the start instruction associated with a certain music section according to the start instruction associated with a certain music section.

[0071] In the embodiments of the present application, each music section can be associated with a start instruction corresponding to a certain smart home, and the start instruction is used to start the corresponding smart home. For example, the music section 1 can be associated with a start instruction of a television set, and the start instruction is used to control the television set to turn on. The terminal device compares the recording times of the correct hitting number with the preset number threshold, and if the recording times are greater than the preset number threshold, the terminal device acquires the start instruction associated with a certain music section, and sends the start instruction to a certain smart home corresponding to the start instruction, and the certain smart home starts according to the received start instruction. For example, the music section 1 is associated with a start instruction of a television set, the terminal device counts the recording times of the correct hitting number as 3, and the preset number threshold is 2. Therefore, the terminal device can acquire the start instruction associated with the television set, and send the start instruction to the television set to turn on the television set.

[0072] By implementing the above-mentioned embodiments, when the user hits a certain number of correct notes in the music interaction process, the corresponding smart home is started to feedback to the user. For example, when the child hits a certain number of correct notes, the television set is automatically turned on as a reward, which can further improve the intelligent degree of the smart pillow and the interest of the music interaction process.

[0073] In some embodiments, before playing the pronunciation of the first target note in the pronunciation order of the target notes, the terminal device can further perform the following steps:

[0074] The terminal device sends a re-presentation instruction to each smart pillow to control the smart pillow to randomly present all the notes presented on the smart pillow one by one according to the re-presentation instruction;

[0075] After the terminal device finishes playing a target note in the order of the target notes, it detects that the target smart pillow is struck and sends the note presented by the target smart pillow, including:

[0076] After the terminal device finishes playing a certain target note in the order of the target notes, it detects that the target smart pillow is struck and sends a new note presented by the target smart pillow;

[0077] The terminal device compares the musical note presented by the target smart pillow with a target musical note and obtains a comparison result corresponding to the target musical note, including:

[0078] The terminal device compares the new note presented by the target smart pillow with a certain target note and obtains a comparison result corresponding to the certain target note.

[0079] In an embodiment of the present application, the terminal device can send a re-presentation instruction to each smart pillow. Each smart pillow cancels the currently presented note according to the re-presentation instruction sent by the terminal device, and re-presents any one of all the notes presented by several smart pillows at random. The re-presented note is a new note. The new notes presented on any two smart pillows are different. For example, before the terminal device sends the re-presentation instruction to smart pillow 1, smart pillow 2, smart pillow 3 and smart pillow 4, smart pillow 1 presents note a, smart pillow 2 presents note b, smart pillow 3 presents note c, and smart pillow 4 presents note d. After the terminal device sends the re-presentation instruction to smart pillow 1, smart pillow 2, smart pillow 3 and smart pillow 4, smart pillow 1, smart pillow 2, smart pillow 3 and smart pillow 4 randomly present a note as a new note. Specifically, smart pillow 1 presents note d, smart pillow 2 presents note c, smart pillow 3 presents note b, and smart pillow 4 presents note a.

[0080] After the terminal device determines that the target notes of the music segment 1 and the pronunciation order are abcd, the pronunciation of the target note a, target note b, target note c and target note d are played in the pronunciation order of abcd. After the terminal device finishes playing the pronunciation of the target note a, the user can select the target note a according to the target note a played by the terminal device. Figure 2 The user taps any of the four smart pillows in the game. For example, if the user taps smart pillow 1, it becomes the target smart pillow. After being tapped, smart pillow 1 transmits its new note d to the terminal device. After playing the target note a, the terminal device continues to test each smart pillow. Upon detecting the new note d from smart pillow 1, the terminal device stops testing each smart pillow and proceeds to the next step.

[0081] The terminal device compares the new note d received from smart pillow 1 with the target note a played in the correct pronunciation order, and obtains a comparison result corresponding to target note a. Since new note d is different from target note a, the comparison result is the second comparison result, meaning that the new note sent by the target smart pillow upon being struck is different from the target note.

[0082] By implementing the above embodiment, the notes presented by each smart pillow can be changed, and then in the subsequent music interaction process, note learning can be performed based on the new notes presented on each smart pillow, avoiding the situation where the notes presented by the smart pillow are fixed, resulting in low note learning efficiency, and further improving the intelligence level of the smart pillow.

[0083] In some embodiments, each smart home is associated with a note sequence, and each target note in the note sequence is part or all of all notes presented on several smart pillows;

[0084] After the terminal device outputs the comparison results corresponding to all target notes in a certain music segment in the form of audio signals, it can also perform the following steps:

[0085] The terminal device detects the striking order of each target smart pillow and sorts all the notes presented on each target smart pillow according to the striking order of each target smart pillow to form a striking sequence;

[0086] If the terminal device matches the note sequence according to the striking sequence, the smart home associated with the matched note sequence is controlled.

[0087] For example, a room's smart door is associated with a note sequence bdca. After the terminal device outputs the comparison results corresponding to target notes a, b, c, and d in music segment 1 as audio signals, the user can then continue to strike each smart pillow. The struck smart pillows are then also the target smart pillows. Here, the user strikes smart pillows 2, 4, 3, and 1 in sequence. After being struck, smart pillows 2, 4, 3, and 1 transmit their pillow identifiers, such as pillow1, to the terminal device. Based on the order of the received pillow identifiers, the terminal device determines the order in which the four target smart pillows should be struck: smart pillow 2, 4, 3, and 1. Smart pillows 2, 4, 3, and 1 then transmit the presented notes a, b, c, and d, respectively, to the terminal device. Based on this striking order, the terminal device determines the note sequence as bdca. The terminal device can then match the determined note sequence bdca with the note sequences associated with each smart home appliance, specifically determining whether the note sequence bdca is the same as the note sequence associated with each smart home appliance. Therefore, the terminal device can determine that the note sequence bdca is the same as the note sequence bdca associated with the room's smart door. At this point, the terminal device can control the room's smart door to open or close. Specifically, the terminal device can control the room's smart door to close when it is open, and to open when it is closed.

[0088] By implementing the above embodiment, the user can control other smart home appliances by inputting musical notes by hitting the smart pillow. The user can conveniently control the smart home appliance without moving after the music interaction ends, thereby improving the intelligence level of the smart pillow and the control efficiency of the smart home appliance.

[0089] See also Figure 4 , Figure 4 This is a schematic diagram of the structure of the first embodiment of the terminal device disclosed in the embodiment of this application. In the embodiment of this application, the terminal device is connected to a number of smart pillows for communication. Each smart pillow has a musical note, and the musical notes displayed on any two smart pillows are different. Figure 4 As shown, the terminal device 400 may include: a note determination unit 410 , a note detection unit 420 , a note comparison unit 430 and a result output unit 440 .

[0090] The note determination unit 410 is used to determine the pronunciation order of each target note contained in a certain music segment; each target note is part or all of the notes presented on the plurality of smart pillows;

[0091] The note detection unit 420 is configured to detect the note presented by the target smart pillow when the target smart pillow is struck after the pronunciation of a target note is played in the pronunciation order of the target notes; the target smart pillow is any one of the multiple smart pillows;

[0092] The note comparison unit 430 is used to compare the note presented by the target smart pillow with a target note to obtain a comparison result corresponding to the target note;

[0093] The result output unit 440 is configured to output the comparison result corresponding to a target note in the form of an audio signal.

[0094] In some embodiments, the note detection unit 420 is further configured to:

[0095] After the pronunciation of a certain target note is played in the pronunciation order of each target note, the smart pillow presenting the target note is controlled to output prompt information; and the note presented by the target smart pillow is detected to be sent when the target smart pillow is hit.

[0096] By implementing the above embodiment, corresponding prompts can be output according to the target notes that have been played, thereby further improving the intelligence level of the smart pillow.

[0097] In some embodiments, the note detection unit 420 is further configured to:

[0098] detecting a striking signal sent by a target smart pillow when it is struck and a musical note presented by the target smart pillow;

[0099] The note comparison unit 430 is further configured to determine a striking force value based on the striking signal and determine whether the striking force value is within a preset force value range before comparing the note presented by the target smart pillow with a target note to obtain a comparison result corresponding to the target note;

[0100] If so, an operation is performed to compare the note presented by the target smart pillow with a certain target note to obtain a comparison result corresponding to the certain target note.

[0101] By implementing the above embodiment, the terminal device can determine whether the user is inputting a note based on the strength of the user's hitting, thereby avoiding the wrong input of notes caused by accidentally touching the smart pillow, further improving the intelligence level of the smart pillow.

[0102] In some embodiments, a certain music segment is associated with a startup instruction corresponding to a certain smart home; the comparison result is a first comparison result or a second comparison result;

[0103] Figure 4 As shown, the terminal device also includes:

[0104] The home control unit 450 is configured to compare the note presented by the target smart pillow with a target note in the note comparison unit 430, and obtain a comparison result corresponding to the target note. If the comparison result corresponding to the target note is a first comparison result, the terminal device records a correct hit count;

[0105] After recording the correct number of strikes according to the comparison results corresponding to each target note, the number of correct strikes recorded is counted;

[0106] If the number of records is greater than a preset threshold, a smart home corresponding to the start instruction is started according to the start instruction associated with a certain music segment.

[0107] By implementing the above embodiment, when the user hits a certain number of notes correctly during the music interaction process, the corresponding smart home is turned on to provide feedback to the user. For example, when a child hits a certain number of notes correctly, the TV is automatically turned on as a reward. This can further improve the intelligence of the smart pillow and increase the fun of the music interaction process.

[0108] In some embodiments, Figure 4 As shown, the smart pillow also includes:

[0109] The note feedback unit 460 is used to compare the note presented by the target smart pillow with a certain target note in the note comparison unit 430, and after obtaining the comparison result corresponding to the certain target note, if the comparison result corresponding to the certain target note is the second comparison result, send the certain target note to the parent's mobile phone and play the pronunciation of the certain target note.

[0110] The implementation of the above embodiment can provide parents with feedback on users, especially children, hitting wrong notes during music interaction, thereby improving the efficiency of note learning during music interaction and further improving the level of intelligence.

[0111] In some embodiments, several smart pillows include airbags.

[0112] Figure 4 As shown, the terminal device also includes:

[0113] The pillow adjustment unit 470 is used to send an airbag adjustment instruction to the smart pillow presenting each target note after the note determination unit 410 determines the pronunciation order of each target note contained in a certain music segment, and before the music detection unit 420 plays the pronunciation of the first target note according to the pronunciation order of each target note, so as to control the smart pillow to adjust the total amount of gas of the included airbags according to the airbag adjustment instruction, so that the total amount of gas of each airbag meets the total amount of gas range.

[0114] By implementing the above embodiment, during the process of musical interaction by hitting the smart pillow, the hitting action will not cause discomfort, nor will the smart pillow be damaged due to the user's hitting action, thereby further improving the intelligence level of the smart pillow.

[0115] In some embodiments, the pillow adjustment unit 470 is further configured to send a re-presentation instruction to each smart pillow before the note detection unit 420 plays the pronunciation of the first target note in the pronunciation order of the target notes, so as to control the smart pillows to randomly present all the notes presented on the smart pillows one by one according to the re-presentation instruction;

[0116] The note detection unit 420 is further configured to detect a new note presented by the target smart pillow when the target smart pillow is struck, after the pronunciation of a target note is played in the pronunciation order of the target notes;

[0117] The note comparison unit 430 is further configured to compare the new note presented by the target smart pillow with a target note to obtain a comparison result corresponding to the target note.

[0118] By implementing the above embodiment, the notes presented by each smart pillow can be changed, and then in the subsequent music interaction process, note learning can be performed based on the new notes presented on each smart pillow, avoiding the situation where the notes presented by the smart pillow are fixed, resulting in low note learning efficiency, and further improving the intelligence level of the smart pillow.

[0119] In some embodiments, each smart home is associated with a note sequence, and each target note in the note sequence is part or all of all notes presented on several smart pillows.

[0120] The home control unit 450 is further configured to detect the striking order of each target smart pillow after the result output unit 440 outputs the comparison result corresponding to all target notes in a music segment in the form of an audio signal, and to sort all the notes presented on each target smart pillow according to the striking order of each target smart pillow to form a striking sequence;

[0121] If a note sequence is matched according to the striking sequence, the smart home associated with the matched note sequence is controlled.

[0122] By implementing the above embodiment, the user can control other smart home appliances by inputting musical notes by hitting the smart pillow. The user can conveniently control the smart home appliance without moving after the music interaction ends, thereby improving the intelligence level of the smart pillow and the control efficiency of the smart home appliance.

[0123] See also Figure 5 , Figure 5 This is a schematic diagram of the structure of the second embodiment of the terminal device disclosed in the embodiment of this application. In the embodiment of this application, the terminal device is connected to a number of smart pillows for communication, each of which has a musical note, and the musical notes displayed on any two smart pillows are different. Figure 5 As shown, the terminal device 500 includes:

[0124] A memory 510 storing executable program code;

[0125] a processor 520 coupled to a memory;

[0126] The processor 520 calls the executable program code stored in the memory 510 and performs the following steps:

[0127] Determining the pronunciation order of target notes contained in a certain music segment; the target notes are part or all of the notes presented on the plurality of smart pillows;

[0128] After playing a target note in the order of the target notes, detecting that a target smart pillow is struck and sending the note presented by the target smart pillow; the target smart pillow is any one of the multiple smart pillows;

[0129] Comparing the musical note presented by the target smart pillow with the target musical note to obtain a comparison result corresponding to the target musical note;

[0130] The comparison result corresponding to the target note is output in the form of an audio signal.

[0131] In some embodiments, after the processor 520 finishes playing a target note in the order of the target notes, the processor 520 detects that the target smart pillow is struck and sends the note presented by the target smart pillow in the following manner:

[0132] After the pronunciation of a certain target note is played in the pronunciation order of the target notes, the smart pillow presenting the target note is controlled to output a prompt message; and the note presented by the target smart pillow is detected to be sent when the target smart pillow is hit.

[0133] In some embodiments, the processor 520 detects that the target smart pillow is struck and sends the musical note presented by the target smart pillow in the following manner:

[0134] detecting a striking signal sent by a target smart pillow when it is struck and a musical note presented by the target smart pillow;

[0135] Before comparing the musical note presented by the target smart pillow with the target musical note to obtain a comparison result corresponding to the target musical note, the processor 520 further performs the following steps:

[0136] Determining a striking force value according to the striking signal, and judging whether the striking force value is within a preset force value range;

[0137] If so, perform the step of comparing the note presented by the target smart pillow with the target note to obtain a comparison result corresponding to the target note.

[0138] In some embodiments, the certain music segment is associated with a startup instruction corresponding to a certain smart home; the comparison result is the first comparison result or the second comparison result;

[0139] After comparing the note presented by the target smart pillow with the target note and obtaining a comparison result corresponding to the target note, the processor 520 further performs the following steps:

[0140] If the comparison result corresponding to the target note is the first comparison result, the correct number of hits is recorded;

[0141] After recording the correct number of strikes according to the comparison results corresponding to the target notes, counting the number of records of the correct number of strikes;

[0142] If the number of records is greater than a preset number threshold, a smart home corresponding to the startup instruction is started according to the startup instruction associated with the certain music segment.

[0143] In some embodiments, after comparing the musical note presented by the target smart pillow with the target musical note and obtaining a comparison result corresponding to the target musical note, the processor 520 further performs the following steps:

[0144] If the comparison result corresponding to the certain target note is the second comparison result, the certain target note is sent to the parent's mobile phone, and the pronunciation of the certain target note is played.

[0145] In some embodiments, several smart pillows include airbags;

[0146] After determining the pronunciation order of the target notes included in a certain music segment and before playing the pronunciation of the first target note according to the pronunciation order of the target notes, the processor 520 may further perform the following steps:

[0147] An airbag adjustment instruction is sent to the smart pillow that presents each target note to control the smart pillow to adjust the total amount of gas in the included airbags according to the airbag adjustment instruction so that the total amount of gas in each airbag meets the total amount of gas range.

[0148] In some embodiments, the processor 520 may further perform the following steps before playing the pronunciation of the first target note in the pronunciation order of the target notes:

[0149] Sending a re-presentation instruction to each smart pillow to control the smart pillows to randomly present all the notes presented on the smart pillows one by one according to the re-presentation instruction;

[0150] After the processor 520 finishes playing a target note in the order of the target notes, it detects that the target smart pillow is struck and sends the note presented by the target smart pillow in the following manner:

[0151] After the pronunciation of a certain target note is played in the pronunciation order of the target notes, a new note presented by the target smart pillow is detected when the target smart pillow is struck;

[0152] The processor 520 compares the musical note presented by the target smart pillow with a target musical note, and obtains the comparison result corresponding to the target musical note in the following manner:

[0153] The new musical note presented by the target smart pillow is compared with a certain target musical note to obtain a comparison result corresponding to the certain target musical note.

[0154] In some embodiments, each smart home is associated with a note sequence, and each target note in the note sequence is part or all of all notes presented on several smart pillows;

[0155] After the processor 520 outputs the comparison results corresponding to all target notes in a certain music segment in the form of audio signals, it may further perform the following steps:

[0156] Detecting the striking order of each target smart pillow, and sorting all the notes presented on each target smart pillow according to the striking order of each target smart pillow to form a striking sequence;

[0157] If a note sequence is matched according to the striking sequence, the smart home associated with the matched note sequence is controlled.

[0158] It should be noted that the processor 520 may also execute other steps described in the previous embodiments, which are not described in detail here.

[0159] Among them, implementation Figure 5 The terminal device shown can enable users to interact with music using a smart pillow, and the smart pillow hit by the user during the interaction can send the presented notes to the terminal device, so that the terminal device can determine whether the notes input by the user interaction are correct, and can help users learn different notes or even music segments, thereby improving the intelligence level of the smart pillow.

[0160] An embodiment of the present application further discloses a computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the steps of the music interaction method based on the smart pillow described in the previous embodiment.

[0161] The above is a detailed introduction to the music interaction method based on a smart pillow, the terminal device, and the storage medium disclosed in the embodiment of the present application. Specific examples are used in this article to illustrate the principles and embodiments of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for general technical personnel in this field, according to the idea of ​​the present application, there will be changes in the specific embodiments and application scope. In summary, the content of this specification should not be understood as a limitation on the application.

Claims

1. A music interaction method based on a smart pillow, characterized in that: The terminal device is communicatively connected to a plurality of smart pillows, each of which displays a musical note, and the musical notes displayed on any two smart pillows are different. The method includes: The terminal device determines the pronunciation order of each target note contained in a certain music segment; the target notes are part or all of all the notes presented on the plurality of smart pillows; After the terminal device finishes playing a target note in the order of the target notes, it detects that a target smart pillow is struck and transmits the note presented by the target smart pillow; the target smart pillow is any one of the multiple smart pillows; The terminal device compares the note presented by the target smart pillow with the target note to obtain a comparison result corresponding to the target note, where the comparison result is a first comparison result or a second comparison result; The terminal device outputs the comparison result corresponding to the target note in the form of an audio signal; If the comparison result corresponding to the target note is the first comparison result, the terminal device records a correct number of strikes; after recording the correct number of strikes according to the comparison results corresponding to the target notes, the terminal device counts the number of records of the correct number of strikes; if the number of records is greater than a preset number threshold, the terminal device starts a smart home corresponding to the startup instruction according to the startup instruction associated with the music segment, and the music segment is associated with the startup instruction corresponding to the smart home; or, The terminal device detects the striking order of each target smart pillow, and sorts all the notes presented on each target smart pillow according to the striking order of each target smart pillow to form a striking sequence; if the terminal device matches a note sequence according to the striking sequence, it controls the smart home associated with the matched note sequence. Each smart home is associated with a note sequence, and each target note in the note sequence is part or all of all the notes presented on the several smart pillows.

2. The music interaction method according to claim 1, characterized in that: After the terminal device finishes playing a target note in the pronunciation order of the target notes, the terminal device detects that the target smart pillow is struck and sends the note presented by the target smart pillow, including: After the terminal device finishes playing the pronunciation of a certain target note in the pronunciation order of the target notes, it controls the smart pillow presenting the target note to output prompt information; and detects that the target smart pillow is hit and sends the note presented by the target smart pillow.

3. The music interaction method according to claim 2, characterized in that: The terminal device detects that the target smart pillow is hit and sends the musical note presented by the target smart pillow, including: The terminal device detects a striking signal sent by the target smart pillow when it is struck and a musical note presented by the target smart pillow; Before the terminal device compares the note presented by the target smart pillow with the target note to obtain a comparison result corresponding to the target note, the method further includes: The terminal device determines a striking force value according to the striking signal, and determines whether the striking force value is within a preset force value range; If so, perform the step of comparing the note presented by the target smart pillow with the target note to obtain a comparison result corresponding to the target note.

4. The music interaction method according to claim 1, characterized in that: After the terminal device compares the note presented by the target smart pillow with the target note and obtains a comparison result corresponding to the target note, the method further includes: If the comparison result corresponding to the certain target note is the second comparison result, the terminal device sends the certain target note to the parent's mobile phone and plays the pronunciation of the certain target note.

5. A terminal device, characterized in that: The terminal device is communicatively connected to a plurality of smart pillows, each of which displays a musical note, and the musical notes displayed on any two smart pillows are different. The terminal device includes: a note determination unit, configured to determine the pronunciation order of target notes contained in a music segment; the target notes being some or all of the notes presented on the plurality of smart pillows; a note detection unit, configured to detect, after playing a target note in the order of the target notes, the note presented by the target smart pillow when the target smart pillow is struck; the target smart pillow being any one of the plurality of smart pillows; a note comparison unit, configured to compare the note presented by the target smart pillow with the target note to obtain a comparison result corresponding to the target note, wherein the comparison result is a first comparison result or a second comparison result; A result output unit, configured to output the comparison result corresponding to the target note in the form of an audio signal; A home control unit, configured to record a correct number of strikes by the terminal device if the comparison result corresponding to a certain target note is the first comparison result; after recording the correct number of strikes according to the comparison results corresponding to each target note, the terminal device counts the number of records of the correct number of strikes; if the number of records is greater than a preset threshold, the terminal device starts a smart home corresponding to the start-up instruction according to the start-up instruction associated with the certain music segment, and the certain music segment is associated with the start-up instruction corresponding to the certain smart home; or, the terminal device detects the striking order of each target smart pillow, and sorts all the notes presented on each target smart pillow according to the striking order of each target smart pillow to form a striking sequence; if the terminal device matches a note sequence according to the striking sequence, it controls the smart home associated with the matched note sequence, and each smart home is associated with a note sequence, and each target note in the note sequence is part or all of all the notes presented on the several smart pillows.

6. A terminal device, characterized in that: The terminal device is communicatively connected to a plurality of smart pillows, each of which displays a musical note, and the musical notes displayed on any two smart pillows are different. The terminal device includes: a memory storing executable program code; a processor coupled to the memory; The processor calls the executable program code stored in the memory and performs the following steps: Determining the pronunciation order of target notes contained in a certain music segment; the target notes are part or all of the notes presented on the plurality of smart pillows; After playing a target note in the order of the target notes, detecting that a target smart pillow is struck and sending the note presented by the target smart pillow; the target smart pillow is any one of the multiple smart pillows; Comparing the musical note presented by the target smart pillow with the target musical note to obtain a comparison result corresponding to the target musical note, where the comparison result is a first comparison result or a second comparison result; Outputting the comparison result corresponding to the target note in the form of an audio signal; If the comparison result corresponding to the target note is the first comparison result, the terminal device records a correct number of strikes; after recording the correct number of strikes according to the comparison results corresponding to the target notes, the terminal device counts the number of records of the correct number of strikes; if the number of records is greater than a preset number threshold, the terminal device starts a smart home corresponding to the startup instruction according to the startup instruction associated with the music segment, and the music segment is associated with the startup instruction corresponding to the smart home; or, The terminal device detects the striking order of each target smart pillow, and sorts all the notes presented on each target smart pillow according to the striking order of each target smart pillow to form a striking sequence; if the terminal device matches a note sequence according to the striking sequence, it controls the smart home associated with the matched note sequence. Each smart home is associated with a note sequence, and each target note in the note sequence is part or all of all the notes presented on the several smart pillows.

7. The terminal device according to claim 6, characterized in that After the processor finishes playing the pronunciation of a certain target note in the pronunciation order of the target notes, the processor detects that the target smart pillow is struck and sends the note presented by the target smart pillow in the following manner: After the pronunciation of a certain target note is played in the pronunciation order of the target notes, controlling the smart pillow presenting the target note to output prompt information; and detecting the musical note presented by the target smart pillow when the target smart pillow is hit.

8. The terminal device according to claim 7, characterized in that The processor detects that the target smart pillow is hit and sends the musical note presented by the target smart pillow in the following manner: detecting a striking signal sent by a target smart pillow when it is struck and a musical note presented by the target smart pillow; Before comparing the note presented by the target smart pillow with the target note to obtain a comparison result corresponding to the target note, the processor further performs the following steps: Determining a striking force value according to the striking signal, and judging whether the striking force value is within a preset force value range; If so, perform the step of comparing the note presented by the target smart pillow with the target note to obtain a comparison result corresponding to the target note.

9. The terminal device according to claim 6, characterized in that After comparing the note presented by the target smart pillow with the target note and obtaining a comparison result corresponding to the target note, the processor further performs the following steps: If the comparison result corresponding to the certain target note is the second comparison result, the certain target note is sent to the parent's mobile phone, and the pronunciation of the certain target note is played.

10. A storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the music interaction method based on the smart pillow are implemented.

Citation Information

Patent Citations

  • A multi-user interactive entertainment system

    CN109782984A

  • Language learning information interaction method, device and equipment

    CN114913307A

  • Multifunctional pillow

    WO2018000315A1