Vehicle-mounted music playing control method and device, storage medium and electronic equipment
Patent Information
- Application Number
- CN202110899846.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-08-06
- Publication Date
- 2026-09-15
- Estimated Expiration
- 2041-08-06
AI Technical Summary
[0003]本发明提供了一种车载音乐播放控制方法、装置、计算机可读存储介质及电子设备,以解决现有的车载音乐播放控制方法操作不方便、控制效果较差的技术问题
[0022] The technical solution provided by this invention acquires the current gesture data of a target object, then identifies the static actions contained within the current gesture data. Different gesture data include different numbers and types of static actions, meaning that the technical solution provided by this invention allows for both static and dynamic gestures. Further, based on the identified static actions, the current tag information corresponding to the current gesture data is determined. Based on the current tag information, static actions, and preset data information, a first target control action is accurately determined. The preset data information includes the mapping relationship between gesture actions and control actions, as well as preset tag information. Then, the playback control of in-vehicle music is performed according to the first target control action. The technical solution provided by this invention utilizes gestures to control in-vehicle music, which is convenient to operate and has good control effects. Furthermore, because gesture data can contain different numbers and types of static actions, and different tag information is set for different static actions, the target control action can be accurately determined, effectively increasing the number of gestures for controlling in-vehicle music and meeting various user control needs.
Smart Images

Figure CN115705178B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of music playback technology, and more specifically, to in-vehicle music playback control methods, devices, storage media, and electronic devices. Background Technology
[0002] While driving or riding in a vehicle, users often choose to play in-car music. Currently, the main methods for playing in-car music are touchscreen control and voice control. Touchscreen control requires users to manually click buttons on the vehicle's screen to control music playback, which is inconvenient and poses safety hazards. Voice control requires users to issue voice commands to control music playback, but during music playback, voice commands may not be accurately captured, resulting in poor control performance. Therefore, determining a more effective and safer method for controlling in-car music playback is of great importance. Summary of the Invention
[0003] This invention provides a method, device, computer-readable storage medium, and electronic device for controlling in-vehicle music playback, in order to solve the technical problems of inconvenient operation and poor control effect of existing in-vehicle music playback control methods.
[0004] Firstly, a method for controlling in-vehicle music playback is provided, which specifically includes the following steps:
[0005] Get the current gesture data of the target object;
[0006] The current gesture data is identified to determine the static actions contained in the current gesture data;
[0007] Based on the static action, determine the current tag information corresponding to the current gesture data;
[0008] Based on the current tag information, the static action, and the preset data information, a first target control action is determined; wherein the preset data information includes the mapping relationship between gesture actions and control actions and preset tag information.
[0009] The in-vehicle music playback is controlled based on the first target control action.
[0010] Secondly, an in-vehicle music control device is provided, specifically including the following modules:
[0011] The gesture data acquisition module is used to acquire the current gesture data of the target object;
[0012] A static action determination module is used to identify the current gesture data and determine the static actions contained in the current gesture data;
[0013] The tag information determination module is used to determine the current tag information corresponding to the current gesture data based on the static action;
[0014] The control action determination module is used to determine a first target control action based on the current tag information, the static action, and preset data information; wherein the preset data information includes the mapping relationship between gesture actions and control actions and preset tag information;
[0015] The music playback control module is used to control the playback of in-vehicle music based on the first target control action.
[0016] Thirdly, a computer-readable storage medium is provided, the storage medium storing a computer program for executing the above-described in-vehicle music playback control method.
[0017] Fourthly, an electronic device is provided, the electronic device comprising:
[0018] processor;
[0019] Memory used to store the processor's executable instructions;
[0020] The processor is configured to read the executable instructions from the memory and execute the instructions to implement the above-described in-vehicle music playback control method.
[0021] Compared with the prior art, the in-vehicle music playback control method, device, computer-readable storage medium, and electronic device provided by the present invention have at least the following beneficial effects:
[0022] The technical solution provided by this invention acquires the current gesture data of a target object, then identifies the static actions contained within the current gesture data. Different gesture data include different numbers and types of static actions, meaning that the technical solution provided by this invention allows for both static and dynamic gestures. Further, based on the identified static actions, the current tag information corresponding to the current gesture data is determined. Based on the current tag information, static actions, and preset data information, a first target control action is accurately determined. The preset data information includes the mapping relationship between gesture actions and control actions, as well as preset tag information. Then, the playback control of in-vehicle music is performed according to the first target control action. The technical solution provided by this invention utilizes gestures to control in-vehicle music, which is convenient to operate and has good control effects. Furthermore, because gesture data can contain different numbers and types of static actions, and different tag information is set for different static actions, the target control action can be accurately determined, effectively increasing the number of gestures for controlling in-vehicle music and meeting various user control needs. Attached Figure Description
[0023] To more clearly illustrate the technical solution of the present invention, the accompanying drawings used in the description of the present invention will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0024] Figure 1 This is a flowchart illustrating an exemplary embodiment of the in-vehicle music playback control method provided by the present invention. Figure 1 ;
[0025] Figure 2 This is a flowchart illustrating an exemplary embodiment of the in-vehicle music playback control method provided by the present invention. Figure 2 ;
[0026] Figure 3 This is a flowchart illustrating an exemplary embodiment of the in-vehicle music playback control method provided by the present invention. Figure 3 ;
[0027] Figure 4 This is a flowchart illustrating an exemplary embodiment of the in-vehicle music playback control method provided by the present invention. Figure 4 ;
[0028] Figure 5 This is a flowchart illustrating an exemplary embodiment of the in-vehicle music playback control method provided by the present invention. Figure 5 ;
[0029] Figure 6 This is a schematic diagram of the structure of an in-vehicle music control device provided in an exemplary embodiment of the present invention;
[0030] Figure 7 This is a structural diagram of an electronic device provided in an exemplary embodiment of the present invention. Detailed Implementation
[0031] The technical solutions of this invention will now be clearly and completely described with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this invention. All other embodiments obtained by those skilled in the art based on the embodiments of this invention without creative effort are within the scope of protection of the embodiments of this invention.
[0032] While driving or riding in a vehicle, users often choose to play in-car music. Currently, in-car music playback is mainly controlled by touchscreen and voice. Touchscreen control requires users to manually click relevant buttons on the vehicle's screen to control music playback, which is inconvenient and poses safety hazards. Voice control requires users to issue voice commands to control music playback, but during music playback, voice commands may not be accurately captured, resulting in poor control performance. To address the technical problems of inconvenient operation and poor control performance of existing in-car music playback control methods, this invention provides the following exemplary methods, devices, electronic devices, computer program products, and readable storage media.
[0033] Exemplary methods
[0034] Figure 1 This is a flowchart illustrating an exemplary embodiment of the in-vehicle music playback control method provided by the present invention, which specifically includes the following steps:
[0035] Step 101: Obtain the current gesture data of the target object.
[0036] In one embodiment, current gesture data refers to the data of the target object's hand movements acquired at the current moment. Specifically, the current gesture data of the target object can be acquired using an image acquisition device.
[0037] Step 102: Recognize the current gesture data to determine the static actions contained in the current gesture data.
[0038] In one embodiment, after recognizing the current gesture data, the type and number of static actions contained in the current gesture data can be determined. Specifically, the current gesture data can be static gestures and dynamic gestures. That is, when determining the static actions included in the current gesture data, at least one static action may be determined. For static gestures, one static action can be determined; for dynamic gestures, two or more static actions can be determined. In other words, this embodiment allows control of in-vehicle music via dynamic gestures, where dynamic gestures can be performed by making a series of different static gestures in a short period of time.
[0039] Step 103: Based on the static action, determine the current tag information corresponding to the current gesture data.
[0040] In one embodiment, since there are static and dynamic gestures, there may be a situation where the initial static action of dynamic gesture A is the same as that of static gesture B. In order to accurately control the in-vehicle music, tag information is set for the gesture actions, so that after determining the static action, the current tag information corresponding to the current gesture data is further determined. The specific current tag information may include static and dynamic gestures, and other tags may also be set, which is not limited in this embodiment.
[0041] Step 104: Based on the current tag information, the static action, and the preset data information, determine the first target control action; wherein the preset data information includes the mapping relationship between gesture actions and control actions and preset tag information.
[0042] In one embodiment, when determining the first target control action, the current tag information, static actions, and preset data information are matched, including matching the current tag information with preset tag information, and matching static actions with gesture actions. Based on the final matching result, the first target control action is determined. Thus, by matching tag information, the determination of the first target control action is ensured to be more accurate and faster.
[0043] Step 105: Control the playback of in-vehicle music based on the first target control action.
[0044] In the above embodiments, the current gesture data of the target object is acquired, and then the current gesture data is identified to determine the static actions contained in the current gesture data. Different gesture data include different numbers and types of static actions, meaning that the technical solution provided in this embodiment allows the existence of both static and dynamic gestures. Further, based on the determined static actions, the current tag information corresponding to the current gesture data is determined. Based on the current tag information, static actions, and preset data information, the first target control action is accurately determined. The preset data information includes the mapping relationship between gesture actions and control actions, and preset tag information. Then, the playback control of in-vehicle music is performed according to the first target control action. The technical solution provided in this embodiment uses gestures to control in-vehicle music, which is convenient to operate and has a good control effect. At the same time, because the gesture data can contain different numbers and types of static actions, and different tag information is set for different static actions, the target control action can be accurately determined, effectively increasing the number of gestures for controlling in-vehicle music and meeting various user control needs.
[0045] like Figure 2 As shown above, in the above Figure 1 Based on the illustrated embodiment, in an exemplary embodiment of the present invention, the method further includes:
[0046] Step 106: Obtain the user's voice data.
[0047] Step 107: Recognize the voice data to determine the second target control action.
[0048] Step 108: Control the playback of in-vehicle music based on the second target control action.
[0049] In the above embodiment, user voice data is acquired, the voice data is recognized, and based on the voice recognition result, the user's intended action is extracted from the voice recognition result. This intended action is used as a second target control action, and the second target control action is used to control the in-vehicle music, thus enabling the user to control the in-vehicle music via voice. This embodiment not only allows control of the in-vehicle music using gestures but also allows control using voice, giving the user selectivity and convenience when controlling the in-vehicle music.
[0050] In one possible application scenario, when no music is playing, the target user can choose to control the in-car music system using voice commands. When music is playing, to ensure high playback quality, the target user can choose to use gestures to play the music. It should be noted that when controlling the in-car music system by voice, the user issuing the voice command can be anyone in the car, including the driver and passengers. Voice control permissions can also be set. After acquiring the user's voice data, voiceprint analysis is performed. Based on the voiceprint analysis results, it is determined whether the voice data belongs to an authorized target user. If so, the voice data is recognized to determine the next target control action; otherwise, the current process stops.
[0051] like Figure 3 As shown above, in the above Figure 1 or Figure 2 Based on the illustrated embodiment, in an exemplary embodiment of the present invention, the method further includes:
[0052] Step 109: Based on the received gesture control setting instructions, obtain the user's set gesture actions.
[0053] In one embodiment, users are allowed to customize their in-vehicle music control gestures to suit different user habits. Specifically, a gesture setting item is added to the settings of the in-vehicle music application. When a user clicks on this gesture setting item, the vehicle system receives a gesture control setting command. Based on this command, the system prompts the user to perform the setting gesture action and uses an image acquisition device to capture the user's gesture action.
[0054] Step 110: Recognize the set gesture action and display the gesture recognition result.
[0055] In one embodiment, after obtaining the user's set gesture action, the set gesture action is identified and the gesture recognition result is displayed so that the user can determine whether the displayed gesture recognition result is consistent with the gesture that the user intended to set.
[0056] Step 111: Based on the user's confirmation command of the gesture recognition result, display the music playback control action settings.
[0057] In one embodiment, if the user confirms that the displayed gesture recognition result matches the gesture the user intends to set, the user will confirm the gesture recognition result, such as by pressing the confirmation button. At this time, the vehicle system will receive the user's confirmation instruction for the gesture recognition result and display the music playback control action settings, that is, determine how the user intends to control the in-vehicle music with the set gesture. The action settings include, but are not limited to, play, pause, previous track, next track, previous three tracks, next three tracks, play music of the target music type, and play the target song. When the user selects the action setting of playing music of the target music type, the user will be further prompted to select the target music type; when the user selects the action setting of playing the target song, the user will be further prompted to select the target song.
[0058] Step 112: Based on the user's settings for the action settings, determine the mapping relationship between gesture actions and control actions.
[0059] In one embodiment, the user selects an action setting item, and based on the user's selection of the action setting item, a mapping relationship between gesture actions and control actions is determined. After the mapping relationship is established, the user can use the gestures he / she sets to control the in-vehicle music.
[0060] In the above embodiments, users are allowed to set their own in-vehicle music control gestures and determine the relationship between the set gestures and control actions, which satisfies the user's need for autonomy, brings more convenience to the user, and improves the user experience.
[0061] like Figure 4 As shown above, in the above Figure 1 , Figure 2 or Figure 3 Based on the illustrated embodiment, in an exemplary embodiment of the present invention, step 104 determines a first target control action based on the current tag information, the static action, and preset data information, including:
[0062] Step 1041: Based on the current tag information, filter out the data information to be matched from the preset data information;
[0063] Step 1042: Based on the static action and the data information to be matched, determine the first target control action.
[0064] In the above embodiments, the current label information is matched with the preset label information in the preset data information. If the preset label information C matches the current label information, the preset data corresponding to the preset label information C is filtered out as the data information to be matched. That is to say, the data information to be matched refers to the data information that matches the preset label information and the current label information, thereby narrowing the matching range. Then, based on the static action and the gesture action corresponding to the data information to be matched, the first target control action is determined, which can determine the first target control action more quickly and accurately.
[0065] In an exemplary embodiment of the present invention, determining the first target control action based on the static action and the data information to be matched includes: if the static action is an OK gesture, then determining the first target control action as starting music playback based on the data information to be matched. That is, using an OK gesture to control music playback.
[0066] In an exemplary embodiment of the present invention, determining the first target control action based on the static action and the data information to be matched includes: if the static action is a thumbs-up gesture, then determining the first target control action as turning up the volume based on the data information to be matched. That is, using a thumbs-up gesture to control turning up the volume.
[0067] In an exemplary embodiment of the present invention, determining the first target control action based on the static action and the data information to be matched includes: if the static action is a thumbs-down gesture, then determining the first target control action as turning down the volume based on the data information to be matched. That is, using a thumbs-down gesture to control turning down the volume.
[0068] In an exemplary embodiment of the present invention, determining the first target control action based on the static action and the data information to be matched includes: if the static action is pointing the index and middle fingers upwards, then determining the first target control action as switching to the previous song based on the data information to be matched. That is, using a gesture where the static action is pointing the index and middle fingers upwards to control switching to the previous song.
[0069] In an exemplary embodiment of the present invention, determining the first target control action based on the static action and the data information to be matched includes: if the static action is pointing the index and middle fingers downwards, then determining the first target control action as switching to the next song based on the data information to be matched. That is, using a gesture with the index and middle fingers pointing downwards as the static action to control switching to the next song.
[0070] In an exemplary embodiment of the present invention, determining the first target control action based on the static action and the data information to be matched includes: if the static action is a heart gesture, then determining the first target control action as a favorite based on the data information to be matched. That is, using a heart gesture to control the favorite action.
[0071] In an exemplary embodiment of the present invention, determining the first target control action based on the static action and the data information to be matched includes: if the static action is a fist clenching, then determining the first target control action as turning off music playback based on the data information to be matched. That is, using a fist clenching gesture to control music playback to turn off.
[0072] It should be noted that the above embodiments for determining the first target control action based on the static action and the data information to be matched can be selected and used by the user as needed. In one possible implementation, determining the first target control action based on the static action and the data to be matched includes: if the static action is an OK gesture, then based on the data to be matched, determining the first target control action as starting music playback; if the static action is a thumbs-up gesture, then based on the data to be matched, determining the first target control action as turning up the volume; if the static action is a thumbs-down gesture, then based on the data to be matched, determining the first target control action as turning down the volume; if the static action is an index and middle finger pointing upwards, then based on the data to be matched, determining the first target control action as switching to the previous song; if the static action is an index and middle finger pointing downwards, then based on the data to be matched, determining the first target control action as switching to the next song; if the static action is a heart gesture, then based on the data to be matched, determining the first target control action as adding to favorites; if the static action is a clenched fist, then based on the data to be matched, determining the first target control action as turning off music playback. This embodiment provides a complete set of music playback control gestures. These gestures are simple, convenient, and conform to the habits of more users, making them easy for users to use.
[0073] like Figure 5 As shown, in Figure 1 Based on the illustrated embodiment, in an exemplary embodiment of the present invention, after step 102 determines that the current gesture data contains a static action, the method further includes:
[0074] Step 113: Determine the usage status of the in-car music system.
[0075] In one embodiment, when determining the usage status of the in-vehicle music system, there are two possible outcomes: the in-vehicle music system is on or off.
[0076] Then, step 104 determines the first target control action based on the current tag information, the static action, and the preset data information, including:
[0077] Step 1043: If the usage state is off, determine whether the current tag information is the target tag information and whether the static action is the target action; if the current tag information is not the target tag information or the static action is not the target action, stop the current process; if the current tag information is the target tag information and the static action is the target action, determine that the first target control action is to start music playback.
[0078] In one embodiment, when the in-car music is off, music playback is only enabled for the current gesture data where the current tag information is the target tag information and the static action is the target action. For gestures where the current tag information is not the target tag and the static action is not the target action, the current process is stopped. In one possible application scenario, the OK gesture indicates that music playback is enabled. That is, when the in-car music is off, the target object can only enable the in-car music by making an OK gesture; other gestures will not enable the in-car music.
[0079] Step 1044: If the usage state is on, then determine the first target control action based on the current tag information, the static action, and the preset data information.
[0080] In one embodiment, when the in-vehicle music is in the "on" state, the first target control action can be determined based on the current tag information, static actions, and preset data information, that is, various gestures can be used to control the in-vehicle music.
[0081] In the above embodiments, when the car music is off, it can only be turned on when the target object performs the target action. After the car music is turned on, it can be controlled in various ways according to various gestures, thus avoiding the phenomenon of the car music being accidentally turned on.
[0082] In an exemplary embodiment of the present invention, the method further includes, before acquiring the current gesture data of the target object, determining the target object based on preset permission data. In the above embodiment, users are allowed to pre-set permissions for personnel controlling in-vehicle music via gestures, and only personnel with the required permissions can become the target object. Specifically, permissions can be set for the driver's seat or the front passenger seat, so that only personnel in the driver's and front passenger seats can control the in-vehicle music.
[0083] In an exemplary embodiment of the present invention, determining the current tag information corresponding to the current gesture data based on the static actions includes: determining the current tag information corresponding to the current gesture data based on the number of static actions. In this embodiment, the current tag information is determined according to the number of static actions. For example, after recognizing the current gesture data, if the current gesture data includes only one static action, it indicates that the current gesture data is a static gesture, and the current tag information can be determined to be "static gesture," that is, the tag information includes "static gesture" and "dynamic gesture," or the current tag information can be determined to be "1," that is, the tag information is a numerical tag, such as "1," "2," or "3." In other words, if the current gesture data includes two static actions, the current tag information is determined to be "2," and if the current gesture data includes three static actions, the current tag information is determined to be "3." When the number of static actions included in the gesture data is different, the corresponding tag information is different, thereby effectively increasing the number of gestures used to control in-vehicle music and enabling more complex control actions to be completed, meeting various control needs of users.
[0084] In an exemplary embodiment of the present invention, determining the current tag information corresponding to the current gesture data based on the static action includes: determining the first static action based on the timing of the static actions; and determining the current tag information corresponding to the current gesture data based on the first static action. In the above embodiment, classifying tag information based on the first static action is beneficial for quickly narrowing the search range. For example, if there is a static gesture "OK" indicating music playback, and a combination of a dynamic gesture "OK" and a number gesture 3 indicating the playback of the previous three tracks, then the current tag information for the "OK" gesture and the combination of the "OK" gesture and the number gesture 3 is the same, which is beneficial for quickly narrowing the search range, ensuring subsequent matching speed, and improving processing efficiency.
[0085] In an exemplary embodiment of the present invention, the step of controlling the playback of in-vehicle music based on the first target control action includes: if the first target control action is to play music of a target music type, then determining a music list corresponding to the target music type and playing music from the music list.
[0086] In the above embodiments, users are allowed to control the playback of music of a target music type using gestures. For example, if the current gesture data is the number 9, the first target control action is determined to be playing light music, and the light music playlist is opened for playback. Specifically, when local and online music exist, users can categorize their local music, such as into light music, rock, and traditional Chinese music. Dynamic gestures can then determine whether the first target control action is to play the local music playlist or the online music playlist. For example, a combination of the number 9 gesture and a thumbs-up gesture can be set to play the local light music playlist, while a combination of the number 9 gesture and a thumbs-down gesture can be set to play the online light music playlist. In this embodiment, the need for the target user to control the playback of music of a target music type using gestures is met, improving the user experience.
[0087] In an exemplary embodiment of the present invention, the step of controlling the playback of in-vehicle music based on the first target control action includes: if the first target control action is to play a target song, then determining the playback time or repetition count carried by the first target control action; and playing the target song based on the playback time or repetition count.
[0088] In the above embodiments, the target object is allowed to repeatedly play the target song using a first target control action, and the playback time and number of repetitions of the target song can be controlled by gestures. In one possible application scenario, if the target object likes song D, then the target object is allowed to repeatedly play song D by setting gesture actions. For example, raising the index finger can be determined as playing the target song; raising the index finger, the OK gesture, and the number gesture can be used as a combination of dynamic gestures, where raising the index finger plays the target song, the OK gesture is the number of repetitions, and the number gesture is the number of repetitions; or raising the index finger, the fist gesture, and the number gesture can be used as a combination of dynamic gestures, where raising the index finger plays the target song, the fist gesture is the time-based repetition, and the number gesture is the repetition duration. Of course, other gesture actions can also be set to achieve repeated playback of the target song, which is not limited in this embodiment. In this embodiment, the need for the target object to repeatedly play the target song can be met, improving the user experience.
[0089] Exemplary device
[0090] Based on the same concept as the embodiments of the method of the present invention, such as Figure 6 As shown, this embodiment of the invention also provides an in-vehicle music control device, specifically including the following modules:
[0091] Gesture data acquisition module 61 is used to acquire the current gesture data of the target object;
[0092] The static action determination module 62 is used to identify the current gesture data and determine the static action contained in the current gesture data;
[0093] The tag information determination module 63 is used to determine the current tag information corresponding to the current gesture data based on the static action;
[0094] The control action determination module 64 is used to determine a first target control action based on the current tag information, the static action, and preset data information; wherein the preset data information includes the mapping relationship between gesture actions and control actions and preset tag information;
[0095] The music playback control module 65 is used to control the playback of in-vehicle music based on the first target control action.
[0096] In an exemplary embodiment of the present invention, the device further includes: a voice control module, the voice control module comprising:
[0097] The voice acquisition unit is used to acquire the user's voice data;
[0098] A voice recognition unit is used to recognize the voice data and determine the second target control action;
[0099] A voice control unit is used to control the playback of in-vehicle music based on the second target control action.
[0100] In an exemplary embodiment of the present invention, the device further includes: an action setting module, the action setting module comprising:
[0101] The gesture setting unit is used to obtain the user's gesture settings based on the received gesture control setting instructions;
[0102] The result display unit is used to recognize the set gesture action and display the gesture recognition result;
[0103] The selection unit is configured to display music playback control action settings based on the user's confirmation command of the gesture recognition result;
[0104] The relationship determination unit is used to determine the mapping relationship between gesture actions and control actions based on the user's settings for the action settings.
[0105] In an exemplary embodiment of the present invention, the control action determination module includes:
[0106] A filtering processing unit is used to filter out data information to be matched from the preset data information based on the current tag information;
[0107] An action determination unit is used to determine a first target control action based on the static action and the data information to be matched.
[0108] In an exemplary embodiment of the present invention, the action determining unit is configured to, if the static action is an OK gesture, determine a first target control action as starting music playback based on the matching data information; and / or, if the static action is a thumbs-up gesture, determine a first target control action as increasing the volume based on the matching data information; and / or, if the static action is a thumbs-down gesture, determine a first target control action as decreasing the volume based on the matching data information; and / or, if the static action is an index and middle finger pointing upwards, determine a first target control action as switching to the previous song based on the matching data information; and / or, if the static action is an index and middle finger pointing downwards, determine a first target control action as switching to the next song based on the matching data information; and / or, if the static action is a heart gesture, determine a first target control action as adding to favorites based on the matching data information; and / or, if the static action is a fist clenching, determine a first target control action as turning off music playback based on the matching data information.
[0109] In an exemplary embodiment of the present invention, the device further includes: a state determination module, configured to determine the usage state of the in-vehicle music system; then the control action determination module includes:
[0110] The processing unit is enabled to determine whether the current tag information is the target tag information and whether the static action is the target action if the usage state is off; if the current tag information is not the target tag information or the static action is not the target action, the current process is stopped; if the current tag information is the target tag information and the static action is the target action, the first target control action is determined to be to start music playback.
[0111] The control processing unit is configured to determine a first target control action based on the current tag information, the static action, and preset data information if the usage state is an on state.
[0112] In an exemplary embodiment of the present invention, the apparatus further includes: an object determination module, configured to determine a target object based on preset permission data.
[0113] In an exemplary embodiment of the present invention, the tag information determining module is used to determine the current tag information corresponding to the current gesture data based on the number of static actions; or, the tag information determining module is used to determine the first static action based on the timing of the static actions; and to determine the current tag information corresponding to the current gesture data based on the first static action.
[0114] In an exemplary embodiment of the present invention, the music playback control module is configured to, if the first target control action is to play music of a target music type, determine a music list corresponding to the target music type and play music from the music list.
[0115] In an exemplary embodiment of the present invention, the music playback control module is configured to, if the first target control action is to play a target song, determine the playback time or number of repetitions carried by the first target control action; and play the target song based on the playback time or number of repetitions.
[0116] Exemplary electronic devices
[0117] Figure 7 A block diagram of an electronic device according to an embodiment of the present invention is shown.
[0118] like Figure 7 As shown, the electronic device 100 includes one or more processors 101 and memory 102.
[0119] The processor 101 may be a central processing unit (CPU) or other form of processing unit with data processing capabilities and / or instruction execution capabilities, and may control other components in the electronic device 100 to perform desired functions.
[0120] The memory 102 may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory may include, for example, random access memory (RAM) and / or cache memory. The non-volatile memory may include, for example, read-only memory (ROM), hard disk, flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 101 may execute the program instructions to implement the in-vehicle music playback control method of the various embodiments of the present invention described above, and / or other desired functions.
[0121] In one example, the electronic device 100 may also include an input device 103 and an output device 104, which are interconnected via a bus system and / or other forms of connection mechanism (not shown).
[0122] Of course, for the sake of simplicity, Figure 7 Only some of the components of the electronic device 100 relevant to the present invention are shown, omitting components such as buses, input / output interfaces, etc. In addition, the electronic device 100 may include any other suitable components depending on the specific application.
[0123] Exemplary computer program products and computer-readable storage media
[0124] In addition to the methods and devices described above, embodiments of the present invention may also be computer program products, which include computer program instructions that, when executed by a processor, cause the processor to perform the steps in the in-vehicle music playback control methods according to various embodiments of the present invention as described in the "Exemplary Methods" section of this specification.
[0125] The computer program product can be written in any combination of one or more programming languages to perform the operations of the embodiments of the present invention. The programming languages include object-oriented programming languages such as Java and C++, as well as conventional procedural programming languages such as C or similar languages. The program code can be executed entirely on the user's computing device, partially on the user's computing device, as a standalone software package, partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server.
[0126] Furthermore, embodiments of the present invention may also be computer-readable storage media storing computer program instructions thereon, which, when executed by a processor, cause the processor to perform the steps of the in-vehicle music playback control method according to various embodiments of the present invention described in the "Exemplary Methods" section above.
[0127] The computer-readable storage medium may be any combination of one or more readable media. A readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may, for example, include, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatuses, or devices, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: electrical connections having one or more wires, portable disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.
[0128] The basic principles of the present invention have been described above with reference to specific embodiments. However, it should be noted that the advantages, benefits, and effects mentioned in the present invention are merely examples and not limitations, and should not be considered as essential features of each embodiment of the present invention. Furthermore, the specific details of the invention described above are for illustrative and facilitative purposes only, and are not limitations. These details do not limit the present invention to the necessity of employing the specific details described above.
[0129] The block diagrams of devices, apparatuses, devices, and systems involved in this invention are merely illustrative examples and are not intended to require or imply that they must be connected, arranged, or configured in the manner shown in the block diagrams. As those skilled in the art will recognize, these devices, apparatuses, devices, and systems can be connected, arranged, and configured in any manner. Words such as “comprising,” “including,” “having,” etc., are open-ended terms meaning “including but not limited to,” and are used interchangeably with them. The terms “or” and “and” as used herein refer to the terms “and / or,” and are used interchangeably with them unless the context clearly indicates otherwise. The term “such as” as used herein refers to the phrase “such as but not limited to,” and is used interchangeably with it.
[0130] It should also be noted that in the apparatus, device, and method of the present invention, the components or steps can be disassembled and / or recombined. These disassemblies and / or recombinations should be considered as equivalent solutions of the present invention.
[0131] The above description of aspects of the invention is provided to enable any person skilled in the art to make or use the invention. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein can be applied to other aspects without departing from the scope of the invention. Therefore, the invention is not intended to be limited to the aspects shown herein, but rather to be carried out within the widest scope consistent with the principles and novel features of the invention herein.
[0132] The above description has been given for purposes of illustration and description. Furthermore, this description is not intended to limit the embodiments of the invention to the forms described herein. Although numerous exemplary aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, alterations, additions, and sub-combinations therein.
Claims
1. A method for controlling in-vehicle music playback, characterized in that, Specifically, the steps include the following: Get the current gesture data of the target object; The current gesture data is identified to determine the static actions contained in the current gesture data; Based on the static action, determine the current tag information corresponding to the current gesture data; the current tag information includes static gestures and dynamic gestures; Based on the current label information, the static action, and the preset data information, a first target control action is determined; The preset data information includes the mapping relationship between gesture actions and control actions, and preset label information; Control the playback of in-vehicle music based on the first target control action; The step of determining the first target control action based on the current tag information, the static action, and the preset data information includes: Based on the current tag information, select the data information to be matched from the preset data information; Based on the static action and the data to be matched, a first target control action is determined; The step of determining the current tag information corresponding to the current gesture data based on the static action includes: Based on the number of static actions, determine the current tag information corresponding to the current gesture data; Alternatively, the first static action can be determined based on the timing of the static actions; Based on the initial static action, the current tag information corresponding to the current gesture data is determined.
2. The method according to claim 1, further comprising: Obtain the user's voice data; The voice data is recognized to determine the second target control action; The playback control of in-vehicle music is performed based on the second target control action.
3. The method according to claim 1, further comprising: Based on the received gesture control settings instructions, obtain the user's set gesture actions; Recognize the set gesture action and display the gesture recognition result; Based on the user's confirmation command of the gesture recognition result, the music playback control action settings are displayed; Based on the user's settings for the action settings, the mapping relationship between gesture actions and control actions is determined.
4. The method according to claim 1, wherein determining the first target control action based on the static action and the data to be matched includes: If the static action is an OK gesture, then based on the data to be matched, the first target control action is determined to be to start music playback; And / or, if the static action is thumbs up, then based on the data to be matched, the first target control action is determined to be turning up the volume; And / or, if the static action is thumb down, then based on the data to be matched, the first target control action is determined to be turning down the volume; And / or, if the static action is to point the index and middle fingers upwards, then based on the data to be matched, the first target control action is determined to be to switch to the previous song; And / or, if the static action is pointing the index and middle fingers downwards, then based on the data to be matched, the first target control action is determined to be switching to the next song; And / or, if the static action is making a heart shape with your hands, then based on the data to be matched, the first target control action is determined to be "collect". And / or, if the static action is clenching a fist, then based on the data to be matched, the first target control action is determined to be turning off music playback.
5. The method according to claim 1, wherein after determining that the current gesture data contains a static action, the method further comprises: Determine the usage status of the in-car music system; The step of determining the first target control action based on the current tag information, the static action, and the preset data information includes: If the usage state is off, then determine whether the current tag information is the target tag information and whether the static action is the target action; if the current tag information is not the target tag information or the static action is not the target action, then stop the current process; if the current tag information is the target tag information and the static action is the target action, then determine that the first target control action is to start music playback. If the usage state is enabled, then the first target control action is determined based on the current tag information, the static action, and the preset data information.
6. The method according to claim 1, further comprising, before acquiring the current gesture data of the target object: The target object is determined based on preset permission data.
7. The method according to any one of claims 1-6, wherein the step of controlling the playback of in-vehicle music based on the first target control action comprises: If the first target control action is to play music of the target music type; Then determine the music list corresponding to the target music type and play the music in the music list.
8. The method according to any one of claims 1-6, wherein the step of controlling the playback of in-vehicle music based on the first target control action comprises: If the first target control action is to play the target song, then determine the playback time or number of repetitions carried by the first target control action; The target song is played based on the playback time or the number of repetitions.
9. A vehicle-mounted music playback control device, characterized in that, Specifically, it includes the following modules: The gesture data acquisition module is used to acquire the current gesture data of the target object; A static action determination module is used to identify the current gesture data and determine the static actions contained in the current gesture data; The tag information determination module is used to determine the current tag information corresponding to the current gesture data based on the static action; the current tag information includes static gestures and dynamic gestures; The control action determination module is used to determine a first target control action based on the current tag information, the static action, and preset data information; The preset data information includes the mapping relationship between gesture actions and control actions, and preset label information; The music playback control module is used to control the playback of in-vehicle music based on the first target control action; The device further includes: A filtering processing unit is used to filter out data information to be matched from the preset data information based on the current tag information; An action determination unit is used to determine a first target control action based on the static action and the data information to be matched; The tag information determination module is used to determine the current tag information corresponding to the current gesture data based on the number of static actions; or, the tag information determination module is used to determine the first static action based on the timing of the static actions; and determine the current tag information corresponding to the current gesture data based on the first static action.
10. A computer-readable storage medium storing a computer program for executing the in-vehicle music playback control method according to any one of claims 1-8.
11. An electronic device, the electronic device comprising: processor; Memory used to store the processor's executable instructions; The processor is configured to read the executable instructions from the memory and execute the instructions to implement the in-vehicle music playback control method according to any one of claims 1-8.
Citation Information
Patent Citations
Information processing method and device, vehicle and computer readable storage medium
CN109976515A
Gesture control method and device
CN110716648A