Vehicle-based bluetooth control method, device, equipment and medium

Abstract

The application provides a vehicle-based Bluetooth control method, device, equipment and medium, the method comprises: obtaining voice information of a user by using a Bluetooth headset; converting the voice information into a first control instruction for the vehicle; sending the first control instruction to the vehicle based on a smart terminal network; in response to the received first control instruction, generating an execution result of the vehicle executing the first control instruction, and feeding back the execution result based on the smart terminal; the smart terminal synchronizes the execution result to the Bluetooth headset, and the execution result is voice broadcasted. The application combines the Bluetooth headset with the smart terminal, voice controls the vehicle, greatly improves the application scenario of voice control of the vehicle, and the voice control method of the application is more convenient and flexible.

Description

Technical Field

[0001] This application relates to the field of vehicle control, specifically to a vehicle-based Bluetooth control method, device, equipment, and medium. Background Technology

[0002] Currently, an increasing number of vehicles are equipped with intelligent voice systems (i.e., in-vehicle voice control systems). Equipping vehicles with intelligent voice systems allows drivers to control functions such as navigation, air conditioning, sunroof, and music via voice commands, thus avoiding traffic accidents caused by drivers shifting their attention away from physical or virtual buttons.

[0003] However, some vehicles are not equipped with a voice control system. Also, outside the vehicle or at a distance of 3 to 100 meters, it is impossible to perform corresponding business operations by voice control outside the vehicle, thus failing to meet the usage scenarios of vehicle voice control. For example, when a user is carrying items into the vehicle, they cannot unlock the vehicle or open the tailgate because their hands are full, making it inconvenient to use the vehicle.

[0004] Application content

[0005] In view of the shortcomings of the prior art described above, this application provides a vehicle-based Bluetooth control method, device, equipment and medium to solve the problem that the existing vehicle voice control system only supports internal control and cannot take into account external vehicle control.

[0006] In a first aspect, this application provides a vehicle-based Bluetooth control method, comprising:

[0007] Obtain voice information from the Bluetooth headset and / or operation information from the Bluetooth headset charging case;

[0008] The voice information is sent to a smart terminal via a first Bluetooth communication, the voice information is recognized to generate a first control command to control the vehicle, and / or the operation information is converted into a second control command for the vehicle;

[0009] The first control command is sent to the vehicle via the smart terminal, and / or the second control command is sent to the vehicle via the second Bluetooth communication.

[0010] In response to the first control command and / or the second control command, an execution result of the vehicle executing the corresponding control command is generated, and the execution result is fed back based on the smart terminal;

[0011] The execution result is synchronized to the Bluetooth headset based on the first Bluetooth communication, and the execution result is broadcast aloud.

[0012] In one embodiment of this application, obtaining voice information from the Bluetooth headset and / or operation information from the Bluetooth headset charging case further includes:

[0013] If a wake-up command is detected, the voice function of the Bluetooth headset is activated; the voice signal is collected, and the voice information is determined; or / and

[0014] The system obtains user clicks on the operation buttons on the outside of the Bluetooth earphone charging case or touches the operation buttons displayed on the Bluetooth earphone charging case, and confirms the operation information. The operation buttons include at least one of the following: vehicle unlock button, vehicle lock button, vehicle trunk control button, vehicle start button, and vehicle parking button.

[0015] In one embodiment of this application, the voice information is sent to a smart terminal via a first Bluetooth communication, the voice information is recognized to generate a first control command to control the vehicle, and / or the operation information is converted into a second control command for the vehicle, further comprising:

[0016] The voice information is subjected to speech recognition to determine text data; the words in the text data are subjected to semantic analysis to determine the first control command for the vehicle.

[0017] The key information corresponding to the operation information is converted into a second control command for the vehicle;

[0018] If the first control command and the second control command are contradictory control commands targeting the same object inside the vehicle, then the second control command is determined to be an erroneous operation command, and only the first control command is used as the control command for the object.

[0019] In one embodiment of this application, before sending the voice information to a smart terminal via first Bluetooth communication and generating a first control command to control the vehicle by recognizing the voice information, the method further includes:

[0020] Determine the current status of the Bluetooth headset;

[0021] If the Bluetooth headset is in a call, the current call is maintained so that the Bluetooth headset can monitor the wake-up command for voice control of the vehicle during the call. If the wake-up command is detected, the voice function of the Bluetooth headset is activated; the voice information of the current user is collected to generate a first control command to control the vehicle.

[0022] If the Bluetooth headset is in a call state and a voice command to control the vehicle is detected, the call state of the Bluetooth headset is switched to a busy state, and the voice function of the Bluetooth headset is used to collect the voice information of the current user to generate a first control command to control the vehicle.

[0023] If the Bluetooth headset is not in a call state, the voice information is converted into a first control command for the vehicle.

[0024] In one embodiment of this application, the voice information is sent to a smart terminal via a first Bluetooth communication, and the voice information is recognized to generate a first control command to control the vehicle, further comprising:

[0025] The collected voice information is sent to the smart terminal via a first Bluetooth communication.

[0026] Perform speech recognition on the voice information to determine the text data; determine whether the text data includes the target object to be controlled;

[0027] If the text data includes a target object to be controlled, then the text data is converted into a first control command for the vehicle target device;

[0028] If the text data does not include the target object to be controlled, then the user identity information is obtained based on the voice information, the semantic prediction model is called based on the user identity information to determine the target object, and the text data is converted into a first control command for the vehicle target device.

[0029] In one embodiment of this application, user identity information is obtained based on the voice information, wherein the user identity information includes registered users and unregistered users, and further includes:

[0030] Extract the voiceprint features from the speech information and match the voiceprint features with a preset voiceprint information database;

[0031] If the voiceprint feature matches at least one voiceprint in the preset voiceprint information database, then the user is determined to be a registered user.

[0032] If the stated voiceprint features do not match any voiceprint information in the preset voiceprint information database, then the user is determined to be an unregistered user.

[0033] In one embodiment of this application, the semantic prediction model includes a first semantic prediction model and a second semantic prediction model. The voice information corresponding to registered users and unregistered users is obtained as a first training set and a second training set, respectively. Features are extracted from the first training set and the second training set to obtain multiple first audio features and multiple second audio features. The multiple first audio features and multiple second audio features are input into the first semantic prediction model and the second semantic prediction model for training. A loss function is constructed based on the training output object and the labeled target object. Minimizing the loss function is determined as the end-of-training condition, thus obtaining the first semantic prediction model and the second semantic prediction model.

[0034] In one embodiment of this application, if the user is a registered user, a first semantic prediction model is used to determine the target object to be controlled by the vehicle; if the user is an unregistered user, a second semantic prediction model is used to determine the target object to be controlled by the vehicle.

[0035] In one embodiment of this application, if the received user is an unregistered user, the usage rights of the unregistered user are determined based on whether voice authorization information from a registered user is received. If voice authorization information from a registered user is received, the voice information of the unregistered user is allowed to be converted into a first control command; if voice authorization information from a registered user is not received, the conversion of the voice information of the unregistered user into a first control command is prohibited.

[0036] In a second aspect, this application provides a vehicle-based Bluetooth control device, including a Bluetooth headset, a Bluetooth headset charging case for the Bluetooth headset, a smart terminal that communicates with the Bluetooth headset via Bluetooth, and the Bluetooth headset charging case being connected to the vehicle via Bluetooth.

[0037] The smart terminal further includes:

[0038] The first acquisition module is used to acquire voice information from the Bluetooth headset;

[0039] The first instruction determination module is used to send the voice information to the smart terminal based on the first Bluetooth communication, and to identify the voice information to generate a first control instruction to control the vehicle.

[0040] The first instruction transmission module is used to send the first control instruction to the vehicle based on the smart terminal;

[0041] A first instruction response module is configured to control the vehicle to respond to a first control instruction, generate a first execution result of the vehicle executing the first control instruction, and feed back the first execution result based on the smart terminal; or / and

[0042] The Bluetooth earphone charging case further includes:

[0043] The second acquisition module is used to acquire operation information of the Bluetooth earphone charging case;

[0044] The second instruction determination module is used to convert the operation information into a second control instruction for the vehicle;

[0045] The second command transmission module is used to send the second control command to the vehicle based on the second Bluetooth communication;

[0046] The second instruction response module is used to control the vehicle to respond to the second control instruction, generate a second execution result of the vehicle executing the second control instruction, and feed back the second execution result based on the smart terminal;

[0047] The Bluetooth headset further includes:

[0048] The voice broadcast module synchronizes the first execution result and / or the second execution result to the Bluetooth headset based on the first Bluetooth communication, and broadcasts the first execution result and / or the second execution result via voice.

[0049] In one embodiment of this application, the Bluetooth headset charging case is provided with operation buttons on its outer side, and the operation buttons include at least one of the following: vehicle unlock button, vehicle lock button, vehicle trunk control button, vehicle start button, and vehicle parking button.

[0050] In one embodiment of this application, the Bluetooth headset charging case is provided with an indicator light and a pairing button on its outer side. If the Bluetooth headset is charged in the Bluetooth headset charging case, the pairing button can be touched to enable the Bluetooth headset to pair with a smart terminal via Bluetooth, and also enable the Bluetooth headset charging case to pair with a vehicle via Bluetooth. The indicator light is used to display the Bluetooth connection status.

[0051] In a third aspect, this application provides an electronic device comprising:

[0052] One or more processors;

[0053] A storage device for storing one or more programs that, when executed by one or more processors, enable the electronic device to implement the vehicle-based Bluetooth control method described above.

[0054] In a fourth aspect, this application provides a computer-readable storage medium storing computer-readable instructions that, when executed by a computer's processor, cause the computer to perform the aforementioned vehicle-based Bluetooth control method.

[0055] The beneficial effects of this application are as follows: This application can acquire voice information from a Bluetooth headset and / or operation information from a Bluetooth headset charging case; send the voice information to a smart terminal via a first Bluetooth communication, recognize the voice information to generate a first control command to control the vehicle, and / or convert the operation information into a second control command for the vehicle; send the first control command to the vehicle via the smart terminal, and / or send the second control command to the vehicle via a second Bluetooth communication; in response to the first control command and / or the second control command, generate an execution result of the vehicle executing the corresponding control command, and feed back the execution result via Bluetooth or a mobile network of the smart terminal; the smart terminal synchronizes the execution result to the Bluetooth headset via the first Bluetooth communication and broadcasts the execution result by voice. On the one hand, the vehicle is controlled via Bluetooth; on the other hand, the combination of Bluetooth headset and smart terminal enables voice control of the vehicle, which not only greatly improves the applicable scenarios of voice control of the vehicle, but also realizes remote voice control of the vehicle, assisting the vehicle in completing tasks. Under the premise of ensuring vehicle control safety, the Bluetooth and voice control method of this application is more convenient and flexible.

[0056] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and do not limit this application. Attached Figure Description

[0057] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application. It is obvious that the drawings described below are merely some embodiments of this application, and those skilled in the art can obtain other drawings based on these drawings without any inventive effort. In the drawings:

[0058] Figure 1 This is a schematic diagram illustrating an implementation environment of a vehicle-based Bluetooth control method, as shown in an exemplary embodiment of this application.

[0059] Figure 2 This is a flowchart illustrating a vehicle-based Bluetooth control method as an exemplary embodiment of this application;

[0060] Figure 3 This is a flowchart illustrating a Bluetooth headset controlling a vehicle, as shown in an exemplary embodiment of this application;

[0061] Figure 4 This is an exemplary embodiment of the present application illustrating a vehicle-based Bluetooth control system framework diagram;

[0062] Figure 5 This is a structural block diagram illustrating a vehicle-based Bluetooth control device, as shown in an exemplary embodiment of this application.

[0063] Figure 6 A schematic diagram of the structure of a computer system suitable for implementing the electronic devices of the present application is shown;

[0064] Figure 7 This is a schematic diagram illustrating the control button arrangement of a Bluetooth headset charging case, as shown in an exemplary embodiment of this application. Detailed Implementation

[0065] The embodiments of this application will be described below with reference to the accompanying drawings and preferred embodiments. Those skilled in the art can easily understand other advantages and effects of this application from the content disclosed in this specification. This application can also be implemented or applied through other different specific embodiments, and various details in this specification can also be modified or changed based on different viewpoints and applications without departing from the spirit of this application. It should be understood that the preferred embodiments are only for illustrating this application and are not intended to limit the scope of protection of this application.

[0066] It should be noted that the illustrations provided in the following embodiments are only schematic representations of the basic concept of this application. Therefore, the drawings only show the components related to this application and are not drawn according to the actual number, shape and size of the components in the actual implementation. In the actual implementation, the form, quantity and proportion of each component can be arbitrarily changed, and the layout of the components may also be more complex.

[0067] In the following description, numerous details are explored to provide a more thorough explanation of embodiments of the present application. However, it will be apparent to those skilled in the art that embodiments of the present application may be practiced without these specific details. In other embodiments, well-known structures and devices are shown in block diagram form rather than in detail to avoid obscuring embodiments of the present application.

[0068] Currently, in-vehicle voice interaction has become the second most common form of interaction in automobiles after the central control screen. In terms of pre-installation adoption, the standard installation rate of voice recognition and interaction functions is gradually increasing. The deep integration of voice interaction and smart cockpits presents a new opportunity to improve the driving experience. Adopting a full-scenario voice-controlled in-vehicle system to extend voice control throughout the entire vehicle is a major future trend. However, current in-vehicle voice control only supports in-vehicle control. If outside the vehicle or at a distance (e.g., 3-100 meters), external voice control cannot perform corresponding business operations. This fails to meet the usage scenarios of voice control, such as when a user is carrying items into the vehicle and their hands are full, making it inconvenient to unlock the vehicle or open the tailgate.

[0069] To address these issues, embodiments of this application propose a vehicle-based Bluetooth control method, a vehicle-based Bluetooth control device, an electronic device, and a computer-readable storage medium, which will be described in detail below.

[0070] Please see Figure 1 This is a schematic diagram illustrating the implementation environment of a vehicle trajectory tracking and control method according to an exemplary embodiment of this application. It includes a Bluetooth control device 1, a person 3, and a vehicle 5. It should be understood that the Bluetooth control device includes a Bluetooth headset, a Bluetooth headset charging case, and a smart terminal, wherein the smart terminal is a smartphone, which connects to the Bluetooth headset via Bluetooth pairing.

[0071] The Bluetooth headset includes a microphone and a speaker. The microphone and speaker are used for voice calls. The microphone is also used to acquire the user's voice information; the speaker is also used to broadcast the execution result. The Bluetooth headset charging case can also be replaced with a Bluetooth headset connector, smart bracelet, smartwatch, smart glasses, or smart helmet. The Bluetooth headset charging case is equipped with operation buttons, including at least one of the following: vehicle unlock button, vehicle lock button, vehicle trunk control button, vehicle start button, and vehicle parking button. See details. Figure 7 The document showcases the vehicle unlock button, vehicle lock button, vehicle trunk control button, and vehicle start button. It's worth noting that the vehicle start button integrates both vehicle start and parking functions. For example, pressing it once starts the vehicle, while pressing it twice parks the vehicle in a preset parking space. Additionally, the Bluetooth headset charging case is used as an example.

[0072] The vehicle is typically a land-based vehicle with three or more wheels, such as a bus or light truck, but can also be a new energy vehicle or an internal combustion engine vehicle. The user wearing the Bluetooth control device can be a registered user or an unregistered user; that is, when using it, the user must carry a Bluetooth headset, a Bluetooth headset charging case, and a smart terminal compatible with the Bluetooth headset to control the vehicle via Bluetooth or voice.

[0073] Please see Figure 2 An exemplary embodiment of this application illustrates a flowchart of a vehicle-based Bluetooth control method, which is described in detail below:

[0074] Step S210: Obtain voice information from the Bluetooth headset and / or operation information from the Bluetooth headset charging case;

[0075] It should be understood that, if a wake-up command is detected, the voice function of the Bluetooth headset is activated; the voice signal is collected to determine the voice information; and / or...

[0076] The system obtains user clicks on the operation buttons on the outside of the Bluetooth earphone charging case or touches the operation buttons displayed on the Bluetooth earphone charging case, and confirms the operation information. The operation buttons include at least one of the following: vehicle unlock button, vehicle lock button, vehicle trunk control button, vehicle start button, and vehicle parking button.

[0077] For example, a wake-up command, similar to Apple's "Siri," uses a preset phrase as a wake-up command. If the command is detected, the voice function of the Bluetooth control device is activated; the voice signal is collected, and the voice information, i.e., voice data, is determined.

[0078] For example, the button information can be determined by sliding and clicking on the display screen, or by pressing the buttons on a Bluetooth control device.

[0079] It should be noted that sometimes only the user's voice information is acquired; or only the user's operation information is acquired; or both the user's voice information and operation information are acquired simultaneously. Operation information includes, but is not limited to, starting the vehicle, opening the trunk, turning on the air conditioning, and opening the windows. Of course, voice information is expressed as control commands in the form of voice data.

[0080] Step S220: The voice information is sent to the smart terminal via the first Bluetooth communication, the voice information is recognized to generate a first control command to control the vehicle, and / or the operation information is converted into a second control command for the vehicle;

[0081] What should be understood here is:

[0082] The voice information is subjected to speech recognition to determine text data; the words in the text data are subjected to semantic analysis to determine the first control command for the vehicle.

[0083] The key information corresponding to the operation information is converted into a second control command for the vehicle;

[0084] If the first control command and the second control command are contradictory control commands targeting the same object inside the vehicle, then the second control command is determined to be an erroneous operation command, and only the first control command is used as the control command for the object.

[0085] For example, a display element might have the text "Car Window." A single physical click on this element opens or closes the car window. Specifically, if the window is open, a single click closes it; if the window is closed, a single click opens it. Additionally, with voice activation, when the user says "Close the window" and the voice input device detects the "Close the window" voice signal, it's equivalent to a single physical click on the "Window" element, thus closing the window.

[0086] In this way, the control commands expressed by voice information can effectively avoid misoperation caused by touch compared to user finger operation, thus improving the accuracy of vehicle control. At the same time, controlling the vehicle by voice can greatly free up the hands, demonstrating the vehicle's level of intelligence.

[0087] Step S230: Send the first control command to the vehicle based on the smart terminal, or / and send the second control command to the vehicle based on the second Bluetooth communication;

[0088] Bluetooth communication includes the Bluetooth transmission protocol, specifically the Bluetooth protocol layer, which includes logical link control and adaptation protocols, radio frequency communication, and service search protocols. Bluetooth communication includes transceiver functions; that is, a Bluetooth module is installed between the vehicle and the Bluetooth headset charging case to achieve transceiver functionality. Additionally, the smart terminal can connect to mobile networks, such as 3G, 4G, or 5G networks. Furthermore, both the smart terminal and the Bluetooth headset are equipped with a Bluetooth module to achieve transceiver functionality. In other words, the smart terminal is compatible with both mobile networks and Bluetooth, and can establish a communication connection with the vehicle based on the current settings.

[0089] Step S240: In response to the first control command and / or the second control command, generate the execution result of the vehicle executing the corresponding control command, and feed back the execution result based on the smart terminal;

[0090] The control commands include, but are not limited to, starting the vehicle, opening the trunk, turning on the air conditioning, opening the windows, and automatic parking. The execution results generated by the vehicle after executing the control commands are fed back via the mobile network of the smart terminal, so that the execution results can be received even if the vehicle is not within Bluetooth communication range.

[0091] For example, in automatic parking, whether the vehicle has reversed into the designated parking space, and whether any traffic accidents have occurred during the automatic parking process, can be accurately determined by the execution results, showing the current state of the vehicle after the business operation has been performed.

[0092] Step S250: Synchronize the execution result to the Bluetooth headset based on the first Bluetooth communication, and broadcast the execution result via voice.

[0093] Specifically, feedback is provided through voice broadcasts, enabling users to be informed in a timely manner of the status of the business operations corresponding to the vehicle's execution of control commands, facilitating timely monitoring.

[0094] In this embodiment, a vehicle key is integrated with a Bluetooth headset charging case. The Bluetooth headset communicates with the mobile phone via Bluetooth, and the Bluetooth headset charging case communicates with the vehicle via Bluetooth. Bluetooth technology is used to connect to an audio output terminal to control the vehicle. This provides a control method based on a Bluetooth headset, enabling users to control the vehicle efficiently in different scenarios through button combinations and voice commands. This Bluetooth headset key can lock, unlock, start, and park the vehicle. It also features audio input / output capabilities, such as listening to audio and transferring calls to the headset with a single button when the mobile phone is connected to the vehicle's infotainment system and playing audio.

[0095] In some embodiments, before transmitting the voice information to a smart terminal via a first Bluetooth communication, and before generating a first control command to control the vehicle by recognizing the voice information, the method further includes:

[0096] Determine the current status of the Bluetooth headset;

[0097] The Bluetooth headset connects to a mobile phone, and the headset's status includes both call and non-call states.

[0098] If the Bluetooth headset is in a call, the current call is maintained so that the Bluetooth headset can monitor the wake-up command for voice control of the vehicle during the call. If the wake-up command is detected, the voice function of the Bluetooth headset is activated; the voice information of the current user is collected to generate a first control command to control the vehicle.

[0099] If the Bluetooth headset is in a call state and a voice command to control the vehicle is detected, the call state of the Bluetooth headset is switched to a busy state, and the voice function of the Bluetooth headset is used to collect the voice information of the current user to generate a first control command to control the vehicle.

[0100] If the Bluetooth headset is not in a call state, the voice information is converted into a first control command for the vehicle.

[0101] In this way, on the one hand, it does not affect the user's use of Bluetooth headsets for voice communication, and on the other hand, it also processes the collected voice information and / or operation information to achieve the purpose of synchronous vehicle control, ensuring that vehicle control and making and receiving phone calls are not interrupted.

[0102] In some embodiments, transmitting the voice information to a smart terminal via a first Bluetooth communication, and recognizing the voice information to generate a first control command to control the vehicle, further includes:

[0103] The collected voice information is sent to the smart terminal via a first Bluetooth communication.

[0104] Perform speech recognition on the voice information to determine the text data; determine whether the text data includes the target object to be controlled;

[0105] If the text data includes a target object to be controlled, then the text data is converted into a first control command for the vehicle target device;

[0106] If the text data does not include the target object to be controlled, then the user identity information is obtained based on the voice information, the semantic prediction model is called based on the user identity information to determine the target object, and the text data is converted into a first control command for the vehicle target device.

[0107] In some embodiments, user identity information is obtained based on the voice information, wherein the user identity information includes registered users and unregistered users, and further includes:

[0108] Extract the voiceprint features from the speech information and match the voiceprint features with a preset voiceprint information database (i.e., voiceprint database);

[0109] For example, voice information is input into a voiceprint recognition model, and the output of the voiceprint recognition model is a voiceprint feature. The voiceprint feature is then matched with all voiceprints in the voiceprint database. For example, if the similarity between two voiceprint features reaches a certain preset threshold, then the match is considered successful.

[0110] If the voiceprint feature matches at least one voiceprint in the preset voiceprint information database, then the user is determined to be a registered user.

[0111] For example, if voiceprint authentication is successful, the user is confirmed as a registered user.

[0112] If the stated voiceprint features do not match any voiceprint information in the preset voiceprint information database, then the user is determined to be an unregistered user.

[0113] For example, if voiceprint authentication fails, the user is determined to be an unregistered user.

[0114] It's important to note that each user, voiceprint ID, and user account information is uniquely linked. The vehicle stores preset data for each vehicle controller within each account's information, such as preference data like favorite music and air conditioning settings. When multiple users control the vehicle simultaneously, while issuing commands to the relevant vehicle controller, the system queries the account information corresponding to the voiceprint ID, retrieves the preset data related to that vehicle controller from the account information, and executes the commands according to the preset data. For example, when user A and user B control the vehicle simultaneously, if user A issues a command to play music, then user A's favorite music will be played; conversely, if user B issues a command to turn on the air conditioning, then the air conditioning will be controlled according to user B's air conditioning settings.

[0115] In some embodiments, the semantic prediction model includes a first semantic prediction model and a second semantic prediction model. The voice information corresponding to registered users and unregistered users is obtained as a first training set and a second training set, respectively. Features are extracted from the first training set and the second training set to obtain multiple first audio features and multiple second audio features. The multiple first audio features and multiple second audio features are input into the first semantic prediction model and the second semantic prediction model for training. A loss function is constructed based on the training output object and the labeled target object. Minimizing the loss function is determined as the end-of-training condition, thus obtaining the first semantic prediction model and the second semantic prediction model.

[0116] By using the above method, users are finely segmented according to whether they are registered, and different datasets are used to construct training sets for each group. Since different user groups have different usage habits on different vehicles, this avoids mutual interference between the two semantic prediction models and helps the semantic prediction models to make more accurate predictions.

[0117] In some embodiments, if the user is a registered user, a first semantic prediction model is used to determine the target object to be controlled by the vehicle; if the user is an unregistered user, a second semantic prediction model is used to determine the target object to be controlled by the vehicle.

[0118] By using the above methods, different semantic prediction models are used for voice prediction for different types of users. On the one hand, this can improve the efficiency of voice prediction. On the other hand, by using fine-grained management for different users, it is possible to obtain different user habits and preferences, which is beneficial for subsequent big data recommendations.

[0119] In some embodiments, if the received user is an unregistered user, the user's access rights are determined based on whether voice authorization information from a registered user is received. If voice authorization information from a registered user is received, the unregistered user's voice information is allowed to be converted into a first control command; if voice authorization information from a registered user is not received, the conversion of the unregistered user's voice information into a first control command is prohibited.

[0120] Specifically, when the voiceprint features of an unregistered user are detected, and the voiceprint features of a registered user are also received, a verification and judgment mechanism is activated. The voice information corresponding to the registered user is subjected to speech recognition to determine the text information, and the words in the text information are subjected to semantic recognition to determine whether there is authorization information for the unregistered user to use the vehicle in the text information. If so, the voice information of the unregistered user is allowed to be converted into control commands; if not, the voice information of the unregistered user is prohibited from being converted into control commands.

[0121] For example, the above authorization can be extended with a time limit, allowing use within a preset time period; or, constraints such as usage area and usage scenario can be added, which will not be elaborated here.

[0122] The above methods not only improve the safety of vehicle voice control, but also meet the needs of situations where vehicles are lent to family members or friends, greatly expanding the applicable scenarios for voice-controlled vehicles.

[0123] In the embodiments of this invention, please refer to Figure 4 An exemplary embodiment of this application illustrates a framework diagram of a vehicle-based Bluetooth control system, including a Bluetooth headset (containing a Bluetooth headset charging case) capable of controlling a car and a vehicle control system. The headset is used to receive voice control commands from the user to control the vehicle, and to issue button control commands using the Bluetooth headset charging case. The received commands are then transmitted to the vehicle control system via Bluetooth signals or a mobile network transmission and reception function. The vehicle control system includes a communication module device and a vehicle control system. After receiving a control command, the communication module transmits the command to the vehicle control system. The vehicle control system analyzes the command and then controls the corresponding vehicle components. After executing the control command, the vehicle control system feeds back the execution result to the Bluetooth headset via a Bluetooth signal. The Bluetooth headset plays the result, providing the user with execution feedback.

[0124] Specifically, for the method of implementing this invention, please refer to [link to relevant documentation]. Figure 3An exemplary embodiment of this application illustrates a flowchart of a Bluetooth headset controlling a vehicle, including: the Bluetooth headset simultaneously supports voice control and button control using the Bluetooth headset charging case. Button control is implemented using the charging case that comes with the Bluetooth headset. Voice control involves acquiring voice information via a Bluetooth voice module and transmitting it to the vehicle control system. The vehicle control system recognizes the user's control commands, thereby controlling the vehicle's components. If the Bluetooth headset is currently in a call, it will not preferentially acquire voice information for voice control of the vehicle. This effectively avoids the problem of users misrecognizing control commands during a call. In this case, the user can control the vehicle using the buttons on the Bluetooth headset to fulfill their vehicle control needs.

[0125] For example, if the Bluetooth headset is in a call, the current call is maintained so that the Bluetooth headset can monitor the wake-up command for voice control of the vehicle during the call. If the wake-up command is detected, the voice function of the Bluetooth headset is activated; the voice information of the current user is collected to generate a first control command to control the vehicle, so as to achieve the purpose of controlling the vehicle by voice even during a call.

[0126] If the Bluetooth headset is in a call state and a wake-up command for voice control of the vehicle is detected, the call state of the Bluetooth headset is switched to busy state. The voice function of the Bluetooth headset is used to collect the voice information of the current user and generate a first control command to control the vehicle. By pausing the call, the voice information of the current user is accurately obtained, thereby ensuring accurate voice control of the vehicle.

[0127] The Bluetooth headset button control is designed to allow users to control their vehicle via Bluetooth headset even during calls or when voice control is inconvenient. Upon receiving a button control command, the Bluetooth headset transmits it to the vehicle control system, which then recognizes the user's command and controls the vehicle's components. Specifically, the Bluetooth headset allows for non-voice control of the vehicle by pressing a button on the Bluetooth headset charging case to issue a vehicle control command.

[0128] Furthermore, if the vehicle control system fails to execute the command after the Bluetooth headset controls the vehicle, the failure message must be transmitted to the Bluetooth headset first via the smartphone and then via Bluetooth signal. The content is then played through the Bluetooth headset to inform the user that the current control task has not been completed.

[0129] In this embodiment, the earphone device consists of a Bluetooth earphone charging case and the Bluetooth earphone itself. The Bluetooth earphone charging case comprises a vehicle control unit, a power supply unit, and a charging unit. The vehicle control unit uses four buttons to issue control commands to the vehicle. For example, the four buttons are an unlock button, a lock button, a start button, and a tailgate control button. The unlock button controls the vehicle's unlocking function, the lock button controls the vehicle's locking function, the start button controls the vehicle's starting function, and when the indicator light shows the vehicle is running, a long press of the start button activates the parking function. The tailgate control button controls the opening and closing of the vehicle's power tailgate. The vehicle control unit contains a Bluetooth hardware module; commands issued by the buttons in the vehicle control unit are transmitted to the vehicle via the Bluetooth hardware module. The vehicle control unit also includes an indicator light to indicate the device's status within the vehicle control unit. In this embodiment, the charging case's power supply unit consists of a battery, a charging control layer circuit, and terminals. The charging case is connected to the earphones via the terminals for power supply. In this embodiment, the charging case's charging unit consists of a battery, a charging control layer circuit, and a charging interface. An external power source supplies power to the charging case's battery through the charging interface. In this embodiment, the earphone body of the earphone device consists of a speaker, microphone, Bluetooth hardware module, audio processing and decoding integrated circuit, and bottom terminals. The earphone-style key vehicle control method in this embodiment comprises two parts: direct vehicle control via buttons on the charging case and vehicle control via a smartphone connected to the earphone body. Specifically, the method of direct vehicle control via buttons on the charging case involves the Bluetooth hardware module in the charging case emitting a Bluetooth signal, which is directly received and processed by the vehicle's communication module before being executed by the vehicle control module.

[0130] like Figure 5 As shown, the exemplary vehicle-based Bluetooth control device 500 includes:

[0131] Bluetooth headset 53, Bluetooth headset charging case 52 for use with the Bluetooth headset, smart terminal 51 for Bluetooth communication with the Bluetooth headset, and Bluetooth headset charging case connected to the vehicle via Bluetooth;

[0132] The smart terminal 51 further includes:

[0133] The first acquisition module 511 is used to acquire voice information from the Bluetooth headset;

[0134] The first instruction determination module 512 is used to send the voice information to the smart terminal based on the first Bluetooth communication, and to identify the voice information to generate a first control instruction to control the vehicle.

[0135] The first instruction transmission module 513 is used to send the first control instruction to the vehicle based on the smart terminal;

[0136] The first instruction response module 514 is configured to control the vehicle to respond to the first control instruction, generate a first execution result of the vehicle executing the first control instruction, and feed back the first execution result based on the smart terminal; or / and

[0137] The Bluetooth earphone charging case 52 further includes:

[0138] The second acquisition module 521 is used to acquire operation information of the Bluetooth earphone charging case;

[0139] The second instruction determination module 522 is used to convert the operation information into a second control instruction for the vehicle;

[0140] The second command transmission module 523 is used to send the second control command to the vehicle based on the second Bluetooth communication;

[0141] The second instruction response module 524 is used to control the vehicle to respond to the second control instruction, generate a second execution result of the vehicle executing the second control instruction, and feed back the second execution result based on the smart terminal;

[0142] The Bluetooth headset 53 further includes:

[0143] The voice broadcast module 531 synchronizes the first execution result and / or the second execution result to the Bluetooth headset based on the first Bluetooth communication, and broadcasts the first execution result and / or the second execution result via voice.

[0144] Among them, smart terminals include, but are not limited to, smartphones, smart tablets, and computers. Here, we take smartphones as an example.

[0145] It should be understood that the Bluetooth earphone charging case has operation buttons on its outer side, including at least one of the following: vehicle unlock button, vehicle lock button, vehicle trunk control button, vehicle start button, and vehicle parking button.

[0146] It should be noted that the Bluetooth earphone charging case has an indicator light and a pairing button on the outside. When the Bluetooth earphone is charged in the Bluetooth earphone charging case, touching the pairing button enables the Bluetooth earphone to pair with the smart terminal via Bluetooth, and also enables the Bluetooth earphone charging case to pair with the vehicle via Bluetooth. The indicator light is used to display the Bluetooth connection status.

[0147] This exemplary method involves acquiring voice information from a Bluetooth headset and / or operation information from a Bluetooth headset charging case; sending the voice information to a smart terminal via a first Bluetooth communication; recognizing the voice information to generate a first control command to control the vehicle, and / or converting the operation information into a second control command for the vehicle; sending the first control command to the vehicle via the smart terminal, and / or sending the second control command to the vehicle via a second Bluetooth communication; generating an execution result of the vehicle executing the corresponding control command in response to the first control command and / or the second control command; and feeding back the execution result via the smart terminal; the smart terminal synchronizing the execution result to the Bluetooth headset via the first Bluetooth communication and broadcasting the execution result via voice. On one hand, the vehicle is controlled via Bluetooth; on the other hand, the combination of a Bluetooth headset and a mobile phone allows for voice control of the vehicle. This not only greatly expands the applicable scenarios for voice control of the vehicle but also enables remote voice control of the vehicle, assisting the vehicle in completing tasks. While ensuring vehicle control safety, the Bluetooth and voice control method of this application is more convenient and flexible.

[0148] It should be noted that the vehicle-based Bluetooth control device and the vehicle-based Bluetooth control method provided in the above embodiments belong to the same concept. The specific operation methods of each module and unit have been described in detail in the method embodiments and will not be repeated here. In practical applications, the vehicle-based Bluetooth control device provided in the above embodiments can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. This is not a limitation here.

[0149] Embodiments of this application also provide an electronic device, including: one or more processors; and a storage device for storing one or more programs, which, when executed by the one or more processors, cause the electronic device to implement the vehicle-based Bluetooth control device provided in the various embodiments described above.

[0150] Figure 6 A schematic diagram of a computer system suitable for implementing the embodiments of this application is shown. It should be noted that... Figure 6 The computer system 600 of the electronic device shown is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments of this application.

[0151] like Figure 6As shown, the computer system 600 includes a Central Processing Unit (CPU) 601, which can perform various appropriate actions and processes based on programs stored in Read-Only Memory (ROM) 602 or programs loaded from storage portion 608 into Random Access Memory (RAM) 603, such as performing the methods described in the above embodiments. The RAM 603 also stores various programs and data required for system operation. The CPU 601, ROM 602, and RAM 603 are interconnected via a bus 604. An Input / Output (I / O) interface 605 is also connected to the bus 604.

[0152] The following components are connected to I / O interface 605: an input section 606 including a keyboard, mouse, etc.; an output section 607 including a cathode ray tube (CRT), liquid crystal display (LCD), etc., and speakers, etc.; a storage section 608 including a hard disk, etc.; and a communication section 609 including a network interface card such as a LAN (Local Area Network) card, modem, etc. The communication section 609 performs communication processing via a network such as the Internet. A drive 610 is also connected to I / O interface 605 as needed. A removable medium 611, such as a disk, optical disk, magneto-optical disk, semiconductor memory, etc., is installed on drive 610 as needed so that computer programs read from it can be installed into storage section 608 as needed.

[0153] Specifically, according to embodiments of this application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this application include a computer program product comprising a computer program carried on a computer-readable medium, the computer program including a computer program for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication section 609, and / or installed from removable medium 611. When the computer program is executed by central processing unit (CPU) 601, it performs various functions defined in the system of this application.

[0154] It should be noted that the computer-readable medium shown in the embodiments of this application can be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. A computer-readable storage medium can be, for example, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), flash memory, optical fiber, portable compact disc read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this application, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying a computer-readable computer program. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. Computer-readable signal media can also be any computer-readable medium other than computer-readable storage media, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The computer program contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to wireless, wired, etc., or any suitable combination thereof.

[0155] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. Each block in a flowchart or block diagram may represent a module, segment, or portion of code, which contains one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram or flowchart, and combinations of blocks in a block diagram or flowchart, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0156] The units described in the embodiments of this application can be implemented in software or hardware, and the described units can also be located in a processor. The names of these units do not necessarily limit the specific unit itself.

[0157] Another aspect of this application provides a computer-readable storage medium having a computer program stored thereon that, when executed by a processor, implements the vehicle-based Bluetooth control device as described above. This computer-readable storage medium may be included in the electronic device described in the above embodiments, or it may exist independently and not incorporated into the electronic device.

[0158] The above embodiments are merely illustrative of the principles and effects of this application and are not intended to limit this application. Any person skilled in the art can modify or alter the above embodiments without departing from the spirit and scope of this application. Therefore, all equivalent modifications or alterations made by those skilled in the art without departing from the spirit and technical concept disclosed in this application should still be covered by the claims of this application.

Claims

1. A vehicle-based Bluetooth control method, characterized in that, include: When outside the vehicle or at a preset distance from the vehicle, acquire voice information from the Bluetooth headset and / or operation information from the Bluetooth headset charging case; The voice information is sent to a smart terminal via a first Bluetooth communication, the voice information is recognized to generate a first control command to control the vehicle, and / or the operation information is converted into a second control command for the vehicle; wherein, if the first control command and the second control command are contradictory control commands for the same object inside the vehicle, the second control command is determined to be a misoperation command, and only the first control command is used as the control command for the object; The first control command is sent to the vehicle via the smart terminal, and / or the second control command is sent to the vehicle via the second Bluetooth communication. In response to the first control command and / or the second control command, an execution result of the vehicle executing the corresponding control command is generated, and the execution result is fed back based on the smart terminal; the execution result is synchronized to the Bluetooth headset based on the first Bluetooth communication, and the execution result is broadcast aloud. Before recognizing the voice information to generate the first control command to control the vehicle, the method further includes: The system determines the current state of the Bluetooth headset. If the Bluetooth headset is in a call, the call is maintained so that the Bluetooth headset can monitor for a voice command to wake up the vehicle. If a wake-up command is detected, the voice function of the Bluetooth headset is activated. The system collects the voice information of the current user to generate a first control command to control the vehicle. If the Bluetooth headset is in a call and a voice command to wake up the vehicle is detected, the call state of the Bluetooth headset is switched to a busy state, and the voice function of the Bluetooth headset is used to collect the voice information of the current user to generate a first control command to control the vehicle. If the Bluetooth headset is not in a call, the voice information is converted into a first control command for the vehicle. The method further includes transmitting the voice information to a smart terminal via a first Bluetooth communication, recognizing the voice information to generate a first control command to control the vehicle, and including: The collected voice information is sent to a smart terminal via a first Bluetooth communication; the voice information is subjected to voice recognition to determine text data; and it is determined whether the text data includes the target object to be controlled. If the text data includes a target object to be controlled, the text data is converted into a first control command for the vehicle target device; if the text data does not include a target object to be controlled, user identity information is obtained based on the voice information, a semantic prediction model is called based on the user identity information to determine the target object, and the text data is converted into a first control command for the vehicle target device. Different users correspond to different user account information; the vehicle stores preset data for each vehicle controller in each user account information; when multiple users control the vehicle at the same time, while issuing instructions to the vehicle controller, the user account information corresponding to the user is queried, and the preset data related to the vehicle controller in the user account information is retrieved, so as to execute the instructions according to the preset data.

2. The vehicle-based Bluetooth control method according to claim 1, characterized in that, Receiving voice information from the Bluetooth earbuds and / or operation information from the Bluetooth earbuds charging case, also includes: If a wake-up command is detected, the voice function of the Bluetooth headset is activated; the voice signal is collected, and the voice information is determined; or / and The system obtains user clicks on the operation buttons on the outside of the Bluetooth earphone charging case or touches the operation buttons displayed on the Bluetooth earphone charging case, and confirms the operation information. The operation buttons include at least one of the following: vehicle unlock button, vehicle lock button, vehicle trunk control button, vehicle start button, and vehicle parking button.

3. The vehicle-based Bluetooth control method according to claim 1, characterized in that, Sending the voice information to a smart terminal via a first Bluetooth communication, recognizing the voice information to generate a first control command to control the vehicle, and / or converting the operation information into a second control command for the vehicle, further includes: The voice information is subjected to speech recognition to determine text data; the words in the text data are subjected to semantic analysis to determine the first control command for the vehicle. The key information corresponding to the operation information is converted into a second control command for the vehicle.

4. The vehicle-based Bluetooth control method according to any one of claims 1 to 3, characterized in that, User identity information is obtained based on the voice information, wherein the user identity information includes registered users and unregistered users, and also includes: Extract the voiceprint features from the speech information and match the voiceprint features with a preset voiceprint information database; If the voiceprint feature matches at least one voiceprint in the preset voiceprint information database, then the user is determined to be a registered user. If the stated voiceprint features do not match any voiceprint information in the preset voiceprint information database, then the user is determined to be an unregistered user.

5. The vehicle-based Bluetooth control method according to claim 4, characterized in that, The semantic prediction model includes a first semantic prediction model and a second semantic prediction model. The voice information corresponding to registered users and unregistered users is obtained as a first training set and a second training set, respectively. Features are extracted from the first and second training sets to obtain multiple first audio features and multiple second audio features. These multiple first and second audio features are input into the first and second semantic prediction models for training. A loss function is constructed based on the training output object and the labeled target object. Minimizing the loss function is determined as the end-of-training condition, thus obtaining the first and second semantic prediction models.

6. The vehicle-based Bluetooth control method according to claim 5, characterized in that, If the user is a registered user, the first semantic prediction model is used to determine the target object to be controlled by the vehicle; if the user is an unregistered user, the second semantic prediction model is used to determine the target object to be controlled by the vehicle.

7. The vehicle-based Bluetooth control method according to claim 6, characterized in that, If the received user is an unregistered user, the user's access rights are determined based on whether a registered user's voice authorization information is received. If a registered user's voice authorization information is received, the unregistered user's voice information is allowed to be converted into a first control command. If no voice authorization information is received from a registered user, then converting the voice information of the unregistered user into a first control command is prohibited.

8. A vehicle-based Bluetooth control device, characterized in that, Includes a Bluetooth headset, a Bluetooth headset charging case that matches the Bluetooth headset, a smart terminal that communicates with the Bluetooth headset via Bluetooth, and the Bluetooth headset charging case that is connected to the vehicle via Bluetooth. The smart terminal further includes: The first acquisition module is used to acquire voice information from the Bluetooth headset when it is outside the vehicle or at a preset distance from the vehicle; The first instruction determination module is used to send the voice information to the smart terminal based on the first Bluetooth communication, and to identify the voice information to generate a first control instruction to control the vehicle. The first instruction transmission module is used to send the first control instruction to the vehicle based on the smart terminal; The first instruction response module is used to control the vehicle to respond to the first control instruction, generate a first execution result of the vehicle executing the first control instruction, and feed back the first execution result based on the smart terminal. Before recognizing the voice information to generate the first control command to control the vehicle, the method further includes: The system determines the current state of the Bluetooth headset. If the Bluetooth headset is in a call, the call is maintained so that the Bluetooth headset can monitor for a voice command to wake up the vehicle. If a wake-up command is detected, the voice function of the Bluetooth headset is activated. The system collects the voice information of the current user to generate a first control command to control the vehicle. If the Bluetooth headset is in a call and a voice command to wake up the vehicle is detected, the call state of the Bluetooth headset is switched to a busy state, and the voice function of the Bluetooth headset is used to collect the voice information of the current user to generate a first control command to control the vehicle. If the Bluetooth headset is not in a call, the voice information is converted into a first control command for the vehicle. The first instruction determination module is specifically used for: The collected voice information is sent to a smart terminal via a first Bluetooth communication; the voice information is subjected to voice recognition to determine text data; and it is determined whether the text data includes the target object to be controlled. If the text data includes a target object to be controlled, the text data is converted into a first control command for the vehicle target device; if the text data does not include a target object to be controlled, user identity information is obtained based on the voice information, a semantic prediction model is called based on the user identity information to determine the target object, and the text data is converted into a first control command for the vehicle target device. Different users correspond to different user account information; the vehicle stores preset data for each vehicle controller in each user account information; when multiple users control the vehicle at the same time, while issuing instructions to the vehicle controller, the user account information corresponding to the user is queried, and the preset data related to the vehicle controller in the user account information is retrieved, so as to execute the instructions according to the preset data. or / and, The Bluetooth earphone charging case further includes: The second acquisition module is used to acquire operation information of the Bluetooth earphone charging case; The second instruction determination module is used to convert the operation information into a second control instruction for the vehicle; The second instruction transmission module is used to send the second control instruction to the vehicle via the second Bluetooth communication; wherein, if the first control instruction and the second control instruction are contradictory control instructions targeting the same object inside the vehicle, the second control instruction is determined to be an erroneous operation instruction, and only the first control instruction is used as the control instruction for the object; The second instruction response module is used to control the vehicle to respond to the second control instruction, generate a second execution result of the vehicle executing the second control instruction, and feed back the second execution result based on the smart terminal; The Bluetooth headset further includes: The voice broadcast module synchronizes the first execution result and / or the second execution result to the Bluetooth headset based on the first Bluetooth communication, and broadcasts the first execution result and / or the second execution result via voice.

9. The vehicle-based Bluetooth control device according to claim 8, characterized in that, The Bluetooth earphone charging case has operation buttons on its outer side, including at least one of the following: vehicle unlock button, vehicle lock button, vehicle trunk control button, vehicle start button, and vehicle parking button.

10. The vehicle-based Bluetooth control device according to claim 8 or 9, characterized in that, The Bluetooth earphone charging case has an indicator light and a pairing button on its outer side. When the Bluetooth earphone is charged in the Bluetooth earphone charging case, the pairing button can be touched to pair the Bluetooth earphone with a smart terminal, and also to pair the Bluetooth earphone charging case with a vehicle. The indicator light is used to display the Bluetooth connection status.

11. An electronic device, characterized in that, include: One or more processors; A storage device for storing one or more programs, which, when executed by the one or more processors, cause the electronic device to implement the vehicle-based Bluetooth control method according to any one of claims 1 to 7.

12. A computer-readable storage medium, characterized in that, It stores computer-readable instructions that, when executed by a computer's processor, cause the computer to perform the vehicle-based Bluetooth control method according to any one of claims 1 to 7.

Images