Method and system for communicating voice commands to a motor vehicle

Abstract

A method for transmitting commands to a motor vehicle (1) comprising a central control unit (23), at least one steered wheel (13), and a steering member (11) acting on the steered wheel (13) is described. The method comprises the following steps: activating a voice recognition function on a smartphone (5) interfaced with the central control unit (23) by means of an interface device (21) on the steering member (11). After the smartphone (5) has received a voice command transmitted by the driver and recognized by activating the voice recognition function, the smartphone (5) selects an instruction corresponding to the received voice command by means of its processing unit. The instruction is then executed.

Description

Technical Field

[0001] This article discloses methods and systems that facilitate driving motor vehicles, particularly saddle-shaped motor vehicles, i.e., tilting motor vehicles, such as motorcycles, scooters, etc. with two or three wheels. Background Technology

[0002] In the field of saddle-shaped motor vehicles with two or three wheels, such as motorcycles, mopeds, and scooters, there is a continuous search for solutions to improve driving comfort and safety.

[0003] DE 102014016827 discloses a method for driving a motor vehicle requiring the use of a helmet, wherein a microphone is integrated into the helmet. The microphone is interfaced with a mobile device (e.g., a smartphone connected to the helmet) having computing power and data transmission and reception capabilities. Activation of the helmet enables activation of the motor vehicle via the mobile device. In this way, the motor vehicle can be started without the need for an ignition key. In the embodiment disclosed in DE 102014016827, voice commands are also transmitted to the motor vehicle via the mobile device. The smartphone includes voice recognition software that recognizes voice commands for the motor vehicle. To avoid sending erroneous voice commands, voice recognition of commands to activate the motor vehicle is performed via a series of voice instructions or by applying an activation command to the helmet. In this way, although the voice recognition system is always active, sending commands to the motor vehicle is prohibited until the driver sends a specific voice instruction that is interpreted by the voice recognition system as an activation command, after which voice commands for controlling the motor vehicle can be transmitted and processed.

[0004] The systems and methods disclosed in DE102014016827 have a number of functional and security limitations and defects.

[0005] JP05092788 discloses a vehicle in which a voice recognition system is integrated for transmitting commands to the vehicle (e.g., activating a direction indicator). Only one driver can use the voice commands provided by the vehicle because voice recognition must be trained. A single user who can utilize voice commands must first set the voice commands in the vehicle and store them in the vehicle's internal memory. Any other user who wishes to use the same function of the vehicle must cancel the commands pre-set by the first user and then set his / her own voice commands. Therefore, the vehicle voice commands disclosed in this prior art document can only be used by one user.

[0006] Therefore, systems and methods that allow for more efficient and safer transmission of voice commands to driven motor vehicles (especially tilting or saddle-shaped motor vehicles) while wearing a helmet would be useful. Summary of the Invention

[0007] According to one aspect, this document discloses a method for transmitting commands to a motor vehicle. The motor vehicle includes a central control unit, at least one steering wheel, and a steering member acting on the steering wheel. The method includes the steps of: activating a voice recognition function on a mobile device interfaced with the central control unit via an interface device on the steering member. For this purpose, the mobile device includes a processing unit adapted to receive a voice command from the driver of the motor vehicle and select an instruction from a plurality of preset instructions on a smartphone based on the received voice command. The method also includes the step of receiving a voice command on the mobile device. Then, the processing unit of the mobile device selects an instruction corresponding to the received voice command and subsequently executes the selected instruction. In particular, the mobile device may be a smartphone. In the intended meaning herein, the term smartphone generally includes a mobile device with a SIM (Subscriber Identity SIM) card.

[0008] By setting individual user voice commands on each user's smartphone, multiple users, each with their own mobile device (smartphone), can use the same vehicle. In this way, signals sent to the vehicle by the smartphone are always recognized as valid by the vehicle, and there is no risk that the vehicle cannot recognize (or worse, misunderstands) the voice commands delivered by the driver.

[0009] Advantageously, the mobile device is adapted to provide an internet connection that allows for the acquisition of a specific user's voice recognition, thereby allowing the recognition of the mobile device owner's voice.

[0010] In this way, voice recognition can be activated only when needed, preventing erroneous commands from being passed to the system and reducing the power consumption of smartphones. By placing the voice recognition activation interface on the steering component (usually the handlebars), the driver can safely activate voice recognition without taking their hands off the handlebars or other steering components.

[0011] According to another aspect, this document discloses a system comprising a motor vehicle having a central control unit, at least one steering wheel, and a steering member acting on the steering wheel. The system also includes an interface device and a mobile device (particularly a smartphone) mounted on the steering member, the mobile device being in a data exchange relationship with the central control unit of the motor vehicle. The interface device is positioned and configured such that it can be operated by the driver who maintains control of the steering member, i.e., without needing to remove their hands from the correct position for interacting with the steering member.

[0012] The smartphone is adapted to activate its voice recognition function upon receiving an activation command. The activation command is sent to the smartphone via an interface device. Based on the voice command received by the smartphone and recognized by its voice recognition function, the smartphone is adapted to select an instruction from a pre-set set of commands.

[0013] Unlike, for example, that disclosed in JP05092788, the systems and methods of the present invention provide the ability to recognize user-transmitted voice using the hardware and software resources of a mobile device (smartphone). In this way, in addition to obtaining advanced vehicle control functions without compromising cost, the advantages of allowing more than one user to drive the same vehicle using user-customized voice commands in a safe manner are also achieved. Attached Figure Description

[0014] The invention will be better understood by following the description and accompanying drawings, which illustrate non-limiting embodiments of the invention. More specifically, in the figures:

[0015] Figure 1 The image shows a motor vehicle driven by a helmeted driver;

[0016] Figure 2 It shows Figure 1 A partial view of the handlebars of a motor vehicle;

[0017] Figure 3 A block diagram showing the components of a motor vehicle and the components of a smartphone connected to its interface; and

[0018] Figure 4 A flowchart is shown for a method of generating and executing instructions delivered via voice commands. Detailed Implementation

[0019] Figure 1 The illustration schematically depicts a motor vehicle 1 driven by a driver 2 wearing a helmet 3. The driver has a smartphone 5, which provides the functionality required to implement the methods described herein and to complete the system shown herein. Specifically, the smartphone includes a processing unit... Figure 2 The processor 5A is schematically represented in the diagram. The processing unit 5A provides processing power to the smartphone 5, enabling it to execute voice recognition programs and store commands and voiceprints (i.e., voice files). The smartphone is also equipped with receiving and transmitting functions for communication with a gateway (i.e., the central control unit located on the vehicle 1). The smartphone is also equipped with functions for communication with the driver 2 (e.g., via a display, preferably via a headset or another general-purpose speaker) and a connection to a microphone or a device typically used for capturing sound.

[0020] exist Figure 1In this context, the smartphone 5 is represented as being carried by the driver 2, for example, housed in a pocket, but it may be mounted on the handlebars of the motor vehicle 1 so that it can be easily seen by the driver 2.

[0021] The smartphone 5 is equipped with a microphone to allow driver 2 to communicate via voice. The smartphone 5 also has a speaker to allow driver 2 to hear auditory information from the smartphone 5. The speaker may be in the form of headphones. Figure 1 In the figure, reference numeral 7 schematically indicates an earphone connected to the interface of smartphone 5, and reference numeral 9 schematically indicates a microphone connected to the interface of smartphone 5. The earphone 7 (or other speaker) and microphone 9 can be connected to smartphone 5 using a wired connection, or preferably wirelessly, such as via Bluetooth. They can be plugged into helmet 3 or integrated therein.

[0022] Motor vehicle 1 includes a handlebar 11, which forms a steering member that rotates a front steering wheel 13 or a pair of front steering wheels 13. The handlebar 11... Figure 2 The image is partially shown in a view taken from the side of the driver 2. The handlebars 11 may include an instrument panel 15, which includes onboard instruments 17, such as a speedometer, odometer, warning lights for the vehicle's lights, etc. In some embodiments, such as... Figure 2 As illustrated schematically, for the purposes of the following explanation, the dashboard may also include a housing for holding the smartphone 5, in which case the smartphone 5 can be held so that the driver 2 can see its display.

[0023] The handlebars 11 include handlebars 11A that can be gripped by the driver 2. An interface device 21 (e.g., in the form of a button, a joystick, etc., the purpose of which will be explained below) is associated with one of the handlebars 11A (in this example, the right handlebar 11A).

[0024] The components of the motor vehicle 1 and the smartphone 5, which are helpful for understanding the methods and systems described herein, are... Figure 3 It is represented in the form of function blocks. More specifically, Figure 3 Box 5, representing a smartphone, is shown. The smartphone has a voice recognition application installed on it or belonging to its operating system. An application, the details of which will be described below, is also installed on the smartphone 5. This application allows for the conversion of voice commands (preferably customized) into instructions for the motor vehicle 1 and optionally for the smartphone 5.

[0025] Similarly, in Figure 3In the accompanying drawings, reference numerals 7 and 9 denote frames representing the earphone 7 and microphone 9, which are connected to the smartphone 5 via connection 6. As described above, the connection between the earphone 7 and microphone 9 and the smartphone 5 can be wireless or wired. Furthermore, the vehicle 1 is equipped with a central control unit 23, which has a data exchange relationship with the smartphone 5. The connection between the central control unit 23 of the vehicle 1 and the smartphone 5 is figuratively represented by double arrows 25. Preferably, connection 25 is a wireless connection, such as using Bluetooth or Wi-Fi technology. However, a wired connection is also feasible.

[0026] Interface device 21 is connected to central control unit 23 via a connection schematically represented by 27. Connection 27 can be a dedicated wired connection or can be obtained via the CAN bus provided by vehicle 1, which connects central control unit 23 to multiple electronic controllers or electronic control units provided by vehicle 1. Figure 3 For example, the CAN bus is represented by 31, which connects a series of control units of the motor vehicle (e.g., instrument panel control unit 33, ABS system control unit 35, engine control unit 37, and any other control unit of the motor vehicle 1 (which is represented as a whole by 39)) to the central control unit 23.

[0027] As already mentioned, the application is installed on the smartphone 5, and the application is activated (i.e. selected) by voice commands delivered by the driver 2 and recognized by the voice recognition software for instructions directed at the motor vehicle 1 and optionally for the smartphone 5.

[0028] In some embodiments, an application installed on smartphone 5 can provide the user with a series of instructions, each of which can be activated by a voice command, which can be customized by driver 2. In practice, during the application setup or programming steps, driver 2 can invoke individual instructions and associate customized voice commands with each instruction. When each individual instruction, which can be pre-set in the application, is activated, it will cause the device (motor vehicle 1; smartphone 5) to perform the activity expected by that instruction.

[0029] In a possible embodiment, the application may include a programming or setup mode that can have the function of invoking and displaying individual instructions, with which the user associates customized voice commands via the microphone and voice recognition software of the smartphone 5. In this way, each voice file (i.e., voiceprint) associated with a preset command or instruction on the application is stored in the smartphone 5. When the application is activated in operating mode, i.e., when voice commands are allowed to be received and their associated instructions executed, the user (i.e., driver 2) can transmit a voice command, which, once recognized by the voice recognition software of the smartphone 5, activates (during setup) the instruction associated with that voice command.

[0030] This operating mode allows users to associate voice commands (even invented or custom-designed ones) with one or more instructions provided by the application. For example, two instructions can be provided to activate the left and right direction indicators. Users can choose to associate easy-to-remember voice commands with these two instructions, such as "turn left" and "turn right" or the shorter "left" and "right," or even spoken or spoken commands whose semantic meaning is unrelated to the associated instructions.

[0031] Besides the advantage of not needing to remember voice commands set by the application but instead selecting preferred voice commands, there is also the advantage of not being limited by a given language while using the application. Therefore, users who speak different languages ​​will also want the same application, even with different pronunciations or dialects. The only potentially useful situation is when the various instructions for setting up or programming the application are available in the user's chosen language. For example, instructions written in various languages ​​are available in a library for each instruction available in the application. The user selects the operating language and can view the various instructions in the selected language on the smartphone's display. Instructions that can be associated with customized voice commands can optionally be displayed graphically rather than verbally. For example, instructions for activating left and right direction indicators can be displayed as icons showing one or the other of the two indicators on a motor vehicle flashing. When the application is downloaded and installed, the various instructions available in the application can be loaded into the smartphone 5, although they can also be selected from a library or database accessible online via the internet, for example, during programming or setup.

[0032] The aforementioned functions and related advantages of this application can also be implemented in systems that do not have the speech recognition activation mode described herein or have different speech recognition activation modes.

[0033] In some embodiments, the application may provide the user with instructions specific to the motor vehicle 1, that is, instructions that activate or cause to perform functions on the motor vehicle 1. In other embodiments, there may also be instructions for the smartphone 5, that is, activation of the instructions causes functions or activities performed by the smartphone 5 to be initiated.

[0034] Typical commands for smartphone 5 to facilitate driving can result in navigator activation, destination selection, high beam headlight activation, selection of motorcycle dynamic settings, selection of driving mode, display of specific parameters on the vehicle's dashboard, activation of complex dashboard functions (e.g., changing language, setting the clock, activating the walkie-talkie, activating the direction indicator, etc.), or functions directly related to applications on smartphone 5 (changing the displayed page, connecting applications to receive data, recording video, recording telemetry data, etc.).

[0035] Typically, instructions for motor vehicle 1 can be divided into instructions that cause actions, activities or operations on motor vehicle 1, and instructions that request information from motor vehicle 1. Motor vehicle 1 communicates with driver 2 via smartphone 5.

[0036] Typical potentially useful commands delivered to a motor vehicle via voice commands may include: activating left and right turn indicators, turning position lights on and off, low beam and high beam headlights, shifting gears, changing driving modes, automatic headlight flashing (when meeting oncoming traffic), changing control system settings (traction / stability control, ABS, cruise control, etc.), changing parameters displayed on the instrument panel, requesting remaining energy for driving distance, changing the data display mode on the instrument panel (e.g., day / night mode), activating / deactivating telemetry data logging, activating the emergency call system, etc.

[0037] Typical instructions that may be useful for allowing driver 2 to obtain information from motor vehicle 1 may involve trip data or other information related to the motor vehicle, such as remaining energy range in the case of electric vehicles and vehicles with internal combustion engines, average energy consumption or average speed of the trip or average energy consumption or average speed within a specific time / space interval (last hour, last 10 kilometers, etc.), distance or time of arrival when navigation is in progress, weather conditions along the route or at a given destination at a given time, estimated remaining energy range upon arrival at the destination, and the level set for various motor vehicle control systems, etc.

[0038] Some commands may affect the safety and driving conditions of a motor vehicle. In such cases, in some embodiments, the application may require the driver to confirm the transmitted command, and if confirmation is not possible, the command will not be executed. Examples include activating the cruise control system or modifying the speed set for the system when the traction / stability / braking system is deactivated (or when any input settings limit its operating range), activating launch control, changing the engine control parameter map, etc.

[0039] The system described herein can be constructed and used to facilitate the driving of motor vehicle 1.

[0040] The central control unit 23 can be configured to send a command to the smartphone 5 via connection 25 to activate the voice recognition function equipped on the smartphone 5. The voice recognition activation command can be triggered by the interface device 21 and communication channel 27. In practice, when a voice command is desired, the driver acts on the interface device 21, causing the central control unit 23 to send a voice recognition activation command to the connected smartphone 5. Once voice recognition is activated, the driver transmits the voice command to the smartphone 5 via microphone 9. The application residing in the smartphone 5 translates the voice command into corresponding instructions.

[0041] Using this arrangement, the smartphone's voice recognition can be kept inactive when not needed and activated only when required. This approach offers several advantages. In particular, it avoids the risk of voice commands being triggered by external noise or the driver's speech, such as during normal phone conversations or when talking to passengers.

[0042] The smartphone 5 application can be programmed to immediately deactivate voice recognition after an instruction corresponding to a received voice command has been delivered. Otherwise, voice recognition can remain active for a predetermined period after activation.

[0043] Interface device 21 can also be used to transmit different commands or instructions, such as activation and subsequent deactivation of voice recognition, or confirmation of transmitted voice commands, for example, as described above when they may affect driving safety. In this case, in practice, interface device 21 can be used sequentially: activating voice recognition; subsequently, after the application on smartphone 5 requests confirmation or permission, allowing the execution of instructions invoked via voice commands transmitted through smartphone 5.

[0044] To transmit different commands using interface device 21, interface device 21 may be provided with different components, such as multiple buttons or joysticks that can move in different directions. In other embodiments, a single button may be provided, which the driver 2 can use to transmit different commands by pressing the button once or multiple times, or by pressing and holding the button for different durations (e.g., a short press to activate voice recognition, or a long press to allow execution of instructions transmitted via voice commands, or vice versa).

[0045] To facilitate the use of the above functions, various situations or requests can be communicated to the driver 2 via optical signals on the display of the smartphone 5 (e.g., if it is mounted on or in the dashboard of the motor vehicle 1, it is clearly readable) or preferably via audio signals through the headset 7. For example, in this way, the driver 2 can be notified of the following situations or requests: proper activation of voice recognition; deactivation of voice recognition; request permission to execute instructions transmitted via voice commands. A voice synthesizer can be provided for communication with the driver 2 via the smartphone 5 (or via the central control unit 23).

[0046] As described above, the instructions that driver 2 can transmit via voice commands can not only trigger the execution of actions on motor vehicle 1, but these instructions can also include requests for information from motor vehicle 1. In this case, the central control unit 23 can convey information to the driver via messages displayed on the smartphone 5 and / or preferably via the headset 7. For example, driver 2 can activate voice recognition and use a voice command to request information about the remaining driving range of motor vehicle 1. The application translates this voice command into an instruction for the control unit. For example, the control unit of the dashboard or other in-vehicle instrument detects the remaining driving range and sends the answer to the smartphone 5. The application translates the received information into voice communication. Information is provided in this way without distracting the driver from the road by looking at the dashboard, or by providing the driver with information that would not be displayed due to the lack of a specific in-vehicle instrument.

[0047] Figure 4 Possible embodiments of the method according to the invention are summarized in the flowchart. In block 101, driver 2 activates interface device 21. Central control unit 23 sends a voice recognition activation command to smartphone 5. Block 102 verifies whether voice recognition is available. This block allows notification to driver 2 that voice recognition is unavailable for any reason, such as if voice recognition requires an internet connection and that connection is temporarily unavailable.

[0048] If voice recognition is unavailable, the smartphone 5 informs the driver 2, for example, via a voice error message and / or via a message on the smartphone 5's display (see box 103).

[0049] If voice recognition is available, the driver 2 sends voice commands to the smartphone 5 via the microphone 9.

[0050] The voice recognition software determines whether the voice has been recognized (box 104). If the voice is not recognized, or if the command is not recognized, for example because it does not correspond to any audio track or file stored in smartphone 5 and associated with the corresponding instruction, an error message is generated (box 105) and communicated to driver 2 via headset 7 and / or on the smartphone's display. The voice recognition function is deactivated. This may occur, for example, if driver 2 inadvertently uses another smartphone, or if the environment is too noisy and the voice recognition software cannot recognize the voice, or for any other reason, such as the voice command not being stored and / or not being associated with a specific instruction that can be passed to motor vehicle 1 and / or smartphone 5.

[0051] If the voice is recognized, the application verifies whether the instruction activated using the voice command requires confirmation from driver 2, i.e., permission to execute, see box 106. If not, the voice command (i.e., the instruction corresponding to the voice command) is executed, see box 107. The application may also request confirmation from driver 2 (via headset 7 and / or via the display of smartphone 5) that the instruction was correctly received and executed. Confirmation of the instruction represents a safety system adapted to prevent driver 2 from unintentionally transmitting potentially dangerous instructions to motor vehicle 1.

[0052] If the voice command activation requires driver permission or confirmation, control proceeds to box 108, awaiting permission or confirmation. If confirmation is given, for example, via interface device 21, control proceeds to box 107 and executes the instruction corresponding to the transmitted voice command. If no execution confirmation is received, box 110 is reached, a message (voice or vision, as shown above) is transmitted to driver 2, and voice recognition is stopped.

Claims

1. A method for transmitting commands to a motor vehicle (1), the motor vehicle (1) being equipped with a central control unit (23), at least one steering wheel (13), a steering member (11) acting on the steering wheel (13), and a smartphone (5) connected wirelessly to the central control unit (23) of the motor vehicle (1), wherein, The method includes the following steps: The voice recognition function on the smartphone (5) connected to the central control unit (23) is activated by the interface device (21) on the steering component (11), wherein the smartphone (5) includes a processing unit (5A) adapted to receive voice commands from the driver (2) of the motor vehicle (1) and select commands from a plurality of preset commands in the smartphone based on the received voice commands. Receive voice commands on the smartphone (5); The processing unit (5A) of the smartphone (5) selects the instruction corresponding to the received voice command; Verify whether the selected instruction needs to be confirmed by the driver (2); If the selected instruction requires confirmation from the driver (2), the smartphone (5) requests the driver (2) to provide confirmation of the execution of the selected instruction through the interface device (21), and executes the selected instruction in response to the driver (2) providing the confirmation. If the selected instruction does not require confirmation from the driver (2), then the selected instruction is executed.

2. The method according to claim 1, wherein, Activating the voice recognition function includes the following steps: The interface device (21) sends a request to the central control unit (23) of the motor vehicle (1) to activate the voice recognition function; and The central control unit (23) of the motor vehicle (1) sends a command to the smartphone (5) to activate the voice recognition function on the smartphone (5).

3. The method according to claim 1, wherein, Execute the selected instructions on the smartphone (5).

4. The method according to claim 2, wherein, Execute the selected instructions on the smartphone (5).

5. The method according to claim 1, wherein, The selected instruction is transmitted from the smartphone (5) to the motor vehicle (1), and the selected instruction is executed on the motor vehicle (1).

6. The method according to claim 2, wherein, The selected instruction is transmitted from the smartphone (5) to the motor vehicle (1), and the selected instruction is executed on the motor vehicle (1).

7. The method according to claim 3, wherein, The selected instruction is transmitted from the smartphone (5) to the motor vehicle (1), and the selected instruction is executed on the motor vehicle (1).

8. The method according to claim 4, wherein, The selected instruction is transmitted from the smartphone (5) to the motor vehicle (1), and the selected instruction is executed on the motor vehicle (1).

9. The method according to any one of claims 5 to 8, wherein, The instructions include at least one of the following: instructions for performing functions on the motor vehicle (1); and requests for sending information from the motor vehicle (1) to the smartphone (5).

10. The method according to any one of claims 1 to 8, wherein, The smart phone (5) is suitable for generating a confirmation that voice recognition has been activated.

11. The method according to claim 10, wherein, The confirmation includes one or more of the following: sound or acoustic signals emitted by a speaker (7) connected to the interface of the smartphone (5); optical or visual signals on the display of the smartphone (5) or on the display connected to the interface of the smartphone (5).

12. The method according to any one of claims 1 to 8, wherein, Smartphones (5) are suitable for associating custom voice commands with instruction strings in the programming process.

13. A system comprising: A motor vehicle (1) is equipped with a central control unit (23), at least one steering wheel (13), and a steering member (11) acting on the steering wheel (13). Interface device (21) on steering component (11); The smartphone (5) is in a data exchange relationship with the central control unit (23) of the motor vehicle (1), wherein the smartphone (5) is connected to the central control unit (23) of the motor vehicle (1) via a wireless connection; The smartphone (5) is adapted to activate the voice recognition function upon receiving an activation command, the sending of which is controlled by the interface device (21); and the smartphone (5) is adapted to select an instruction from a series of preset instructions on the smartphone based on a voice command received by the smartphone (5) and recognized by the voice recognition function; and At least one of the smart phone (5) and the central control unit (23) is configured to verify whether the selected instruction requires confirmation, and if the selected instruction requires confirmation, request confirmation of the execution of the selected instruction via voice command, and execute the selected instruction in response to the confirmation being provided, wherein the confirmation of the execution is activated by the interface device (21).

14. The system according to claim 13, wherein, The smartphone (5) is adapted to associate multiple voice commands with corresponding multiple preset instructions; and each of the instructions may be one of the following: an instruction executable on the smartphone (5); and an instruction executable on the motor vehicle (1).

15. The system according to claim 13, wherein, At least one of the preset instructions includes at least one of the following: a request to send information from the motor vehicle (1) to the smartphone (5), an instruction to perform a function on the motor vehicle (1), and an instruction to perform a function on the smartphone (5).

16. The system according to claim 14, wherein, At least one of the preset instructions includes at least one of the following: a request to send information from the motor vehicle (1) to the smartphone (5), an instruction to perform a function on the motor vehicle (1), and an instruction to perform a function on the smartphone (5).

17. The system according to any one of claims 13 to 16, wherein, Wireless connectivity is either Bluetooth or Wi-Fi.

Images