Method and device for signaling to an occupant of a vehicle a problem of involuntary cutting of a microphone of the vehicle

Abstract

The invention relates to a method and a device for signaling to an occupant of a vehicle a problem of involuntary cutting of a microphone of the vehicle. The method comprises the steps of detecting an open communication (201), when the voice data are exchanged between the communication module and the separate device; of identifying words emitted by the occupant (202), the identification being determined from an acquisition of sound data by a sensor of the vehicle; of determining an active operating state of the microphone (203), microphone activated or microphone deactivated; of determining a problem of involuntary cutting (204) when the communication is open and words are emitted by the occupant and the microphone is deactivated; when a communication problem is determined, generating an instruction of an alert signal (205), intended for a human-machine interface configured to inform said occupant.Figure to be published for the abstract: Figure 2.

Description

Title of the invention: Method and device for signaling to an occupant of a vehicle a problem of involuntary cutting of a microphone of the vehicle Technical field of the invention

[0001] The invention relates to the field of vehicle communication systems. The invention relates in particular, but not exclusively, to a method and a device for signaling a communication problem to an occupant of a vehicle. The invention applies in particular to motor vehicles. State of the art

[0002] “Vehicle” means any type of vehicle such as a motor vehicle, a moped, a motorcycle, a storage robot in a warehouse, etc.

[0003] A "communication module" means an electronic or computer component configured to transmit or receive information between different devices or systems. It is a self-contained unit that integrates specific communication functionalities, such as the transmission and reception of signals, the conversion of data formats, the management of communication protocols, etc.

[0004] The communication module facilitates communication with other systems by providing a standardized interface and predefined functionalities. Thus, the communication module can exchange voice data with a device separate from the vehicle.

[0005] The communication module is intended to be able to communicate with devices or systems external to the vehicle, such as a communication module of a second vehicle or a portable device, by wireless communication known to those skilled in the art such as WI-FI, Bluetooth, etc.

[0006] A "microphone" means an electronic device integrated into the vehicle and designed to pick up sounds, such as the voices of occupants or ambient noise, to enable clearly audible communications. It is generally integrated into an audio system or a vehicle communication system, such as a hands-free system or an emergency call system.

[0007] The microphone may be placed in different locations inside the vehicle, depending on the specific purpose of the microphone. For example, in a hands-free system, it may be integrated into the dashboard or on the steering wheel to facilitate hands-free telephone conversations.

[0008] “Separate device” means a device intended to receive a communication from a communication module and positioned outside the vehicle. For example, the separate device may be a communications module positioned in another vehicle or a smartphone or mobile phone or smartwatch.

[0009] Human-machine interfaces, commonly called HMIs, are configured to receive and / or transmit information from a user. For example, this may be a touch screen, a sound or haptic system, an odor diffuser, etc.

[0010] A first embodiment of the prior art is a vehicle speaker system comprising two microphones forming a microphone array, a speaker configured to output non-human sound, and a processor, the processor being programmed to determine whether human-generated sound is detected in the audio signal and instruct the speaker to adjust the non-human sound in response to the detection of human-generated sound. Human-generated sound means speech. Non-human sound emitted by the speaker means music or other media.

[0011] A second embodiment of the prior art is a computer-implemented method for operating a vehicle comprising receiving audio signals from a vehicle occupant by one or more microphones and generating an alert based on the vehicle occupant's behavior with respect to a set of rules.

[0012] However, such embodiments pose several problems. On the one hand, they do not take into consideration the case where the occupant enters into communication with a party external to the vehicle. On the other hand, they do not detect the case where the microphone has been involuntarily cut off by the occupant.

[0013] Indeed, in the case where the microphone has been cut while the occupant wishes to enter into communication or is in communication with a person outside the vehicle, the occupant is not aware that the information that he wishes to transmit to his person is not reaching him.

[0014] This microphone cutoff can lead to ineffective or frustrating communication because the occupant does not realize that the other party cannot hear them. Summary of the invention

[0015] An object of the present invention is to remedy the aforementioned problem, in particular to detect that the microphone has been muted while the occupant wishes to dialogue or is in dialogue with an external interlocutor via a telephone, a video conference or any other application using the microphone, and to alert the occupant that the microphone is muted, while minimizing distractions to the occupant.

[0016] To this end, a first aspect of the invention relates to a method for signaling to an occupant of a vehicle a problem of involuntary cutting of a microphone of the vehicle, the vehicle comprising the microphone and a communication module configured to exchange voice data with a device separate from the vehicle, the method being implemented by a processor and comprising the steps of: • Detection of open communication, when voice data is exchanged between the communication module and the separate device; • Identification of speech emitted by the occupant, the identification being determined from an acquisition of sound data by a vehicle sensor; • Determination of an active microphone operating state, microphone on or microphone off; • Determination of an involuntary disconnection problem when the communication is open and words are emitted by the occupant and the microphone is deactivated; • When a communication problem is determined, generation of an alert signal instruction to a configured human-machine interface to inform the occupant.

[0017] Thus, the vehicle's human-machine interface receives an alert signal and transmits it to the occupant so that he is informed that what he wishes to communicate is not transmitted to his interlocutor, which makes it possible to avoid ineffective or frustrating communication.

[0018] Advantageously, the human-machine interface emits an audible signal from the alert signal.

[0019] Advantageously, the human-machine interface emits, from the alert signal, a text message and / or a pop-up type message, the message being displayed on at least one screen.

[0020] Advantageously, the human-machine interface displays, from the alert signal, a pictogram on at least one screen.

[0021] Advantageously, the human-machine interface provides, from the alert signal, haptic feedback to said occupant of the vehicle.

[0022] Thus, the occupant is alerted by an audible signal, a text message, a pop-up message, a pictogram and / or haptic feedback that what he wishes to communicate is not being transmitted to his interlocutor. He can then remedy the problem.

[0023] Advantageously, the communication module is integrated into a portable device of the occupant of said vehicle, the portable device being paired with the vehicle.

[0024] Thus, when the occupant has paired his portable device, such as a mobile phone or “smartphone”, to the vehicle and he has accidentally muted the microphone, he is alerted by an audible signal, a text message, a pop-up message, a pictogram and / or haptic feedback that what he wishes to communicate is not transmitted to his interlocutor.

[0025] A second aspect of the invention relates to a device comprising a microphone, a communication module, a human-machine interface, a memory associated with at least one processor configured to implement the method according to the first aspect of the invention.

[0026] The invention also relates to a vehicle comprising the device.

[0027] The invention also relates to a computer program comprising instructions which, when the program is executed by the device according to the second aspect of the invention, lead the latter to implement the method according to the first aspect of the invention. Brief description of the figures

[0028] Other characteristics and advantages of the invention will emerge from the description of the non-limiting embodiments of the invention below, with reference to the appended figures, in which:

[0029] [Fig.l] schematically illustrates a device, according to a particular example of embodiment of the present invention.

[0030] [Fig.2] schematically illustrates a method for signaling to an occupant of a vehicle a problem of involuntary cutting of a microphone of the vehicle, according to a particular exemplary embodiment of the present invention. Detailed description of the invention

[0031] The invention is described below in its non-limiting application to the case of a motor vehicle.

[0032] [Fig.l] represents an example of a device 101 included in the vehicle, in a network (“cloud”) or in a server. This device 101 can be used as a centralized device in charge of at least certain steps of the method described below with reference to [Fig.2]. In one embodiment, it corresponds to a controller of a human-machine interface.

[0033] In the present invention, the device 101 is included in the vehicle.

[0034] This device 101 can take the form of a box comprising circuits printed, from any type of computer or even from a mobile phone (“smartphone”).

[0035] The device 101 comprises a random access memory 102 for storing instructions for the implementation by a processor 103 of at least one step of the method as described below. The device also comprises a mass memory 104 for storing data intended to be retained after the implementation of the method.

[0036] The device 101 may further comprise a digital signal processor (DSP) 105. This DSP 105 receives data to format, demodulate and amplify, in a manner known per se, this data.

[0037] The device 101 also comprises an input interface 106 for receiving the data implemented by the method according to the invention and an output interface 107 for transmitting the data implemented by the method according to the invention.

[0038] For example, the input interface 106 can receive the following data: navigation options, adjustment of comfort parameters, adjustment of sound volume, adjustment of air conditioning temperature, destination of the trip, adjustment of the position of the seats, adjustment of the lights, information related to the maintenance of the vehicle, etc. For example, the sensors capable of providing data are: touch screens, physical controls such as dials, switches or control levers, voice commands, GPS associated or not with a map, vehicle sensors such as RADAR, LIDAR, lasers, ultrasound, camera, microphone, communication module, human-machine interface, ...

[0039] For example, the input interface 106 can also receive voice data from a communication module or a separate device, a signal representative of an open communication, sound data, an active operating state of a microphone, microphone activated or microphone deactivated, a pairing state, ...

[0040] For example, the output interface 107 can transmit data similar to the data received by the input interface 106. The output interface 107 can also transmit a signal representative of a communication problem, an alert signal, an audible signal, a request to display a text message, a pop-up type message and / or a pictogram, a request to activate a haptic interface, etc.

[0041] [Fig.2] schematically illustrates a method for signaling to an occupant of a vehicle a problem of involuntary cutting of a microphone of the vehicle, according to a particular exemplary embodiment of the present invention. Said vehicle comprises the microphone and a communication module configured to exchange voice data with a device separate from the vehicle. Said method is implemented by a processor 103 and comprises several steps.

[0042] Step 201, DetCom, is a step of detecting an open communication, when the voice data is exchanged between the communication module and the separate device. For example, the method determines that the communication is open from a reception, by the input interface 106, of data or signals such as a signal transmitted from the separate device or the communication module.

[0043] Step 202, IdParole, is a step of identifying words emitted by the occupant, the identification being determined from an acquisition of sound data by a sensor of the vehicle. For example, a sensor such as a microphone is used, which can be positioned in the dashboard of the vehicle or in a front or rear door pillar of the vehicle, to capture sound data. For example, sound data is captured in real time. Filters can be used to reduce unwanted noise and audio signal processing techniques can be used to separate speech from other sound elements. For example, algorithms such as background subtraction, convolutional neural networks (CNNs) or machine learning-based methods can be used to identify whether the sound data corresponds to spoken speech, for example by comparing the sound data to a speech database.

[0044] Step 203, DetAct, is a step for determining an active operating state of the microphone, microphone activated or microphone deactivated. An activated microphone state is a state in which the microphone is active or functional. A deactivated microphone state is a state in which the microphone is inactive or muted. For example, the method determines the state of the microphone from a reception of a signal representative of the state of the microphone, the signal being transmitted by another device. It is known to determine by a device, such as a microphone itself, an HMI controlling the microphone, a sensor integrated into the microphone, or any other device, a state or status of the microphone. This state can be an activated state, which corresponds to a microphone which receives sounds and transmits signals. This state can be a deactivated state, which corresponds to a microphone which does not transmit signals.

[0045] Step 204, DetProb, is a step for determining an involuntary disconnection problem when the communication is open and speech is emitted by the occupant and the microphone is deactivated. The determinations that the communication is open, that speech is emitted by the occupant, and that the microphone is deactivated were made in the previous steps. Thus, effectively, in the presence of different means, vehicle microphone, communication module and separate device, it was possible to detect that the microphone was involuntarily disconnected while the occupant wishes to communicate or is communicating with an external interlocutor via a telephone, a videoconference or any other application using the microphone.

[0046] Step 205, Alert, is a step, when a communication problem is determined, of generating an instruction of an alert signal to a human-machine interface configured to inform the occupant. The communication problem is determined in step 204.

[0047] The alert signal can be transmitted to the human-machine interface by a specific communication protocol, of the CAN data bus type (acronym for “Controller Area Network”), LIN Bus (acronym for “Local Interconnect Network”), FlexRay, Ethernet, MOST (acronym for “Media Oriented Systems Transport”), etc.

[0048] Advantageously, the human-machine interface emits an audible signal from the alert signal. For example, upon receipt of the alert signal, the human-machine interface emits an alert beep. For example, upon receipt of the alert signal, the human-machine interface emits an audible signal, which may consist of 3 short beeps or 2 long beeps. For example, upon receipt of the alert signal, the human-machine interface emits a pre-recorded voice message.

[0049] Advantageously, said human-machine interface emits, from said alert signal, a text message and / or a pop-up type message, said message being displayed on at least one screen.

[0050] Thus, upon receipt of the alert signal, the human-machine interface informs the occupant in a visible manner, by means of a message. For example, a text message is displayed. The text message may be “microphone muted”, “unable to pick up sound”, etc., this message is displayed on a screen visible to the occupant. For example, the human-machine interface may emit a pop-up type message such as a window that opens in front of a main window of a screen and which displays the message “attention, microphone muted” or “the interlocutor cannot hear you”.

[0051] Advantageously, said human-machine interface displays, from said alert signal, a pictogram on at least one screen. For example, the human-machine interface can display a pictogram representing a crossed-out microphone on a screen, or a pictogram representing a triangular symbol with an exclamation point in its center.

[0052] Advantageously, the human-machine interface provides, from said alert signal, haptic feedback to the occupant of the vehicle. For example, haptic feedback is a vibration of the steering wheel or the pedals or the occupant's seat.

[0053] Advantageously, the communication module is integrated into a portable device of the occupant of said vehicle, the portable device being paired with the vehicle. The portable device of the occupant of the vehicle may be a mobile phone or "smartphone", a connected bracelet, etc. The pairing of the portable device of the occupant with the vehicle may be carried out, for example, by Bluetooth or by wired communication. For example, the pairing of the portable device of the occupant with the vehicle allows him to make calls from his vehicle in complete safety, while keeping his hands free. However, the occupant or a function linked to audio, for example another alert, may have inadvertently deactivated the microphone. Thus, the present invention allows the occupant to make calls from his vehicle and to be informed that his interlocutor cannot hear him.Thus, by being alerted clearly and effectively that the other person cannot hear them, the occupant's distractions are minimised since they are not forced to look for reasons, such as a network availability problem or a technical failure of the communication module, for . which his interlocutor does not hear him.

[0054] The present invention is not limited to the embodiments described above as examples: it extends to other variants.

[0055] For example, the method has been described according to a sequence of steps. Certain steps can be carried out in parallel or according to another sequence.

Claims

Claims

1. Method for signaling to an occupant of a vehicle a problem of involuntary cutting of a microphone of the vehicle, said vehicle comprising the microphone and a communication module configured to exchange voice data with a device separate from the vehicle, said method being implemented by a processor (103) and comprising the steps of: • Detection of an open communication (201), when the voice data are exchanged between the communication module and the separate device; • Identification of words emitted by the occupant (202), the identification being determined from an acquisition of sound data by a sensor of the vehicle; • Determination of an active operating state of the microphone (203), microphone activated or microphone deactivated;• Determining an involuntary disconnection problem (204) when the communication is open and words are emitted by the occupant and the microphone is deactivated; • When a communication problem is determined, generating an instruction for an alert signal (205), intended for a human-machine interface configured to inform said occupant.;

2. The method of claim 1, wherein said human-machine interface emits an audible signal from said alert signal.

3. Method according to one of the preceding claims, in which said human-machine interface emits, from said alert signal, a text message and / or a pop-up type message, said message being displayed on at least one screen.

4. Method according to one of the preceding claims, in which said human-machine interface displays, from said alert signal, a pictogram on at least one screen.

5. Method according to one of the preceding claims, in which said human-machine interface provides, from said alert signal, haptic feedback to said occupant of the vehicle.

6. A method according to any preceding claim, wherein said communication module is integrated into a portable device of the occupant of said vehicle, said portable device being paired with said vehicle.

7. Device (101) comprising a microphone, a communication module, a human-machine interface, and a memory (102) associated with at least one processor (103) configured to implement the method according to one of the preceding claims.

8.

9. Vehicle comprising the device according to the preceding claim. Computer program comprising instructions which, when the program is executed by the device (101) according to claim 7, cause the latter to implement the method according to one of claims 1 to 6.

Images