Vehicle machine voice wake-up prevention method and system suitable for rest of people in vehicle and vehicle

Abstract

The invention discloses an in-vehicle voice wake-up prevention method and system suitable for resting of people in a vehicle and the vehicle, and belongs to the technical field of intelligent in-vehicle inforams.The method comprises the steps that the electrification condition of the vehicle is detected at intervals; when the detection vehicle is electrified, various vital sign monitoring signals in the vehicle are obtained, and whether a driver and passengers exist in the vehicle or not is judged; on the contrary, when the detection vehicle is not electrified, detection at the next moment after the interval time period is carried out; when it is judged that the driver and the passenger exist in the vehicle, the state of the driver and the passenger in the vehicle continues to be judged; if it is judged that the driver and passengers in the vehicle are in the resting state, the current vehicle voice wake-up function is turned off; and if the driver and the passengers in the vehicle are judged to be in the active state, the current vehicle voice wake-up function is kept to be started. Whether the voice wake-up function is started or not is controlled according to different states of drivers and passengers in the automobile, the situation that people outside the automobile can wake up the intelligent automobile by voice when the drivers and the passengers have a rest in the automobile is avoided, and the safety of the intelligent automobile is improved.

Description

Technical Field

[0001] The present invention belongs to the technical field of intelligent vehicle machine voice wake-up, and in particular relates to a method, system and vehicle for preventing vehicle machine voice wake-up suitable for people in a vehicle to rest. Background Art

[0002] With the vigorous development of smart cars, smart cars are becoming more and more popular, and more and more smart vehicles are equipped with intelligent voice systems. Most of the existing smart car systems are awakened by voice, and the operation of the smart car systems is controlled by voice commands, such as controlling the opening of windows and doors after issuing commands to the car computer by voice. Although the intelligent voice wake-up control brings portability to the operation of the driver and passengers, this method also has certain safety hazards: when the driver and passengers are resting in the car and fall asleep, and the car computer is powered on, since the smart car is also equipped with a microphone array outside the car to collect audio signals, the outsiders can wake up the smart car system by voice outside the car, and issue voice control commands to open the windows or trunk by voice, and steal valuables in the car without the driver and passengers noticing when they are resting, or even more serious security incidents may occur.

[0003] In view of the above situation, the existing methods of preventing wake-up outside the vehicle are mostly through voiceprint feature recognition of the acquired voice signal outside the vehicle. For example, patent CN202310079028.8 proposes a vehicle wake-up method and device, electronic equipment and storage medium. The corresponding voice wake-up operation will be performed only when the recognized voiceprint feature is consistent with the pre-stored voiceprint signal feature. However, the existing voiceprint recognition and matching technology is immature and has low recognition accuracy, which can easily lead to external strangers achieving voice wake-up outside the vehicle through simple imitation, etc., and there is still a high safety hazard. Summary of the invention

[0004] In order to solve the deficiencies of the above-mentioned prior art, the present invention provides a method, system and vehicle for preventing car computer voice wake-up which is suitable for people in the car to rest. By real-time monitoring of the situation in the car, it is determined whether there are drivers and passengers in the car and the status of the drivers and passengers in the car, and the activation or non-activation of the voice wake-up function of the smart car computer is controlled according to the different statuses. In this way, it is avoided that when the drivers and passengers are resting in the car, people outside the car can voice wake up the smart car computer to open the windows or trunk, which causes theft incidents, thereby effectively improving the safety of smart cars.

[0005] In a first aspect, the present invention provides a method for preventing vehicle machine from being awakened by voice when people in the vehicle are resting.

[0006] A method for preventing a vehicle machine from being awakened by voice when a person in the vehicle is resting, comprising:

[0007] Set the interval time period, and check the power status of the vehicle computer after each interval time period;

[0008] When the detection vehicle computer is powered, multiple vital signs monitoring signals in the vehicle are obtained to determine whether there are passengers in the vehicle; conversely, when the detection vehicle computer is not powered, the detection is performed at the next moment after the interval time period;

[0009] When it is determined that there are passengers in the car, continue to determine the status of the passengers in the car; if it is determined that the passengers in the car are in a resting state, turn off the current car voice wake-up function; if it is determined that the passengers in the car are in an active state, keep the current car voice wake-up function turned on.

[0010] In a second aspect, the present invention provides a voice wake-up system for preventing vehicle operators from resting in a vehicle.

[0011] A voice wake-up system for preventing vehicle operators from resting in a vehicle, comprising:

[0012] The vehicle computer power detection module is used to detect the power status of the vehicle computer after each interval time period;

[0013] Vital sign monitoring module, used to collect and monitor various vital sign monitoring signals in the vehicle;

[0014] The central processing unit is electrically connected to the vehicle computer power detection module and the vital signs monitoring module, and is used to execute the anti-vehicle computer voice wake-up method proposed in the first aspect, which is suitable for people in the vehicle to rest.

[0015] In a third aspect, the present invention further provides an electronic device comprising a memory and a processor and computer instructions stored in the memory and executed on the processor, wherein when the computer instructions are executed by the processor, the steps of the method proposed in the first aspect are completed.

[0016] In a fourth aspect, the present invention further provides a computer-readable storage medium for storing computer instructions, which, when executed by a processor, complete the steps of the method proposed in the first aspect.

[0017] In a fifth aspect, the present invention further provides a vehicle, which executes a vehicle-prevention voice wake-up method suitable for occupants to rest as proposed in the first aspect, or includes a vehicle-prevention voice wake-up system suitable for occupants to rest as proposed in the first aspect.

[0018] One or more of the above technical solutions have the following beneficial effects:

[0019] The present invention provides a method, system and vehicle for preventing vehicle computer voice wake-up when people in the vehicle are resting. For the scenario where people in the vehicle are resting, the system monitors the situation in the vehicle in real time and judges based on multiple monitoring signals to quickly judge whether there are drivers and passengers in the vehicle and the status of the drivers and passengers in the vehicle. The system controls whether the intelligent vehicle computer voice wake-up function is turned on or off according to the different status of the drivers and passengers, that is, when the drivers and passengers in the vehicle are resting, the current vehicle computer voice wake-up function is turned off, thereby avoiding the occurrence of theft incidents caused by people outside the vehicle voice-waking up the intelligent vehicle computer to open the window or trunk when the drivers and passengers are resting in the vehicle, thereby effectively improving the safety of smart cars. Compared with the traditional method of identifying voiceprint features, the method of the present invention has higher safety and reliability. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The accompanying drawings in the specification, which constitute a part of the present invention, are used to provide a further understanding of the present invention. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute improper limitations on the present invention.

[0021] Figure 1 The present invention is a flowchart of a method for voice awakening a vehicle anti-vehicle machine suitable for resting passengers in a vehicle according to an embodiment of the present invention.

[0022] Figure 2 This is a structural block diagram of the anti-vehicle machine voice wake-up system suitable for resting people in a vehicle according to an embodiment of the present invention. DETAILED DESCRIPTION

[0023] It should be noted that the following detailed descriptions are exemplary only, are intended to describe specific embodiments, are intended to provide further explanation of the present invention, and are not intended to limit exemplary embodiments according to the present invention. Unless otherwise specified, all technical and scientific terms used herein have the same meanings as those of ordinary skill in the art to which the present invention belongs. In addition, it should also be understood that when the terms "comprising" and / or "including" are used in this specification, it indicates the presence of features, steps, operations, devices, components and / or combinations thereof.

[0024] Embodiment 1

[0025] For vehicles with voice intelligent wake-up smart car machine, in order to avoid theft caused by people outside the car waking up the smart car machine by voice while the driver and passengers are resting in the car to open the car window or trunk, this embodiment proposes a voice wake-up method for preventing the car machine from being stolen when the passengers are resting in the car. Figure 1 As shown, the specific steps include:

[0026] Set the interval time period, and check the power status of the vehicle computer after each interval time period;

[0027] When the detection vehicle computer is powered, multiple vital signs monitoring signals in the vehicle are obtained to determine whether there are passengers in the vehicle; conversely, when the detection vehicle computer is not powered, the detection is performed at the next moment after the interval time period;

[0028] When it is determined that there are passengers in the car, continue to determine the status of the passengers in the car; if it is determined that the passengers in the car are in a resting state, turn off the current car voice wake-up function; if it is determined that the passengers in the car are in an active state, keep the current car voice wake-up function turned on.

[0029] The following content introduces in more detail the anti-vehicle machine voice wake-up method suitable for people in the car to rest proposed in this embodiment.

[0030] Step S1, set an interval time period, and detect the power status of the vehicle computer after each interval time period. If the vehicle computer is detected to be powered, execute the following step S3; if the vehicle computer is detected to be unpowered, execute the following step S2.

[0031] Step S2: When the vehicle computer is not powered, the next detection is performed after the set interval time period. Since the voice wake-up function cannot be turned on when the vehicle computer is not powered, no processing or adjustment is required at this time, and people outside the vehicle cannot use voice to wake up the vehicle computer to control the vehicle body. In addition, under normal circumstances, the interval time period of the detection is very short, usually in microseconds, and the interval time period does not affect the safety detection and safety of the vehicle.

[0032] Step S3: When the vehicle computer is detected to be powered, multiple vital signs monitoring signals in the vehicle are obtained to determine whether there are passengers in the vehicle. Further, if it is determined that there are passengers in the vehicle, step S4 is executed; otherwise, if it is determined that there are no passengers in the vehicle, the process ends directly, and the voice wake-up function of the vehicle computer is turned off.

[0033] Specifically, the above vital signs monitoring signals include pressure signals of all seats and backrests in the car, infrared signals of the interior space, visible light image data of the interior space, and human-computer interaction signals in the car, etc., wherein the human-computer interaction signals in the car include steering wheel pressure signals, car screen touch screen signals, etc. The above multiple data signals are obtained through multiple pressure sensors, infrared data meters, cameras, capacitive touch sensors, etc. Among them, multiple pressure sensors are respectively arranged inside each seat and backrest in the car, for obtaining pressure signals of each seat and backrest; infrared data meters and cameras are arranged at the position of the interior lighting or the position of the interior rearview mirror, for respectively obtaining infrared signals of the interior space and visible light image data of the interior space, so as to facilitate the acquisition of global signals or data in the car; pressure sensors are also arranged around the steering wheel to obtain steering wheel pressure signals; capacitive touch sensors are arranged under the car screen to obtain car screen touch screen signals.

[0034] In this embodiment, after obtaining the pressure signals of all seats and backrests in the car at the current moment, the infrared signals of the interior space, the visible light image data of the interior space, the steering wheel pressure signals, and the touch screen signals of the car computer screen, a judgment is made based on the various data signals obtained to determine whether there are any drivers or passengers in the car.

[0035] Furthermore, according to the multiple data signals obtained above, judgment is made. When any one of the data signals meets the preset conditions, it is judged that there are drivers and passengers in the car; conversely, when multiple data signals do not meet the preset conditions, it is judged that there are no drivers and passengers in the car. Among them, the preset conditions include: the pressure signal of any seat and backrest in the car exceeds the preset pressure threshold, there is a human body heat area in the infrared signal of the interior space, there is a human body area in the visible light image data of the interior space, the steering wheel pressure signal in the car exceeds the preset pressure value, and the car touch screen senses a touch signal. In the above conditions, the pressure threshold, pressure value, human body heat area, and human body area are all pre-set according to actual conditions. The pressure threshold and pressure value are specific data. The human body heat area is an area that conforms to the human body heat area and distribution. The human body area is an area with specific human body characteristics.

[0036] Specifically, the above-mentioned determination of whether the acquired data signal meets the preset condition includes:

[0037] (1) Comparing the pressure signals of all seats and backrests in the vehicle with a preset pressure threshold, if the pressure of any seat or backrest exceeds the preset pressure threshold, it is determined that there is a driver or passenger in the vehicle;

[0038] (2) Based on the infrared signal of the vehicle interior, the heat distribution is judged. If there is a human body heat area, it is judged that there are passengers in the vehicle;

[0039] (3) Based on the visible light image of the interior space of the vehicle, a pre-trained existing detection model is used to perform image processing and recognition. If a human body area is found in the recognized image, it is determined that there are passengers in the vehicle;

[0040] (4) comparing the steering wheel pressure signal with a preset pressure value, and if the steering wheel pressure exceeds the preset pressure value, determining that there is a driver or passenger in the vehicle;

[0041] (5) Based on the touch signal sensed by the vehicle computer touch screen, if a touch signal on the vehicle computer touch screen is sensed, it is determined that there is a driver or passenger in the vehicle.

[0042] When it is determined that the multiple vital sign monitoring signals meet any of the above preset conditions, it is considered that there is a driver or passenger in the vehicle, and the next step S4 is executed; otherwise, it is considered that there is no driver or passenger in the vehicle.

[0043] Step S4: When it is determined that there are passengers in the vehicle, continue to determine the status of the passengers in the vehicle.

[0044] Specifically, the state judgment method is:

[0045] Obtain the in-vehicle image data within a set time period through the camera;

[0046] Based on multiple continuous frames of in-vehicle images in the in-vehicle image data, the existing image processing and recognition algorithms are used to identify the driver and passengers and their eye areas in each image;

[0047] The state of the driver and occupant is judged based on the identified position and posture changes of the driver and occupant in the vehicle, as well as the identified state of the driver and occupant's eye area; wherein, when the position or posture of the driver and occupant in the vehicle changes in any two consecutive frame images, or the driver and occupant's eye area is open in any two consecutive frame images, it is judged that the driver and occupant in the vehicle is in an active state; otherwise, it is judged that the driver and occupant in the vehicle is in a resting state.

[0048] Furthermore, if it is determined that the driver and passengers in the car are in a resting state, the current car computer voice wake-up function will be turned off to avoid theft caused by people outside the car waking up the smart car computer by voice to open the window or trunk when the driver and passengers are resting in the car; if it is determined that the driver and passengers in the car are in an active state, the current car computer voice wake-up function will remain turned on.

[0049] As another implementation method, when it is determined that the driver and passengers in the car are in an active state, while keeping the current car computer voice wake-up function turned on, the vital signs data of the driver and passengers are monitored and obtained, such as monitoring human body temperature data through an infrared data meter, or monitoring human heart rate data through wearable monitoring devices, and finally uploading the monitoring data to the cloud server for subsequent data processing and application.

[0050] Embodiment 2

[0051] This embodiment provides a voice wake-up system for preventing vehicle operators from resting in a vehicle. Figure 2 As shown, including:

[0052] The vehicle computer power detection module is used to detect the power status of the vehicle computer after each interval time period;

[0053] Vital sign monitoring module, used to collect and monitor various vital sign monitoring signals in the vehicle;

[0054] The central processing unit is electrically connected to the vehicle computer power detection module and the vital sign monitoring module, and is used to execute a method for preventing vehicle computer voice wake-up for resting occupants proposed in the first embodiment.

[0055] In this embodiment, the vehicle computer power detection module includes a current transformer, which detects the power status of the vehicle computer at set time intervals according to the control instructions issued by the central controller, and transmits the detection results to the central processor.

[0056] Furthermore, the above-mentioned vital signs monitoring module is used to collect multiple data signals and transmit them to the central processing unit. The vital signs monitoring module includes multiple pressure sensors, infrared data meters, cameras, capacitive touch sensors, etc. arranged in the vehicle, wherein multiple pressure sensors are respectively arranged inside each seat and backrest in the vehicle, the infrared data meter and the camera are arranged at the position of the interior lighting or the position of the interior rearview mirror, the pressure sensors are also arranged around the steering wheel, and the capacitive touch sensor is arranged under the vehicle screen.

[0057] Furthermore, the central processor is also electrically connected to the intelligent vehicle computer. The central processor uses the method proposed in Example 1 to make a judgment based on the power status of the vehicle computer and multiple vital sign monitoring signals, and controls the turning on and off of the vehicle computer voice wake-up function based on the judgment result.

[0058] Embodiment 3

[0059] This embodiment provides an electronic device, including a memory and a processor, and computer instructions stored in the memory and running on the processor. When the computer instructions are run by the processor, the steps of the above-mentioned anti-vehicle machine voice wake-up method suitable for resting people in the vehicle are completed.

[0060] Embodiment 4

[0061] This embodiment also provides a computer-readable storage medium for storing computer instructions. When the computer instructions are executed by a processor, the steps in the above-mentioned anti-vehicle machine voice wake-up method suitable for resting occupants are completed.

[0062] Embodiment 5

[0063] This embodiment also provides a vehicle, which executes the above-mentioned anti-vehicle machine voice wake-up method suitable for occupant resting, or includes the above-mentioned anti-vehicle machine voice wake-up system suitable for occupant resting.

[0064] The steps involved in the above embodiments 2 to 5 correspond to the method embodiment 1. For the specific implementation, please refer to the relevant description part of embodiment 1. The term "computer-readable storage medium" should be understood as a single medium or multiple media including one or more instruction sets; it should also be understood to include any medium that can store, encode or carry an instruction set for execution by a processor and enable the processor to execute any method in the present invention.

[0065] Those skilled in the art should understand that the modules or steps of the present invention described above can be implemented by a general-purpose computer device, or alternatively, they can be implemented by a program code executable by a computing device, so that they can be stored in a storage device and executed by the computing device, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. The present invention is not limited to any specific combination of hardware and software.

[0066] The above description is only a preferred embodiment of the present invention. Although the specific implementation mode of the present invention is described in conjunction with the accompanying drawings, it is not a limitation of the protection scope of the present invention. Those skilled in the art should understand that on the basis of the technical solution of the present invention, various modifications or variations that can be made by those skilled in the art without creative work are still within the protection scope of the present invention.

Claims

1. A method for waking up a vehicle machine with voice for a person to rest in the vehicle, characterized in that: include: Set the interval time period, and check the power status of the vehicle computer after each interval time period; When the detection vehicle computer is powered, multiple vital signs monitoring signals in the vehicle are obtained to determine whether there are passengers in the vehicle; conversely, when the detection vehicle computer is not powered, the detection is performed at the next moment after the interval time period; When it is determined that there are passengers in the vehicle, continue to determine the status of the passengers in the vehicle; If it is determined that the driver and passengers in the car are in a resting state, the current car computer voice wake-up function is turned off; if it is determined that the driver and passengers in the car are in an active state, the current car computer voice wake-up function is kept turned on.

2. A method for waking up a vehicle alarm system by voice suitable for a person in a vehicle who is resting as claimed in claim 1, characterized in that: Obtain various vital signs monitoring signals in the car to determine whether there are passengers in the car, including: Obtain the pressure signals of all seats and backrests in the car at the current moment, the infrared signals of the interior space, the visible light image data of the interior space, the steering wheel pressure signals, and the touch screen signals of the car screen; Based on the various data signals obtained, it is determined whether there are any passengers in the car.

3. A method for waking up a vehicle alarm system by voice suitable for a person in a vehicle who is resting as claimed in claim 2, characterized in that: The determining whether there is a driver or passenger in the vehicle includes: A judgment is made based on the multiple data signals obtained. When any one of the data signals meets the preset conditions, it is judged that there are passengers in the vehicle; otherwise, when the multiple data signals do not meet the preset conditions, it is judged that there are no passengers in the vehicle; Among them, the preset conditions include: the pressure signal of any seat and backrest in the car exceeds the preset pressure threshold, there is a human body heat area in the infrared signal of the interior space of the car, there is a human body area in the visible light image data of the interior space of the car, the steering wheel pressure signal in the car exceeds the preset pressure value, and the car touch screen senses a touch signal.

4. A method for waking up a vehicle alarm system by voice for a person in a vehicle who is resting as claimed in claim 1, characterized in that: Determine whether the vehicle occupants are at rest or active, including: Obtain in-vehicle image data within a set time period; Based on multiple continuous frames of in-vehicle images in the in-vehicle image data, image processing and recognition algorithms are used to identify the driver and passengers and their eye areas in each image; The status of the driver and occupants is determined based on the identified positions and posture changes of the driver and occupants in the vehicle, as well as the identified status of the driver and occupants' eye areas.

5. A method for waking up a vehicle alarm system by voice suitable for a person in a vehicle who is resting as claimed in claim 4, characterized in that: When the position or posture of the driver or occupant in the vehicle changes between any two consecutive frame images, or the eye area of ​​the driver or occupant in any two consecutive frame images is open, it is determined that the driver or occupant in the vehicle is in an active state; Otherwise, it is judged that the occupants in the vehicle are in a resting state.

6. A method for waking up a vehicle alarm system by voice for a person in a vehicle who is resting as claimed in claim 1, characterized in that: When it is determined that the driver and passengers in the car are in an active state, the current car computer voice wake-up function is kept turned on while monitoring and obtaining the vital signs data of the driver and passengers, and uploading the monitoring data to the cloud server.

7. A voice wake-up system for vehicle alarm system suitable for resting passengers in a vehicle, characterized in that: include: The vehicle computer power detection module is used to detect the power status of the vehicle computer after each interval time period; Vital sign monitoring module, used to collect and monitor various vital sign monitoring signals in the vehicle; The central processing unit is electrically connected to the vehicle computer power detection module and the vital signs monitoring module, and is used to execute a method for preventing vehicle computer voice wake-up when a person in the vehicle is resting as described in any one of claims 1 to 6.

8. An electronic device, characterized in that: The invention comprises a memory and a processor and computer instructions stored in the memory and executed on the processor. When the computer instructions are executed by the processor, the steps of a method for voice awakening a vehicle machine suitable for resting people in a vehicle as described in any one of claims 1 to 6 are completed.

9. A computer-readable storage medium, characterized in that: Used to store computer instructions, which, when executed by a processor, complete the steps of a method for voice awakening a vehicle machine suitable for resting people in a vehicle as described in any one of claims 1 to 6.

10. A vehicle, characterized in that: A method for waking up a vehicle anti-vehicle machine by voice suitable for a person in a vehicle to rest as described in any one of claims 1 to 6 is implemented, or a system for waking up a vehicle anti-vehicle machine by voice suitable for a person in a vehicle to rest as described in claim 7 is included.

Images