Emergency handling system for vehicle, emergency handling method and vehicle

Abstract

The invention provides a vehicle emergency processing system and method, a vehicle, computer equipment and a computer readable storage medium. The emergency situation processing system comprises an input module which is configured to acquire a video picture in a vehicle in real time and generate an input signal; the processing module comprises a visual identification unit, and the visual identification unit is configured to identify the input signal and generate an emergency processing signal based on a preset triggering mechanism; the interaction module is configured to obtain an emergency processing instruction from a user based on the emergency processing signal; and an execution module configured to execute an emergency handling action in response to the emergency handling instruction. When the emergency situation processing system recognizes that the user encounters the emergency situation in the vehicle, the emergency situation processing requirement of the user can be obtained by communicating with the user, so that help and / or support provided by the vehicle required by the user can be obtained.

Description

Technical Field

[0001] The present invention relates to the field of vehicles, and more particularly to the field of vehicle safety systems. More specifically, the present invention relates to an emergency handling system for a vehicle, an emergency handling method, a vehicle applying the emergency handling system, a computer device implementing the emergency handling method, and a computer-readable storage medium executing the emergency handling method. Background Art

[0002] With the increasing development of society, vehicles have become an indispensable part of people's lives. However, while enjoying the convenience brought by vehicles, people also face some safety problems, such as emergencies like kidnapping and hijacking. These emergencies pose threats not only to the vehicles but also to the safety of drivers and passengers.

[0003] Currently, although there are some vehicle safety systems, such as anti-theft systems, etc., these systems mainly focus on the safety of the vehicle itself rather than the safety of drivers and passengers. When drivers and passengers in the vehicle encounter emergencies, the current vehicle safety systems may not be able to provide effective assistance and support.

[0004] Therefore, a system for handling emergencies in vehicles is needed. Summary of the Invention

[0005] The object of the present invention is to solve the problems existing in the above-mentioned prior art, and to provide an emergency handling system for a vehicle, enabling the vehicle to handle emergencies in a cost-effective and reliable manner.

[0006] To this end, according to one aspect of the present invention, there is provided an emergency handling system for a vehicle, the emergency handling system comprising: an input module configured to collect video images inside the vehicle in real time and generate an input signal; a processing module including a visual recognition unit configured to recognize the input signal and generate an emergency handling signal based on a preset triggering mechanism; an interaction module configured to obtain an emergency handling instruction from a user based on the emergency handling signal; and an execution module configured to execute an emergency handling action in response to the emergency handling instruction.

[0007] According to the above technical concept, the present invention may further include any one or more of the following optional forms.

[0008] In some optional forms, the input module includes at least one camera, and the camera is an RGB camera and / or an RGB infrared camera.

[0009] In some alternative forms, the input signal includes at least one of lip movements, gesture movements, eyelid movements, and head movements.

[0010] In some alternative forms, the preset trigger mechanism includes at least one of preset lip movements, gesture movements, eyelid movements, and head movements from the user.

[0011] In some alternative forms, the emergency handling instruction includes at least one of the destination, route, speed, and emergency contact required by the user.

[0012] In some alternative forms, the interaction module is configured to communicate with the user using at least one of the vehicle's in-vehicle infotainment system, a mobile device communicatively connected to the vehicle's operating system, and an external emergency service terminal.

[0013] In some alternative forms, the interaction module is further configured to enable the user to transmit the emergency handling instruction to the operating system using at least one of lip movements, gesture movements, eyelid movements, and head movements.

[0014] In some alternative forms, the interaction module includes a non-verbal communication unit, and the non-verbal communication unit includes visual cues, a touch interface, or a combination thereof.

[0015] In some alternative forms, the non-verbal communication unit is configured to display a preset identifier on the screen of the in-vehicle infotainment system for the user to select.

[0016] In some alternative forms, the emergency handling actions include at least one of sending a silent emergency call to an emergency service department, sending a silent emergency alert to an emergency contact, and enabling a safety function of the vehicle.

[0017] In some alternative forms, the execution module includes an auxiliary safety unit communicatively connected to the vehicle's operating system, and the auxiliary safety unit is configured to perform auxiliary safety functions, and the auxiliary safety functions include actions for ensuring the privacy of the user.

[0018] In some alternative forms, the emergency handling system is provided in the vehicle's central controller or vehicle controller, and / or the emergency handling system is provided in a remote device.

[0019] According to another aspect of the present invention, there is provided an emergency handling method for a vehicle, the emergency handling method including: collecting in real time a video image inside the vehicle and generating an input signal; identifying the input signal and generating an emergency handling signal based on a preset triggering mechanism; obtaining an emergency handling instruction from a user based on the emergency handling signal; and performing an emergency handling action in response to the emergency handling instruction.

[0020] According to another aspect of the present invention, there is provided a vehicle, the vehicle including the above-mentioned emergency handling system for a vehicle.

[0021] According to another aspect of the present invention, there is provided a computer device, the computer device including a memory, a processor, and instructions stored on the memory and executable by the processor, wherein when the processor executes the instructions, the above-mentioned emergency handling method for a vehicle is implemented.

[0022] According to another aspect of the present invention, there is provided a computer-readable storage medium having computer-executable instructions stored thereon, the computer-executable instructions being used to execute the above-mentioned emergency handling method for a vehicle.

[0023] When the emergency handling system of the present invention recognizes that the driver and / or passenger encounters an emergency inside the vehicle, it can communicate with the driver and / or passenger to obtain their handling requirements for the emergency, so as to obtain the help and / or support that the driver and / or passenger needs from the operating system of the vehicle. Description of the Drawings

[0024] Other features and advantages of the present invention will be better understood through the following optional embodiments described in detail in conjunction with the drawings, wherein:

[0025] Figure 1 Shows a schematic diagram of an emergency handling system for a vehicle according to an embodiment of the present invention;

[0026] Figure 2 Shows a schematic flowchart of an emergency handling method for a vehicle according to an embodiment of the present invention;

[0027] Figure 3 Shows a help-seeking gesture of a user in an emergency according to an embodiment of the present invention; and

[0028] Figure 4 Shows a schematic diagram of a computer device according to an embodiment of the present invention. Detailed Embodiments

[0029] The implementation and use of the embodiments will be discussed in detail below. However, it should be understood that the specific embodiments discussed are merely exemplary illustrations of specific ways of implementing and using the present invention, and do not limit the scope of the present invention.

[0030] In addition, the flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of the methods and systems according to various embodiments of the present invention. It should be noted that the functions marked in the blocks may also occur in an order different from that marked in the accompanying drawings. For example, two consecutive blocks shown may actually be executed substantially in parallel, or they may sometimes be executed in the reverse order, depending on the functions involved.

[0031] During the driving of a vehicle, the user (driver and / or passenger) may encounter some emergency situations such as robbery where they are unable to speak. At this time, the user may need the vehicle's operating system to provide some assistance or support to enable the user to obtain rescue.

[0032] Referring to Figure 1 , Figure 1 shows a schematic diagram of an emergency situation handling system for a vehicle according to an embodiment of the present invention.

[0033] An emergency situation handling system 100 for a vehicle according to an embodiment of the present invention generally includes an input module 110, a processing module 120, an interaction module 130, and an execution module 140. Specifically, the input module 110 is used to collect video images inside the vehicle in real time and generate an input signal based on the collected video images. The processing module 120 includes a visual recognition unit 121, and this visual recognition unit 121 is used to recognize the input signal, that is, to recognize the collected video images inside the vehicle, and based on a preset triggering mechanism, determine whether an emergency situation such as kidnapping or hijacking has occurred inside the vehicle. When it is determined that an emergency situation has occurred inside the vehicle, the visual recognition unit 121 generates an emergency situation handling signal. The interaction module 130 is used to receive the emergency situation handling signal from the processing module 120, and communicate with the user based on this emergency situation handling signal, and obtain an emergency situation handling instruction from the user according to the user's needs. The execution module 140 is used to receive the emergency situation handling instruction from the interaction module 130, and execute an emergency situation handling action in response to this emergency situation handling instruction.

[0034] In this way, the emergency situation handling system 100 of the present invention can recognize the state of the user inside the vehicle, and communicate with the user when it recognizes that the user encounters an emergency situation, so as to obtain the user's handling requirements for the emergency situation, thereby enabling the vehicle to execute the assistance and / or support required by the user.

[0035] In some embodiments, the input module 110 may include at least one camera installed in the cockpit of the vehicle. The camera may be an RGB camera to continuously capture real-time video images inside the vehicle. RGB cameras typically use photosensitive elements of three primary colors, red, green, and blue, and can provide high-resolution and color images, which helps with tasks such as object detection, recognition, and tracking. Additionally, the camera may also be an RGB infrared camera. An RGB infrared camera has an RGB sensor for capturing visible light and an infrared sensor for capturing images in the infrared spectral range, and can perform tasks such as object detection, recognition, and tracking at night or in low-light environments. Additionally, in some embodiments, the RGB camera and the RGB infrared camera may be used in combination to improve the performance of the input module 110 at night or in low-light environments and reduce manufacturing costs.

[0036] In some embodiments, the input signals may include lip movements, gesture movements, eyelid movements, head movements, and other limb movements, etc. In the case where the input signal is a lip movement, the camera captures the lip movement of the driver or passenger and converts the captured lip movement into a digital signal as the input signal. Then, the visual recognition unit 121 in the processing module 120 analyzes the input signal and recognizes the word or phrase spoken by the user. At this time, the visual recognition unit 121 may include a lip-reading recognition unit. In this way, information can be transmitted more covertly when the user is not convenient to speak, without attracting the attention of others, enabling the user to provide input signals more securely.

[0037] After the visual recognition unit 121 of the processing module 120 analyzes and recognizes the input signal from the input module 110, it will determine whether an emergency situation occurs based on a preset trigger mechanism. In some embodiments, the preset trigger mechanism may include preset behavioral actions from the user, such as lip movements, gesture movements, eyelid movements, head movements, etc. For example, when the visual recognition unit 121 recognizes that the lip movement of the user includes a preset keyword or phrase (at this time the visual recognition unit 121 may include a lip-reading recognition unit), such as "help", "emergency situation", etc., or when the visual recognition unit 121 recognizes that the user makes a preset help gesture as shown in Figure 3 the visual recognition unit 121 will determine that the user is in an emergency situation and generate an emergency situation processing signal. In this way, the user can make the emergency situation processing system 100 of the vehicle confirm that the user is in an emergency state without being noticed by others through the preset trigger mechanism, which improves the safety of the user and enables the emergency situation processing system 100 to respond in a timely manner.

[0038] When the processing module 120 recognizes an emergency or a triggering mechanism, the interaction module 130 will be activated. In some embodiments, the interaction module 130 can use various communication channels, such as the vehicle's in-vehicle infotainment system, mobile devices (such as smartphones, tablets, laptops, etc.) communicatively connected to the vehicle's operating system, and external emergency service terminals, etc., to communicate with the user and obtain the user's requirements for handling the emergency. Specifically, when the user is in an emergency state, the interaction module 130 can transmit emergency handling instructions to the vehicle's operating system through lip movements, gesture movements, eyelid movements, head movements, etc. The emergency handling instructions can include the user's requirements and preferences, such as destination, route, speed, emergency contacts, etc. In this way, the vehicle's operating system can obtain more accurate emergency handling instructions, enabling the operating system to respond faster, reducing the judgment time of the operating system, and using lip reading to avoid potential threats to the user and protect the user's safety.

[0039] In some embodiments, the interaction module 130 can include a non-verbal interaction unit 131, which is used to further facilitate communication between the user and the emergency handling system 100 without verbal interaction. Specifically, the non-verbal interaction unit 131 can include visual cues, touch interfaces, or a combination thereof for the user to select. For example, the non-verbal interaction unit 131 can cause the emergency handling system 100 to display visual cues on the screen of the in-vehicle infotainment system, and these visual cues can indicate different types of help and support required by the user for the user to select. The visual cues can be a series of preset identifiers. For example, a circular identifier indicates that the user needs to call the police, and a square identifier indicates that the user needs to send an emergency alert to a designated emergency contact, etc. Additionally, the setting location of the visual cues is not limited to this and can also be set at positions accessible to the user, such as on the vehicle seat, steering wheel, etc. In this way, the user can select the required help without verbal interaction with the vehicle, enabling the emergency handling system 100 to provide more accurate help, reducing the system's response time, and improving the user's safety.

[0040] After the user selects the required help through the interaction module 130, the execution module 140 will be activated. The execution module 140 performs emergency handling actions in response to the emergency handling instructions. That is to say, the execution module 140 will execute appropriate responses according to the user's selection. In some embodiments, the emergency handling actions can include sending a silent emergency call to the emergency service department, sending a silent emergency alert to a designated emergency contact, enabling specific vehicle safety functions, which can be, for example, turning on the hazard lights, automatically braking the vehicle, driving the vehicle to a safe location, etc. It can be understood that the emergency handling actions are not limited to this and can be set as needed.

[0041] As Figure 1 shown, the execution module 140 according to the present embodiment may further include an auxiliary safety unit 141, which is communicatively connected to the vehicle's operating system and is configured to perform auxiliary safety functions. In some embodiments, the auxiliary safety functions may include locking the doors, windows, and front and rear trunks, etc. Additionally, the auxiliary safety functions may further include actions for ensuring user privacy, such as disabling audio and video devices, and encrypting communication data, etc. In this way, for example, it can prevent criminals from attempting to escape from the vehicle, and make it difficult for criminals to obtain the user's personal information, which helps to protect the user's privacy. Additionally, it can also reduce interference from outside the vehicle to the situation inside the vehicle, and prevent criminals from using the vehicle for improper communication or eavesdropping.

[0042] In some embodiments, the emergency handling system 100 may be disposed in the vehicle's central controller or vehicle controller, etc. In this way, the vehicle can achieve a more immediate response, and the emergency handling system 100 can directly communicate with and control various systems of the vehicle (such as doors, windows, etc.), reducing the risk of misoperation and improving the safety of the vehicle and the user.

[0043] Alternatively, the emergency handling system 100 may be disposed in a remote device, that is, in the cloud, for control through the background. In this way, the emergency contact or emergency service department can monitor the situation inside the vehicle and perform corresponding rescue measures without having to be directly near the vehicle. Additionally, when the vehicle is hijacked, the remote device can avoid the emergency contact or emergency service department directly contacting the dangerous environment, improving the safety of their rescue.

[0044] Referring to Figure 2 , Figure 2 shows a schematic flowchart of an emergency handling method for a vehicle according to an embodiment of the present invention.

[0045] An emergency handling method for a vehicle according to an embodiment of the present invention includes the following steps.

[0046] Step S101: Implement collecting a video image inside the vehicle and generating an input signal.

[0047] Step S102: Identify the input signal and generate an emergency handling signal based on a preset triggering mechanism.

[0048] Step S103: Obtain an emergency handling instruction from the user based on the emergency handling signal.

[0049] Step S104: Execute an emergency handling action in response to the emergency handling instruction.

[0050] For the specific functions of the emergency handling method of the vehicle, reference can be made to the description in the foregoing Figure 1 embodiment, which will not be elaborated here.

[0051] Refer to Figure 4 , Figure 4 FIG. shows a schematic diagram of a computer device according to an embodiment of the present invention.

[0052] The present invention also provides a computer device 200. As Figure 4 shown, the computer device 200 may include a memory 210 and a processor 220. Instructions 211 may be stored in the memory 210, and the instructions 211 may be executed by the processor 220. When the processor 220 executes the instructions 211, the emergency handling method of the vehicle according to the above embodiment is implemented.

[0053] The computer device 200 of the present embodiment may be a device such as a notebook, a desktop computer, and a cloud server. It can be understood that the components included in the computer device 200 are not limited to the memory 210 and the processor 220 and may vary depending on different needs. Exemplarily, the computer device 200 may further include a plurality of components connected to its input / output interface ( Figure 4 not shown in the figure), including but not limited to: an input unit, such as a keyboard, a mouse, etc.; an output unit, such as a display, a speaker, etc.; a storage unit, such as a semiconductor storage device, a magnetic surface storage device, an optical storage device, etc.; and a communication unit, such as a network card, a wireless communication transceiver, etc.

[0054] In some embodiments, the memory 210 may include, for example, a random access memory (RAM) or a read-only memory (ROM). The memory 210 may be used to store instructions, programs, codes, and other programs and data required by the computer device 200, but is not limited thereto.

[0055] In addition, the processor 220 may be a central processing unit (CPU), or other general-purpose processors, such as a digital signal processing (DSP), a field-programmable gate array (FPGA), a programmable logic array (PLA), etc.

[0056] In an exemplary embodiment of the present invention, there is also provided a computer-readable storage medium having computer-executable instructions stored thereon for performing the emergency handling method of a vehicle according to the above embodiment.

[0057] Optionally, the computer-readable storage medium according to the present embodiment may be a ROM, a RAM, a semiconductor storage device, a magnetic surface storage device, an optical storage device, etc.

[0058] When a user encounters some emergency situations where they cannot speak while in the vehicle, the emergency handling system of the vehicle according to the present invention can enable the vehicle's operating system to provide the help required by the user. The emergency handling system determines that the user is in an emergency by recognizing specific behavioral actions of the user (lip actions, gesture actions, eyelid actions, head actions, etc. in the embodiments of the present invention), and obtains the help required by the user through non-verbal communication with the user, providing a communication method in addition to spoken language, improving the response ability of the emergency handling system, and enhancing the safety of the user and the vehicle.

[0059] It should be understood that the embodiments shown in the figures only illustrate alternative configuration modes of the emergency handling system of the vehicle according to the present invention, but they are merely illustrative and not restrictive. Other configuration modes may be adopted without departing from the spirit and scope of the present invention.

[0060] The technical content and technical features of the present invention have been disclosed above. However, it can be understood that under the creative concept of the present invention, those skilled in the art can make various changes and improvements to the above-disclosed concept, but they all fall within the protection scope of the present invention. The description of the above embodiments is illustrative rather than restrictive, and the protection scope of the present invention is determined by the claims.

Claims

1. An emergency handling system for a vehicle, characterized in that, The emergency situation handling system (100) includes: An input module (110), which is configured to collect video images inside the vehicle in real time and generate an input signal; A processing module (120), the processing module (120) includes a visual recognition unit (121), and the visual recognition unit (121) is configured to recognize the input signal and generate an emergency situation handling signal based on a preset triggering mechanism; An interaction module (130), which is configured to obtain an emergency situation handling instruction from the user based on the emergency situation handling signal; An execution module (140), which is configured to execute an emergency situation handling action in response to the emergency situation handling instruction.

2. The emergency situation handling system for a vehicle according to claim 1, characterized in that, The input module (110) includes at least one camera, and the camera is an RGB camera and / or an RGB infrared camera.

3. The emergency handling system for a vehicle according to claim 1, characterized in that, The input signal includes at least one of lip movements, gesture movements, eyelid movements, and head movements.

4. The emergency handling system of a vehicle according to claim 1, characterized in that, The preset triggering mechanism includes at least one of preset lip movements, gesture movements, eyelid movements, and head movements from the user.

5. The emergency handling system of a vehicle according to claim 1, wherein The emergency situation handling instruction includes at least one of the destination, route, speed, and emergency contact required by the user.

6. The emergency handling system for a vehicle according to claim 1, wherein, The interaction module (130) is configured to communicate with the user using at least one of the vehicle's in-vehicle infotainment system, a mobile device communicatively connected to the vehicle's operating system, and an external emergency service terminal.

7. The emergency handling system for a vehicle according to claim 6, wherein, The interaction module (130) is further configured to enable the user to transmit the emergency situation handling instruction to the operating system using at least one of lip movements, gesture movements, eyelid movements, and head movements.

8. The emergency handling system for a vehicle according to claim 6, characterized in that, The interaction module (130) includes a non-verbal interaction unit (131), and the non-verbal interaction unit (131) includes a visual cue, a touch interface, or a combination thereof.

9. The emergency situation handling system for a vehicle according to claim 8, characterized in that, The non-verbal interaction unit (131) is configured to display a preset identifier on the screen of the in-vehicle infotainment system for the user to select.

10. The emergency situation handling system for a vehicle according to claim 1, wherein The emergency situation handling action includes at least one of sending a silent emergency call to an emergency service department, sending a silent emergency alert to an emergency contact, and enabling the vehicle's safety function.

11. The emergency situation handling system of a vehicle according to claim 1, wherein, The execution module (140) includes an auxiliary safety unit (141) communicatively connected to the vehicle's operating system, and the auxiliary safety unit (141) is configured to execute an auxiliary safety function, and the auxiliary safety function includes actions for ensuring the privacy of the user.

12. The emergency handling system for a vehicle according to any one of claims 1 to 11, characterized in that, The emergency situation handling system (100) is provided in the vehicle's central controller or vehicle controller, and / or the emergency situation handling system (100) is provided in a remote device.

13. An emergency handling method for a vehicle, characterized in that, The emergency situation handling method includes: Collecting video images inside the vehicle in real time and generating an input signal (S101); Recognizing the input signal and generating an emergency situation handling signal based on a preset triggering mechanism (S102); Obtaining an emergency situation handling instruction from the user based on the emergency situation handling signal (S103); Execute an emergency handling action (S104) in response to the emergency handling instruction.

14. A vehicle, characterized in that, The vehicle includes an emergency handling system for the vehicle according to any one of claims 1 to 12.

15. A computer device, characterized in that, The computer device (200) includes a memory (210), a processor (220), and instructions (211) stored on the memory (210) and executable by the processor (220), wherein when the processor (220) executes the instructions (211), the emergency handling method for the vehicle according to claim 13 is implemented.

16. A computer-readable storage medium, characterized in that, The computer-readable storage medium has computer-executable instructions stored thereon for executing the emergency handling method for the vehicle according to claim 13.

Images