Detection system

By combining blind spot and glasses modules, the vehicle and driver status can be detected in real time, solving the problem of insufficient blind spot and line of sight detection in existing technologies and reducing the accident rate.

CN115503609BActive Publication Date: 2024-11-22INVENTEC PUDONG TECH CORPOARTION +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202110632448.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-06-07
Publication Date
2024-11-22
Estimated Expiration
2041-06-07

AI Technical Summary

Technical Problem

Existing vehicle detection systems are unable to effectively detect blind spots and the driver's line of sight, leading to frequent traffic accidents.

Method used

Employing blind spot detection and glasses modules, combined with recording, identification, judgment, and transmission devices, it uses millimeter-wave wireless transmission and artificial intelligence to detect the vehicle's surrounding environment and the driver's status in real time, providing visual and voice warnings.

Benefits of technology

It provides real-time alerts to drivers' blind spots and blind areas, reducing the incidence of traffic accidents.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115503609B_ABST
    Figure CN115503609B_ABST
Patent Text Reader

Abstract

The present invention discloses a detection system. It includes a blind spot detection module and a glasses module. The blind spot detection module includes a first recording device for recording images around the vehicle; a first identification device for generating blind spot identification results; a first judgment device for judging whether to transmit images around the vehicle and / or blind spot warning information; and a transmission device for transmitting images around the vehicle and / or blind spot warning information. The glasses module includes a receiving device for receiving images around the vehicle and / or blind spot warning information; a second recording device for recording images around the user; a second identification device for generating eye identification results; a second judgment device for judging whether to display images around the user and / or eye warning information through artificial intelligence; and a display device for displaying images around the user and / or eye warning information.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to a detection system, in particular to a detection system for detecting vehicle blind spots and user's eyes. Background Art

[0002] Driving often causes car accidents due to blind spots (such as A-pillars) or because the driver is distracted and fails to notice the people and things around the vehicle. The functions of current vehicles to detect the surrounding conditions and driving conditions are limited, and it is difficult to avoid the above-mentioned car accidents. Therefore, how to detect the surrounding conditions and driving conditions of the vehicle is an urgent problem to be solved. Summary of the invention

[0003] The present invention provides a detection system for detecting the blind spots of a vehicle and the eyes of a user to solve the above-mentioned problems.

[0004] According to one embodiment, the detection system of the present invention includes a blind spot detection module and a glasses module. The blind spot detection module includes a first video recording device for recording an image around a vehicle; a first identification device for identifying at least one blind spot of a vehicle to generate a blind spot identification result; a first judgment device coupled to the first video recording device and the first identification device for judging whether to transmit at least one of the image around the vehicle and a blind spot warning message based on the image around the vehicle and the blind spot identification result to generate a first judgment result; and a transmission device coupled to the first judgment device for transmitting at least one of the image around the vehicle and the blind spot warning message based on the first judgment result. The eyeglass module includes a receiving device for receiving at least one of the vehicle's surrounding image and the blind spot warning information from the transmitting device; a second recording device for recording a user's surrounding image; a second identification device for identifying a user's eyes to generate an eye identification result; a second judgment device coupled to the second recording device and the second identification device, for judging whether to display at least one of the user's surrounding image and the eye warning information through artificial intelligence (AI) based on the user's surrounding image and the eye identification result to generate a second judgment result; and a display device coupled to the receiving device and the second judgment device, for displaying at least one of the user's surrounding image and the eye warning information, and displaying at least one of the vehicle's surrounding image and the blind spot warning information based on the second judgment result.

[0005] The vehicle surrounding image includes a vehicle surround image.

[0006] The blind spot warning information includes at least one of an image message and a voice message.

[0007] The transmitting device includes: a first communication module for performing a millimeter wave wireless transmission; wherein through the millimeter wave wireless transmission, the transmitting device transmits at least one of the vehicle surrounding image and the blind spot warning information.

[0008] The glasses module is an augmented reality glasses module or a mixed reality glasses module.

[0009] The eyeglass module further includes: a third identification device coupled to the display device, for identifying a voice command of the user; wherein according to the voice command, the display device displays at least one of the vehicle surrounding image and the user surrounding image corresponding to the voice command.

[0010] The receiving device includes: a second communication module for performing a millimeter wave wireless transmission; wherein through the millimeter wave wireless transmission, the receiving device receives at least one of the vehicle surrounding image and the blind spot warning information.

[0011] The second identification device identifies at least one of an eyeball rotation direction and an eyelid closure status of the user's eye.

[0012] The eye warning information includes at least one of an image message and a voice message.

[0013] The display device is a micro-light emitting diode display device. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 FIG. 1 is a schematic diagram of a detection system according to an embodiment of the present invention.

[0015] Figure 2 FIG. 1 is a schematic diagram of a glasses module according to an embodiment of the present invention.

[0016] Figure 3 FIG. 1 is a schematic diagram of a detection method according to an embodiment of the present invention.

[0017] Explanation of symbols:

[0018] 10: Detection system

[0019] 100: Blind spot detection module

[0020] 102: First video recording device

[0021] 104: First identification device

[0022] 106: First judgment device

[0023] 108:Transmission device

[0024] 200,20: Glasses module

[0025] 202: Receiving device

[0026] 204: Second video recording device

[0027] 206: Second identification device

[0028] 208 second judgment device

[0029] 210: Display device

[0030] 212: Third identification device

[0031] S10, S12, S14, S16, S18, S20, S22, S24: Steps DETAILED DESCRIPTION

[0032] Figure 1 Schematic diagram of a detection system 10 according to an embodiment of the present invention. The detection system 10 includes a blind spot detection module 100 and a glasses module 200. The blind spot detection module 100 includes a first video recording device 102 (e.g., a rear-mounted vehicle video recorder), a first identification device 104, a first judgment device 106, and a transmission device 108. The glasses module 200 includes a receiving device 202, a second video recording device 204 (e.g., a video recorder), a second identification device 206, a second judgment device 208, and a display device 210.

[0033] exist Figure 1 In the embodiment, the first video recording device 102 is used to record the image around the vehicle. The first identification device 104 is used to identify at least one blind spot of a vehicle to generate a blind spot identification result. The first judgment device 106 is coupled to the first video recording device 102 and the first identification device 104. According to the image around the vehicle and the blind spot identification result, the first judgment device 106 determines whether to transmit at least one of the image around the vehicle and the blind spot warning information to generate a first judgment result. The transmission device 108 is coupled to the first judgment device 106. According to the first judgment result, the transmission device 108 transmits at least one of the image around the vehicle and the blind spot warning information.

[0034] In one embodiment, the vehicle surrounding image includes a vehicle surround image. The vehicle surround image includes images of the front, rear and both sides of the vehicle. In one embodiment, the blind spot warning information includes at least one of image information and voice information. For example, when a vehicle (such as a rear-mounted vehicle) turns and there are other vehicles or pedestrians in the driving blind spot, or when the vehicle deviates from the lane, the detection system 10 provides an image of the driving blind spot / vehicle deviation (such as image information), and / or issues a warning sound (such as voice information) to remind the user (such as the driver) to pay attention. In one embodiment, the transmitting device 108 includes a first communication module for performing millimeter wave (mm wave) wireless transmission. Through millimeter wave wireless transmission, the transmitting device 108 transmits at least one of the vehicle surrounding image and blind spot warning information.

[0035] exist Figure 1 In the embodiment, the receiving device 202 receives at least one of the vehicle surrounding image and the blind spot warning information from the transmitting device 108. The second recording device 204 is used to record the user's surrounding image. The second recognition device 206 is used to recognize the eyes of the user (e.g., the driver) to generate an eye recognition result. The second judgment device 208 is coupled to the second recording device 204 and the second recognition device 206. According to the user's surrounding image and the eye recognition result, the second judgment device 208 determines whether to display at least one of the user's surrounding image and the eye warning information through artificial intelligence (AI) to generate a second judgment result. The display device 210 is coupled to the receiving device 202 and the second judgment device 210. According to the second judgment result, the display device 210 displays at least one of the user's surrounding image and the eye warning information, and displays at least one of the vehicle's surrounding image and the blind spot warning information.

[0036] In one embodiment, the glasses module 200 is an augmented reality (AR) glasses module or a mixed reality (MR) glasses module. In one embodiment, the receiving device 202 includes a second communication module for performing millimeter wave wireless transmission. Through millimeter wave wireless transmission, the receiving device 202 receives at least one of the images around the vehicle and the blind spot warning information. In one embodiment, the second recognition device 206 recognizes the direction of eyeball rotation of the user's eyes. For example, when the vehicle turns, the user (such as the driver) should pay attention to other vehicles or pedestrians in the direction of the turn. In this case, the second recognition device 206 recognizes whether the user's eyeballs are rotated to the corresponding direction. For example, when the vehicle passes through an intersection, the second recognition device 206 recognizes the direction of rotation of the user's eyeballs to determine whether the user pays attention to vehicles coming from the left and right. In one embodiment, the second recognition device 206 recognizes the closure of the eyelids of the user's eyes to determine whether the user is dozing off or in a trance.

[0037] In one embodiment, based on the images around the user, through artificial intelligence (e.g., artificial intelligence labeling (AI labeling)), the second judgment device 208 determines whether there are other objects in the blind spot of the user's vision, and determines whether the vehicle has deviated from the lane. In one embodiment, the eye warning information includes at least one of image information and voice information. For example, when there are other objects or pedestrians in the blind spot of the user's vision, the glasses module 200 provides an image of the blind spot (e.g., image information) and / or issues a warning sound (e.g., voice information) to remind the user to pay attention. For example, when the user is dozing off or in a trance, the glasses module 200 issues a warning sound (e.g., voice information). In one embodiment, the display device 210 is a micro light-emitting diode (micro LED) display device.

[0038] Figure 2 Schematic diagram of an eyeglass module 20 according to an embodiment of the present invention. The eyeglass module 200 includes a receiving device 202, a second video recording device 204, a second identification device 206, a second determination device 208, a display device 210 and a third identification device 212. Figure 2 The glasses module 20 can be applied to Figure 1 The receiving device 202, the second video recording device 204, the second identification device 206, the second determination device 208, and the display device 210 can refer to Figure 1, which will not be described in detail here. The third recognition device 212 is coupled to the display device 210, and is used to recognize the user's voice command. According to the voice command, the display device 210 displays at least one of the vehicle surrounding image and the user surrounding image corresponding to the voice command. For example, when the vehicle is reversing, according to the user's voice command "reverse", the display device 210 displays the vehicle surrounding image or the vehicle rear image. For example, when the vehicle turns (for example, turn left), according to the user's voice command "turn", the display device 210 displays the vehicle side (for example, left) image.

[0039] Figure 3 Schematic diagram of a detection method according to an embodiment of the present invention. The display method of the present invention includes a blind spot detection module of a detection system recording an image around a vehicle, and identifying at least one blind spot of a vehicle to generate a blind spot recognition result (step S10). According to the image around the vehicle and the blind spot recognition result, the blind spot detection module determines whether to transmit at least one of the image around the vehicle and a blind spot warning message to generate a first judgment result (step S12). According to the first judgment result, the blind spot detection module transmits the image around the vehicle and the at least one of the blind spot warning message (step S14). Then, according to the first judgment result, the blind spot detection module transmits the image around the vehicle and the at least one of the blind spot warning message to a glasses module of the detection system (step S16). The glasses module receives the image around the vehicle and the at least one of the blind spot warning message from the transmission device (step S18). The glasses module records an image around a user, and identifies the eyes of a user to generate an eye recognition result (step S20). According to the user's surrounding image and the eye recognition result, the glasses module determines whether to display at least one of the user's surrounding image and an eye warning message through an artificial intelligence to generate a second judgment result (step S22). According to the second judgment result, the glasses module displays at least one of the user's surrounding image and the eye warning message, and displays at least one of the vehicle's surrounding image and the blind spot warning message (step S24).

[0040] The embodiments of the detection method of the present invention can be referred to Figure 1 and Figure 2 The embodiments of the present invention are not described in detail here.

[0041] In summary, the present invention provides a detection system that detects the surrounding conditions of the vehicle (e.g., blind spots) and detects whether the user is drowsy or absent-minded based on the images recorded by the video recording device and the identification results of the identification device through artificial intelligence. In this way, if there is a critical situation while driving, the detection system can immediately remind the user, thereby effectively reducing the occurrence of traffic accidents.

[0042] The above description is only a preferred embodiment of the present invention. All equivalent changes and modifications made according to the claims of the present invention should fall within the scope of the present invention.

Claims

1. A detection system, characterized in that: Contains: A blind spot detection module, including: A first video recording device for recording an image around a vehicle; a first identification device, used to identify at least one blind spot of a vehicle to generate a blind spot identification result; a first determination device, coupled to the first video recording device and the first identification device, for determining whether to transmit at least one of the vehicle surrounding image and a blind spot warning message according to the vehicle surrounding image and the blind spot identification result, so as to generate a first determination result; and a transmitting device, coupled to the first determining device, for transmitting at least one of the vehicle surrounding image and the blind spot warning information according to the first determining result; and A glasses module, comprising: a receiving device, configured to receive at least one of the vehicle surrounding image and the blind spot warning information from the transmitting device; A second video recording device for recording images of a user's surroundings; a second recognition device for recognizing the eyes of a user to generate an eye recognition result; a second determination device, coupled to the second video recording device and the second recognition device, for determining whether to display at least one of the user's surrounding image and an eye warning message through an artificial intelligence according to the user's surrounding image and the eye recognition result, so as to generate a second determination result; as well as A display device is coupled to the receiving device and the second judgment device, and is used to display at least one of the user's surrounding image and the eye warning information, and to display at least one of the vehicle's surrounding image and the blind spot warning information according to the second judgment result.

2. The detection system according to claim 1, characterized in that: The vehicle surrounding image includes a vehicle surround image.

3. The detection system according to claim 1, characterized in that: The blind spot warning information includes at least one of an image message and a voice message.

4. The detection system according to claim 1, characterized in that: The transmission device comprises: A first communication module, configured to perform a millimeter wave wireless transmission; The transmitting device transmits at least one of the vehicle surrounding image and the blind spot warning information through the millimeter wave wireless transmission.

5. The detection system according to claim 1, characterized in that: The glasses module is an augmented reality glasses module or a mixed reality glasses module.

6. The detection system according to claim 1, characterized in that: The glasses module further comprises: a third recognition device, coupled to the display device, for recognizing a voice command of the user; According to the voice command, the display device displays at least one of the vehicle surrounding image and the user surrounding image corresponding to the voice command.

7. The detection system according to claim 1, characterized in that: The receiving device comprises: a second communication module, configured to perform a millimeter wave wireless transmission; Through the millimeter wave wireless transmission, the receiving device receives at least one of the vehicle surrounding image and the blind spot warning information.

8. The detection system according to claim 1, characterized in that: The second identification device identifies at least one of an eyeball rotation direction and an eyelid closure status of the user's eye.

9. The detection system according to claim 1, characterized in that: The eye warning information includes at least one of an image message and a voice message.

10. The detection system according to claim 1, wherein: The display device is a micro-light emitting diode display device.