Electronic side mirror warning system

Abstract

To provide an electronic side mirror warning system.SOLUTION: Two cameras, disposed on two sides of a head of the vehicle respectively, and configured to capture side images of front wheels of the vehicle respectively, the two cameras being disposed in a cab of the vehicle and storing a plurality of textures and first image features of road conditions and a plurality of second image features of objects, the two cameras being configured to receive the side images and perform image recognition processing on the side images by using the textures, the first image features and the second image features; An electronic side mirror warning system, comprising: a processor capable of obtaining driving road condition information of a vehicle; and a display device disposed in a driver's cab and capable of receiving and displaying a side image and emitting a warning signal, wherein the processor controls the display device to emit the warning signal when the driving road condition information is that there is a danger within an expected driving range of the vehicle.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present disclosure relates to driving monitoring technology, and more particularly to electronic side mirror warning systems. [Background technology]

[0002] Currently, most vehicles are equipped with blind spot detection (BSD) devices. Blind spot detection devices are typically installed on the vehicle's side mirrors and detect images directed toward the rear of the side mirror to assist driving and determine whether there are any objects to the side of the vehicle. However, such blind spot detection devices can only detect objects behind the vehicle and cannot detect moving objects located in front of the side mirror outside the vehicle. As a result, the driver is unable to determine the situation in the blind spot in front of the vehicle, which can lead to driving hazards.

[0003] Therefore, there is an urgent need for a road monitoring and warning system that overcomes the problems present in the known art. Summary of the Invention [Means for solving the problem]

[0004] Therefore, an object of the present disclosure is to provide an electronic side mirror warning system that can acquire road condition information, such as whether the road is drivable within the vehicle's expected driving range and whether there are any obstacles, by having its processor receive side images of both front wheels of the vehicle captured by a camera and perform image recognition processing on these side images using a texture and image feature database built into the processor. Based on the road condition information, the processor can control the display device to display a warning image and / or emit a warning sound to alert the driver. The electronic side mirror warning system can actively detect road conditions and alert the driver when there is a danger within the expected driving range, thereby improving driving safety.

[0005] According to the above-mentioned object of the present disclosure, there is proposed an electronic side mirror warning system including two cameras provided on either side of the front of the vehicle, each configured to capture a side image of the front wheels of the vehicle; a processor provided in the cab of the vehicle and signal-connected to the cameras, storing textures and at least one first image feature for each of a plurality of road conditions and at least one second image feature for each of a plurality of objects, and configured to receive the side images and perform image recognition processing on the side images using the textures, first image feature, and second image feature to obtain road condition information for the vehicle; and a display device provided in the cab and signal-connected to the processor, configured to receive and display the side images and issue a warning signal, wherein the road condition information includes a danger within the expected driving range of the vehicle, and the processor controls the display device to issue a warning signal.

[0006] According to one embodiment of the present disclosure, the cameras are provided on two side mirrors located on the left and right sides of the vehicle, respectively.

[0007] According to one embodiment of the present disclosure, the viewing angle range of each camera is 120 degrees, and the viewfinder direction of each camera is tilted 20 degrees outward from the vehicle head.

[0008] According to one embodiment of the present disclosure, the processor is signally connected to a turn indicator control system of the vehicle to obtain turning information of the vehicle, and further includes controlling the display device to issue a warning signal based on the turning information.

[0009] According to one embodiment of the present disclosure, the processor is signally connected to a steering control system of the vehicle to obtain turning information of the vehicle, and the processor further includes controlling the display device to issue a warning signal based on the turning information.

[0010] According to one embodiment of the present disclosure, the road condition information includes whether the road is drivable within the expected driving range of the vehicle and whether there is at least one obstacle within the expected driving range.

[0011] According to one embodiment of the present disclosure, the display device is a rectangular device, is installed laterally in the driver's cab, has a rectangular display area, and the side images are arranged along the length of the rectangular display area.

[0012] According to one embodiment of the present disclosure, the warning signal emitted by the display device includes flashing the side image.

[0013] According to one embodiment of the present disclosure, the processor is provided within a display device, and the display device has a touch screen.

[0014] According to one embodiment of the present disclosure, the display device includes a horn that is signally connected to the processor, and when the road condition information indicates that there is a danger within the expected driving range of the vehicle, the processor controls the horn to emit a warning sound. [Brief explanation of the drawings]

[0015] Aspects of the present disclosure can be better understood from the following detailed description taken in conjunction with the accompanying drawings. It should be noted that, in accordance with standard industry practice, features are not drawn to scale. In fact, the dimensions of any feature may be arbitrarily increased or decreased for clarity of discussion. [Figure 1] FIG. 1 is a block diagram of an electronic side mirror warning system according to one embodiment of the present disclosure. [Figure 2] 1 is a schematic diagram of a camera of an electronic side mirror warning system according to an embodiment of the present disclosure when mounted on a vehicle; FIG. [Figure 3] 1 is a schematic diagram of an electronic side mirror warning system according to an embodiment of the present disclosure when installed in a vehicle; [Figure 4]1 is a schematic diagram of a display device of an electronic side mirror warning system according to an embodiment of the present disclosure. FIG. DETAILED DESCRIPTION OF THE INVENTION

[0016] The following detailed description of the embodiments of the present disclosure will be given. However, as will be understood, the embodiments provide many applicable concepts that can be implemented in a variety of specific contexts. The discussed and disclosed embodiments are for illustrative purposes only and are not intended to limit the scope of the present disclosure. Although all embodiments of the present disclosure disclose a number of different features, these features may be implemented individually or in combination as needed.

[0017] Additionally, the terms "first," "second," etc., as used in this specification do not refer to a particular order or sequence, but are merely used to distinguish between elements or operations described with the same technical terminology.

[0018] The spatial relationship between two elements described in this disclosure applies not only to the orientation shown in the drawings but also to orientations not shown in the drawings, such as the opposite orientation. Furthermore, the term "connection," "electrical connection," or similar terms between two members described in this disclosure is not limited to direct connection or electrical connection between the two, and may include indirect connection or electrical connection as needed.

[0019] Please refer to Figures 1 to 3, which respectively show a block diagram of an electronic side mirror warning system 100 according to one embodiment of the present disclosure, a schematic diagram of a camera 200 of the electronic side mirror warning system 100 mounted on a vehicle 500, and a schematic diagram of the electronic side mirror warning system 100 mounted on the vehicle 500. The electronic side mirror warning system 100 is applied to a general vehicle 500 such as a passenger car, jeep, pickup truck, or light van. The electronic side mirror warning system 100 can improve driving safety by providing the driver with information and warnings about road conditions ahead of the vehicle 500 and near the front wheels 510.

[0020] The electronic side mirror warning system 100 may mainly include two cameras 200, a processor 300, and a display device 400. The two cameras 200 are respectively provided on either side of the headway 520 of the vehicle 500. For example, the two cameras 200 may be mounted on the left and right side mirrors 530 of the vehicle 500, respectively. Each camera 200 is configured to capture side images SI1 and SI2 of the front wheels 510 on that side of the vehicle 500 on which it is provided. These side images SI1 and SI2 of the front wheels 510 both cover the area in front of and behind the front wheels 510. In some embodiments, the viewing angle range α of each camera 200 is substantially 120 degrees, and the tilt angle β of each camera 200 toward the outside of the headway 520 in the viewfinder direction is substantially 20 degrees. For example, the viewing angle range α of each camera 200 is 60 degrees in front of and 60 degrees behind the location where each camera 200 is installed. The lens of each camera 200 is offset 20 degrees outward from the vehicle head 520 so that the viewfinder direction of the camera 200 has a tilt angle β of substantially 20 degrees.

[0021] The processor 300 is provided in the cab 540 of the vehicle 500. The processor 300 may be signal-connected to the cameras 200 via a wired or wireless transmission method. This allows the processor 300 to receive side images SI1 and SI2 of the front wheels 510 of the vehicle 500 captured by the cameras 200. In this embodiment, the processor 300 stores textures and at least one first image feature for each of a plurality of road conditions and at least one second image feature for each of a plurality of objects. Specifically, the processor 300 stores textures and at least one first image feature for each of drivable road textures, such as flat grass, cement ground, asphalt pavement, and brick pavement. The processor 300 also stores textures and at least one first image feature for each of impassable roads, such as water, potholes, side strips, and islands. The processor 300 also stored one or more second image features of objects such as people, animals, cars, motorcycles, bicycles, pyramids, fire hydrants, and fences.

[0022] The processor 300 can further use the stored texture, first image feature, and second image feature to perform image recognition processing on the side images SI1 and SI2 of the front wheel 510, for example, by using artificial intelligence (AI) calculations to compare and recognize the texture and image feature of the side images SI1 and SI2, thereby obtaining road condition information for the vehicle 500. For example, if the processor 300 finds that the texture and image feature of a pothole appear in the side images SI1 and SI2 of the front wheel 510, the processor 300 can further obtain road condition information based on the comparison result, i.e., that a pothole has appeared within the expected driving range of the vehicle 500 and that the road belongs to an impassable road type. Also, for example, if the processor 300 finds that the texture and image feature of a smooth asphalt road appear in the side images SI1 and SI2 of the front wheel 510, but finds that the image feature of a child appears in the side images SI1 and SI2 of the front wheel 510, the processor 300 can obtain road condition information that an obstacle exists within the expected driving range of the vehicle 500, which is a drivable road, based on the comparison result. Therefore, the road condition information that the processor 300 can obtain by recognizing the side images SI1 and SI2 of the front wheel 510 includes whether the road within the expected driving range of the vehicle 500 is drivable and whether there is at least one obstacle within the driving range.

[0023] In some embodiments, the processor 300 is signal-connected to a turn indicator control system of the vehicle 500 using a wired or wireless transmission method to obtain turning information of the vehicle 500. In other embodiments, the processor 300 is signal-connected to a steering wheel control system of the vehicle 500 using a wired or wireless transmission method to obtain reliable turning information of the vehicle 500. The processor 300 can combine the road condition information and the turning information of the vehicle 500 to control the display device 400 to issue a warning signal.

[0024] Please refer to Figures 3 and 4. Figure 4 shows a schematic diagram of a display device 400 of an electronic side mirror warning system 100 according to one embodiment of the present disclosure. As shown in Figure 3, the display device 400 may be provided in a cab 540 of a vehicle 500 and may be signal-connected to the processor 300 via a wired or wireless transmission method. In some embodiments, the processor 300 may be provided in the display device 400 and electrically connected to the display device 400 via a physical line. The display device 400 can receive side images SI1 and SI2 of the two front wheels 510 from the processor 300 and display the side images SI1 and SI2. The display device 400 includes a screen 410 having a display area 412 for displaying the side images SI1 and SI2.

[0025] 3, the display device 400 is a rectangular device and is mounted laterally in the driver's cab 540. That is, the screen 410 of the display device 400 has a rectangular display area 412, and a length direction LD of the rectangular display area 412 extends in the horizontal direction. The side images SI1 and SI2 are arranged along the length direction LD of the rectangular display area 412. That is, the side images SI1 and SI2 are arranged left and right, thus making driving more intuitive.

[0026] The display device 400 can further issue a warning signal. Specifically, if the road condition information indicates a danger within the expected driving range of the vehicle 500, for example, if an impassable road or an obstacle is present, the processor 300 controls the display device 400 to issue a warning signal. For example, the display device 400 can issue a warning signal by flashing the side image SI1 or SI2, which includes the obstacle or the impassable road. That is, when the processor 300 recognizes that an obstacle or an impassable road is present in the side image SI1, the processor 300 controls the display device 400 to flash the side image SI1.

[0027] The screen 410 of the display device 400 may be, for example, a touch screen, so that the screen 410 of the display device 400 can function as a man-machine operation interface, facilitating the operation setting of the shooting angle of the camera 200, the image recognition of the processor 300, and the display setting and warning setting of the display device 400, etc.

[0028] In some embodiments, as shown in FIG. 1 , the display device 400 may include a horn 420. The horn 420 may be similarly signal-connected to the processor 300 via a wired or wireless transmission method. When the road condition information acquired by the processor 300 after recognizing the side images SI1 and SI2 indicates a danger within the driving range of the vehicle 500, the processor 300 may control the horn 420 to emit a warning sound to alert the driver. For example, when the road condition information recognized by the processor 300 indicates an obstacle to the left of the left front wheel 510 of the vehicle 500 and the turn signal control system or the steering control system indicates that the vehicle 500 is about to turn left, the display device 400 may be controlled to flash the side image SI1, and the horn 420 may be further controlled to emit a warning sound to improve the warning effect.

[0029] As can be seen from the above embodiments, the advantages of the present disclosure are as follows: The processor of the electronic side mirror warning system can receive side images of both front wheels of the vehicle captured by a camera, and can perform image recognition processing of these side images using a texture and image feature database built into the processor, thereby obtaining road condition information, such as whether the road is drivable within the vehicle's expected driving range and whether there are any obstacles. Based on the road condition information, the processor can control the display device to display a warning image and / or issue a warning sound to alert the driver. The electronic side mirror warning system can actively detect road conditions and alert the driver when there is a danger within the expected driving range, thereby improving driving safety.

[0030] The present disclosure has been disclosed in the above examples, but the above examples are not intended to limit the present disclosure, and anyone skilled in the art can make various changes and modifications without departing from the spirit and scope of the present disclosure. Therefore, the scope of protection of the present disclosure should be limited by the scope of the patent application to be attached later. [Explanation of symbols]

[0031] 100: Electronic side mirror warning system 200: Camera 300: Processor 400:Display device 410: Screen 412: Display area 420: Horn 500: Vehicle 510: Front wheel 520: Vehicle head 530:Side mirror 540: Driver's cab LD: Length direction SI1: Lateral image SI2: Lateral image α: Viewing angle range β: Inclination angle

Claims

1. two cameras provided on either side of the head of the vehicle, each configured to capture a side image of a front wheel of the vehicle; a processor provided in a cab of the vehicle, signally connected to the camera, storing textures and at least one first image feature for each of a plurality of road conditions and at least one second image feature for each of a plurality of objects, and configured to receive the side images and perform image recognition processing on the side images using the textures, the first image feature, and the second image feature to obtain road condition information for the vehicle; a display device disposed within the cab and signally connected to the processor, the display device configured to receive and display the side image and to issue a warning signal; Including, In addition, when the road condition information indicates that there is a danger within the predicted driving range of the vehicle, the processor controls the display device to issue the warning signal.

2. 2. The electronic side mirror warning system according to claim 1, wherein the cameras are respectively provided on two side mirrors located on the left and right sides of the vehicle.

3. 2. The electronic side mirror warning system according to claim 1, wherein the viewing angle range of each of the cameras is 120 degrees, and the viewfinder direction of each of the cameras is tilted 20 degrees outward from the vehicle head.

4. 2. The electronic side mirror warning system of claim 1, further comprising: the processor is signally connected to a turn signal control system of the vehicle to obtain turning information of the vehicle, and the processor controls the display device to issue the warning signal based on the turning information.

5. 2. The electronic side mirror warning system of claim 1, further comprising: the processor is signally connected to a steering control system of the vehicle to obtain turning information of the vehicle, and the processor controls the display device to issue the warning signal based on the turning information.

6. 2. The electronic side mirror warning system according to claim 1, wherein the road condition information includes whether the predicted driving range of the vehicle is a drivable road or not, and whether there is at least one obstacle or not within the predicted driving range.

7. 2. The electronic side mirror warning system of claim 1, wherein the display device is a rectangular device, is arranged laterally within the driver's cab, has a rectangular display area, and the side images are arranged along the length of the rectangular display area.

8. 2. The electronic side mirror warning system of claim 1, wherein the warning signal emitted by the display device includes flashing the side image.

9. 10. The electronic side mirror warning system of claim 1, wherein the processor is located within the display device, and the display device has a touch screen.

10. 2. The electronic side mirror warning system according to claim 1, wherein the display device includes a horn signally connected to the processor, and when the road condition information indicates that there is a danger within the predicted driving range of the vehicle, the processor controls the horn to emit a warning sound.

Images