A rearview system for a vehicle and a vehicle

Abstract

The application discloses a kind of automobile rearview system and car, the first camera module in automobile rearview system is to the environment of the first side rear of car and is photographed, obtains first side image, display module receives first side image, first side image is shown in first display area, and the environment of the second side rear of car is displayed by second display area.The application can realize split-screen display effect, and driver only needs to observe one display module, can simultaneously observe the situation that the first side image reflected by first display area is shown and the second side image reflected by second display area is shown, so that driver can timely understand the situation of the pedestrian, vehicle or obstacle etc. on both sides of car rear, is favorable to guarantee driving safety, simultaneously, driver does not need to carry out again and alternately observe left and right rearview mirror etc. action, improves driving convenience.The application is widely applied in the field of automobile technology.

Description

Technical Field

[0001] This invention relates to the field of automotive technology, and in particular to a rearview system and a car. Background Technology

[0002] Rearview mirrors installed on cars allow drivers to observe the environment behind the vehicle, thus helping them to make appropriate driving decisions such as changing lanes, avoiding obstacles, slowing down, or braking. This is especially important when reversing. Typically, one rearview mirror is installed on each side of the car. Due to the obstruction of the car body itself, each mirror only reflects the view behind the car on its corresponding side. Since drivers usually need to observe both sides of the rearview mirror simultaneously while driving, this requires them to turn their heads to check both mirrors. This is particularly true when reversing, where drivers need to turn their heads even more frequently. This is not only detrimental to safe driving but also inconvenient for the driver. Summary of the Invention

[0003] In view of the technical problems of current car rearview mirrors, which can only reflect the view behind the side they are facing, resulting in driving safety risks and inconvenience, the purpose of this invention is to provide a car rearview system and a car.

[0004] On one hand, embodiments of the present invention include a vehicle rearview system, comprising:

[0005] First camera module; the first camera module is used to capture images of the environment behind the first side of the car to obtain a first side image;

[0006] The display module includes a first display area and a second display area. The display module is used to receive the first side image, display the first side image in the first display area, and display the environment behind the second side of the vehicle through the second display area.

[0007] Furthermore, the vehicle rearview system also includes:

[0008] The second camera module is used to capture images of the environment behind the second side of the car to obtain a second-side image;

[0009] The display module is used to receive the second side image and display the second side image in the second display area.

[0010] Furthermore, the second display area has light-reflecting properties, and the second display area is used to reflect light from the environment from the second rear side of the vehicle.

[0011] Furthermore, the display module is also used to perform image detection on the second side image, and adjust the second display area according to the image detection result.

[0012] Further, the step of performing image detection on the second side image and adjusting the second display area based on the image detection result includes:

[0013] Identify feature targets in the second-side image;

[0014] Detect the movement direction of the feature target;

[0015] Control the second display area to move in the same direction as the movement direction of the feature target.

[0016] Furthermore, the display module is also used for:

[0017] Based on the direction of movement of the feature target, determine the predicted position of the feature target behind the first side of the vehicle;

[0018] Extract the contour image of the feature target;

[0019] The contour image is displayed in the first display area at the position corresponding to the predicted position.

[0020] Furthermore, the display module is also used for:

[0021] Identify feature targets in the second-side image;

[0022] Generate early warning icons and warning audio signals corresponding to the featured targets;

[0023] Display the warning icon in the second display area;

[0024] The warning audio signal is sent to the audio playback module.

[0025] Furthermore, the display module is also used to obtain the current reversing direction of the car, and control the movement direction and size of the second display area according to the current reversing direction.

[0026] Furthermore, controlling the movement direction and size of the second display area according to the current reversing direction includes:

[0027] Control the second display area to move in the same direction as the current reversing direction;

[0028] The size of the second display area is controlled to be positively correlated with the degree to which the current reversing direction is biased towards the second side.

[0029] On the other hand, embodiments of the present invention also include a vehicle, the vehicle including the vehicle rearview system of the embodiments.

[0030] The beneficial effects of the present invention are as follows: The rearview system of the vehicle in the embodiment can realize the split-screen display effect of the first display area as the main screen and the second display area as the secondary screen. The driver only needs to observe one display module to simultaneously observe the situation on the left rear of the vehicle reflected by the first side image displayed in the first display area and the situation on the right rear of the vehicle reflected by the second side image displayed in the second display area. This allows the driver to be aware of pedestrians, vehicles or obstacles on both sides of the vehicle in a timely manner, which is conducive to ensuring driving safety. At the same time, the driver does not need to turn his head to alternately observe the left and right rearview mirrors, which improves driving convenience. Attached Figure Description

[0031] Figure 1 This is a schematic diagram of the structure of the vehicle rearview system in the embodiment;

[0032] Figure 2 This is a schematic diagram of the first display area and the second display area in the embodiment;

[0033] Figure 3 This is a schematic diagram illustrating the display effect of the display module in the embodiment;

[0034] Figure 4 This is a schematic diagram illustrating how the second display area is controlled to move in the same direction as the moving direction of the feature target in the embodiment.

[0035] Figure 5 This is a schematic diagram illustrating the display of the contour image in the first display area at the position corresponding to the predicted position in the embodiment.

[0036] Figure 6 This is a schematic diagram illustrating the display of the warning sign in the second display area in the embodiment;

[0037] Figure 7 This is a schematic diagram illustrating the control of the second display area to move along the same direction as the current reversing direction in the embodiment;

[0038] Figure 8 This is a schematic diagram illustrating the installation of two rearview systems on a single vehicle in an embodiment. Detailed Implementation

[0039] In this embodiment, unless otherwise specified, "first side" refers to the left side of the vehicle body and "second side" refers to the right side of the vehicle body.

[0040] In this embodiment, the vehicle rearview system includes a first camera module and a display module.

[0041] The first camera module is a webcam. (See reference...) Figure 1The first camera module is mounted on the left-side rearview mirror of the car. When the left-side rearview mirror is open, the field of view of the first camera module faces the left rear of the car. That is, the image captured by the first camera module is equivalent to the view of the left rear as observed by the driver while seated in the driver's seat through the left-side rearview mirror. The first camera module captures the first-side image.

[0042] Accordingly, the car's rearview system can also be equipped with a second camera module, which can also be a camera. (See reference...) Figure 1 The second camera module is mounted on the right-side rearview mirror of the car. When the right-side rearview mirror is open, the field of view of the second camera module faces the right rear of the car. This means the image captured by the second camera module is equivalent to the view of the right rear as observed by the driver while seated in the driver's seat through the right-side rearview mirror. The second camera module captures the image from the second side.

[0043] In this embodiment, the display module integrates a control unit with data processing and control functions, and a display screen with display functions. (Refer to...) Figure 2 The display screen's interface is divided into two parts: a first display area and a second display area. These two areas may not be physically separated; rather, the control unit within the display module controls the first and second display areas to display different images, making them visually distinct. The control unit in the display module, through signal processing, can control the position and size of the second display area on the screen, as well as other visual effects.

[0044] In this embodiment, the display module, the first camera module, and the second camera module can be connected via a CAN bus. The first camera module sends the captured first-side image to the display module, and the second camera module sends the captured second-side image to the display module.

[0045] After receiving the first side image and the second side image, the control unit in the display module generates a display signal based on the first side image and the second side image, and sends the display signal to the display screen, so that the first display area of ​​the display screen displays the first side image and the second display area displays the second side image.

[0046] In this embodiment, refer to Figure 2 Ignoring the second display area, the first display area is equivalent to the area covering the entire display screen of the display module. The second display area is smaller than the first display area and is located inside the first display area. When the display module displays the first side image and the second side image simultaneously, the display effect is as follows: Figure 3As shown, a split-screen display effect is formed with the first display area as the main screen and the second display area as the secondary screen. The driver only needs to observe one display screen to simultaneously observe the situation on the left rear of the car as reflected by the first side image displayed in the first display area, and the situation on the right rear of the car as reflected by the second side image displayed in the second display area. This allows the driver to be aware of pedestrians, vehicles, or obstacles on both sides behind the car in a timely manner, which is conducive to ensuring driving safety. At the same time, the driver does not need to turn his head to alternately check the left and right rearview mirrors, which improves driving convenience.

[0047] In this embodiment, the display module can be installed on the center console inside the vehicle for easy viewing by the driver.

[0048] In this embodiment, the display screen in the display module can display corresponding images using devices such as liquid crystals or light-emitting diodes (LEDs). For example, some LEDs in the display screen are used to display a first-side image, thereby forming a first display area, while other LEDs are used to display a second-side image, thereby forming a second display area.

[0049] In this embodiment, the second display area in the display module can be equipped with a reflector, thereby enabling the second display area to reflect light. When the second display area is equipped with both a light-emitting diode (LED) and a reflector, the reflector can be placed at the bottom of the LED. When the LED emits light, the driver can observe the image formed by the LED's light emission from the second display area. When the LED does not emit light, the reflector under the LED layer reflects light, and the driver can observe the image formed by the reflected light from the reflector from the second display area. Alternatively, the second display area can only be equipped with a reflector without an LED; that is, the second display area in the display module is simply a reflector, allowing the driver to observe the image from the second display area by reflecting light.

[0050] A display module with a reflector in the second display area is installed on the right side of the car body, replacing the existing right-side rearview mirror. This allows the driver to observe the situation to the left rear of the car reflected in the first side image from the first display area of ​​the module, while simultaneously observing the situation to the right rear of the car reflected in the second display area. Therefore, the driver can understand the situation on both sides behind the car by observing a single display module.

[0051] By using a display module with light-reflecting properties in the second display area, it is equivalent to adding the function of simultaneously displaying the situation behind the other side of the rearview mirror to the existing car rearview mirror. Such a display module can replace the existing rearview mirror and allow the driver to observe only one side of the display module while being aware of the situation on both sides behind the car without changing the driver's habit of observing the rearview mirror. This ensures driving safety and improves driving convenience.

[0052] In this embodiment, the control unit in the display module performs image detection on the second side image sent by the second camera module, and adjusts the second display area according to the image detection result.

[0053] Specifically, the control unit in the display module can perform the following steps:

[0054] P1. Identify characteristic targets in the second-side image;

[0055] P2. Detect the direction of movement of the target feature;

[0056] P3. Control the second display area to move in the same direction as the movement direction of the feature target.

[0057] In step P1, the display module can scan each frame of the second-side image to attempt to identify feature targets. These feature targets can be targets with specific characteristics, such as pedestrians with facial features or vehicles or obstacles with specific shapes.

[0058] When a feature target is detected, the display module determines the direction of movement of the feature target by detecting its position in multiple frames before and after the detection.

[0059] In step P3, refer to Figure 4 Taking the feature target moving to the left as an example, the display module controls the second display area to move in the same direction (left) as the feature target, so that the relative position of the displayed second side image in the display module moves to the left.

[0060] By performing steps P1-P3, the driver can clearly observe the relative position movement of the second-side image in the display module, thereby noticing the movement of feature targets in the second-side image, which helps the driver to react in time and maintain driving safety.

[0061] In this embodiment, the display module also performs the following steps:

[0062] P4. Based on the direction of movement of the feature target, determine the predicted position of the feature target behind the first side of the car;

[0063] P5. Extract the contour image of the feature target;

[0064] P6. Display the contour image in the first display area at the position corresponding to the predicted position.

[0065] When performing step P4, based on the movement direction of the feature target detected in step P2, the historical movement trajectory of the feature target can be determined, and the future movement trajectory of the feature target can be predicted based on the historical movement trajectory (the future movement trajectory extends to the first rear side of the car, i.e., the left rear side). The end of the future movement trajectory is the predicted position of the feature target at the first rear side of the car.

[0066] During step P5, an image related to but not identical to the feature target can be generated, such as the contour image of the feature target. Figure 5 The dotted lines forming the human figure in the image represent the outline of the feature target (the solid lines forming the human figure).

[0067] In step P6, the contour image is displayed in the first display area at the position corresponding to the predicted position.

[0068] By executing steps P4-P6, when the feature target is actually located at the second rear side of the car, the future position of the feature target at the first rear side of the car can be predicted. This predicted position is then marked in the first display area using the outline image of the feature target. This allows the driver to understand the future position of the feature target at the first rear side of the car by observing the display module, which helps the driver make driving predictions and maintain driving safety.

[0069] In this embodiment, the display module may also perform the following steps:

[0070] P7. Identify characteristic targets in the second-side image;

[0071] P8. Generate early warning icons and alert audio signals corresponding to the featured targets;

[0072] P9. Display the warning sign in the second display area;

[0073] P10. Send the warning audio signal to the audio playback module.

[0074] Step P7 is the same as step P1. In step P8, refer to... Figure 6 When a feature target is detected in the second-side image, the control unit in the display module generates a warning sign and displays the warning sign in the second display area during step P9. The warning sign can be a specific pattern with a prominent color, making it easy for the driver to observe through the display module and understand that a feature target is present in the second-side image.

[0075] In step P8, the control unit in the display module generates a warning audio signal. During step P10, this warning audio signal is sent to an external audio playback module or an audio playback module integrated within the display module. When the audio playback module plays the warning audio signal, it produces a beeping sound or other warning noise, thus informing the driver of the presence of a feature target in the second-side image.

[0076] By performing steps P7-P10, the driver can become aware of the presence of a feature target in the second-side image through visual and auditory means, which helps the driver to take timely driving actions such as avoidance, deceleration, and braking, thus ensuring driving safety.

[0077] In this embodiment, the display module may also perform the following steps:

[0078] P11. Control the second display area to move in the same direction as the current reversing direction;

[0079] P12. Control the size of the second display area, which is positively correlated with the degree to which the current reversing direction is biased towards the second side.

[0080] By executing steps P11-P12, the display module can obtain the current reversing direction of the car and control the movement direction and size of the second display area according to the current reversing direction.

[0081] During step P11, the display module can communicate with the electronic control unit (ECU) installed in the vehicle to obtain the vehicle's current reversing direction. The current reversing direction includes information such as the direction (left or right) of the steering wheel, steering gear, or steering wheel deflection and the deflection angle when the vehicle is reversing.

[0082] In step P11, refer to Figure 7 Taking the current reversing direction as left as an example, control the second display area to move to the left.

[0083] In step P12, the size of the second display area is controlled to be positively correlated with the degree to which the current reversing direction is biased to the right. (Refer to...) Figure 7 When the current reversing direction is to the left, the second display area is shrunk, and the greater the angle of the current reversing direction to the left, the smaller the second display area is shrunk; if the current reversing direction is to the right, the second display area is expanded, and the greater the angle of the current reversing direction to the right, the larger the second display area is expanded.

[0084] By performing step P11, the driver can understand the current reversing direction of the car by observing the movement direction of the second display area, thereby reducing the impact of spatial disorientation during reversing operations and helping to maintain driving safety.

[0085] In this embodiment, the first display area is used to display the environment behind the left side of the car, and the second display area is used to display the environment behind the right side of the car. By executing step P12, when the current reversing direction is to the left, the larger first display area is used to display the environment behind the left side of the car, which is more conducive to the driver observing the environment behind the left side of the car in a timely and clear manner, and helps the driver make correct driving behavior and maintain driving safety. Conversely, when the current reversing direction is to the right, the area of ​​the second display area increases, which is more conducive to the driver observing the environment behind the right side of the car in a timely and clear manner, and helps the driver make correct driving behavior and maintain driving safety.

[0086] In this embodiment, the left side of the vehicle body is taken as the "first side" and the right side of the vehicle body is taken as the "second side". When the meanings of "first side" and "second side" are interchanged, that is, the right side of the vehicle body is taken as the "first side" and the left side of the vehicle body is taken as the "second side", the same technical effect can be achieved based on the same principle.

[0087] In practice, a car can be equipped with two sets of the rearview systems described in this embodiment. In one rearview system, "first side" refers to the left side of the vehicle and "second side" refers to the right side of the vehicle; in the other rearview system, "first side" refers to the right side of the vehicle and "second side" refers to the left side of the vehicle. By setting up two sets of rearview systems as described in this embodiment, the driver can... Figure 8 As shown, when observing the display module (left-side display screen) of one set of automotive rearview systems, the driver can understand the situation on the left rear of the vehicle by observing the first display area of ​​the module, and the situation on the right rear of the vehicle by observing the second display area. On the other hand, when the driver observes the display module (right-side display screen) of another set of automotive rearview systems, the driver can understand the situation on the right rear of the vehicle by observing the first display area of ​​the module, and the situation on the left rear of the vehicle by observing the second display area. This provides the driver with more visual information about the rear of the vehicle, which helps the driver make reasonable driving operations and ensures driving safety.

[0088] It should be noted that, unless otherwise specified, when a feature is referred to as "fixed" or "connected" to another feature, it can be directly fixed or connected to the other feature, or indirectly fixed or connected to the other feature. Furthermore, the descriptions of "upper," "lower," "left," and "right" used in this disclosure are only relative to the relative positional relationships of the various components of this disclosure in the accompanying drawings. The singular forms "a," "described," and "the" used in this disclosure are also intended to include the plural forms, unless the context clearly indicates otherwise. Moreover, unless otherwise defined, all technical and scientific terms used in this embodiment have the same meaning as commonly understood by one of ordinary skill in the art. The terminology used in this embodiment specification is only for describing particular embodiments and is not intended to limit the invention. The term "and / or" as used in this embodiment includes any combination of one or more of the associated listed items.

[0089] It should be understood that although the terms first, second, third, etc., may be used to describe various elements in this disclosure, these elements should not be limited to these terms. These terms are only used to distinguish elements of the same type from each other. For example, a first element may also be referred to as a second element without departing from the scope of this disclosure, and similarly, a second element may also be referred to as a first element. The use of any and all instances or exemplary language (“e.g.,” “such as,” etc.) provided in this embodiment is intended only to better illustrate embodiments of the invention and, unless otherwise required, does not impose a limitation on the scope of the invention.

[0090] It should be recognized that embodiments of the present invention can be implemented or carried out by computer hardware, a combination of hardware and software, or by computer instructions stored in a non-transitory computer-readable storage medium. The method can be implemented using standard programming techniques—including a non-transitory computer-readable storage medium configured with a computer program, wherein such a storage medium causes the computer to operate in a specific and predefined manner—according to the methods and drawings described in the specific embodiments. Each program can be implemented in a high-level procedural or object-oriented programming language to communicate with the computer system. However, if desired, the program can be implemented in assembly or machine language. In any case, the language can be a compiled or interpreted language. Furthermore, for this purpose, the program can run on a programmed application-specific integrated circuit (ASIC).

[0091] Furthermore, the procedures described in this embodiment can be performed in any suitable order unless otherwise indicated by this embodiment or clearly contradicted by the context. The procedures (or variations and / or combinations thereof) described in this embodiment can be executed under the control of one or more computer systems configured with executable instructions, and can be implemented by hardware or a combination thereof as code (e.g., executable instructions, one or more computer programs, or one or more applications) that commonly executes on one or more processors. The computer program includes a plurality of instructions executable by one or more processors.

[0092] Furthermore, the method can be implemented in any suitable type of computing platform, including but not limited to personal computers, minicomputers, mainframes, workstations, networked or distributed computing environments, standalone or integrated computer platforms, or in communication with charged particle tools or other imaging devices. Aspects of the invention can be implemented as machine-readable code stored on a non-transitory storage medium or device, whether removable or integrated into a computing platform, such as a hard disk, optical read and / or write storage medium, RAM, ROM, etc., such that it is readable by a programmable computer, and when the storage medium or device is read by the computer, it can be used to configure and operate the computer to perform the processes described herein. Furthermore, the machine-readable code, or portions thereof, can be transmitted via wired or wireless networks. The invention described in this embodiment includes these and other different types of non-transitory computer-readable storage media when such media comprises instructions or programs that implement the steps described above in conjunction with a microprocessor or other data processor. When programmed according to the methods and techniques described in the invention, the invention also includes the computer itself.

[0093] A computer program can be applied to input data to perform the functions described in this embodiment, thereby transforming the input data to generate output data stored in non-volatile memory. The output information can also be applied to one or more output devices, such as a display. In a preferred embodiment of the invention, the transformed data represents physical and tangible objects, including specific visual depictions of physical and tangible objects generated on the display.

[0094] The above description is merely a preferred embodiment of the present invention. The present invention is not limited to the above-described embodiments. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention, as long as they achieve the technical effects of the present invention by the same means, should be included within the scope of protection of the present invention. Within the scope of protection of the present invention, the technical solutions and / or implementation methods can have various modifications and variations.

Claims

1. A car rearview system, characterized in that, The vehicle rearview system includes: First camera module; the first camera module is used to capture images of the environment behind the first side of the car to obtain a first side image; The display module includes a first display area and a second display area. The first display area covers the entire display screen of the display module, and the second display area is smaller than the first display area and located inside the first display area. The display module is used to receive a first side image, display the first side image on the first display area, and display the environment behind the second side of the car through the second display area. When the display module displays both the first side image and the second side image simultaneously, it performs split-screen display with the first display area as the main screen and the second display area as the secondary screen. The display module is installed on the second side of the car body as a rearview mirror on the second side of the car. The display module is used to receive the second side image, display the second side image on the second display area, perform image detection on the second side image, and adjust the second display area according to the image detection results. The second camera module is used to capture images of the environment behind the second side of the car to obtain a second-side image; The first side is the left side and the second side is the right side, or the first side is the right side and the second side is the left side; The step of performing image detection on the second side image and adjusting the second display area based on the image detection results includes: Identify feature targets in the second-side image; Detect the direction of movement of the feature target; Control the second display area to move in the same direction as the movement direction of the feature target.

2. The automotive rearview system according to claim 1, characterized in that, The display module is also used for: Based on the direction of movement of the feature target, determine the predicted position of the feature target behind the first side of the vehicle; Extract the contour image of the feature target; The contour image is displayed in the first display area at the position corresponding to the predicted position.

3. The automotive rearview system according to claim 1, characterized in that, The display module is also used for: Identify feature targets in the second-side image; Generate early warning icons and warning audio signals corresponding to the featured targets; Display the warning icon in the second display area; The warning audio signal is sent to the audio playback module.

4. The automotive rearview system according to claim 1, characterized in that, The display module is also used to obtain the current reversing direction of the car, and control the movement direction and size of the second display area according to the current reversing direction.

5. The automotive rearview system according to claim 4, characterized in that, The step of controlling the movement direction and size of the second display area according to the current reversing direction includes: Control the second display area to move in the same direction as the current reversing direction; The size of the second display area is controlled to be positively correlated with the degree to which the current reversing direction is biased towards the second side.

6. A car, characterized in that, The vehicle includes a rearview system according to any one of claims 1-5.

Images