Automobile rearview display system and automobile

Abstract

The embodiment of the invention discloses an automobile rear-view display system and an automobile, the automobile rear-view display system processes rear-view images shot by a rear-view camera module and then sends the rear-view images to a display module installed in an automobile cab to be displayed, and the display module comprises a plurality of display units, so that the display units can display the rear-view images. Therefore, the rearview image can be displayed in a multi-level mode, so that a driver can know the condition behind the vehicle in multiple ways, the driver can efficiently make proper driving behaviors, and traffic safety is guaranteed. In addition, the automobile rearview display system in the embodiment can overcome the defects that a traditional rearview part is prone to being interfered by severe weather and glare of a rear automobile, and the visual blind area is large, and it is guaranteed that a driver clearly knows the situation behind the automobile. The invention is widely applied to the technical field of automobiles.

Description

Technical Field

[0001] This invention relates to the field of automotive technology, and in particular to a rearview display system and an automobile. Background Technology

[0002] When driving a car, the driver faces forward. To allow the driver to see what's behind the vehicle, a rearview mirror is needed. Traditional rearview mirrors rely on optical reflection to allow the driver to see what's behind the car. However, traditional rearview mirrors have drawbacks such as susceptibility to adverse weather conditions, glare from following vehicles, and large blind spots. Summary of the Invention

[0003] In view of at least one of the above-mentioned technical problems, the purpose of the present invention is to provide a car rearview display system and a car.

[0004] On one hand, embodiments of the present invention include a vehicle rearview display system, the vehicle rearview display system comprising: Rearview camera module; the rearview camera module is used to capture images from the rear of the vehicle to obtain a rearview image; Display module; the display module includes multiple display units; the display module is used for installation in the driver's cab of a vehicle; A control module is used to set the display mode of each of the display units, generate the display screen of each of the display units according to the rear view image, and control the display units to display the corresponding display screen in the corresponding display mode.

[0005] Furthermore, the rear-view camera module includes a main rear-view camera and a side-rear blind spot camera; The main rear-view camera is used to capture and obtain the main rear-view image; The side-rear blind spot camera is used to capture and obtain side-rear view images; The front rear view image and the side rear view image are combined to form the rear view image.

[0006] Furthermore, the plurality of display units includes a first display unit, a second display unit, and a third display unit; the first display unit is a central control screen, the second display unit is an instrument panel screen, and the third display unit is a head-up display.

[0007] Furthermore, the vehicle rearview display system also includes a driving control signal detection module; the driving control signal detection module is used to detect the driving control signals of the vehicle. Setting the display mode for each of the display units includes: Image recognition is performed on the rear view image to determine the driving status of the following vehicle; The driving status of the vehicle is determined based on the driving control signals. Based on the driving status of the following vehicle and / or the driving status of the vehicle itself, each of the aforementioned display modes is set; the display mode includes the size, position, and additional visual effects of the display screen in the display unit.

[0008] Furthermore, the vehicle rearview display system also includes an in-vehicle camera; the in-vehicle camera is used to capture a facial image of the driver of the vehicle. Setting the display mode for each of the display units includes: Image recognition is performed on the facial image to obtain pupil features; Based on the pupil characteristics, determine the driver's gaze direction; Each of the aforementioned display modes is set according to the viewing direction; the display mode includes the size, position, and additional visual effects of the displayed image in the display unit.

[0009] Further, generating the respective display screen of each of the display units based on the rear view image includes: For any of the display units, the rear view image is adjusted and / or information is extracted according to the display characteristics of the display unit to obtain the display screen corresponding to the display unit.

[0010] Furthermore, the vehicle rearview display system also includes an environmental parameter sensing module; the environmental parameter sensing module is used to detect the environmental parameters of the environment in which the vehicle is located; The step of adjusting and / or extracting information from the rear view image to obtain the display screen corresponding to the display unit includes: Set environmental reference values; Obtain the deviation of the environmental parameter from the environmental reference value; Based on the deviation value, set an adjustment upper limit; Within the range of zero and the aforementioned adjustment upper limit, multiple adjustment values ​​are set; Obtain one of the adjustment values, adjust the image parameters of the rear view image accordingly, and obtain the display screen corresponding to the display unit.

[0011] Further, generating the respective display screen of each of the display units based on the rear view image includes: Each of the display units is classified so that different display units obtain different levels; According to the corresponding level from high to low, traverse each of the display units; For the current level display unit, where the current level display unit is any of the display units visited in the traversal, the following steps are performed: When the level of the current display unit is the highest level, the rear view image is converted into the display screen corresponding to the current display unit; When the level of the current display unit is not the highest level, the display screen corresponding to the current display unit is generated according to the display screen corresponding to the higher level display unit; the higher level display unit is the display unit with a higher level than the current display unit.

[0012] Further, generating the display screen corresponding to the current-level display unit based on the display screen corresponding to the higher-level display unit includes: At least one advanced screen is acquired; the advanced screen is the display screen corresponding to the advanced display unit. Unsupervised detection is performed on the advanced image to determine the detection targets in the advanced image; When the level of the current display unit is not the lowest level, the part corresponding to the detected target is extracted from the higher level screen and used as the current level display screen; When the level of the current display unit is the lowest level, the part corresponding to the detected target is extracted from the high-level screen, semantic recognition is performed to obtain text information, and the current display screen is generated based on the text information. The display screen at this level is used as the display screen corresponding to the display unit at this level.

[0013] On the other hand, embodiments of the present invention also include a vehicle that includes the vehicle rearview display system of the claims.

[0014] The beneficial effects of the embodiments of the present invention are as follows: The rearview display system in the embodiments processes the rearview image captured by the rearview camera module and sends it to the display module installed in the car's cab for display. Since the display module includes multiple display units, it can display the rearview image in a multi-layered form, allowing the driver to understand the situation behind the vehicle through multiple means, thereby enabling the driver to make appropriate driving actions efficiently and ensuring traffic safety. The rearview display system in the embodiments can also overcome the shortcomings of traditional rearview components, such as susceptibility to interference from severe weather, susceptibility to glare from following vehicles, and large blind spots, ensuring that the driver can clearly understand the situation behind the vehicle. Attached Figure Description

[0015] Figure 1 This is a schematic diagram of the structure of the automotive rearview display system in the embodiment; Figure 2 This is a schematic diagram of the display module in the embodiment; Figure 3 This is a schematic diagram illustrating the steps executed by the control module in the embodiment; Figure 4 This is a schematic diagram illustrating the principle of step S201A in the embodiment; Figure 5 This is a schematic diagram illustrating the principle of steps S201B-S205B in the embodiment. Detailed Implementation

[0016] This embodiment provides a vehicle rearview display system. (Refer to...) Figure 1 The automotive rearview display system includes a control module, a display module, a driver control signal detection module, and a perception layer. The control module is a module with functions such as data acquisition, data processing, data output, and control. Specifically, an Electronic Control Unit (ECU) can be used as the control module, which can run various algorithms such as image processing algorithms, control algorithms, and visual computing algorithms. The display module includes multiple display units, which are physically independent display devices, generally with different sizes and display principles. For example, in this embodiment, the display module includes three display units: a first display unit, a second display unit, and a third display unit. Specifically, the first display unit is a central control screen, the second display unit is an instrument panel screen, and the third display unit is a head-up display (HUD). The display (HUD) allows each display unit to be independently controlled by the control module, thus displaying the corresponding screen. The driving control signal detection module can collect the vehicle's gear position signal (indicating whether the current gear is neutral, forward, or reverse), vehicle speed signal (indicating the vehicle's speed), and steering signal (indicating whether the turn signal is on and the steering wheel's angle indicator). These signals are related to the vehicle's driving control and therefore belong to driving control signals, indicating the vehicle's driving status, such as whether the vehicle is currently parked or moving, forward or reverse, the gear and speed used while moving, and whether it is going straight or turning. The perception layer includes multiple components that can perceive the environment inside and outside the vehicle, such as vehicle radar / distance sensors, reversing cameras, in-vehicle cameras, rearview camera modules (including main rearview cameras and side blind spot cameras), and environmental parameter sensing modules (including light sensors and rain / humidity sensors).

[0017] In this embodiment, the control module, display module, driving control signal detection module, and perception layer can be connected via a CAN bus.

[0018] In this embodiment, the rearview camera module includes a main rearview camera and side rear blind spot cameras. The main rearview camera can be installed in the center of the rear of the vehicle (e.g., in the center of the bumper or trunk lid), and its field of view faces directly to the rear of the vehicle. The image captured by the main rearview camera is the main rearview image. There can be at least two side rear blind spot cameras. One side rear blind spot camera is installed on the left side of the rear of the vehicle (e.g., on the left side of the bumper or trunk lid), and the other side rear blind spot camera is installed on the right side of the rear of the vehicle (e.g., on the right side of the bumper or trunk lid). The field of view of the side rear blind spot cameras faces the left and right rear of the vehicle, and the images captured by the side rear blind spot cameras are side rearview images. The main rearview image and the side rearview images, combined, can obtain a rearview image with a wide field of view (including the driver's blind spots on the left and right rear sides). Since the main rearview camera and the side blind spot camera can continuously capture images for a long time, a video stream composed of multiple consecutive rearview images can be obtained. The processing of multiple rearview images is equivalent to repeating a single rearview image. Therefore, the processing of a single rearview image will be used as an example for explanation.

[0019] In this embodiment, the side-rear blind spot camera serves to supplement the main rearview camera. When the main rearview camera has a sufficiently large field of view, its field of view can cover that of the side-rear blind spot camera. Therefore, the rearview camera module can include only the main rearview camera without the side-rear blind spot camera. In this case, the main rearview image captured by the main rearview camera is used as the rearview image.

[0020] In this embodiment, each display unit in the display module is installed in the car's driver's cab, allowing the driver to easily see the displayed images on each unit without having to turn their head while driving. For example, refer to... Figure 2 The first display unit (central control screen), the second display unit (instrument screen), and the third display unit (head-up display HUD) are installed on the dashboard and near the steering wheel.

[0021] In this embodiment, some or all of the display units have their own display modes. The display mode of a display unit refers to the size (scaling degree), position, and additional visual effects (such as superimposed warning boxes, flashing, and additional beeping sounds) of the display screen in the display unit when the display control module sends the display screen.

[0022] For example, refer to Figure 2The first display unit (central control screen) has two display modes: picture-in-picture and split-screen. When set to picture-in-picture mode, the first display unit (central control screen) uses a small portion of its screen to display its corresponding content, while the majority is used to display other content (such as audio-visual entertainment interfaces, automotive human-machine interfaces, etc.). When set to split-screen mode, the first display unit (central control screen) uses a larger portion of its screen to display its corresponding content, while a significant portion is used to display other content (such as audio-visual entertainment interfaces, automotive human-machine interfaces, etc.), thus creating a split-screen display effect. This allows the driver to see the first display unit (central control screen) more clearly. The display in split-screen mode is essentially a scaled and moved version of the display in picture-in-picture mode.

[0023] Reference Figure 2 The second display unit (instrument screen) displays the corresponding display screen through the streaming media screen. The display mode of the second display unit (instrument screen) corresponds to the size of the display screen. That is, by switching the display screen of the second display unit (instrument screen), the size of the streaming media screen can be adjusted, so that the display screen is scaled accordingly.

[0024] In this embodiment, the display modes of the third display unit (head-up display HUD) include a normal mode and an alert mode. In the normal mode, only the display screen itself is displayed when the display screen is displayed. In the alert mode, a flashing yellow alert frame is superimposed on the display screen when the display screen is displayed.

[0025] In this embodiment, refer to Figure 1 The rear-view camera module in the perception layer sends the captured rear-view images to the control module for reference. Figure 3 The control module performs the following steps: S1. Set the display mode for each display unit; S2. Generate the display screen for each display unit based on the rear view image; S3. Control the display unit to display the corresponding display screen in the corresponding display mode.

[0026] In this embodiment, when the control module executes step S1, which is to set the display mode of each display unit, it can specifically perform the following steps: S101A. Perform image recognition on the rear view image to determine the driving status of the following vehicle; S102A. Determine the vehicle's driving status based on driving control signals; S103A. Set each display mode according to the driving status of the following vehicle and / or the driving status of the vehicle itself.

[0027] Steps S101A-S103A are the first execution method of step S1.

[0028] In step S101A, the control module can run a target detection algorithm to identify the following vehicle target from the rear view image, and further identify the distance and relative position between the following vehicle target and the vehicle itself, thereby determining the driving status of the following vehicle. The specific values ​​of the driving status of the following vehicle are shown in Table 1.

[0029] Table 1

[0030] In step S102A, the control module can determine the vehicle's driving status based on the specific values ​​of driving control signals such as gear position signal, vehicle speed signal, and steering signal. The specific values ​​for the vehicle's driving status are shown in Table 2.

[0031] Table 2

[0032] In step S103A, the display mode of each display unit can be set according to the specific values ​​of the driving status of the following vehicle shown in Table 1, or the specific values ​​of the driving status of the current vehicle shown in Table 2, or a combination thereof.

[0033] For example, when the vehicle's driving status is "normal driving," the control module can set the display mode of the first display unit (central control screen) to picture-in-picture mode. This allows the driver to observe the display screen containing rear-view images while also reserving a sufficiently large area to display other content such as the audio-visual entertainment interface. When the vehicle's driving status is "reversing," "lane changing," or "meeting oncoming traffic on a narrow road," the control module can set the display mode of the first display unit (central control screen) to split-screen mode. This allows the first display unit (central control screen) to display the display screen containing rear-view images in a larger area, making it easier for the driver to observe the situation behind the vehicle. This assists the driver in dealing with special situations requiring full observation, such as reversing, changing lanes, and meeting oncoming traffic on narrow roads, thus ensuring vehicle driving safety.

[0034] For example, when the vehicle's driving status is "normal driving", the control module can set the streaming media image in the second display unit (instrument screen) to a fixed narrow area (approximately 5-8cm wide) on the far left (or far right) of the screen. When the vehicle's driving status is "reversing", "changing lanes", or "meeting oncoming traffic on a narrow road", the control module can magnify the streaming media image in the second display unit (instrument screen) by 2-3 times and display it for 3-5 seconds. This enhances the driver's assistance in special situations requiring sufficient observation, such as reversing, changing lanes, and meeting oncoming traffic on narrow roads, thus ensuring vehicle driving safety.

[0035] For example, when the following vehicle's driving status is "normal driving," the control module can set the display mode of the third display unit (head-up display HUD) to the normal mode, meaning no additional visual effects are superimposed. When the following vehicle's driving status is "too close to this vehicle" or "within this vehicle's blind spot," the control module can set the display mode of the third display unit (head-up display HUD) to the warning mode. This means that in addition to displaying its own image, the third display unit (head-up display HUD) will also display a red vehicle icon and a flashing yellow warning box, and can simultaneously trigger the vehicle's side radar to emit a buzzer warning. This will increase the driver's attention to the abnormally driving following vehicle, allowing the driver to make timely driving decisions and ensuring vehicle safety.

[0036] In this embodiment, when the control module executes step S1, which is to set the display mode of each display unit, it can specifically perform the following steps: S101B. Perform image recognition on facial images to obtain pupil features; S102B. Determine the driver's line of sight based on pupil characteristics; S103B. Set each display mode according to the direction of the view.

[0037] Steps S101B-S103B are the second execution method of step S1.

[0038] In step S101B, the in-vehicle camera sends the captured facial image of the driver to the control module. The control module executes a facial recognition algorithm (e.g., Haar feature classifier, YOLO algorithm) to distinguish between the left and right eyes, thereby obtaining the driver's pupil features. Further features such as pupil center coordinates, iris edge contour, corneal reflector position, and eyelid opening / closing degree can be extracted to form pupil features. These pupil features represent information such as the driver's pupil orientation, which can be represented as a straight line on the plane of the facial image. In step S102B, the control module obtains the spatial coordinates of the in-vehicle camera and converts the straight line corresponding to the pupil orientation into a straight line in the three-dimensional space where the in-vehicle camera is located, thereby determining the driver's gaze direction.

[0039] In step S103B, the control module can obtain the pre-calibrated spatial coordinates of the first display unit (central control screen), the second display unit (instrument screen), and the third display unit (head-up display HUD), thereby calculating whether the driver's line of sight passes through these first display units (central control screen), second display units (instrument screen), and third display units (head-up display HUD). If it does, the coordinates of the intersection point between the line of sight and each display unit are calculated, thereby determining which display unit the driver's line of sight falls on and its specific location.

[0040] In step S103B, taking the second display unit (instrument screen) as an example, the size and position of the streaming media image can be adjusted according to the intersection of the driver's line of sight on the second display unit (instrument screen). This allows the streaming media image to cover the intersection of the line of sight on the second display unit (instrument screen), ensuring that the driver can always see the image displayed on the second display unit (instrument screen) through the streaming media image. This allows the driver to always understand the content of the rear view image through the display image, enabling the driver to obtain the situation behind the vehicle in a timely manner, which is conducive to the driver making timely driving decisions and ensuring vehicle driving safety.

[0041] In this embodiment, when the control module executes step S2, which is the step of generating the display screen of each display unit based on the rear view image, it can specifically perform the following steps: S201A. For any display unit, adjust and / or extract information from the rear view image according to the display characteristics of the display unit to obtain the display screen corresponding to the display unit.

[0042] Step S201A is the first execution method of step S2.

[0043] The principle of step S201A is as follows: Figure 4 As shown. (Refer to...) Figure 4Each display unit receives its processed rear view image from the control module in parallel and then displays it.

[0044] Specifically, the control module can process the rear view image differently based on the display characteristics of the display unit, such as its size and light-emitting principle. For example, the first display unit (central control screen) has the largest display area among all display units and can display image details to the maximum extent. Therefore, the control module can, based on these display characteristics, either not process the rear view image or only perform simple adjustments such as size cropping to obtain display screen 1 corresponding to the first display unit (central control screen) and send display screen 1 to the first display unit (central control screen) for display. Similarly, the second display unit (instrument screen) has a medium display area among all display units. Therefore, the control module can, based on these display characteristics, perform adjustments such as size cropping on the rear view image to obtain the second display screen... The display screen 2 corresponding to the instrument panel will be sent to the second display unit (instrument panel) for display. As for the third display unit (head-up display HUD), due to its display principle, it is generally not suitable for displaying images with complex details, but is suitable for displaying text and other content. Therefore, the control module can recognize the content of the rear view image based on these display characteristics and convert it into text information such as "There is a car coming from behind" or "The car behind is in the blind spot" to represent the content of the rear view image. This text information is then sent to the third display unit (head-up display HUD) for display as the display screen 3 corresponding to the third display unit (head-up display HUD).

[0045] In this embodiment, by executing step S201A, the control module can convert the rear view image into a display screen that adapts to the display characteristics of each display unit, thereby enabling each display unit to achieve its optimal display effect, improving information transmission efficiency, and allowing the driver to obtain the situation behind the vehicle in a timely manner, thus ensuring vehicle driving safety.

[0046] In this embodiment, when the control module performs step S201A, which involves adjusting the rear view image and / or extracting information to obtain the display screen corresponding to the display unit, it can specifically perform the following steps: S20101A. Set environmental reference values; S20102A. Obtain the deviation of environmental parameters from environmental reference values; S20103A. Set the adjustment upper limit based on the deviation value; S20104A. Set multiple adjustment values ​​within the range of zero and the adjustment upper limit; S20105A. Obtain one of the adjustment values, adjust the image parameters of the rear view image accordingly, and obtain the display screen corresponding to the display unit.

[0047] In step S20101A, the set environmental reference value is a value with the same properties as the environmental parameters detected by the environmental parameter sensing module, and can be used to measure the magnitude of the environmental parameters. For example, referring to... Figure 1 The environmental parameter sensing module includes a light sensor and a rain / humidity sensor. The light sensor detects light intensity signals as environmental parameters, while the rain / humidity detected by the rain / humidity sensor can also be converted into light intensity signals as environmental parameters through a pre-calibrated conversion relationship. Therefore, in step S20101A, a specific light intensity value can be set as an environmental reference value.

[0048] In step S20102A, the deviation of the environmental parameters from the environmental reference values ​​is calculated, i.e., using the formula... Deviation value = Environmental parameter - Environmental reference value Calculate the deviation value. When the environmental parameter is a light intensity signal, the deviation value indicates the degree to which the light intensity of the current environment in which the vehicle is located exceeds the standard.

[0049] In step S20103A, an adjustment upper limit is set based on the deviation value calculated in step S20102A. The adjustment upper limit is the maximum adjustment value for image parameters (e.g., brightness) of the rear view image. In step S20103A, an adjustment upper limit that is positively correlated with the deviation value can be set, that is, the larger the deviation value, the larger the adjustment upper limit.

[0050] In step S20104A, multiple adjustment values ​​are set within the range of zero and the upper limit of adjustment, meaning that any one of the adjustment values ​​satisfies... 0 ≤ Adjustment value ≤ Adjustment limit In this embodiment, the number of adjustment values ​​is the same as the number of display units. For example, in the case of three display units—a first display unit (central control screen), a second display unit (instrument screen), and a third display unit (head-up display HUD)—three adjustment values—adjustment value 1, adjustment value 2, and adjustment value 3—can be set. Specifically, the following can be set: Adjustment value 1 = 0 Adjustment value 2 = Adjustment limit / 2 Adjustment value 3 = Adjustment limit In step S20105A, each adjustment value is assigned to each display unit, so that each display unit receives a corresponding adjustment value. The assignment method can be random or based on a fixed size relationship. For example, in this embodiment, adjustment value 1 can be assigned to the first display unit (central control screen), adjustment value 2 to the second display unit (instrument screen), and adjustment value 3 to the third display unit (head-up display HUD).

[0051] Thus, during step S20105A, the control module adjusts the image parameters of the rear view image according to adjustment value 1, that is, it does not adjust the image parameters (brightness) of the rear view image, but maintains the original image parameters (brightness) of the rear view image, and obtains the display screen 1 corresponding to the first display unit (central control screen); the control module adjusts the image parameters of the rear view image according to adjustment value 2, that is, it increases the image parameters (brightness) of the rear view image by adjustment upper limit / 2, and obtains the display screen 2 corresponding to the second display unit (instrument screen), which is brighter than the rear view image, but the increase in brightness is small; the control module adjusts the image parameters of the rear view image according to adjustment value 3, that is, it increases the image parameters (brightness) of the rear view image by adjustment upper limit, and obtains the display screen 3 corresponding to the third display unit (head-up display HUD), which is brighter than the rear view image, but the increase in brightness is large.

[0052] In this embodiment, the above-mentioned adjustment of image parameters (brightness) can also be done in the opposite direction, that is, the rear view image is darkened by different degrees, thereby reducing the glare caused by the headlights of the following vehicle.

[0053] In this embodiment, the principle of executing steps S20101A-S20105A is as follows: the control module can adjust the image parameters of the rear view image accordingly (e.g., brighten it) based on changes in environmental parameters (specifically, brightness), so that the display image displayed by the display unit has better environmental parameters (e.g., brighter) than the rear view image, thereby achieving WDR (Wide Dynamic Range) and HDR (High Dynamic Range), which helps the driver to observe the content of the rear view image more clearly; by setting multiple adjustment values ​​to make different adjustments to the rear view image to obtain different display images, different display units can experience different degrees of adjustment to the display images, thus providing the driver with more choices. For example, the driver can choose to observe a display image with a larger degree of brightness adjustment, or a display image with a smaller degree of brightness adjustment but retaining more original details and less noise, which helps the driver to efficiently obtain information related to the following vehicle and make driving decisions, ensuring vehicle driving safety.

[0054] In this embodiment, when the control module executes step S2, which is the step of generating the display screen of each display unit based on the rear view image, it can specifically perform the following steps: S201B. Classify each display unit so that different display units obtain different levels; S202B. Traverse each display unit in descending order of its corresponding level; S203B. For the current level display unit, where the current level display unit is any display unit visited in the traversal, perform the following steps: When the current display unit is the highest level, the rear view image is converted to the display screen corresponding to the current display unit. When the level of the current display unit is not the highest level, the display screen corresponding to the current display unit is generated based on the display screen corresponding to the higher-level display unit.

[0055] Steps S201B-S205B are the second execution method of step S2.

[0056] The principle of steps S201B-S205B is as follows: Figure 5 As shown. (Refer to...) Figure 5 The control module processes each display screen step by step. That is, after processing and obtaining a display screen, it continues to process the obtained display screen to obtain a new display screen. In step S201B, the control module can randomly classify the display units or classify them according to their display characteristics. For example, in this embodiment, the first display unit (central control screen) with the largest display area and capable of displaying the most image details is set to the highest level 3, the second display unit (instrument screen) with a medium display area and capable of displaying a relatively large number of image details is set to the medium level 2, and the third display unit (head-up display HUD) which can generally only display text information is set to the lowest level 1.

[0057] In step S202B, the control module traverses the corresponding display units in descending order of level, namely the first display unit (central control screen), the second display unit (instrument screen), and the third display unit (head-up display HUD).

[0058] For example, the control module first iterates to the first display unit (central control screen). At this point, the current display unit is the first display unit (central control screen), and its corresponding level 3 is the highest level. Therefore, when executing step S203B, the rear view image is converted to the display screen corresponding to this level display unit, that is, the rear view image is converted to display screen 1 corresponding to the first display unit (central control screen). Specifically, the rear view image can be cropped and its image parameters transformed, resulting in display screen 1 that still retains a lot of image detail. The control module then sends display screen 1 to the first display unit (central control screen) for display.

[0059] Next, the control module first traverses to the second display unit (instrument panel). At this time, the current display unit is the second display unit (instrument panel), and its corresponding level 2 is a medium level, not the highest level. Therefore, when executing step S203B, the first display unit (central control screen) is a high-level display unit relative to the current display unit. The display screen corresponding to the current display unit, i.e., display screen 1, is used to generate the display screen corresponding to the current display unit, i.e., display screen 2. Specifically, at this time, display screen 1 is a high-level screen. The control module can perform unsupervised detection on the high-level screen, i.e., display screen 1, to determine the detection targets in the high-level screen. Specifically, display screen 1 can be input into an unsupervised trained artificial intelligence model for processing to obtain the detection targets output by the artificial intelligence model. In this embodiment, unsupervised detection is a detection that does not pre-set specific targets, but can identify abnormal content in display screen 1. For example, display screen 1 may show a following vehicle with high-risk driving behavior such as too close a distance or deviation from the direction. Such abnormal content is represented by the detection targets in display screen 1. Since the level 2 corresponding to this level display unit [the second display unit (instrument panel)] is a medium level rather than the lowest level, the part corresponding to the detected target is extracted from the high-level screen (display screen 1) and used as the current level display screen, i.e., display screen 2. Thus, the obtained display screen 2 is the detected target extracted from display screen 1, and its content is an image of a following vehicle in display screen 1 exhibiting high-risk driving behaviors such as following too closely or deviating from the direction.

[0060] Next, the control module first iterates to the third display unit (Head-Up Display HUD). At this point, the current display unit is the third display unit (Head-Up Display HUD), and its corresponding level 3 is the lowest level, not the highest. Therefore, when executing step S203B, relative to the current display unit, the first display unit (central control screen) and the second display unit (instrument screen) are both high-level display units. The display screen corresponding to the current display unit, i.e., display screen 1 and display screen 2, is used to generate the display screen corresponding to the current display unit, i.e., display screen 3. In this embodiment, only the high-level display screen corresponding to the higher-level high-level display unit, i.e., display screen 2, can be obtained to generate the display screen corresponding to the current display unit, i.e., display screen 3. Specifically, since the level 2 corresponding to the current display unit [the third display unit (Head-Up Display HUD)] is the lowest level, semantic recognition can be performed on the high-level screen (display screen 2) (or the part corresponding to the detection target can be extracted from it) to obtain text information. Specifically, the advanced display screen (display screen 2) can be input into a trained multimodal model for semantic recognition. If display screen 1 contains abnormal content such as a following vehicle exhibiting high-risk driving behaviors like being too close or deviating from its direction, and display screen 2 contains such abnormal content, the text information obtained from semantic recognition of the display screen will be "following vehicle too close" or "following vehicle deviating from its direction," etc., and this will be used as the current level display screen, i.e., display screen 3. Thus, the obtained display screen 3 is the text information obtained from semantic recognition of display screen 2, namely "following vehicle too close" or "following vehicle deviating from its direction," etc.

[0061] In this embodiment, the principle of executing steps S201B-S205B is as follows: By executing steps S201B-S205B, multiple display screens can be obtained by processing the rear view image step by step. Except for the highest level display screen, each display screen is obtained by further identification based on the already obtained high-level screen. Therefore, it is equivalent to performing multi-level information extraction on the rear view image, thereby making full use of the characteristic that the display module has multiple display units and controlling different display units to display different levels of information. For example, based on executing steps S201B-S205B, the driver can choose to observe the display screen 1 displayed by the first display unit (central control screen) to understand the original information in the rear view image. The driver can choose to observe the display screen 2 displayed by the second display unit (instrument screen) to understand the abnormal situation in the rear view image. The driver can choose to observe the display screen 3 displayed by the third display unit (head-up display HUD) to understand the text description of the abnormal situation in the rear view image. Therefore, the driver can simultaneously obtain different levels of understanding of the situation of the vehicle behind, which is conducive to the driver fully grasping the situation of the vehicle behind and making driving decisions, thus ensuring the safety of vehicle driving.

[0062] In this embodiment, the automotive rearview display system has the following technical effects.

[0063] 1. In terms of hardware, the traditional rearview mirror can be eliminated (or it can be retained), and the vehicle terminal and camera / radar / sensor can be reused to simplify the cabin layout, remove the obstruction of the traditional rearview mirror, and ensure a complete field of vision (a streaming media rearview mirror main camera can also be added). 2. In terms of safety, it presents information behind the vehicle and core driving information in the same field of vision, significantly reducing the time of eye deflection and reducing the risk of accidents; 3. In terms of user experience, the screen is optimized for multiple scenarios, and flexible interaction is provided to improve environmental adaptability and system reliability.

[0064] In this embodiment, the rearview display system can be installed on a car, so that the rearview display system and other components form a complete car, and such a car has all the technical effects of the rearview display system.

[0065] It should be noted that, unless otherwise specified, when a feature is referred to as "fixed" or "connected" to another feature, it can be directly fixed or connected to the other feature, or indirectly fixed or connected to the other feature. Furthermore, the descriptions of "upper," "lower," "left," and "right" used in this disclosure are only relative to the relative positional relationships of the components of this disclosure in the accompanying drawings. The singular forms "a" and "the" used in this disclosure are also intended to include the plural forms, unless the context clearly indicates otherwise. Moreover, unless otherwise defined, all technical and scientific terms used in this embodiment have the same meaning as commonly understood by one of ordinary skill in the art. The terminology used in this embodiment specification is only for describing specific embodiments and is not intended to limit the embodiments of the invention. The term "and / or" as used in this embodiment includes any combination of one or more of the associated listed items.

[0066] It should be understood that although the terms first, second, third, etc., may be used to describe various elements in this disclosure, these elements should not be limited to these terms. These terms are only used to distinguish elements of the same type from each other. For example, a first element may also be referred to as a second element without departing from the scope of this disclosure, and similarly, a second element may also be referred to as a first element. The use of any and all instances or exemplary language (“e.g.,” “such as,” etc.) provided in this embodiment is intended only to better illustrate embodiments of the invention and, unless otherwise required, does not impose a limitation on the scope of embodiments of the invention.

[0067] It should be recognized that embodiments of the present invention can be implemented or carried out by computer hardware, a combination of hardware and software, or by computer instructions stored in a non-transitory computer-readable storage medium. The method can be implemented using standard programming techniques—including a non-transitory computer-readable storage medium configured with a computer program, wherein such a storage medium causes the computer to operate in a specific and predefined manner—according to the methods and drawings described in the specific embodiments. Each program can be implemented in a high-level procedural or object-oriented programming language to communicate with the computer system. However, if desired, the program can be implemented in assembly or machine language. In any case, the language can be a compiled or interpreted language. Furthermore, for this purpose, the program can run on a programmed application-specific integrated circuit (ASIC).

[0068] Furthermore, the procedures described in this embodiment can be performed in any suitable order unless otherwise indicated by this embodiment or otherwise obviously contradict the context. The procedures (or variations and / or combinations thereof) described in this embodiment can be executed under the control of one or more computer systems configured with executable instructions, and can be implemented by hardware or a combination thereof as code (e.g., executable instructions, one or more computer programs, or one or more applications) that commonly executes on one or more processors. A computer program includes a plurality of instructions executable by one or more processors.

[0069] Furthermore, the method can be implemented in any suitable type of computing platform, including but not limited to personal computers, minicomputers, mainframes, workstations, networked or distributed computing environments, standalone or integrated computer platforms, or in communication with charged particle tools or other imaging devices, etc. Aspects of embodiments of the invention can be implemented as machine-readable code stored on a non-transitory storage medium or device, whether removable or integrated into a computing platform, such as a hard disk, optical read and / or write storage medium, RAM, ROM, etc., such that it is readable by a programmable computer, and when the storage medium or device is read by the computer, it can be used to configure and operate the computer to perform the processes described herein. Furthermore, the machine-readable code, or portions thereof, can be transmitted via wired or wireless networks. The invention of this embodiment includes these and other different types of non-transitory computer-readable storage media when such media comprises instructions or programs that implement the steps above in conjunction with a microprocessor or other data processor. Embodiments of the invention also include the computer itself when programmed according to the methods and techniques of embodiments of the invention.

[0070] A computer program can be applied to input data to perform the functions of this embodiment, thereby transforming the input data to generate output data stored in non-volatile memory. The output information can also be applied to one or more output devices, such as a display. In a preferred embodiment of the invention, the transformed data represents physical and tangible objects, including a specific visual depiction of physical and tangible objects generated on the display.

[0071] The above are merely preferred embodiments of the present invention. The embodiments of the present invention are not limited to the above-described implementations. Any modifications, equivalent substitutions, or improvements made within the spirit and principles of the embodiments of the present invention, as long as they achieve the same technical effects, should be included within the scope of protection of the embodiments of the present invention. Within the scope of protection of the embodiments of the present invention, the technical solutions and / or implementation methods can have various modifications and variations.

Claims

1. A vehicle rearview display system, characterized in that, The vehicle rearview display system includes: Rearview camera module; the rearview camera module is used to capture images from the rear of the vehicle to obtain a rearview image; Display module; the display module includes multiple display units; the display module is used for installation in the driver's cab of a vehicle; A control module is used to set the display mode of each of the display units, generate the display screen of each of the display units according to the rear view image, and control the display units to display the corresponding display screen in the corresponding display mode.

2. The automotive rearview display system according to claim 1, characterized in that: The rear-view camera module includes a main rear-view camera and a side-rear blind spot camera; The main rear-view camera is used to capture and obtain the main rear-view image; The side-rear blind spot camera is used to capture and obtain side-rear view images; The front rear view image and the side rear view image are combined to form the rear view image.

3. The automotive rearview display system according to claim 1, characterized in that, The plurality of display units include a first display unit, a second display unit, and a third display unit; the first display unit is a central control screen, the second display unit is an instrument panel screen, and the third display unit is a head-up display.

4. The automotive rearview display system according to claim 1, characterized in that: The vehicle rearview display system also includes a driving control signal detection module; The driving control signal detection module is used to detect the driving control signals of the vehicle. Setting the display mode for each of the display units includes: Image recognition is performed on the rear view image to determine the driving status of the following vehicle; The driving status of the vehicle is determined based on the driving control signals. Based on the driving status of the following vehicle and / or the driving status of the vehicle itself, each of the aforementioned display modes is set; the display mode includes the size, position, and additional visual effects of the display screen in the display unit.

5. The automotive rearview display system according to claim 1, characterized in that: The vehicle rearview display system also includes an in-vehicle camera; the in-vehicle camera is used to capture facial images of the driver of the vehicle. Setting the display mode for each of the display units includes: Image recognition is performed on the facial image to obtain pupil features; Based on the pupil characteristics, determine the driver's gaze direction; Each of the aforementioned display modes is set according to the viewing direction; the display mode includes the size, position, and additional visual effects of the displayed image in the display unit.

6. The automotive rearview display system according to any one of claims 1-5, characterized in that, The step of generating the display screen of each display unit based on the rear view image includes: For any of the display units, the rear view image is adjusted and / or information is extracted according to the display characteristics of the display unit to obtain the display screen corresponding to the display unit.

7. The automotive rearview display system according to claim 6, characterized in that: The vehicle rearview display system also includes an environmental parameter sensing module; the environmental parameter sensing module is used to detect the environmental parameters of the environment in which the vehicle is located; The step of adjusting and / or extracting information from the rear view image to obtain the display screen corresponding to the display unit includes: Set environmental reference values; Obtain the deviation of the environmental parameter from the environmental reference value; Based on the deviation value, set an adjustment upper limit; Within the range of zero and the aforementioned adjustment upper limit, multiple adjustment values ​​are set; Obtain one of the adjustment values, adjust the image parameters of the rear view image accordingly, and obtain the display screen corresponding to the display unit.

8. The automotive rearview display system according to any one of claims 1-5, characterized in that, The step of generating the display screen of each display unit based on the rear view image includes: Each of the display units is classified so that different display units obtain different levels; According to the corresponding level from high to low, traverse each of the display units; For the current level display unit, where the current level display unit is any of the display units visited in the traversal, the following steps are performed: When the level of the current display unit is the highest level, the rear view image is converted into the display screen corresponding to the current display unit; When the level of the current display unit is not the highest level, the display screen corresponding to the current display unit is generated according to the display screen corresponding to the higher level display unit; the higher level display unit is the display unit with a higher level than the current display unit.

9. The automotive rearview display system according to claim 8, characterized in that, The step of generating the display screen corresponding to the current-level display unit based on the display screen corresponding to the higher-level display unit includes: At least one advanced screen is acquired; the advanced screen is the display screen corresponding to the advanced display unit. Unsupervised detection is performed on the advanced image to determine the detection targets in the advanced image; When the level of the current display unit is not the lowest level, the part corresponding to the detected target is extracted from the higher level screen and used as the current level display screen; When the level of the current display unit is the lowest level, the part corresponding to the detected target is extracted from the high-level screen, semantic recognition is performed to obtain text information, and the current display screen is generated based on the text information. The display screen at this level is used as the display screen corresponding to the display unit at this level.

10. A car, characterized in that, The vehicle includes the vehicle rearview display system according to any one of claims 1-9.

Images