Method for processing mirror display image, mirror display device and mirror

Abstract

This application relates to the field of image processing technology, specifically providing a method for processing images displayed in a sight mirror, a sight mirror display device, and a sight mirror. The method for processing images displayed in a sight mirror includes determining the image display type based on the vehicle's driving state; wherein the image display type includes single-curvature display or multi-curvature display; processing image data around the vehicle according to the image display type to obtain processed display image data. Based on this method, when the image display type is multi-curvature display, data can be processed using a multi-curvature display method to expand the field of view, reduce the driver's blind spots, and improve safety during vehicle driving. This method can achieve multi-curvature display of the sight mirror without relying on multi-curvature lenses, reducing the manufacturing difficulty and cost of lenses.

Description

Technical Field

[0001] This application relates to the field of image processing technology, and more specifically, to a method for processing images displayed in a viewing mirror, a viewing mirror display device, and a viewing mirror. Background Technology

[0002] Vehicle side mirrors are one of the most important safety devices in a vehicle, primarily serving to help drivers observe road conditions around the vehicle and avoid traffic accidents. Traditional vehicle side mirrors typically consist of a lens, a mirror housing, and a bracket. Traditional lenses usually use plane mirrors or convex mirrors with low curvature, but these lenses have limitations such as limited field of view and susceptibility to distortion. While using hypercurvature or multi-curvature lenses can expand the field of view, these lenses are more difficult to manufacture and therefore more expensive. Summary of the Invention

[0003] In view of the above, the purpose of this application is to provide a method for processing images displayed in a viewing mirror, a viewing mirror display device, and a viewing mirror, so as to solve the above-mentioned technical problems.

[0004] In a first aspect, embodiments of this application provide a method for processing images displayed through a viewing mirror, the method comprising:

[0005] The image display type is determined based on the vehicle's driving status; wherein, the image display type includes single curvature display or multi-curvature display;

[0006] The image data around the vehicle is processed according to the image display type to obtain the processed display image data.

[0007] In the above implementation process, the image processing method for the rearview mirror includes determining the image display type based on the vehicle's driving state; wherein, the image display type includes single curvature display or multi-curvature display; and processing the image data around the vehicle according to the image display type to obtain processed display image data. Based on this image processing method, when the image display type is multi-curvature display, data can be processed using a multi-curvature display approach to expand the field of view, reduce the driver's blind spots, and improve safety during vehicle driving. This method can achieve multi-curvature display of the rearview mirror without relying on multi-curvature lenses, reducing the manufacturing difficulty and cost of lenses.

[0008] Furthermore, based on this image processing method for the rearview mirror, when the vehicle speed is low or there is no need to turn or make a U-turn, the data can be processed using a single curvature display method to improve the driver's comfort in observing the content displayed in the rearview mirror.

[0009] Optionally, in this embodiment of the application, the method for determining the vehicle driving state includes: determining the vehicle driving state based on the vehicle's driving speed information and driving direction information.

[0010] In the above implementation process, the vehicle's driving status is determined based on the vehicle's speed and direction information, and the image display type is adjusted according to the vehicle's driving status; that is, the processing method of the image data around the vehicle is adjusted according to the vehicle's speed and direction information so that the processed display image data can meet the driver's field of vision requirements.

[0011] Optionally, in this embodiment of the application, when the image display type is a multi-curvature display, the processed display image data includes multiple curvature display sub-regions; the step of processing the image data around the vehicle according to the image display type to obtain the processed display image data includes: determining the sub-region display curvature of each of the curvature display sub-regions according to the vehicle driving state; and processing the image data around the vehicle according to the sub-region display curvature to obtain the processed display image data.

[0012] In the above implementation process, the processed display image data includes multiple curvature display sub-regions. By determining the display curvature of each sub-region and processing the image data around the vehicle based on the sub-region display curvature, processed display image data for realizing multi-curvature display can be obtained. Furthermore, based on the processed display image data, multi-curvature display of the side mirror is achieved, expanding the driver's field of vision.

[0013] Optionally, in this embodiment of the application, the method further includes: displaying the plurality of curvature display sub-regions through an image display module; wherein, the image display module is disposed in the vehicle; the curvature of the sub-region corresponding to the curvature display sub-region that is farther away from the driver's seat of the vehicle is greater.

[0014] In the above implementation process, by setting the curvature of the sub-region corresponding to the greater the distance from the driver's seat, the driver's field of vision can be expanded while ensuring the realism of the image displayed on the inner mirror as much as possible. This allows the driver to accurately judge the actual distance between the vehicle and nearby objects based on the image displayed in the rearview mirror.

[0015] Optionally, in this embodiment of the application, when the image display type is a multi-curvature display, the step of processing the image data around the vehicle according to the image display type to obtain the processed display image data includes: determining the curvature change function of the multi-curvature display according to the vehicle driving state; wherein, the curvature change function includes a display curvature that changes continuously with the vehicle distance; calculating the display position of each pixel in the image data around the vehicle in the image display module according to the curvature change function; wherein, the vehicle distance includes the distance between the pixel and the vehicle; and obtaining the processed display image data based on the display position of each pixel in the image data around the vehicle.

[0016] In the above implementation process, the curvature change function for multi-curvature display is determined based on the vehicle's driving state; according to the curvature change function, the display position of each pixel in the image data around the vehicle in the image display module is calculated; and based on the display position of each pixel in the image data around the vehicle, processed display image data for implementing multi-curvature display can be obtained. Furthermore, the curvature change function includes a display curvature that continuously changes with vehicle distance; based on the continuously changing display curvature, the driver's adaptability to multi-curvature display can be improved.

[0017] Optionally, in this embodiment, the curvature variation function includes x ′ α represents the distance between the pixel and the vehicle, x represents the distance between the pixel and the vehicle after the curvature change, α represents the first change parameter, β represents the second change parameter, and ratio represents the display curvature corresponding to the pixel.

[0018] The step of determining the curvature change function of the multi-curvature display based on the vehicle driving state includes: determining the first change parameter and the second change parameter in the curvature change function based on the vehicle driving state;

[0019] The step of calculating the display position of each pixel in the image data around the vehicle in the image display module according to the curvature change function includes: according to x ′ =α*ln(β*x+1)+γ, calculate the distance between the pixel after the curvature change and the vehicle; where γ represents the fixed offset of the pixel; calculate the display position of each pixel in the image data in the image display module based on the distance between the pixel after the curvature change and the vehicle.

[0020] Optionally, in this embodiment of the application, when the image display type is a single curvature display, the step of processing the image data around the vehicle according to the image display type to obtain the processed display image data includes: determining a target display curvature according to the vehicle's driving state; and processing the image data around the vehicle according to the target display curvature and the display area of ​​the image display module to obtain the processed display image data.

[0021] In the above implementation process, the target display curvature is determined based on the vehicle's driving status. Based on the target display curvature and the display area of ​​the image display module, image data around the vehicle is processed to obtain processed display image data for achieving single-curvature display. Based on the processed display image data, single-curvature display of the rearview mirror can be achieved, improving the driver's viewing comfort.

[0022] Secondly, embodiments of this application provide a viewing mirror display device, which includes: an image acquisition module, an image signal processing module, and an image display module;

[0023] The image acquisition module is used to acquire and send image data of the vehicle's surroundings to the image signal processing module. The image signal processing module is used to determine the image display type based on the vehicle's driving state. The image display type includes single curvature display or multi-curvature display. The image data of the vehicle's surroundings is processed according to the image display type and the display area of ​​the image display module to obtain processed display image data. The image display module is used to display the processed display image data.

[0024] Thirdly, this application provides a viewing mirror, the viewing mirror comprising: a viewing mirror body and a viewing mirror display device as described in the second aspect.

[0025] Fourthly, embodiments of this application provide a computer program product, including a computer program / instructions, which, when executed by a processor, implement the image processing method for displaying images via a viewing mirror as described in any of the first aspects above.

[0026] The beneficial effects of this application include at least the following: the image processing method for the rearview mirror includes determining the image display type based on the vehicle's driving state; wherein the image display type includes single-curvature display or multi-curvature display; and processing image data around the vehicle according to the image display type to obtain processed display image data. Based on this image processing method for the rearview mirror, when the image display type is multi-curvature display, data can be processed using a multi-curvature display approach to expand the field of vision, reduce the driver's blind spots, and improve safety during vehicle driving. This method can achieve multi-curvature display of the rearview mirror without relying on multi-curvature lenses, reducing the processing difficulty and cost of lenses. Furthermore, based on this image processing method for the rearview mirror, when the vehicle speed is low or there is no need for turning or U-turns, data can also be processed using a single-curvature display approach to improve the driver's viewing comfort of the rearview mirror display content. Attached Figure Description

[0027] To more clearly illustrate the technical solutions of the embodiments of this application, the accompanying drawings used in the embodiments of this application will be briefly introduced below. It should be understood that the following drawings only show some embodiments of this application and should not be regarded as a limitation of the scope. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0028] Figure 1 This is a schematic diagram of the structure of a sight glass provided in an embodiment of this application;

[0029] Figure 2 A flowchart illustrating a method for processing images displayed through a viewing mirror, as provided in an embodiment of this application;

[0030] Figure 3 This is a schematic diagram illustrating the division of the curvature display sub-region provided in an embodiment of this application;

[0031] Figure 4 This application provides a schematic diagram of an image data processing procedure for a multi-curvature display.

[0032] Figure 5 A flowchart illustrating an image data processing method for a single curvature display provided in an embodiment of this application;

[0033] Figure 6 This application provides a schematic diagram of an image data processing procedure under a single curvature display scenario.

[0034] Figure 7 This application provides a schematic diagram of an image data processing procedure for a multi-curvature display.

[0035] Figure 8 This is a schematic diagram of the structure of a viewing mirror display device provided in an embodiment of this application. Detailed Implementation

[0036] The embodiments of the technical solution of this application will now be described in detail with reference to the accompanying drawings. These embodiments are only used to more clearly illustrate the technical solution of this application and are therefore merely examples, and should not be used to limit the scope of protection of this application.

[0037] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs; the terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit this application.

[0038] In the description of the embodiments of this application, technical terms such as "first" and "second" are used only to distinguish different objects and should not be construed as indicating or implying relative importance or implicitly specifying the number, specific order, or primary and secondary relationship of the indicated technical features. In the description of the embodiments of this application, "multiple" means two or more, unless otherwise explicitly defined.

[0039] Please refer to Figure 1 , Figure 1 This is a schematic diagram of the structure of a viewing mirror 01 provided in an embodiment of this application. The viewing mirror includes: a viewing mirror body 011 and a viewing mirror display device 012 as described in the third aspect.

[0040] The sight glass body may include a lens, a sight glass housing, a connecting bracket, and other structures. The image acquisition module in the sight glass display device 012 can be implemented using an image sensor, the image signal processing module can be implemented using an FPGA unit, microcontroller, or single-chip microcomputer, and the image display module can be implemented using an LED display device or a liquid crystal display device. The sight glass may also include power supply, wiring harness, and other power (communication) devices. It should be noted that the sight glass display device 012 can be housed within the sight glass housing (e.g., ...). Figure 1 (As shown). The image acquisition module in the sight mirror display device 012 can also be located on the surface of the sight mirror housing or outside the actual housing; the image signal processing module in the sight mirror display device 012 can also be located in other locations in the vehicle (e.g., inside the vehicle) and communicate with the image acquisition module and the image display module via an image signal transmission line.

[0041] Please refer to Figure 2 , Figure 2 This is a flowchart illustrating a method for processing images displayed through a viewing mirror, as provided in an embodiment of this application. The method for processing images displayed through a viewing mirror may include the following steps:

[0042] S101. Determine the image display type based on the vehicle's driving status; wherein, the image display type includes single curvature display or multi-curvature display;

[0043] S102. Process the image data around the vehicle according to the image display type to obtain the processed display image data.

[0044] In step S101, the vehicle's driving state can include a parked state and a driving state. The driving state can include a directional driving state and a turning driving state. The vehicle's stance state can be comprehensively determined based on driving parameters such as vehicle speed, acceleration, and / or steering angle. For example, a directional driving state can include a driving state with a steering angle of less than or equal to 2°, and a turning driving state can include a driving state with a steering angle greater than 2°. It should be noted that a directional driving state can also include a driving state with a steering angle of less than or equal to 1.5° or 3°, which is not specifically limited in this application. Furthermore, the turning driving state can be divided into multiple turning levels according to the size of the steering angle, and the image display type and display curvature corresponding to different turning levels may not be completely the same. The driving state can also include a low-speed driving state, a medium-speed driving state, and a high-speed driving state. For example, a low-speed driving state can include a driving state with a driving speed of less than or equal to 30 km / h, a medium-speed driving state can include a driving state with a driving speed greater than 30 km / h and less than or equal to 60 km / h, and a high-speed driving state can include a driving state with a driving speed greater than 60 km / h. Furthermore, high-speed driving can be further subdivided into multiple levels based on driving speed. The image data processing can determine whether to use a single curvature display or a multi-curvature display based on the vehicle's driving state, and the specific display curvature is determined comprehensively based on the actual driving scenario. For example, a small-angle steering driving state (e.g., a steering angle less than or equal to 2°) can further include: a constant-speed small-angle steering state and an accelerating small-angle steering state (which can include low-acceleration small-angle steering state, medium-acceleration small-angle steering state, and high-acceleration small-angle steering state). It should be noted that even for the same vehicle driving state, different single-curvature or multi-curvature display methods can be selected based on the relative size of the vehicle's steering angle and the relative speed of driving.

[0045] In step S102, when the image display type includes single curvature display, a specific single display curvature can be determined based on the vehicle's speed and direction information. Then, the image data around the vehicle is processed according to the determined single display curvature to obtain processed display image data for implementing single curvature display. Correspondingly, when the image display type includes multi-curvature display, multiple specific display curvatures can be determined based on the vehicle's speed and direction information. Then, the image data around the vehicle is processed according to the determined multiple display curvatures to obtain processed display image data for implementing multi-curvature display. The image data around the vehicle can include image data of the areas surrounding the vehicle, such as the front, rear, front left, rear left, front right, and rear right. The size of the area surrounding the vehicle can be adjusted according to actual conditions, and this application does not specifically limit it. Taking single curvature display as an example, after determining the specific single display curvature, processing methods such as bilinear interpolation or cubic spline interpolation can be used, and the image data around the vehicle can be processed based on the single display curvature to obtain the processed display image data used to achieve single curvature display.

[0046] Therefore, the image processing method for the rearview mirror provided in this application can process data based on a multi-curvature display when the image display type is multi-curvature display, thereby expanding the field of vision, reducing the driver's blind spots, and improving vehicle driving safety. This method can achieve multi-curvature display of the rearview mirror without relying on multi-curvature lenses, reducing the processing difficulty and cost of lenses. Furthermore, based on this image processing method, when the vehicle speed is low or there is no need for turning or U-turns, a single-curvature display method can also be used to process the data, thereby improving the driver's viewing comfort of the rearview mirror display content.

[0047] In some alternative embodiments, taking into account the driver's driving habits, the display curvature of the rearview mirror generally does not need to be adjusted during a turn when the vehicle is turning at a constant speed, to ensure driving safety. However, at the end of the turn (i.e., from steering to directional driving), the overall / partial display curvature of the rearview mirror can be increased to display a wider field of view and better assist the driver in making driving decisions.

[0048] In some optional embodiments, the method for determining the vehicle's driving state includes: determining the vehicle's driving state based on the vehicle's driving speed information and driving direction information.

[0049] The vehicle's driving speed range (e.g., 0-150 km / h) can be divided into multiple speed levels, and the speed information can include the vehicle's current speed level. The vehicle's driving direction information can include the vehicle's steering angle information. Similarly, the vehicle's steering angle range (e.g., 0-40°) can be divided into multiple steering angle levels, and the driving direction information can include the vehicle's current steering angle level. Based on the vehicle's speed and driving direction information, it can be determined whether the vehicle is in a driving state requiring a large field of vision, such as turning or high-speed driving. When the vehicle is in a driving state requiring a large field of vision, a multi-curvature display image type is selected to process the image data around the vehicle, obtaining processed display image data to meet the driver's vision requirements. Therefore, by determining the vehicle's driving state based on its speed and driving direction information, and adjusting the image display type accordingly, the processing method of the image data around the vehicle is adjusted to ensure that the processed display image data meets the driver's vision requirements and improves driving safety.

[0050] In some optional embodiments, when the image display type is a multi-curvature display, the processed display image data includes multiple curvature display sub-regions; S102, processing the image data around the vehicle according to the image display type to obtain the processed display image data includes: determining the sub-region display curvature of each of the curvature display sub-regions according to the vehicle driving state; processing the image data around the vehicle according to the sub-region display curvature to obtain the processed display image data.

[0051] The number of curvature display sub-regions can be 2, 3, 5, or other reasonable values, and can be adjusted according to the actual application. Multiple curvature display sub-regions can be obtained through vertical division, horizontal division, or grid-like division; and the curvature displayed in adjacent curvature display sub-regions can be the same or different. Please refer to [reference needed]. Figure 3 , Figure 3 This is a schematic diagram illustrating the division of the curvature display sub-region provided in an embodiment of this application. Figure 3 The left side shows a case where the division is left and right, and the number of curvature display sub-regions is 3; Figure 3 The middle section shows the case where the division is left and right, and the number of curvature display sub-regions is 2; Figure 3The right side shows a case where the image is divided vertically and there are two curvature display sub-regions. It should be noted that the sizes of the multiple curvature display sub-regions can be the same or different; this application does not specifically limit this. When the image display type is specifically a dual-curvature display (a type of multi-curvature display), the number of curvature display sub-regions can be two, and the curvature of each sub-region is different. The curvature of each sub-region can be 1, 2, or other reasonable values, and can be adjusted according to the actual application. Taking the first curvature display sub-region having a curvature of 1, and the lower left corner of the image data as the origin of the coordinate system, for the first curvature display sub-region, it can be based on x... in =x out +offset calculates the pixel coordinates x in the displayed image data. out The corresponding pixel coordinate x in the image data around the vehicle in Then, based on the corresponding pixel coordinates x in the image data around the vehicle in The corresponding pixel parameters determine the pixel coordinates x in the displayed image data. out The pixel parameters at that location are used to obtain the processed display image data. Accordingly, for the second curvature display sub-region, the pixel parameters can be determined based on x. in =(x out +x u )*rx u Calculate the pixel coordinates x in the displayed image data out The corresponding pixel coordinate x in the image data around the vehicle in (The x and y coordinates of pixels can be processed based on the above formula), x u The coordinates represent the lower left corner of the second curvature display sub-region, and r represents the display curvature of the sub-region corresponding to the second curvature display sub-region. The processed display image data includes multiple curvature display sub-regions. By determining the sub-region display curvature of each curvature display sub-region and processing the image data around the vehicle based on the sub-region display curvature, processed display image data for achieving multi-curvature display can be obtained. Compared to single-curvature display, based on the processed display image data for achieving multi-curvature display, the driver's field of vision can be expanded, thereby improving driving safety.

[0052] In some optional embodiments, the method further includes: displaying the plurality of curvature display sub-regions through an image display module; wherein the image display module is disposed in the vehicle; the curvature of the sub-region corresponding to the curvature display sub-region that is farther away from the driver's seat of the vehicle is greater.

[0053] The distance between the curvature display sub-region and the driver's seat can be determined based on the actual distance between the imaged object in the curvature display sub-region and the driver's seat. The image display module can be a display device (such as an LCD or LED display) installed on the vehicle's side mirror. By setting the curvature display sub-region with a larger curvature corresponding to the farther away from the driver's seat, the driver's field of vision can be expanded while ensuring the realism of the image displayed on the inner mirror surface as much as possible. This allows the driver to accurately judge the actual distance between the vehicle and nearby objects based on the image displayed in the side mirror.

[0054] Please refer to Figure 4 , Figure 4 This is a flowchart illustrating an image data processing method for multi-curvature displays provided in an embodiment of this application.

[0055] In some optional embodiments, when the image display type is a multi-curvature display, S102, processing the image data around the vehicle according to the image display type to obtain processed display image data includes: S1021, determining the curvature change function of the multi-curvature display according to the vehicle driving state; wherein, the curvature change function includes a display curvature that changes continuously with the vehicle distance; S1022, calculating the display position of each pixel in the image data around the vehicle in the image display module according to the curvature change function; wherein, the vehicle distance includes the distance between the pixel and the vehicle; S1023, obtaining the processed display image data based on the display position of each pixel in the image data around the vehicle.

[0056] The rate of change or range of change of the curvature change function can differ depending on the vehicle's driving state. The vehicle distance can be determined based on the actual distance between the image object in the surrounding image data and the driver's seat (or the vehicle's center point or other reference points inside the vehicle). The curvature change function can be implemented using a logarithmic function, an exponential function, or other nonlinear functions. The curvature change function for multi-curvature display is determined based on the vehicle's driving state; the display position of each pixel in the surrounding image data is calculated in the image display module based on the curvature change function; and the processed display image data for multi-curvature display is obtained based on the display position of each pixel in the surrounding image data. Furthermore, the curvature change function includes a display curvature that continuously changes with vehicle distance; this continuously changing display curvature improves the driver's adaptability to multi-curvature display.

[0057] In some optional embodiments, the curvature variation function includes x ′Let x represent the distance between the pixel and the vehicle, α represent the distance between the pixel and the vehicle after the curvature change, β represent the first change parameter, and ratio represent the display curvature corresponding to the pixel; S1021, determine the curvature change function for multi-curvature display based on the vehicle's driving state, including: determining the first change parameter and the second change parameter in the curvature change function based on the vehicle's driving state; S1022, calculate the display position of each pixel in the image data around the vehicle in the image display module based on the curvature change function, including: based on x... ′ =α*ln(β*x+1)+γ, calculate the distance between the pixel after the curvature change and the vehicle; where γ represents the fixed offset of the pixel; calculate the display position of each pixel in the image data in the image display module based on the distance between the pixel after the curvature change and the vehicle.

[0058] Wherein, when the first variable parameter α changes with the vehicle's driving state, the second variable parameter β can be a constant or a curvature change parameter that changes with the vehicle's driving state. Correspondingly, when the second variable parameter β changes with the vehicle's driving state, the first variable parameter α can also be a constant; this application does not specifically limit this. The specific value range of α and β can be adjusted according to the actual display requirements of the viewing mirror (e.g., maximum display curvature value, minimum display curvature value, etc.).

[0059] Optionally, when the distance x between the pixel and the vehicle after curvature change is normalized (i.e., x∈[0,1]), the product of α and β can be greater than or equal to 1. Since Therefore, at x = 0, the corresponding maximum display curvature value α*β is ensured. By limiting α*β ≥ 1, the processing method of the visual mirror display image provided in this application can expand the driver's field of vision and improve driving safety. For example, the value range of β can include [0.25, 4], and the value range of α can include [1.5, 5]. Specifically, when β = 1, α can be 2.1, with a maximum display curvature value of 2.1 and a minimum display curvature of 1.05. When β = 0.5, α can be 3.1, with a maximum display curvature value of 1.55 and a minimum display curvature of 1.033. When β = 0.333, α can be 4.1, with a maximum display curvature value of 1.3653 and a minimum display curvature of 1.024. When β = 2, α can be 2, with a maximum display curvature value of 4 and a minimum display curvature of 1.333. When β = 4, α can be 1.5, at which point the maximum display curvature value is 6 and the minimum display curvature is 1.2.

[0060] Here, γ represents the fixed pixel offset. When calculating the horizontal display position of a pixel, γ represents the horizontal offset of the pixel after the curvature change compared to the pixel before the curvature change; when calculating the vertical display position of a pixel, γ represents the vertical offset of the pixel after the curvature change compared to the pixel before the curvature change. When γ represents the horizontal offset, its magnitude affects the horizontal display range of the viewing mirror (corresponding to the width of the field of view); when γ represents the vertical offset, its magnitude affects the vertical display range of the viewing mirror (corresponding to the height of the field of view).

[0061] Please refer to Figure 5 , Figure 5 This is a flowchart illustrating an image data processing method for a single curvature display, as provided in an embodiment of this application.

[0062] In some optional embodiments, when the image display type is a single curvature display, S102, processing the image data around the vehicle according to the image display type to obtain processed display image data includes: S1024, determining the target display curvature according to the vehicle driving state; S1025, processing the image data around the vehicle according to the target display curvature and the display area of ​​the image display module to obtain the processed display image data.

[0063] In the case of single-curvature display, the target display curvature can be 1 or other reasonable values. The target display curvature corresponding to the same vehicle driving state can be adjusted according to the actual application, and this application does not impose specific limitations on this. By determining the target display curvature based on the vehicle driving state, and processing the image data around the vehicle based on the target display curvature and the display area of ​​the image display module, processed display image data for achieving single-curvature display can be obtained. Based on the processed display image data, single-curvature display of the rearview mirror can be achieved, thereby improving the driver's viewing comfort of the rearview mirror display content.

[0064] Please refer to Figure 6 , Figure 6 This is a schematic diagram illustrating an image data processing procedure for a single curvature display scenario, provided as an embodiment of this application. In the case of a single curvature display, the image data surrounding all (or part of) the vehicle acquired by the image acquisition module can be processed according to the target display curvature. Figure 6 This example illustrates a scenario where "image data around a vehicle acquired by the image acquisition module is processed, and the target display curvature is not 1." Please refer to... Figure 7 , Figure 7 This is a schematic diagram illustrating an image data processing procedure for a multi-curvature display, as provided in an embodiment of this application. Figure 7 An example is shown where "the processed display image data includes three sub-regions with different curvatures (a first curvature sub-region, a second curvature sub-region, and a third curvature sub-region), and the curvature of the first curvature sub-region is 1". For example... Figure 7 As shown, based on the processed display image data used to achieve multi-curvature display, the driver's field of vision can be expanded, thereby improving safety during driving.

[0065] Please refer to Figure 8 , Figure 8 This is a schematic diagram of a viewing mirror display device provided in an embodiment of this application. The viewing mirror display device 012 includes: an image acquisition module 201, an image signal processing module 202, and an image display module 203;

[0066] The image acquisition module 201 is used to acquire and send image data of the area around the vehicle to the image signal processing module.

[0067] The image signal processing module 202 is used to determine the image display type according to the vehicle's driving state; wherein, the image display type includes single curvature display or multi-curvature display; and to process the image data around the vehicle according to the image display type to obtain processed display image data.

[0068] The image display module 203 is used to display the processed image data.

[0069] The rearview mirror display device 012 provided in this application embodiment can acquire image data of the vehicle's surroundings based on the image acquisition module 201; when the image display type is multi-curvature display, the image signal processing module 202 processes the data based on the multi-curvature display method to obtain processed display image data that can expand the field of view; and the image display module 203 displays the processed display image data. Therefore, the rearview mirror display device 012 can reduce the driver's blind spot and improve the safety of driving. This rearview mirror display device 012 can achieve multi-curvature display of the rearview mirror without relying on multi-curvature lenses, which can reduce the processing difficulty and cost of lenses. In addition, based on this rearview mirror display device 012, when the vehicle speed is low or there is no need to turn or make a U-turn, the data can also be processed using a single-curvature display method to improve the driver's viewing comfort of the rearview mirror display content.

[0070] It should be understood that the image signal processing module 202 of the viewing mirror display device corresponds to the embodiment of the image processing method for the viewing mirror display described above. The image signal processing module 202 is capable of executing the various steps involved in the above method embodiment. The specific functions of the image signal processing module 202 can be found in the description above; to avoid repetition, detailed descriptions are appropriately omitted here. The image signal processing module 202 includes at least one software function module that can be stored in memory or embedded in the device's operating system (OS) in the form of software or firmware.

[0071] This application also provides a computer program product, including a computer program / instructions that, when executed by a processor, implement the method as described in any of the first aspects.

[0072] It should be understood that the disclosed apparatus / systems and methods can also be implemented in other ways, as provided in the embodiments of this application. The apparatus embodiments described above are merely illustrative. For example, the flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code, which contains one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than those marked in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, or they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram and / or flowchart, and combinations of blocks in block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0073] In addition, the functional modules in the various embodiments of this application can be integrated together to form an independent part, or each module can exist independently, or two or more modules can be integrated to form an independent part.

[0074] The above description is only an optional implementation of the embodiments of this application, but the protection scope of the embodiments of this application is not limited thereto. Any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in the embodiments of this application should be covered within the protection scope of the embodiments of this application.

Claims

1. A method for processing images displayed through a viewing mirror, characterized in that, The method includes: The image display type is determined based on the vehicle's driving status; wherein, the image display type includes single curvature display or multi-curvature display; The image data around the vehicle is processed according to the image display type to obtain the processed display image data; Wherein, in the case of a multi-curvature display, the step of processing the image data around the vehicle according to the image display type to obtain processed display image data includes: Based on the vehicle's driving state, a curvature change function for the multi-curvature display is determined; wherein, the curvature change function includes a display curvature that changes continuously with the vehicle's distance; Based on the curvature change function, the display position of each pixel in the image data around the vehicle in the image display module is calculated; wherein, the vehicle distance includes the distance between the pixel and the vehicle; The processed display image data is obtained based on the display position of each pixel in the image data around the vehicle; The curvature variation function includes x ′ α represents the distance between the pixel and the vehicle, x represents the distance between the pixel and the vehicle after the curvature change, α represents the first change parameter, β represents the second change parameter, and ratio represents the display curvature corresponding to the pixel. The step of determining the curvature change function of the multi-curvature display based on the vehicle's driving state includes: Based on the vehicle's driving state, determine the first change parameter and the second change parameter in the curvature change function; The step of calculating the display position of each pixel in the image data around the vehicle in the image display module according to the curvature change function includes: According to x ′ =α*ln(β*x+1)+γ, calculate the distance between the pixel after the curvature change and the vehicle; where γ represents the fixed pixel offset; Based on the distance between the pixel and the vehicle after the curvature change, the display position of each pixel in the image data in the image display module is calculated.

2. The method according to claim 1, characterized in that, The methods for determining the vehicle's driving status include: The vehicle's driving status is determined based on its speed and direction of travel information.

3. The method according to claim 1, characterized in that, in, When the image display type is multi-curvature display, the processed display image data includes multiple curvature display sub-regions; The step of processing the image data around the vehicle according to the image display type to obtain processed display image data includes: Based on the vehicle's driving state, determine the sub-region display curvature of each of the curvature display sub-regions; The image data around the vehicle is processed according to the curvature of the sub-region to obtain the processed display image data.

4. The method according to claim 3, characterized in that, The method further includes: displaying the plurality of curvature display sub-regions through an image display module; The image display module is located in the vehicle; the curvature of the sub-region corresponding to the curvature display sub-region that is farther away from the driver's seat of the vehicle is greater.

5. The method according to claim 1, characterized in that, When the image display type is a single curvature display, the step of processing the image data around the vehicle according to the image display type to obtain processed display image data includes: Determine the target display curvature based on the vehicle's driving status; Based on the target display curvature and the display area of ​​the image display module, the image data around the vehicle is processed to obtain the processed display image data.

6. A viewing mirror display device, characterized in that, The viewing mirror display device includes: an image acquisition module, an image signal processing module, and an image display module; The image acquisition module is used to acquire and send image data of the area around the vehicle to the image signal processing module. The image signal processing module is used to determine the image display type based on the vehicle's driving status; wherein, the image display type includes single curvature display or multi-curvature display; and to process the image data around the vehicle according to the image display type to obtain processed display image data; The image display module is used to display the processed image data. Specifically, the image signal processing module is used for: Based on the vehicle's driving state, a curvature change function for the multi-curvature display is determined; wherein, the curvature change function includes a display curvature that changes continuously with the vehicle's distance; Based on the curvature change function, the display position of each pixel in the image data around the vehicle in the image display module is calculated; wherein, the vehicle distance includes the distance between the pixel and the vehicle; The processed display image data is obtained based on the display position of each pixel in the image data around the vehicle; The curvature variation function includes x ′ α represents the distance between the pixel and the vehicle, x represents the distance between the pixel and the vehicle after the curvature change, α represents the first change parameter, β represents the second change parameter, and ratio represents the display curvature corresponding to the pixel. Specifically, the image signal processing module is used to determine the curvature change function for the multi-curvature display based on the vehicle's driving state. Based on the vehicle's driving state, determine the first change parameter and the second change parameter in the curvature change function; The step of calculating the display position of each pixel in the image data around the vehicle in the image display module according to the curvature change function includes: According to x ′ =α*ln(β*x+1)+γ, calculate the distance between the pixel after the curvature change and the vehicle; where γ represents the fixed pixel offset; Based on the distance between the pixel and the vehicle after the curvature change, the display position of each pixel in the image data in the image display module is calculated.

7. A sight glass, characterized in that, The viewing mirror includes: a viewing mirror body and a viewing mirror display device as described in claim 6.

8. A computer program product comprising a computer program / instructions, characterized in that, When the computer program / instruction is executed by the processor, it implements the method as described in any one of claims 1-5.

Images