Processing method of sight glass display image, sight glass display device and sight glass

Abstract

The invention relates to the technical field of image processing, and particularly provides a processing method of a sight glass display image, a sight glass display device and a sight glass. The processing method for the sight glass display image comprises the steps of determining an image display type according to a vehicle driving state; wherein the image display type comprises single curvature display or multi-curvature display; and processing the image data around the vehicle according to the image display type to obtain processed display image data. According to the processing method for displaying the image on the basis of the sight glass, data can be processed on the basis of a multi-curvature display mode under the condition that the image display type is multi-curvature display, so that the view field range is expanded, the view field blind area of a driver is reduced, and the safety in the vehicle driving process is improved. According to the method, multi-curvature display of the sight glass can be realized without depending on a multi-curvature lens, and the processing difficulty and cost of the lens can be reduced.

Description

Technical Field

[0001] The present application relates to the field of image processing technologies, and more specifically, to a method for processing a mirror display image, a mirror display device, and a mirror. Background Art

[0002] A vehicle mirror is one of the important safety devices of a vehicle, and its main function is to help a driver observe the road conditions around the vehicle and avoid traffic accidents. Traditional vehicle mirrors usually consist of a lens, a mirror housing, and a bracket. Traditional lenses usually use plane mirrors or convex mirrors with a small curvature, but these lenses have problems such as a limited field of view and easy deformation. Although using a double-curvature or multi-curvature lens can expand the field of view, the processing of double-curvature or multi-curvature lenses is more difficult and the cost is higher. Summary of the Invention

[0003] In view of this, the purpose of the embodiments of the present application is to provide a method for processing a mirror display image, a mirror display device, and a mirror to solve the above technical problems.

[0004] In a first aspect, the embodiments of the present application provide a method for processing a mirror display image, the method including:

[0005] Determine an image display type according to the vehicle driving state; wherein, the image display type includes single-curvature display or multi-curvature display;

[0006] Process the image data around the vehicle according to the image display type to obtain processed display image data.

[0007] In the above implementation process, the method for processing a mirror display image includes determining an image display type according to the vehicle driving state; wherein, the image display type includes single-curvature display or multi-curvature display; processing the image data around the vehicle according to the image display type to obtain processed display image data. Based on this method for processing a mirror display image, when the image display type is multi-curvature display, data can be processed in a multi-curvature display manner to expand the field of view, reduce the driver's field of view blind area, and improve the safety during vehicle driving. This method can achieve multi-curvature display of the mirror without relying on a multi-curvature lens, and can reduce the processing difficulty and cost of the lens.

[0008] In addition, based on this method for processing a mirror display image, when the vehicle driving speed is low or there is no need to turn around, data can also be processed in a single-curvature display manner to improve the driver's observation comfort of the mirror display content.

[0009] Optionally, in the embodiments of the present application, the method for determining the vehicle driving state includes: determining the vehicle driving state according to the driving speed information and driving direction information of the vehicle.

[0010] In the above implementation process, the vehicle driving state is determined according to the driving speed information and driving direction information of the vehicle, and the image display type is adjusted according to the vehicle driving state; that is, the processing method of the image data around the vehicle is adjusted according to the driving speed information and driving direction information of the vehicle, so that the processed display image data can meet the visual field requirements of the driver.

[0011] Optionally, in the embodiments of the present application, when the image display type is multi-curvature display, the processed display image data includes multiple curvature display sub-regions; the method for processing the image data around the vehicle according to the image display type to obtain the processed display image data includes: determining the sub-region display curvature of each curvature display sub-region according to the vehicle driving state; processing the image data around the vehicle according to the sub-region display curvature to obtain the processed display image data.

[0012] In the above implementation process, the processed display image data includes multiple curvature display sub-regions. By determining the sub-region display curvature of each curvature display sub-region and processing the image data around the vehicle according to the sub-region display curvature, the processed display image data for realizing multi-curvature display can be obtained. Furthermore, based on the processed display image data, the multi-curvature display of the rearview mirror is realized, and the visual field range of the driver is expanded.

[0013] Optionally, in the embodiments of the present application, the method further includes: displaying the multiple curvature display sub-regions through an image display module; wherein, the image display module is arranged on the vehicle; the larger the sub-region display curvature corresponding to the curvature display sub-region farther away from the driver's seat of the vehicle.

[0014] In the above implementation process, by setting the larger the sub-region display curvature corresponding to the curvature display sub-region farther away from the driver's seat of the vehicle, while expanding the visual field range of the driver, the authenticity of the display image of the inner mirror can be ensured as much as possible. So that the driver can accurately judge the actual distance between the vehicle and the nearby object based on the rearview mirror display image.

[0015] Optionally, in the embodiments of the present application, when the image display type is multi-curvature display, the processing of the image data around the vehicle according to the image display type to obtain the processed display image data includes: determining a curvature change function for the multi-curvature display according to the vehicle driving state; wherein, the curvature change function includes a display curvature that continuously changes with the vehicle distance; calculating the display position of each pixel point in the image data around the vehicle in the image display module according to the curvature change function; wherein, the vehicle distance includes the distance between the pixel point and the vehicle; and obtaining the processed display image data based on the display position of each pixel point in the image data around the vehicle.

[0016] In the above implementation process, the curvature change function for the multi-curvature display is determined through the vehicle driving state; the display position of each pixel point in the image data around the vehicle in the image display module is calculated according to the curvature change function; and the processed display image data for realizing the multi-curvature display can be obtained based on the display position of each pixel point in the image data around the vehicle. In addition, the curvature change function includes a display curvature that continuously changes with the vehicle distance, and based on the continuously changing display curvature, the adaptability of the driver to the multi-curvature display can be improved.

[0017] Optionally, in the embodiments of the present application, the curvature change function includes x ′ represents the distance between the pixel point and the vehicle, x represents the distance between the pixel point after curvature change and the vehicle, α represents the first change parameter, β represents the second change parameter, and ratio represents the display curvature corresponding to the pixel point;

[0018] The determining of the curvature change function for the multi-curvature display according to the vehicle driving state includes: determining the first change parameter and the second change parameter in the curvature change function according to the vehicle driving state;

[0019] The calculating of the display position of each pixel point in the image data around the vehicle in the image display module according to the curvature change function includes: according to x ′ =α*ln(β*x + 1)+γ, calculating the distance between the pixel point after curvature change and the vehicle; wherein, γ represents the pixel fixed offset; and calculating the display position of each pixel point in the image data in the image display module according to the distance between the pixel point after curvature change and the vehicle.

[0020] Optionally, in the embodiments of the present application, when the image display type is single-curvature display, the processing of the image data around the vehicle according to the image display type to obtain the processed display image data includes: determining a target display curvature according to the vehicle driving state; processing the image data around the vehicle according to the target display curvature and the display area of the image display module to obtain the processed display image data.

[0021] In the above implementation process, by determining the target display curvature according to the vehicle driving state and processing the image data around the vehicle according to the target display curvature and the display area of the image display module, the processed display image data for realizing single-curvature display can be obtained. Based on the processed display image data, single-curvature display of the rearview mirror can be realized to improve the observation comfort of the driver for the display content of the rearview mirror.

[0022] In a second aspect, an embodiment of the present application provides a rearview mirror display device, which includes: an image acquisition module, an image signal processing module, and an image display module;

[0023] Among them, the image acquisition module is used to acquire and send the image data around the vehicle to the image signal processing module; the image signal processing module is used to determine the image display type according to the vehicle driving state, where the image display type includes single-curvature display or multi-curvature display; process the image data around the vehicle according to the image display type and the display area of the image display module to obtain the processed display image data; the image display module is used to perform display according to the processed display image data.

[0024] In a third aspect, the present application provides a rearview mirror, which includes: a rearview mirror body and the rearview mirror display device as described in the second aspect.

[0025] In a fourth aspect, an embodiment of the present application provides a computer program product, including computer programs / instructions, which when executed by a processor implement the method for processing the rearview mirror display image as described in any item of the first aspect above.

[0026] The beneficial effects of the present application at least include: The method for processing the image displayed by the rearview mirror includes determining the image display type according to the vehicle driving state; wherein, the image display type includes single-curvature display or multi-curvature display; processing the image data around the vehicle according to the image display type to obtain the processed display image data. Based on the method for processing the image displayed by the rearview mirror, when the image display type is multi-curvature display, the data can be processed based on the multi-curvature display method to expand the field of view, reduce the driver's blind spot of vision, and improve the safety during vehicle driving. This method can achieve the multi-curvature display of the rearview mirror without relying on multi-curvature lenses, which can reduce the processing difficulty and cost of the lenses. In addition, based on the method for processing the image displayed by the rearview mirror, when the vehicle driving speed is low or there is no need to turn around, the data can also be processed in the single-curvature display mode to improve the driver's observation comfort of the content displayed by the rearview mirror. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] To more clearly illustrate the technical solutions of the embodiments of the present application, the following will briefly introduce the drawings required to be used in the embodiments of the present application. It should be understood that the following drawings only show some embodiments of the present application, and therefore should not be regarded as limiting the scope. For those of ordinary skill in the art, without creative efforts, other related drawings can also be obtained based on these drawings.

[0028] Figure 1 Structural schematic diagram of a rearview mirror provided by an embodiment of the present application;

[0029] Figure 2 Flow schematic diagram of a method for processing an image displayed by a rearview mirror provided by an embodiment of the present application;

[0030] Figure 3 Schematic diagram of the division method of the curvature display sub-region provided by an embodiment of the present application;

[0031] Figure 4 Schematic diagram of the image data processing process in the case of multi-curvature display provided by an embodiment of the present application;

[0032] Figure 5 Flow schematic diagram of a method for processing image data in the case of single-curvature display provided by an embodiment of the present application;

[0033] Figure 6 Schematic diagram of the image data processing process in the case of single-curvature display provided by an embodiment of the present application;

[0034] Figure 7 Schematic diagram of the image data processing process in the case of multi-curvature display provided by an embodiment of the present application;

[0035] Figure 8 The structural schematic diagram of a mirror display device provided by an embodiment of the present application. Detailed implementation manners

[0036] The embodiments of the technical solutions of the present application will be described in detail below with reference to the accompanying drawings. The following embodiments are only used to illustrate the technical solutions of the present application more clearly, so they are only examples and cannot be used to limit the protection scope of the present application.

[0037] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those of ordinary skill in the technical field to which this application belongs; the terms used herein are only for the purpose of describing specific embodiments and are not intended to limit this application.

[0038] In the description of the embodiments of the present application, technical terms such as "first" and "second" are only used to distinguish different objects and cannot be understood as indicating or implying relative importance or implicitly indicating the quantity, specific order or primary-secondary relationship of the indicated technical features. In the description of the embodiments of the present application, "a plurality" means two or more unless otherwise specifically defined.

[0039] Please refer to Figure 1 , Figure 1 The structural schematic diagram of a mirror 01 provided by an embodiment of the present application. The mirror includes: a mirror body 011 and a mirror display device 012 as described in the third aspect.

[0040] Among them, the mirror body may include structures such as a lens, a mirror housing, and a connecting bracket. The image acquisition module in the mirror display device 012 may be implemented by an image sensor, the image signal processing module in the mirror display device 012 may be implemented by an FPGA unit, a microcontroller, or a single-chip microcomputer, etc., and the image display module in the mirror display device 012 may be implemented by an LED display device or a liquid crystal display device. The mirror may further include power supply, wiring harness and other power supply (communication) devices. It should be noted that the mirror display device 012 may be disposed inside the mirror housing (as shown in Figure 1 ). The image acquisition module in the mirror display device 012 may also be disposed on the surface of the mirror housing or outside the actual housing; the image signal processing module in the mirror display device 012 may also be disposed at other positions of the vehicle (for example, inside the vehicle) and communicate with the image acquisition module and the image display module through an image signal transmission line.

[0041] Please refer to Figure 2 , Figure 2 The flowchart of a method for processing a mirror display image provided by an embodiment of the present application. The method for processing the mirror display image may include the following steps:

[0042] S101. Determine the image display type according to the vehicle driving state; wherein, the image display type includes single-curvature display or multi-curvature display;

[0043] S102. Process the image data around the vehicle according to the image display type to obtain the processed display image data.

[0044] Among them, in step S101, the vehicle driving state may include a parking state and a driving state, and the driving state may include a straight driving state and a turning driving state. The driving state of the vehicle can be comprehensively determined based on driving parameters such as the driving speed, driving acceleration, and / or steering angle of the vehicle. Exemplarily, the straight driving state may include a driving state with a steering angle less than or equal to 2°, and the turning driving state may include a driving state with a steering angle greater than 2°. It should be noted that the straight driving state may also include a driving state with a steering angle less than or equal to 1.5° or 3°, and the present application does not make specific limitations in this regard. Moreover, the turning driving state can also be divided into multiple turning levels according to the size of the steering angle, and the image display type and display curvature corresponding to different turning levels may not be completely the same. The driving state may also include a low-speed driving state, a medium-speed driving state, and a high-speed driving state. Exemplarily, the low-speed driving state may include a driving state with a driving speed less than or equal to 30 km / h, the medium-speed driving state may include a driving state with a driving speed greater than 30 km / h and less than or equal to 60 km / h, and the high-speed driving state may include a driving state with a driving speed greater than 60 km / h. Moreover, the high-speed driving state can also be divided into multiple different levels of detailed driving states according to the driving speed. It is possible to determine whether to process the image data in a single-curvature display or multi-curvature display manner according to the vehicle driving state, and comprehensively determine the specific display curvature in combination with the actual driving scenario. Exemplarily, the driving state of small-angle turning (for example, the driving state with a steering angle less than or equal to 2°) may specifically further include: a uniform small-angle turning state and an accelerating small-angle turning state (which may include a low-acceleration small-angle turning state, a medium-acceleration small-angle turning state, and a high-acceleration small-angle turning state). It should be noted that even for the same vehicle driving state, it is possible to select a single-curvature display manner or a multi-curvature display manner with different display curvatures according to the relative size of the vehicle's steering angle and the relative speed of driving.

[0045] Among them, in step S102, when the image display type includes single-curvature display, the specific single display curvature can be determined according to the vehicle's driving speed information and driving direction information, and then the image data around the vehicle can be processed according to the determined single display curvature to obtain the processed display image data for realizing single-curvature display. Correspondingly, when the image display type includes multi-curvature display, the specific multiple display curvatures can be determined according to the vehicle's driving speed information and driving direction information, and then the image data around the vehicle can be processed according to the determined multiple display curvatures to obtain the processed display image data for realizing multi-curvature display. The image data around the vehicle can include the image data of the areas around the vehicle such as directly in front of the vehicle, directly behind the vehicle, in front of the vehicle on the left, behind the vehicle on the left, in front of the vehicle on the right, and behind the vehicle on the right. Moreover, the size of the area range of the area around the vehicle can be adjusted according to the actual situation, and the present application does not make specific limitations thereto. Taking single-curvature display as an example, after determining the specific single display curvature, processing methods such as bilinear interpolation or cubic spline interpolation can be adopted, and the image data around the vehicle can be processed based on the single display curvature to obtain the processed display image data for realizing single-curvature display.

[0046] It can be seen that the method for processing the mirror display image provided by the embodiments of the present application can process the data in the multi-curvature display mode when the image display type is multi-curvature display, so as to expand the field of view, reduce the driver's field of view blind area, and improve the safety during vehicle driving. This method can realize the multi-curvature display of the mirror without relying on multi-curvature lenses, and can reduce the processing difficulty and cost of the lenses. In addition, based on this method for processing the mirror display image, when the vehicle is driving at a low speed or there is no need to turn around, the data can also be processed in the single-curvature display mode to improve the driver's observation comfort of the content displayed on the mirror.

[0047] In some alternative embodiments, considering the driver's driving habits, the display curvature of the mirror generally does not need to be adjusted during the process of the vehicle turning at a constant speed to ensure safety during driving. And during the end process of the turning process (that is, changing from the steering driving state to the directional driving state), the overall / partial display curvature of the mirror can be increased to display a wider field of view picture and better assist the driver in making driving decisions.

[0048] In some alternative embodiments, the determining manner of the vehicle driving state includes: determining the vehicle driving state according to the vehicle's driving speed information and driving direction information.

[0049] Among them, the driving speed range of the vehicle (for example, 0 - 150 km / h) can be divided into multiple driving speed levels, and the driving speed information can include the current driving speed level of the vehicle. The driving direction information of the vehicle can include the steering angle information of the vehicle. The steering angle range of the vehicle (for example, 0 - 40°) can be divided into multiple steering angle levels, and the driving direction information can include the current steering angle level of the vehicle. According to the driving speed information and driving direction information of the vehicle, it can be determined whether the vehicle is in a driving state that requires a large field of view, such as turning or driving at high speed. Furthermore, when the vehicle is in a driving state that requires a large field of view, the image display type of multi-curvature display is selected to process the image data around the vehicle, and the processed display image data for realizing multi-curvature display is obtained to meet the visual needs of the driver. Therefore, by determining the driving state of the vehicle according to the driving speed information and driving direction information of the vehicle, and adjusting the image display type according to the driving state of the vehicle; that is, adjusting the processing method of the image data around the vehicle according to the driving speed information and driving direction information of the vehicle, so that the processed display image data can meet the visual needs of the driver and improve the safety during driving.

[0050] In some alternative embodiments, when the image display type is multi-curvature display, the processed display image data includes multiple curvature display sub-regions; S102. Processing the image data around the vehicle according to the image display type to obtain the processed display image data includes: determining the sub-region display curvature of each curvature display sub-region according to the driving state of the vehicle; and processing the image data around the vehicle according to the sub-region display curvature to obtain the processed display image data.

[0051] Among them, the number of curvature display sub-regions can be 2, or 3, 5 or other reasonable values, and the number of curvature display sub-regions can be adjusted according to the actual application situation. The multiple curvature display sub-regions can be obtained through division methods such as vertical division, horizontal division or grid division; and the sub-region display curvatures corresponding to adjacent curvature display sub-regions can be the same or different. Please refer to Figure 3 , Figure 3 for the schematic diagram of the division method of the curvature display sub-regions provided by the embodiments of the present application. Figure 3 The left side shows the case where the division method is horizontal division and the number of curvature display sub-regions is 3; Figure 3 The middle part shows the case where the division method is horizontal division and the number of curvature display sub-regions is 2; Figure 3The right side shows a case where the division method is upper-lower division and the number of curvature display sub-regions is 2. It should be noted that the sizes of multiple curvature display sub-regions can be the same or not completely the same, and the present application does not make specific limitations in this regard. In the case where the image display type is specifically dual-curvature display (a type of multi-curvature display), the number of curvature display sub-regions can be 2, and the sub-region display curvatures corresponding to the 2 curvature display sub-regions are different. The sub-region display curvature corresponding to the curvature display sub-region can specifically be 1, or 2, or other reasonable values, and the sub-region display curvature corresponding to each curvature display sub-region can be adjusted according to the actual application situation. Taking the sub-region display curvature corresponding to the first curvature display sub-region as 1 and the lower left corner of the image data as the coordinate origin, for the first curvature display sub-region, based on x in =x out +offset, calculate the pixel coordinate x out in the display image data corresponding to the pixel coordinate x in in the image data around the vehicle, and then based on the pixel parameters corresponding to the pixel coordinate x in in the image data around the vehicle, determine the pixel parameters at the pixel coordinate x out in the display image data to obtain the processed display image data. Correspondingly, for the second curvature display sub-region, based on x in =(x out +x u )*r - x u , calculate the pixel coordinate x out in the display image data corresponding to the pixel coordinate x in in the image data around the vehicle (the horizontal and vertical coordinates of the pixel points can be processed based on the above formula), x u represents the coordinate at the lower left corner of the second curvature display sub-region, and r represents the sub-region display curvature corresponding to the second curvature display sub-region. The processed display image data includes multiple curvature display sub-regions. By determining the sub-region display curvature of each curvature display sub-region and processing the image data around the vehicle according to the sub-region display curvature, the processed display image data for realizing multi-curvature display can be obtained. Compared with single-curvature display, based on the processed display image data for realizing multi-curvature display, the driver's field of view can be expanded, thereby improving the safety during driving.

[0052] In some alternative embodiments, the method further includes: displaying the multiple curvature display sub-regions through an image display module; wherein, the image display module is disposed on the vehicle; the larger the sub-region display curvature corresponding to the curvature display sub-region farther away from the driver's seat of the vehicle.

[0053] Among them, the distance between the curvature display sub-region and the driver's seat of the vehicle can be determined based on the actual distance between the imaging object in the curvature display sub-region and the driver's seat of the vehicle. The image display module can be a display device provided on the vehicle mirror (which can be a liquid crystal display device or an LED display device, etc.). By setting the sub-region corresponding to the curvature display sub-region farther away from the driver's seat of the vehicle to have a larger displayed curvature, while expanding the driver's field of view, the authenticity of the displayed image on the inner mirror can be ensured as much as possible. So that the driver can accurately judge the actual distance between the vehicle and the nearby object based on the mirror display image.

[0054] Please refer to Figure 4 , Figure 4 which is a schematic flowchart of an image data processing method in the case of multi-curvature display provided by an embodiment of the present application.

[0055] In some optional embodiments, when the image display type is multi-curvature display, S102. Process the image data around the vehicle according to the image display type to obtain the processed display image data, including: S1021. Determine the curvature change function of the multi-curvature display according to the vehicle driving state; where the curvature change function includes a display curvature that continuously changes with the vehicle distance; S1022. Calculate the display position of each pixel point in the image data around the vehicle in the image display module according to the curvature change function; where the vehicle distance includes the distance between the pixel point and the vehicle; S1023. Obtain the processed display image data based on the display position of each pixel point in the image data around the vehicle.

[0056] Among them, the change rate or change range of the curvature change function corresponding to different vehicle driving states can be different. The above vehicle distance can be determined according to the actual distance between the imaging object in the image data around the vehicle and the driver's seat of the vehicle (which can also be the center point of the vehicle or other reference points inside the vehicle). The curvature change function can be implemented by a logarithmic function, an exponential function or other non-linear functions. By the vehicle driving state, determine the curvature change function of the multi-curvature display; according to the curvature change function, calculate the display position of each pixel point in the image data around the vehicle in the image display module; and based on the display position of each pixel point in the image data around the vehicle, the processed display image data for realizing multi-curvature display can be obtained. In addition, the curvature change function includes a display curvature that continuously changes with the vehicle distance. Based on the continuously changing display curvature, the driver's adaptability to multi-curvature display can be improved.

[0057] In some optional embodiments, the curvature change function includes x ′represents the distance between the pixel point and the vehicle, x represents the distance between the pixel point after curvature change and the vehicle, α represents the first change parameter, β represents the second change parameter, and ratio represents the display curvature corresponding to the pixel point; S1021. Determine the curvature change function for multi-curvature display according to the vehicle driving state, including: determining the first change parameter and the second change parameter in the curvature change function according to the vehicle driving state; S1022. Calculate the display position of each pixel point in the image data around the vehicle in the image display module according to the curvature change function, including: according to x ′ =α*ln(β*x + 1)+γ, calculate the distance between the pixel point after curvature change and the vehicle; where γ represents the pixel fixed offset; calculate the display position of each pixel point in the image data in the image display module according to the distance between the pixel point after curvature change and the vehicle.

[0058] Among them, when the first change parameter α changes with the vehicle driving state, the second change parameter β can be a constant or a curvature change parameter that changes with the vehicle driving state. Correspondingly, when the second change parameter β changes with the vehicle driving state, the first change parameter α can also be a constant, and the present application does not make specific limitations on this. The specific value ranges of α and β can be adjusted according to actual mirror display requirements (for example, the maximum display curvature value, the minimum display curvature value, etc.).

[0059] Optionally, when normalizing the distance x between the pixel point after curvature change and the vehicle (that is, x ∈ [0, 1]), the product of α and β can be greater than or equal to 1. Since Therefore, at x = 0, it corresponds to the maximum display curvature value α*β. By restricting α*β≥1, it can be ensured that the processing method of the mirror display image provided by the present application can expand the driver's field of vision and improve the safety during driving. Exemplarily, the value range of β can include [0.25, 4], and the value range of α can include [1.5, 5]. Specifically, when β = 1, α can be 2.1, and the corresponding maximum display curvature value is 2.1, and the minimum display curvature is 1.05. When β = 0.5, α can be 3.1, and the corresponding maximum display curvature value is 1.55, and the minimum display curvature is 1.033. When β = 0.333, α can be 4.1, and the corresponding maximum display curvature value is 1.3653, and the minimum display curvature is 1.024. When β = 2, α can be 2, and the corresponding maximum display curvature value is 4, and the minimum display curvature is 1.333. When β = 4, α can be 1.5, and the corresponding maximum display curvature value is 6, and the minimum display curvature is 1.2.

[0060] Among them, γ represents the fixed pixel offset. When calculating the horizontal display position of a pixel, γ represents the horizontal position offset of the pixel after curvature change compared to the pixel before curvature change; when calculating the vertical display position of a pixel, γ represents the vertical position offset of the pixel after curvature change compared to the pixel before curvature change. When γ represents the horizontal position offset, the magnitude of γ will affect the horizontal display range (corresponding to the field of view width range) of the viewfinder screen; when γ represents the vertical position offset, the magnitude of γ will affect the vertical display range (corresponding to the field of view height range) of the viewfinder screen.

[0061] Please refer to Figure 5 , Figure 5 which is a schematic flowchart of an image data processing method in the case of single curvature display provided by an embodiment of the present application.

[0062] In some optional embodiments, when the image display type is single curvature display, in S102, the image data around the vehicle is processed according to the image display type to obtain the processed display image data, including: S1024, determining the target display curvature according to the vehicle driving state; S1025, processing the image data around the vehicle according to the target display curvature and the display area of the image display module to obtain the processed display image data.

[0063] Among them, in the case of single curvature display, the target display curvature can also be 1 or other reasonable values. The target display curvature corresponding to the same vehicle driving state can be adjusted according to the actual application situation, and the present application does not make specific limitations on this. By determining the target display curvature according to the vehicle driving state and processing the image data around the vehicle according to the target display curvature and the display area of the image display module, the processed display image data for realizing single curvature display can be obtained. Based on the processed display image data, single curvature display of the viewfinder can be realized to improve the observation comfort of the driver for the viewfinder display content.

[0064] Please refer to Figure 6 , Figure 6 which is a schematic diagram of an image data processing process in the case of single curvature display provided by an embodiment of the present application. In the case of single curvature display, all (part of) the image data around the vehicle collected by the image acquisition module can be processed according to the target display curvature. Figure 6 Exemplarily shows the case of "processing part of the image data around the vehicle collected by the image acquisition module and the target display curvature is not 1". Please refer to Figure 7 , Figure 7 which is a schematic diagram of an image data processing process in the case of multi-curvature display provided by an embodiment of the present application.Figure 7 Exemplarily, the case where "the processed display image data includes three curvature display sub-regions with different display curvatures (the first curvature display sub-region, the second curvature display sub-region, and the third curvature display sub-region), and the display curvature of the first curvature display sub-region is 1" is shown. As Figure 7 shown, based on the processed display image data for realizing multi-curvature display, the field of view of the driver can be expanded, thereby improving safety during driving.

[0065] Please refer to Figure 8 , Figure 8 which is a schematic structural diagram of a mirror display device provided by an embodiment of the present application. The mirror display device 012 includes: an image acquisition module 201, an image signal processing module 202, and an image display module 203;

[0066] Among them, the image acquisition module 201 is configured to acquire and send the image data around the vehicle to the image signal processing module;

[0067] The image signal processing module 202 is configured to determine the image display type according to the vehicle driving state; wherein, the image display type includes single-curvature display or multi-curvature display; process the image data around the vehicle according to the image display type to obtain processed display image data;

[0068] The image display module 203 is configured to perform display according to the processed display image data.

[0069] The mirror display device 012 provided by the embodiment of the present application can acquire the image data around the vehicle based on the image acquisition module 201; based on the image signal processing module 202, when the image display type is multi-curvature display, process the data in a multi-curvature display manner to obtain processed display image data that can expand the field of view; and perform display on the processed display image data based on the image display module 203. Therefore, based on the mirror display device 012, the blind area of the driver's field of view can be reduced, and the safety during vehicle driving can be improved. The mirror display device 012 can realize the multi-curvature display of the mirror without relying on multi-curvature lenses, and can reduce the processing difficulty and cost of the lenses. In addition, based on the mirror display device 012, when the vehicle driving speed is low or there is no need to turn around, the data can also be processed in a single-curvature display manner to improve the observation comfort of the driver for the content displayed on the mirror.

[0070] It should be understood that the image signal processing module 202 of the mirror display device corresponds to the embodiment of the method for processing the mirror display image, and the image signal processing module 202 can perform the various steps involved in the above method embodiment. The specific functions of the image signal processing module 202 can be found in the description above, and the detailed description is appropriately omitted here to avoid repetition. The image signal processing module 202 includes at least one software function module that can be stored in a memory in the form of software or firmware or solidified in the operating system (OS) of the device.

[0071] An embodiment of the present application further provides a computer program product, including a computer program / instruction, which, when executed by a processor, implements the method as described in any one of the first aspects.

[0072] In several embodiments provided by the embodiments of the present application, it should be understood that the disclosed device / system and method can also be implemented in other ways. The device embodiments described above are merely schematic. For example, the flowcharts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the devices, methods and computer program products according to the multiple embodiments of the embodiments of the present application. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of the code, and a part of the module, program segment or code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of boxes in the block diagram and / or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or action, or can be implemented with a combination of dedicated hardware and computer instructions.

[0073] In addition, the functional modules in each embodiment of the present application can be integrated together to form an independent part, or each module can exist separately, or two or more modules can be integrated to form an independent part.

[0074] The above description is only an optional implementation manner of the embodiments of the present application, but the protection scope of the embodiments of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or replacements within the technical scope disclosed in the embodiments of the present application, which should be covered within the protection scope of the embodiments of the present application.

Claims

1. A method for processing an image displayed by a mirror, characterized in that: The method comprises: Determine the image display type according to the vehicle driving state; wherein the image display type includes single curvature display or multi-curvature display; The image data around the vehicle is processed according to the image display type to obtain processed display image data.

2. The method according to claim 1, characterized in that The method for determining the vehicle driving state includes: The driving state of the vehicle is determined according to the driving speed information and the driving direction information of the vehicle.

3. The method according to claim 1, characterized in that in, In the case where the image display type is a multi-curvature display, the processed display image data includes a plurality of curvature display sub-areas; The step of processing the image data around the vehicle according to the image display type to obtain processed display image data includes: Determining a sub-area display curvature of each of the curvature display sub-areas according to the vehicle driving state; The image data around the vehicle is processed according to the sub-region display curvature to obtain the processed display image data.

4. The method according to claim 3, characterized in that The method further comprises: displaying the plurality of curvature display sub-areas through an image display module; Wherein, the image display module is arranged in the vehicle; the sub-region corresponding to the curvature display sub-region which is farther away from the driving position of the vehicle has a larger display curvature.

5. The method according to claim 1, characterized in that In the case where the image display type is a multi-curvature display, the processing of the image data around the vehicle according to the image display type to obtain the processed display image data includes: Determining a curvature variation function of a multi-curvature display according to the vehicle driving state; wherein the curvature variation function includes a display curvature that continuously varies with the vehicle distance; According to the curvature change function, calculating the display position of each pixel point in the image data around the vehicle in the image display module; wherein the vehicle distance includes the distance between the pixel point and the vehicle; The processed display image data is obtained based on the display position of each pixel in the image data around the vehicle.

6. The method according to claim 5, characterized in that in, The curvature variation function includes x ′ represents the distance between the pixel point and the vehicle, x represents the distance between the pixel point and the vehicle after the curvature changes, α represents the first change parameter, β represents the second change parameter, and ratio represents the display curvature corresponding to the pixel point; Determining the curvature variation function of the multi-curvature display according to the vehicle driving state includes: Determining the first change parameter and the second change parameter in the curvature change function according to the vehicle driving state; The step of calculating the display position of each pixel point in the image data around the vehicle in the image display module according to the curvature change function includes: According to x ′ =α*ln(β*x+1)+γ, calculate the distance between the pixel point and the vehicle after the curvature changes; wherein γ represents the pixel fixed offset; The display position of each pixel point in the image data on the image display module is calculated according to the distance between the pixel point and the vehicle after the curvature changes.

7. The method according to claim 1, characterized in that In the case where the image display type is a single curvature display, the processing of the image data around the vehicle according to the image display type to obtain the processed display image data includes: Determining a target display curvature according to the vehicle driving state; The image data around the vehicle is processed according to the target display curvature and the display area of ​​the image display module to obtain the processed display image data.

8. A mirror display device, characterized in that: The mirror display device comprises: an image acquisition module, an image signal processing module and an image display module; Wherein, the image acquisition module is used to acquire and send image data of the surroundings of the vehicle to the image signal processing module; The image signal processing module is used to determine the image display type according to the driving state of the vehicle; wherein the image display type includes single curvature display or multi-curvature display; and process the image data around the vehicle according to the image display type to obtain processed display image data; The image display module is used to display according to the processed display image data.

9. A viewing mirror, characterized in that: The mirror comprises: a mirror body and the mirror display device as claimed in claim 8.

10. A computer program product comprising a computer program / instructions, characterized in that When the computer program / instructions are executed by a processor, the method according to any one of claims 1 to 7 is implemented.

Images