Display method and display device for images outside vehicle

Abstract

The invention discloses a method and a device for displaying images outside a vehicle. The display method comprises the following steps: acquiring an original image outside a vehicle; obtaining vehicle data and / or driver data to determine a use scene of the original image; dividing the original image into at least one concerned first area image and at least one non-concerned second area image according to the use scene; a first compression coefficient corresponding to the first area image and a second compression coefficient corresponding to the second area image are determined respectively, and the first compression coefficient is smaller than the second compression coefficient; and performing partition compression on the first area image and the second area image according to the first compression coefficient and the second compression coefficient to obtain a display image. By executing the steps, the display method not only can meet the definition of a concerned area in the driving process of a driver, but also can display images of other areas, and ensures that no blind area exists in the whole driving process.

Description

Technical Field

[0001] The present invention relates to the field of image display, and in particular to a method for displaying an image outside a vehicle, a device for displaying an image outside a vehicle, and a computer-readable storage medium. Background Art

[0002] At present, some vehicles on the market are equipped with electronic mirrors (Emirrors), which replace traditional exterior mirrors with cameras to provide drivers with a better view of the surrounding environment. Electronic mirrors have a wider field of view, improve visibility in bad weather or lighting conditions, and provide important safety warnings.

[0003] In the current display solutions of electronic rearview mirrors, in order to meet the needs of applications such as electronic rearview mirrors and around view monitors (AVM), the field of view (FOV) of the camera is often relatively large. However, the actual field of view displayed on the vehicle's display screen must take into account the requirements of the target area in different applications. It is often necessary to crop the captured image and compress the image before the set image area can be displayed on the display screen.

[0004] If the image cropping processing method is adopted, these cropped areas will not be provided to the display screen for display, and will not be observed by the driver, which will undoubtedly artificially add new visual blind spots. If the full image compression processing method is adopted, although a complete image with multiple field of view angles can be provided, it cannot meet the high-definition requirements for the local area images in the displayed image. Even if a high-resolution camera is used, due to the limitation of the display screen resolution, the system needs to compress the full image, which will result in insufficient pixels per unit area (insufficient clarity) due to the large field of view angle. Therefore, the above technical problems cannot be well solved.

[0005] In order to solve the above problems existing in the prior art, the art urgently needs a display technology for images outside the vehicle, which can not only meet the clarity of the area of ​​concern to the driver during driving, but also take into account the display of images in other areas to ensure that there are no blind spots in the entire driving process. Summary of the invention

[0006] A brief summary of one or more aspects is given below to provide a basic understanding of these aspects. This summary is not an exhaustive overview of all conceived aspects, and is neither intended to identify the key or decisive elements of all aspects nor to define the scope of any or all aspects. Its only purpose is to give some concepts of one or more aspects in a simplified form as a prelude to a more detailed description that will be given later.

[0007] In order to overcome the above-mentioned defects of the prior art, the present invention provides a method for displaying images outside the vehicle, a device for displaying images outside the vehicle, and a computer-readable storage medium, which can not only meet the clarity of the area of ​​concern to the driver during driving, but also take into account the display of images in other areas, ensuring that there are no blind spots in the entire driving process.

[0008] Specifically, the method for displaying the above-mentioned outside-vehicle image provided according to the first aspect of the present invention includes the following steps: acquiring an original image outside the vehicle; acquiring vehicle data and / or driver data to determine the usage scenario of the original image; dividing the original image into at least one first area image of concern and at least one second area image of no concern according to the usage scenario; respectively determining a first compression coefficient corresponding to the first area image and a second compression coefficient corresponding to the second area image, wherein the first compression coefficient is less than the second compression coefficient; and performing partition compression on the first area image and the second area image according to the first compression coefficient and the second compression coefficient to obtain a display image.

[0009] Optionally, in some embodiments of the present invention, the vehicle data includes a driving speed and / or a turning signal, and the step of acquiring the vehicle data and / or driver data to determine the usage scenario of the original image includes: in response to the driving speed being greater than a preset speed threshold, determining that the vehicle is in a high-speed driving mode; and / or in response to the driving speed being less than or equal to the speed threshold, determining that the vehicle is in a low-speed driving mode; and / or in response to the turning signal, determining that the vehicle is in a turning mode.

[0010] Optionally, in some embodiments of the present invention, the step of dividing the original image into at least one first area image of interest and at least one second area image of non-interest according to the usage scenario includes: in the high-speed driving mode, determining at least one area image of the original image away from the vehicle as the first area image, and determining at least one area image of the original image close to the vehicle as the second area image; and / or in the low-speed driving mode, determining at least one area image of the original image close to the vehicle as the first area image, and determining at least one area image of the original image away from the vehicle as the second area image; and / or in the turning mode, determining at least one area image of the original image located in the turning direction as the first area image, and determining other area images of the original image as the second area image.

[0011] Optionally, in some embodiments of the present invention, the driver data includes an eye movement signal of the driver, and the step of acquiring vehicle data and / or driver data to determine the usage scenario of the original image includes: in response to the eye movement signal indicating that the driver is observing the display screen, determining that the original image is in observation mode, and the step of dividing the original image into at least one first area image of interest and at least one second area image of non-interest according to the usage scenario includes: in the observation mode, determining the driver's area of ​​interest on the display screen as the first area image, and determining other area images in the original image as the second area image.

[0012] Optionally, in some embodiments of the present invention, the steps of respectively determining a first compression coefficient corresponding to the first area image and a second compression coefficient corresponding to the second area image include: setting the first compression coefficient corresponding to the first area image to 1 so that the first area image maintains its original first resolution; and setting the second compression coefficient corresponding to the second area image to be greater than 1 based on the display resolution of the display screen, the first resolution, and the original second resolution of the second area image, and compressing the second resolution so that the displayed image conforms to the display resolution.

[0013] Optionally, in some embodiments of the present invention, the step of setting the second compression coefficient corresponding to the second area image to be greater than 1 according to the display resolution of the display screen, the first resolution, and the original second resolution of the second area image, and compressing the second resolution so that the displayed image conforms to the display resolution includes: determining the horizontal display resolution of each of the second area images in the area horizontally adjacent to the first area image according to the difference between the horizontal display resolution of the display screen and the first horizontal resolution of the first area image; and determining a fixed second horizontal compression coefficient for each of the second area images in the area horizontally adjacent to the first area image according to the ratio of the horizontal display resolution and the sum of the second horizontal resolutions of each of the second area images in the area horizontally adjacent to the first area image.

[0014] Optionally, in some embodiments of the present invention, the step of setting the second compression coefficient corresponding to the second area image to be greater than 1 according to the display resolution of the display screen, the first resolution, and the original second resolution of the second area image, and compressing the second resolution so that the displayed image conforms to the display resolution includes: determining the vertical display resolution of each of the second area images in the area vertically adjacent to the first area image according to the difference between the vertical display resolution of the display screen and the first vertical resolution of the first area image; and determining a fixed second vertical compression coefficient for each of the second area images in the area numerically adjacent to the first area image according to the ratio of the vertical display resolution and the sum of the second vertical resolutions of each of the second area images in the area vertically adjacent to the first area image.

[0015] Optionally, in some embodiments of the present invention, the step of setting the second compression coefficient corresponding to the second area image to be greater than 1 according to the display resolution of the display screen, the first resolution, and the original second resolution of the second area image, and compressing the second resolution so that the displayed image conforms to the display resolution also includes: determining the second horizontal compression coefficient of the remaining second area images vertically adjacent to the second area image according to the second horizontal compression coefficient fixed for each of the second area images in the area horizontally adjacent to the first area image; and / or determining the second vertical compression coefficient of the remaining second area images horizontally adjacent to the second area image according to the second vertical compression coefficient fixed for each of the second area images in the area vertically adjacent to the first area image.

[0016] Optionally, in some embodiments of the present invention, the step of setting the second compression coefficient corresponding to the second area image to be greater than 1 according to the display resolution of the display screen, the first resolution, and the original second resolution of the second area image, and compressing the second resolution so that the displayed image conforms to the display resolution also includes: determining a gradient second horizontal compression coefficient of each second area image according to the first compression coefficient, a fixed second horizontal compression coefficient of each second area image in an area horizontally adjacent to the first area image, and a horizontal distance from each second area image to the first area image; and determining a gradient second vertical compression coefficient of each second area image according to the first compression coefficient, a fixed second vertical compression coefficient of each second area image in an area vertically adjacent to the first area image, and a vertical distance from each second area image to the first area image.

[0017] Optionally, in some embodiments of the present invention, the step of determining the second lateral compression coefficient of each second region image gradually changing according to the first compression coefficient, the second lateral compression coefficient fixed to each second region image in the region horizontally adjacent to the first region image, and the horizontal distance from each second region image to the first region image comprises: determining the second lateral compression coefficient of each second region image gradually changing according to the first compression coefficient k1, the second lateral compression coefficient fixed to each second region image in the region horizontally adjacent to the first region image, and the horizontal distance from each second region image to the first region image. 20x And the horizontal coordinate x of the center of the region 20 , and the critical horizontal coordinate x1 of the first region image close to the second region image, determine the lateral gradient slope of the second lateral compression coefficient of each second region image And according to the lateral gradient slope a x , the first compression coefficient k1, the critical horizontal coordinate x1, and the horizontal coordinate x2 of each of the second region images, calculate the second horizontal compression coefficient k1 of the second region image gradient 2x =a x ×(x2-x1)+k1.

[0018] Optionally, in some embodiments of the present invention, the step of determining the second longitudinal compression coefficient of each second region image gradually changing according to the first compression coefficient, the second longitudinal compression coefficient fixed to each second region image in a region vertically adjacent to the first region image, and the vertical distance from each second region image to the first region image comprises: determining the second longitudinal compression coefficient of each second region image gradually changing according to the first compression coefficient k1, the second longitudinal compression coefficient fixed to each second region image in a region vertically adjacent to the first region image, and the vertical distance from each second region image to the first region image. 20y and the vertical coordinate y of the center of the region 20 , and the critical vertical coordinate y1 of the first region image close to the second region image, determine the longitudinal gradient slope of the second longitudinal compression coefficient of each second region image And according to the longitudinal gradient slope a y , the first compression coefficient k1, the critical vertical coordinate y1, and the vertical coordinate y2 of each of the second region images, calculate the second longitudinal compression coefficient k1 of the second region image gradient 2y =a y ×(y2-y1)+k1.

[0019] Optionally, in some embodiments of the present invention, the step of acquiring the original image outside the vehicle includes: collecting a rear view image of the vehicle via a camera facing the rear of the vehicle; or acquiring a panoramic image around the vehicle via a panoramic image monitoring system of the vehicle.

[0020] In addition, according to the second aspect of the present invention, the above-mentioned display device for the image outside the vehicle is provided. The display device for the image outside the vehicle includes a memory and a processor. The processor is connected to the memory and is configured to implement the above-mentioned display method for the image outside the vehicle provided by the first aspect of the present invention.

[0021] Optionally, in some embodiments of the present invention, the display device also includes: at least one display screen, wherein the at least one display screen is arranged at the exterior rearview mirror position on the left side of the vehicle, the exterior rearview mirror position on the right side of the vehicle and / or the interior rearview mirror position, and / or is integrated into the central control display screen of the vehicle.

[0022] In addition, according to the third aspect of the present invention, there is also provided a computer-readable storage medium on which computer instructions are stored. When the computer instructions are executed by a processor, the above-mentioned method for displaying an image outside a vehicle provided by the first aspect of the present invention is implemented. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] The above features and advantages of the present invention can be better understood after reading the detailed description of the embodiments of the present disclosure in conjunction with the following drawings. In the drawings, the components are not necessarily drawn to scale, and components with similar related properties or features may have the same or similar reference numerals.

[0024] Figure 1 A flow chart of a method for displaying an image outside a vehicle provided according to some embodiments of the present invention is shown;

[0025] Figure 2 A schematic diagram showing an original image provided according to some embodiments of the present invention;

[0026] Figure 3 A schematic diagram of a curve showing fixed coefficient compression of a display image provided by some embodiments of the present invention is shown;

[0027] Figure 4 A schematic diagram showing a curve of gradient coefficient compression of a display image provided by some embodiments of the present invention; and

[0028] Figure 5 A structural block diagram of a device for displaying an image outside a vehicle provided according to some embodiments of the present invention is shown.

[0029] Reference numerals:

[0030] Steps S110 to S150;

[0031] 200 original images;

[0032] 311, 321, 411, 421 first region image;

[0033] 312, 322, 412, 422 second region image;

[0034] 500 display device;

[0035] 510 Memory;

[0036] 520 processor. DETAILED DESCRIPTION

[0037] The following specific embodiments illustrate the implementation of the present invention, and those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. Although the description of the present invention will be introduced in conjunction with the preferred embodiment, this does not mean that the features of this invention are limited to this implementation. On the contrary, the purpose of introducing the invention in conjunction with the implementation is to cover other options or modifications that may be extended based on the claims of the present invention. In order to provide a deep understanding of the present invention, the following description will include many specific details. The present invention can also be implemented without using these details. In addition, in order to avoid confusion or blurring the focus of the present invention, some specific details will be omitted in the description.

[0038] In the description of the present invention, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0039] In addition, the terms "upper", "lower", "left", "right", "top", "bottom", "horizontal" and "vertical" used in the following description should be understood as the directions shown in the paragraph and the related drawings. Such relative terms are only used for the convenience of description and do not mean that the device described therein must be manufactured or operated in a specific direction, and therefore should not be understood as limiting the present invention.

[0040] It is understood that although the terms "first", "second", "third", etc. may be used herein to describe various components, regions, layers and / or parts, these components, regions, layers and / or parts should not be limited by these terms, and these terms are only used to distinguish different components, regions, layers and / or parts. Therefore, the first component, region, layer and / or part discussed below may be referred to as a second component, region, layer and / or part without departing from some embodiments of the present invention.

[0041] As mentioned above, in the prior art, if the image cropping processing method is adopted, these cropped areas will not be provided to the display screen for display, and will not be observed by the driver, which undoubtedly artificially adds new visual blind spots. If the full image compression processing method is adopted, although a complete image with multiple field of view angles can be provided, it cannot meet the high-definition requirements for local area images in the displayed image. Even if a high-resolution camera is used, due to the limitation of the display screen resolution, the system needs to compress the full image, which will result in insufficient pixels per unit area (insufficient clarity) due to the large field of view angle. Therefore, the above technical problems cannot be well solved.

[0042] In order to solve the above problems existing in the prior art, the present invention provides a method for displaying images outside the vehicle, a display device for images outside the vehicle and a computer-readable storage medium, which can not only meet the clarity of the area of ​​concern to the driver during driving, but also take into account the display of images in other areas to ensure that there are no blind spots in the entire driving process.

[0043] In some non-limiting embodiments, the method for displaying the image outside the vehicle provided by the first aspect of the present invention may be implemented by the device for displaying the image outside the vehicle provided by the second aspect of the present invention.

[0044] The working principle of the above-mentioned display device for the image outside the vehicle will be described below in conjunction with some embodiments of the display method for the image outside the vehicle. Those skilled in the art will understand that the embodiments of these methods for displaying the image outside the vehicle are only some non-restrictive implementation methods provided by the present invention, and are intended to clearly demonstrate the main concept of the present invention and provide some specific solutions that are convenient for the public to implement, rather than to limit all working modes or all functions of the display device for the image outside the vehicle. Similarly, the display device for the image outside the vehicle is also only a non-restrictive implementation method provided by the present invention, and does not constitute a limitation on the implementation subject of each step in these methods for displaying the image outside the vehicle.

[0045] Please see Figure 1 , Figure 1 FIG. 1 is a flow chart showing a method for displaying an image outside a vehicle according to some embodiments of the present invention. Figure 1 As shown, in some embodiments, the method for displaying an image outside a vehicle may mainly include the following steps:

[0046] S110: Acquire an original image outside the vehicle.

[0047] Specifically, in some embodiments, the rear view image of the vehicle can be captured by a camera facing the rear of the vehicle; or a panoramic image of the surroundings of the vehicle can be acquired through a panoramic image monitoring system of the vehicle. Those skilled in the art can understand that the configuration position of the image acquisition device, that is, the installation position of the camera or the panoramic image monitoring system on the vehicle, is not limited to the several methods mentioned in this embodiment, and any image acquisition device that can clearly capture the image around the vehicle and its configuration method are within the protection scope of the present invention.

[0048] In some optional embodiments, the original images of the vehicle's external environment can be collected from multiple viewing angles by using a camera or a panoramic image monitoring system installed on the vehicle. Figure 2 , Figure 2 A schematic diagram of an original image provided according to some embodiments of the present invention is shown.

[0049] Optionally, images captured by a camera or a panoramic image monitoring system may be transmitted to the vehicle's electronic control unit for subsequent processing. The electronic control unit performs nonlinear scaling conversion on the full screen area, adjusts the scaling ratio of each area according to the importance of different areas in different usage scenarios, and sends the adjusted image to a display screen for display.

[0050] Next, please refer to step S120: acquiring vehicle data and / or driver data to determine the usage scenario of the original image.

[0051] In some optional embodiments, the use scenario of the original image can be determined according to the intelligent control signal of some vehicle data in the vehicle system. Optionally, the vehicle data can include driving speed and / or turn signal.

[0052] Specifically, optionally, a speed threshold can be set, and the current driving speed of the vehicle can be compared with the speed threshold. In response to the driving speed being greater than the preset speed threshold, it can be determined that the vehicle is currently in a high-speed driving mode. In other words, the usage scenario of the original image 200 acquired at this time is a high-speed driving mode. In response to the driving speed being less than or equal to the speed threshold, it can be determined that the vehicle is currently in a low-speed driving mode. In other words, the usage scenario of the original image 200 acquired at this time is a low-speed driving mode. In addition, in some embodiments, if the vehicle system sends a turn signal, it can be determined that the vehicle is currently in a turning mode. In other words, the usage scenario of the original image 200 acquired at this time is a turning mode.

[0053] Furthermore, in some optional embodiments, during driving, the position of the focus area in the picture can be modified accordingly in combination with the above-mentioned vehicle data (such as speed signals, turn signals, etc.) to ensure that the focus area can be displayed with the best clarity in any use case.

[0054] In the prior art, although the vehicle system can automatically adjust the clipping area, the size of the clipping area needs to be individually designed for different vehicles. For example, the corresponding clipping area is different in the road test during the development stage and the correction before delivery. By using the above embodiments of the present invention, the display area can be appropriately increased, which is conducive to improving the compatibility of the display system.

[0055] In other optional embodiments, the use scenario of the original image can be determined based on the driver data or in combination with the driver data. Optionally, the driver data can include the driver's eye movement signal. Specifically, in some embodiments, a screen-type eye tracker can be installed inside the vehicle, or the driver can wear a small portable eye tracker. The driver's eye movement signal can be obtained by the eye tracker in combination with the human eye positioning technology. When the driver's eye movement signal obtained indicates that the driver is observing the display screen, it can be determined that the original image 200 is in observation mode.

[0056] Furthermore, in some optional embodiments, the image scaling ratio and display position of the area where the eye movement signal is located and its surrounding areas can be appropriately adjusted to meet the clarity of the area of ​​concern to the driver while taking into account the display of images in other areas to ensure that there are no blind spots during use.

[0057] Next, please refer to step S130: according to the usage scenario, the original image is divided into at least one first region image of interest and at least one second region image of no interest.

[0058] Generally speaking, when the vehicle is in high-speed driving mode and low-speed driving mode, the driver may prefer to focus on different areas of the image. Specifically, in some embodiments, when it is determined that the vehicle is in high-speed driving mode, for driving safety, the driver may prefer to focus on areas that are slightly farther (e.g., medium to long) away on the vehicle's driving route. Therefore, at least one area image far away from the vehicle in the original image may be determined as a first area image of concern, and at least one area image close to the vehicle in the original image may be determined as a second area image of non-concern. Figure 2 As shown, in this embodiment, according to different usage scenarios, the original image 200 is divided into 9 regions, such as a focus region and a non-focus region, according to different attention levels of each local image in the original image 200. The image of the local region 1 in the original image 200 can be defined as a first region image, and the local regions 2 to 9 can be defined as second region images.

[0059] In other embodiments, when determining that the vehicle is in a low-speed driving mode, the driver may want to pay more attention to the area close to the vehicle body to avoid collision or scraping of the vehicle, so at least one area image close to the vehicle in the original image can be determined as a first area image of interest, and at least one area image far from the vehicle in the original image can be determined as a second area image of no interest. Figure 2 As shown, in this embodiment, the images of local areas 2, 3, 4, 8, and 9 in the original image 200 can be defined as first area images, and local areas 1, 5, 6, and 7 can be defined as second area images.

[0060] Furthermore, in some other implementations, when determining that the vehicle is in a turning mode, the driver prefers to observe more areas of the turning distance in the turning direction, such as information on multiple lanes adjacent to the turning lane, so at least one area image in the turning direction of the original image can be determined as a first area image of interest, and other area images in the original image can be determined as second area images of non-interest. Figure 2 As shown, in this embodiment, the images of local areas 2, 3, 8, and 9 in the original image 200 can be defined as first area images, and local areas 1, 4, 5, 6, and 7 can be defined as second area images.

[0061] Those skilled in the art can understand that the “concerned” used to define the first area image and the “unconcerned” used to define the second area image in the present invention are a pair of relative concepts, wherein “unconcerned” does not mean completely unconcerned, but rather has a lower degree of attention relative to the first area image, that is, during driving, the first area image in the original image has the highest degree of importance, and the second area image has the second highest degree of importance.

[0062] Optionally, in other embodiments, when determining that the vehicle is in observation mode, the driver's focus area on the display screen located by the human eye can be determined as the first focus area image, and other area images in the original image can be determined as the second non-focus area images. Generally speaking, the human eye tends to observe the center of the image. Therefore, if Figure 2 As shown, in this embodiment, images of local areas 1 and 4 tending to the center of the original image 200 can be defined as first area images, and local areas 2, 3, 5, 6, 7, 8, and 9 can be defined as second area images.

[0063] Next, please refer to step S140: determining a first compression coefficient corresponding to the first region image and a second compression coefficient corresponding to the second region image respectively.

[0064] Combination Figure 2 As shown, in an embodiment of the present invention, it is possible to Figure 2The image pixels of each local area after the division adopt different image compression processing methods to achieve the beneficial technical effect of displaying the full FOV imaging of the image at the same time and not reducing the imaging clarity of the focus area.

[0065] Generally speaking, in a usage scenario (ie, after the usage scenario is fixed), the region division situation and the size after division can also be fixed after the usage scenario of the system is determined, and the size of the local image is a known condition.

[0066] For example, assuming that the original image captured by the camera is 1920×1080, assuming that the focus area is 600×300 under current conditions, and the display resolution is 1280×720, the system-on-chip (SOC) needs to adopt different compression ratios for images in different areas to achieve compression of the 1920×1080 image to a screen resolution of 1280×720 for display. In the prior art, the electronic control unit (ECU) of the vehicle can cut the 1920×1080 image into a 1280×720 image and display it on the display. The cut area includes the above-mentioned focus area 600×300, but this also loses the image information of other areas, corresponding to this example, almost half of the effective pixels are lost.

[0067] In the embodiment of the present invention, the compression coefficients of images in different regions may be non-linearly compressed according to the importance (degree of attention) of the display region.

[0068] Specifically, in some embodiments, the first compression coefficient corresponding to the first region image may be set to 1, so that the first region image of focus maintains its original first resolution and has sufficient clarity. Subsequently, according to the display resolution of the display screen, the first resolution, and the original second resolution of the second region image, the second compression coefficient corresponding to the second region image may be set to be greater than 1, so that the displayed image conforms to the display resolution of the display screen by compressing the second resolution of the second region image of relatively less focus.

[0069] In this regard, in some embodiments of the present invention, when scaling a 1920×1080 area to a 1280×720 display screen, the focus area 600×300 is used as the first area image, and its corresponding first compression coefficient is set to 1, so that the first area image of focus maintains its original first resolution, that is, no image compression processing is performed, and different compression ratios can be used for other areas belonging to the second area image. For example, Figure 2The image of the local area 1 in the original image 200 is not compressed, and the images in the other local areas 2 to 9 are compressed.

[0070] Furthermore, in some embodiments of the present invention, the compression process performed on the images in other local areas 2 to 9 may be divided into a compression method using a fixed compression coefficient or a compression method using a gradient coefficient.

[0071] Specifically, in some preferred embodiments, the method of using a fixed compression coefficient includes: determining the horizontal display resolution of each second region image in the area horizontally adjacent to the first region image based on the difference between the horizontal display resolution of the display screen and the first horizontal resolution of the first region image. Then, determining a fixed second horizontal compression coefficient for each second region image in the area horizontally adjacent to the first region image based on the ratio of the horizontal display resolution to the sum of the second horizontal resolutions of each second region image in the area horizontally adjacent to the first region image. Figure 2 In the original image 200 shown, the images of the local areas 2 and 3 can be horizontally compressed with a fixed compression factor.

[0072] For example, the horizontal display resolution of the display screen is 1280, and the first horizontal resolution of the first area image is 600. The difference between the two is 1280-600=680, where 680 is the horizontal display resolution of the display screen, that is, the remaining pixels that can be displayed horizontally on the display. The sum of the second horizontal resolutions of the second area images in the horizontally adjacent areas of the first area image is obtained to be 1920-600=1320, where 1320 is the horizontally remaining pixels in the original image 200. The ratio of the horizontally remaining pixels in the original image 200 to the horizontally remaining pixels that can be displayed on the display is 1320 / 680=1.9, where 1.9 is the second horizontal compression coefficient that is fixed to the second area images in the horizontally adjacent areas of the first area image.

[0073] For this, see Figure 3 , Figure 3 FIG. 4 is a schematic diagram showing a curve of fixed coefficient compression of a display image provided according to some embodiments of the present invention. Figure 3 As shown, in the fixed coefficient compression mode of the displayed image, Figure 3 In the right half plane (horizontal pixels-horizontal compression rate), the first horizontal compression coefficient corresponding to the first region image 311 is 1, and the fixed second horizontal compression coefficient corresponding to each second region image 312 horizontally adjacent to the first region image 311 is 1.9, which can be corresponded to Figure 2 A fixed lateral compression coefficient of the images of the local areas 2 and 3 in the original image 200.

[0074] Optionally, in some other preferred embodiments, the vertical display resolution of each second region image in the area vertically adjacent to the first region image can be determined based on the difference between the vertical display resolution of the display screen and the first vertical resolution of the first region image. Then, the second vertical compression coefficient fixed to each second region image in the area numerically adjacent to the first region image is determined based on the ratio of the vertical display resolution to the sum of the second vertical resolutions of each second region image in the area vertically adjacent to the first region image. Figure 2 In the original image 200 shown, the images of the local areas 4 and 5 can be longitudinally compressed with a fixed compression factor.

[0075] For example, the vertical display resolution of the display screen is 720, and the first vertical resolution of the first region image is 300. The difference between the two is 720-300=420, where 420 is the vertical display resolution of the display screen, that is, the remaining pixels that can be displayed in the vertical direction of the display. The sum of the second vertical resolutions of each second region image in the vertically adjacent region of the first region image is obtained to be 1080-300=780, where 780 is the vertical remaining pixels in the original image 200. The ratio of the vertical remaining pixels in the original image 200 to the vertical remaining pixels that can be displayed by the display is 780 / 420=1.86, where 1.86 is the second vertical compression coefficient fixed to each second region image in the vertically adjacent region of the first region image.

[0076] like Figure 3 As shown, in the fixed coefficient compression mode of the displayed image, Figure 3 In the left half plane (vertical pixel-vertical compression rate), the first longitudinal compression coefficient corresponding to the first region image 321 is 1, and the fixed second longitudinal compression coefficient corresponding to each second region image 322 vertically adjacent to the first region image 321 is 1.86, which can be corresponded to Figure 2 A fixed longitudinal compression coefficient of the images of the local areas 4 and 5 in the original image 200.

[0077] Further, in some preferred embodiments of the present invention, due to Figure 2 The local areas 6, 7, 8, and 9 are relatively less concerned areas, so the local areas 6, 7, 8, and 9 can be comprehensively compressed by combining the above-mentioned fixed second transverse compression coefficient and the fixed second longitudinal compression coefficient.

[0078] Specifically, according to the first region image (corresponding to Figure 2 The second area images of the horizontally adjacent areas of the local area 1) (corresponding to Figure 2 The local areas 2 and 3 in the second region have a fixed second lateral compression coefficient, and the remaining second region images vertically adjacent to the second region image (corresponding to Figure 2 Optionally, the second lateral compression coefficient of the local area 6, 8 and 7, 9 in the first area image (corresponding to Figure 2 The second area images of each vertically adjacent area of ​​the local area 1) in Figure 2 The second longitudinal compression coefficient of the local area 4, 5 in the image is fixed, and the remaining second area images horizontally adjacent to the second area image (corresponding to Figure 2 The second longitudinal compression coefficient of the local areas 6, 8 and 7, 9 in FIG. 1 is shown in FIG. 1 . For example, Figure 2 The second lateral compression coefficients of the local areas 6, 8, 7, 9 can all be fixed second longitudinal compression coefficients, for example, all are determined to be 1.9 as mentioned above, and the second longitudinal compression coefficients of the local areas 6, 8, 7, 9 can all be fixed second longitudinal compression coefficients, for example, all are determined to be 1.86 as mentioned above.

[0079] In some other preferred embodiments of the present invention, the gradient coefficient compression method includes: the gradient coefficient compression method can be used to perform image compression processing on the remaining images except the first area image, wherein the image close to the first compressed image of interest has a compression coefficient of 1, and as the pixel moves away from the first compressed image, its compression coefficient gradually increases.

[0080] Specifically, in some embodiments, a second horizontal compression coefficient of each second area image that is gradually changed can be determined based on the first compression coefficient, a second horizontal compression coefficient that is fixed for each second area image in an area horizontally adjacent to the first area image, and a horizontal distance from each second area image to the first area image; and a second vertical compression coefficient of each second area image that is gradually changed can be determined based on the first compression coefficient, a second vertical compression coefficient that is fixed for each second area image in an area vertically adjacent to the first area image, and a vertical distance from each second area image to the first area image.

[0081] For example, see Figure 4 , Figure 4 FIG. 4 is a schematic diagram showing a curve of gradient coefficient compression of a display image provided by some embodiments of the present invention. Figure 4 As shown, according to the first compression coefficient k1 corresponding to the first region image 411, for example, k1 is 1, the second region image 412 in the horizontally adjacent region of the first region image 411 has a fixed second lateral compression coefficient k 20x , for example k 20x is 1.9 above, and the horizontal coordinate x of the center of the region 20 For example, when the horizontal midpoint of the first image area 411 is taken as the coordinate origin O, x 20is 1280 / 2=640, and the critical horizontal coordinate x1 of the first region image 411 close to the second region image 412, for example, x1 is 600 / 2=300, and the horizontal gradient slope of the second horizontal compression coefficient of each second region image 412 is determined Then, we can adjust the horizontal gradient slope a x , the first compression coefficient k1, the critical horizontal coordinate x1, and the horizontal coordinate x2 of each second region image 412, for example, x2 is 1920 / 2=960, the second horizontal compression coefficient k of the second region image gradient can be calculated 2x =a x ×(x2-x1)+k1=0.0026×(960-300)+1=2.7.

[0082] like Figure 4 As shown, in other embodiments, according to the first compression coefficient k1 corresponding to the first region image 421, for example, k1 is 1, and the second longitudinal compression coefficient k of each second region image 422 vertically adjacent to the first region image 421 is fixed. 20y , for example k 20y is 1.86, and the vertical coordinate y of the center of the region 20 For example, when the longitudinal midpoint of the first image area 421 is taken as the coordinate origin O, y 20 is 720 / 2=360, and the critical vertical coordinate y1 of the first region image 421 close to the second region image 422, for example, y1 is 300 / 2=150, and the vertical gradient slope of the second vertical compression coefficient of each second region image 422 is determined. Then, the second longitudinal compression coefficient k of the second region image gradient can be calculated based on the longitudinal gradient slope ay, the first compression coefficient k1, the critical longitudinal coordinate y1, and the longitudinal coordinate y2 of each second region image 422, for example, y2 is 1080÷2=540. 2y =a y ×(y2-y1)+k1=0.0041×(540-150)+1=2.6.

[0083] Through the above embodiment, the image of the part close to the focus area (the area of ​​the first area image) is compressed with a low zoom ratio, and the image of the part far from the focus area is compressed with a high zoom ratio. This gradient coefficient compression method can use linear gradient coefficients (such as Figure 4 As shown in the figure, you can also select an exponential gradient coefficient. In this way, you can still see the images of all areas captured by the camera on the display screen to avoid driving blind spots, but at the same time you can ensure sufficient clarity in the area of ​​interest, improving driving safety.

[0084] Those skilled in the art will appreciate that the above-listed linear gradient compression coefficient and exponential gradient compression coefficient schemes are only a non-limiting implementation provided by the present invention, which is intended to clearly demonstrate the main concept of the present invention and provide a specific scheme that is convenient for the public to implement, rather than to limit the protection scope of the present invention. In some other embodiments, any processing method that can reflect linear or nonlinear gradient compression of the surrounding images (each second region image) starting from the first region image is within the protection scope of the present invention.

[0085] Finally, step S150 is performed: the first region image and the second region image are subjected to partition compression according to the first compression coefficient and the second compression coefficient to obtain a display image.

[0086] In some embodiments, the first area image and the second area image in the original image 200 can be compressed by partitioning according to the first compression coefficient and the second compression coefficient obtained above, so as to obtain a display image that not only includes all areas during driving but also meets the resolution of the display screen.

[0087] Although the above methods are illustrated and described as a series of actions for simplicity of explanation, it should be understood and appreciated that these methods are not limited by the order of the actions, because according to one or more embodiments, some actions may occur in a different order and / or concurrently with other actions from those illustrated and described herein or not illustrated and described herein but understandable to those skilled in the art.

[0088] So far, a method for displaying an image outside a vehicle provided by the first aspect of the present invention has been introduced. Figure 5 , Figure 5 A structural block diagram of a device for displaying an image outside a vehicle provided according to some embodiments of the present invention is shown.

[0089] like Figure 5 As shown, the display device 500 of the vehicle exterior image may be configured with a memory 510 and a processor 520. The memory 510 includes but is not limited to the computer-readable storage medium provided in the third aspect of the present invention, on which computer instructions are stored. The processor 520 is connected to the memory 510 and is configured to execute the computer instructions stored in the memory 510 to implement the vehicle exterior image display method provided in the first aspect of the present invention.

[0090] Further, in some preferred embodiments, the display device 500 for displaying images outside the vehicle may include at least one display screen, wherein the at least one display screen may be arranged at the position of the vehicle exterior rearview mirror on the left side of the vehicle, the vehicle exterior rearview mirror on the right side of the vehicle and / or the vehicle interior rearview mirror, as an electronic rearview mirror configuration. Optionally, in some embodiments, the at least one display screen may also be integrated into the central control display screen of the vehicle to display images outside the vehicle.

[0091] In summary, the present invention provides a method for displaying images outside the vehicle, a device for displaying images outside the vehicle, and a computer-readable storage medium, which can not only meet the clarity requirements of the area of ​​concern to the driver during driving, but also take into account the display of images in other areas, ensuring that there are no blind spots in the entire driving process.

[0092] The previous description of the disclosure is provided to enable any person skilled in the art to make or use the disclosure. Various modifications to the disclosure will be apparent to those skilled in the art, and the general principles defined herein may be applied to other variations without departing from the spirit or scope of the disclosure. Thus, the disclosure is not intended to be limited to the examples and designs described herein, but should be granted the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for displaying an image outside a vehicle, characterized in that: The following steps are involved: Obtaining the original image outside the vehicle; Acquiring vehicle data and / or driver data to determine a usage scenario of the original image; According to the usage scenario, the original image is divided into at least one first region image of interest and at least one second region image of no interest; respectively determining a first compression coefficient corresponding to the first region image and a second compression coefficient corresponding to the second region image, wherein the first compression coefficient is smaller than the second compression coefficient; as well as The first region image and the second region image are subjected to zone compression according to the first compression coefficient and the second compression coefficient to obtain a display image.

2. The display method according to claim 1, characterized in that: The vehicle data includes a driving speed and / or a turn signal, and the step of acquiring the vehicle data and / or the driver data to determine the usage scenario of the original image includes: In response to the driving speed being greater than a preset speed threshold, determining that the vehicle is in a high-speed driving mode; and / or In response to the driving speed being less than or equal to the speed threshold, determining that the vehicle is in a low-speed driving mode; and / or In response to the turn signal, it is determined that the vehicle is in a turn mode.

3. The display method according to claim 2, characterized in that: The step of dividing the original image into at least one first region image of interest and at least one second region image of no interest according to the usage scenario comprises: In the high-speed driving mode, at least one area image in the original image far from the vehicle is determined as the first area image, and at least one area image in the original image close to the vehicle is determined as the second area image; and / or In the low-speed driving mode, at least one area image in the original image close to the vehicle is determined as the first area image, and at least one area image in the original image far from the vehicle is determined as the second area image; and / or In the turning mode, at least one area image in the original image located in the turning direction is determined as the first area image, and other area images in the original image are determined as the second area images.

4. The display method according to claim 1, characterized in that: The driver data includes an eye movement signal of the driver, and the step of acquiring vehicle data and / or driver data to determine the usage scenario of the original image includes: in response to the eye movement signal indicating that the driver is observing the display screen, determining that the driver is in an observation mode, The step of dividing the original image into at least one first area image of interest and at least one second area image of non-interest according to the usage scenario includes: in the observation mode, determining the driver's area of ​​interest on the display screen as the first area image, and determining other area images in the original image as the second area image.

5. The display method according to any one of claims 1 to 4, characterized in that: The step of respectively determining a first compression coefficient corresponding to the first region image and a second compression coefficient corresponding to the second region image comprises: Setting a first compression coefficient corresponding to the first region image to 1 so that the first region image maintains its original first resolution; and According to the display resolution of the display screen, the first resolution, and the original second resolution of the second area image, the second compression coefficient corresponding to the second area image is set to be greater than 1, and the second resolution is compressed so that the displayed image conforms to the display resolution.

6. The display method according to claim 5, characterized in that: The step of setting the second compression coefficient corresponding to the second region image to be greater than 1 according to the display resolution of the display screen, the first resolution, and the original second resolution of the second region image, and compressing the second resolution so that the displayed image conforms to the display resolution comprises: Determining, according to a difference between the horizontal display resolution of the display screen and the first horizontal resolution of the first region image, a horizontal display resolution of each of the second region images in a region horizontally adjacent to the first region image; and A second horizontal compression coefficient fixed to each of the second region images in the region horizontally adjacent to the first region image is determined according to a ratio of the horizontal display resolution to a sum of second horizontal resolutions of each of the second region images in the region horizontally adjacent to the first region image.

7. The display method according to claim 5, characterized in that: The step of setting the second compression coefficient corresponding to the second region image to be greater than 1 according to the display resolution of the display screen, the first resolution, and the original second resolution of the second region image, and compressing the second resolution so that the displayed image conforms to the display resolution comprises: Determining, according to a difference between the vertical display resolution of the display screen and the first vertical resolution of the first region image, a vertical display resolution of each of the second region images in a region vertically adjacent to the first region image; and A fixed second longitudinal compression coefficient of each of the second region images in the region numerically adjacent to the first region image is determined according to the ratio of the longitudinal display resolution to the sum of the second longitudinal resolutions of each of the second region images in the region vertically adjacent to the first region image.

8. The display method according to claim 6 or 7, characterized in that: The step of setting the second compression coefficient corresponding to the second region image to be greater than 1 according to the display resolution of the display screen, the first resolution, and the original second resolution of the second region image, and compressing the second resolution so that the displayed image conforms to the display resolution further includes: Determining second lateral compression coefficients of remaining second region images vertically adjacent to the second region image according to a fixed second lateral compression coefficient of each of the second region images in a region horizontally adjacent to the first region image; and / or The second longitudinal compression coefficients of the remaining second region images horizontally adjacent to the second region image are determined according to the fixed second longitudinal compression coefficients of the second region images in the regions vertically adjacent to the first region image.

9. The display method according to claim 6 or 7, characterized in that: The step of setting the second compression coefficient corresponding to the second region image to be greater than 1 according to the display resolution of the display screen, the first resolution, and the original second resolution of the second region image, and compressing the second resolution so that the displayed image conforms to the display resolution further includes: Determine a second lateral compression coefficient of each second region image that changes gradually according to the first compression coefficient, a second lateral compression coefficient that is fixed for each second region image in a region horizontally adjacent to the first region image, and a horizontal distance from each second region image to the first region image; and A second longitudinal compression coefficient of each second region image that is gradually changed is determined based on the first compression coefficient, a second longitudinal compression coefficient that is fixed for each second region image in an area vertically adjacent to the first region image, and a vertical distance from each second region image to the first region image.

10. The display method according to claim 9, characterized in that: The step of determining the second lateral compression coefficient of each second region image gradually changing according to the first compression coefficient, a second lateral compression coefficient fixed to each second region image in a region horizontally adjacent to the first region image, and a horizontal distance from each second region image to the first region image comprises: According to the first compression coefficient k1, a second lateral compression coefficient k fixed to a second area image in an area horizontally adjacent to the first area image 20x And the horizontal coordinate x of the center of the region 20 , and the critical horizontal coordinate x1 of the first region image close to the second region image, determine the lateral gradient slope of the second lateral compression coefficient of each second region image as well as According to the lateral gradient slope a x , the first compression coefficient k1, the critical horizontal coordinate x1, and the horizontal coordinate x2 of each of the second region images, calculate the second horizontal compression coefficient k1 of the second region image gradient 2x =a x ×(x2-x1)+k1.

11. The display method according to claim 9, characterized in that: The step of determining the second longitudinal compression coefficient of each second region image gradually changing according to the first compression coefficient, a second longitudinal compression coefficient fixed to each second region image in a region vertically adjacent to the first region image, and a vertical distance from each second region image to the first region image comprises: According to the first compression coefficient k1, the second longitudinal compression coefficient k fixed to the second region image of the region vertically adjacent to the first region image 20y and the vertical coordinate y of the center of the region 20 , and the critical vertical coordinate y1 of the first region image close to the second region image, determine the longitudinal gradient slope of the second longitudinal compression coefficient of each second region image as well as According to the longitudinal gradient slope a y , the first compression coefficient k1, the critical vertical coordinate y1, and the vertical coordinate y2 of each of the second region images, calculate the second longitudinal compression coefficient k1 of the second region image gradient 2y =a y ×(y2-y1)+k1.

12. The display method according to claim 1, characterized in that: The step of obtaining the original image outside the vehicle comprises: A rear-view image of the vehicle is captured by a camera facing the rear of the vehicle; or The panoramic image around the vehicle is obtained through the vehicle's panoramic image monitoring system.

13. A display device for an image outside a vehicle, characterized in that: include: Memory; as well as A processor is connected to the memory and is configured to implement the method for displaying an image outside a vehicle according to any one of claims 1 to 12.

14. The display device according to claim 13, wherein: Also includes: At least one display screen, wherein the at least one display screen is arranged at the position of the exterior rearview mirror on the left side of the vehicle, the position of the exterior rearview mirror on the right side of the vehicle and / or the position of the interior rearview mirror, and / or is integrated into the central control display screen of the vehicle.

15. A computer-readable storage medium having computer instructions stored thereon, characterized in that: When the computer instructions are executed by a processor, the method for displaying an image outside a vehicle according to any one of claims 1 to 12 is implemented.

Images