A method for displaying a blue screen and a flower screen fault based on a vehicle display screen

Abstract

The application discloses a kind of based on the display processing method of blue screen, screen failure display of vehicle display screen, comprising the following steps: S1, the image of vehicle front, rear, left and right is collected;S2, splicing generates video image to be displayed;S3, whether the video image to be displayed is identical with preset fault image is detected, the video image to be displayed is not identical with preset fault image, then the video image to be displayed is transmitted to vehicle display screen and is displayed, the video image to be displayed is identical with preset fault image, then step S4 is executed;S4, feedback fault alarm signal to MCU processor;S5, the image of single camera acquisition is output, then step S7 is executed;S6, emergency image is output, then step S7 is executed;S7, vehicle display screen is displayed.The application compared with prior art, effectively avoid the display of blue screen, screen failure of vehicle display screen, improve the display effect of vehicle display screen.

Description

Technical Field

[0001] This invention relates to the field of vehicle display device technology, and in particular to a method for handling blue screen and distorted screen display faults based on a vehicle display screen. Background Technology

[0002] Modern vehicles are generally equipped with in-vehicle displays to show relevant vehicle data. For example, due to their large size, buses typically have cameras installed around their perimeter, which, together with the displays inside the vehicle, provide a 360° panoramic view to ensure that the driver has a full understanding of the surrounding environment. For example, Chinese patent CN201821326985.7 discloses a passenger detection system for an unmanned bus platform, including an onboard computing terminal, an exterior front camera, an exterior rear camera, an exterior left camera, an exterior right camera, a display, a GPS global positioning module, a 4G network communication module, and a PC remote monitoring center; the onboard computing terminal includes an ARM controller, a DSP image stitching module, a DSP image detection module, a GPU module, and a CAN communication module; the DSP image stitching module is connected to the ARM controller and is used to process the video from the four exterior cameras in real time and stitch them into a panoramic video; the DSP image detection module is connected to the ARM controller and is used to process the video from the interior front camera in real time and to identify and detect passengers at the unmanned bus platform for automatic vehicle parking; the 4G network communication module is connected to the ARM controller; the four exterior camera modules are used to collect real-time video of the surrounding area outside the vehicle.

[0003] If the camera malfunctions (disconnects or is damaged) while displaying images from a camera on the in-vehicle display screen, the screen will display a blue screen or show no image. A malfunction in the processing of the acquired video data signal will cause the screen to display a distorted or garbled image. These fatal errors, such as blue screens and distorted images, prevent the in-vehicle display screen from displaying images of the surrounding environment. Furthermore, blue screens and distorted images can cause discomfort to viewers. Summary of the Invention

[0004] The purpose of this invention is to provide a method for handling blue screen and distorted screen display faults based on vehicle display screens, effectively avoiding blue screen and distorted screen display faults on vehicle display screens and improving the display effect of vehicle display screens.

[0005] To achieve the above objectives, the present invention adopts the following technical solution: a method for handling blue screen and distorted screen display faults based on an in-vehicle display screen, comprising the following steps:

[0006] S1. The front camera, rear camera, left camera, and right camera respectively capture images of the front, rear, left, and right sides of the vehicle;

[0007] S2. The first image processing module receives and stitches together the images captured by the front camera, rear camera, left camera and right camera, generates a video image to be displayed and transmits it to the image monitoring module.

[0008] S3. The image monitoring module detects whether the video image to be displayed is the same as the preset fault image. If the video image to be displayed is not the same as the preset fault image, the video image to be displayed is transmitted to the vehicle display screen for display. If the video image to be displayed is the same as the preset fault image, step S4 is executed.

[0009] S4. If the image monitoring module determines that the video image to be displayed is the same as the preset fault image of the screen distortion caused by the damage of a single camera, it will send the first fault alarm signal to the MCU processor. The MCU processor will control the first image processing module to execute step S5. If the image monitoring module determines that the video image to be displayed is the same as the preset fault image of the blue screen, it will send the second fault alarm signal to the MCU processor. The MCU processor will control the image backup module to execute step S6.

[0010] S5. After receiving the images captured by the front camera, rear camera, left camera and right camera, the first image processing module eliminates the faulty camera, and then outputs the image captured by the highest priority single camera to the image monitoring module according to the set single camera start-up order, and then executes step S7.

[0011] S6. The image backup module processes the video image to be displayed stored before the second fault alarm signal is generated into an emergency image and transmits it to the image monitoring module, and then executes step S7.

[0012] S7. The image monitoring module detects images and transmits them to the vehicle display screen for display.

[0013] The above fault display and processing method is implemented based on a fault display and processing system, which includes:

[0014] The image acquisition module includes a front camera installed on the front side of the vehicle, a rear camera installed on the rear side of the vehicle, a left camera installed on the left side of the vehicle, and a right camera installed on the right side of the vehicle. The front camera, rear camera, left camera, and right camera respectively acquire images of the front, rear, left, and right sides of the vehicle in real time.

[0015] The first image processing module is used to receive and stitch together images captured by the front camera, rear camera, left camera and right camera, generate a video image to be displayed and transmit it to the image monitoring module.

[0016] The image monitoring module is used to detect whether the video image to be displayed is the same as the preset fault image. If the video image to be displayed is the same as the preset fault image, a fault alarm signal is fed back to the MCU processor. If the video image to be displayed is not the same as the preset fault image, the video image to be displayed is transmitted to the vehicle display screen for display.

[0017] An image backup module is used to store the video images to be displayed generated by the first image processing module.

[0018] The MCU processor is used to control the first image processing module or the image backup module to output images to the image monitoring module based on the fault alarm signal.

[0019] As a further description of the above technical solution:

[0020] In step S5, the single camera activation sequence is: right camera, rear camera, left camera, and front camera.

[0021] As a further description of the above technical solution:

[0022] In step S5, the first image processing module includes a startup order correction unit, which is used to acquire vehicle driving data and adjust the startup order of the single camera according to the vehicle driving data.

[0023] As a further description of the above technical solution:

[0024] Vehicle driving data includes vehicle gear information.

[0025] As a further description of the above technical solution:

[0026] The first image processing module includes an image stitching unit and a single-camera image output control unit. The image stitching unit is used to receive and stitch together images captured by the front camera, rear camera, left camera, and right camera to generate a video image to be displayed to the image monitoring module. The single-camera image output control unit is used to output images captured by a single camera with high priority to the image monitoring module according to the set single-camera startup order.

[0027] As a further description of the above technical solution:

[0028] The image backup module includes a frame extraction processing unit, which is used to extract a frame from the video image to be displayed stored before the second fault alarm signal is generated, as an emergency image.

[0029] As a further description of the above technical solution:

[0030] The image backup module also includes an image labeling unit, which is used to add red border lines to the edges of vehicle bodies in emergency images.

[0031] In summary, due to the adoption of the above technical solution, the beneficial effects of the present invention are:

[0032] 1. In this invention, when the image displayed on the vehicle display screen is incomplete due to a single camera being disconnected or damaged, causing the panoramic image formed by stitching together multiple camera images output by the first image processing module to be incomplete, the vehicle display screen will "display a distorted image". Therefore, the fault display processing system controls the first image processing module to stop outputting the stitched panoramic image and instead display the image captured by the current camera, thus preserving the function of the vehicle display screen to display the surrounding environment of the vehicle while avoiding a distorted image.

[0033] 2. In this invention, if the image output by the image monitoring module is the same as the preset fault image for the blue screen, or if the image monitoring module does not receive the image transmitted by the first image processing module, a second fault alarm signal is fed back to the MCU processor. The MCU processor causes the image backup module to output an emergency image to the image monitoring module, thereby enabling the vehicle display screen to display the image and effectively avoid the blue screen.

[0034] 3. In this invention, the startup sequence correction unit adjusts the startup sequence of the single cameras based on whether the vehicle is in drive or reverse gear. When the vehicle is in drive and moving forward, the startup sequence of the single cameras is the right-side camera, rear-side camera, left-side camera, and front-side camera; when the vehicle is in reverse and reversing, the startup sequence of the single cameras is the rear-side camera, right-side camera, left-side camera, and front-side camera. When the in-vehicle display screen cannot display a panoramic view, it prioritizes displaying the rear environment image to ensure reversing safety. Attached Figure Description

[0035] To more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings used in the embodiments will be briefly introduced below. It should be understood that the following drawings only show some embodiments of the present invention and should not be regarded as a limitation on the scope. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0036] Figure 1 This is a system architecture diagram of a blue screen and distorted screen fault display and processing system based on an in-vehicle display screen. Detailed Implementation

[0037] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. The components of the embodiments of the present invention described and shown in the accompanying drawings can generally be arranged and designed in various different configurations.

[0038] Therefore, the following detailed description of the embodiments of the invention provided in the accompanying drawings is not intended to limit the scope of the claimed invention, but merely to illustrate selected embodiments of the invention. All other embodiments obtained by those skilled in the art based on the embodiments of the invention without inventive effort are within the scope of protection of the invention.

[0039] Please see Figure 1 This invention provides a technical solution: a method for handling blue screen and distorted screen display faults based on an in-vehicle display screen, comprising the following steps:

[0040] S1. The front camera, rear camera, left camera, and right camera respectively capture images of the front, rear, left, and right sides of the vehicle;

[0041] S2. The first image processing module receives and stitches together the images captured by the front camera, rear camera, left camera and right camera, generates a video image to be displayed and transmits it to the image monitoring module.

[0042] S3. The image monitoring module detects whether the video image to be displayed is the same as the preset fault image. If the video image to be displayed is not the same as the preset fault image, the video image to be displayed is transmitted to the vehicle display screen for display. If the video image to be displayed is the same as the preset fault image, step S4 is executed.

[0043] S4. If the image monitoring module determines that the video image to be displayed is the same as the preset fault image of the screen distortion caused by the damage of a single camera, it will send the first fault alarm signal to the MCU processor. The MCU processor will control the first image processing module to execute step S5. If the image monitoring module determines that the video image to be displayed is the same as the preset fault image of the blue screen, it will send the second fault alarm signal to the MCU processor. The MCU processor will control the image backup module to execute step S6.

[0044] S5. After receiving the images captured by the front camera, rear camera, left camera and right camera, the first image processing module eliminates the faulty camera, and then outputs the image captured by the highest priority single camera to the image monitoring module according to the set single camera start-up order, and then executes step S7.

[0045] S6. The image backup module processes the video image to be displayed stored before the second fault alarm signal is generated into an emergency image and transmits it to the image monitoring module, and then executes step S7.

[0046] S7. The image monitoring module detects images and transmits them to the vehicle display screen for display.

[0047] The above fault display and processing method is implemented based on a fault display and processing system, which includes:

[0048] The image acquisition module includes a front camera installed on the front side of the vehicle, a rear camera installed on the rear side of the vehicle, a left camera installed on the left side of the vehicle, and a right camera installed on the right side of the vehicle. The front camera, rear camera, left camera, and right camera respectively acquire images of the front, rear, left, and right sides of the vehicle in real time.

[0049] The first image processing module is used to receive and stitch together images captured by the front camera, rear camera, left camera and right camera, generate a video image to be displayed and transmit it to the image monitoring module.

[0050] The image monitoring module is used to detect whether the video image to be displayed is the same as the preset fault image. If the video image to be displayed is the same as the preset fault image, a fault alarm signal is fed back to the MCU processor. If the video image to be displayed is not the same as the preset fault image, the video image to be displayed is transmitted to the vehicle display screen for display.

[0051] An image backup module is used to store the video images to be displayed generated by the first image processing module.

[0052] The MCU processor is used to control the first image processing module or the image backup module to output images to the image monitoring module based on the fault alarm signal.

[0053] In step S5, the activation order of the single cameras is: right-side camera, rear-side camera, left-side camera, and front-side camera. The right-side camera has the highest priority, and the front-side camera has the lowest priority. The environmental data on the right side of the vehicle body collected by the right-side camera, which is furthest from the driver, is the most important and is displayed first.

[0054] In step S5, the first image processing module includes a startup order correction unit. This unit acquires vehicle driving data and adjusts the startup order of the single cameras based on this data. The vehicle driving data includes vehicle gear position data. The startup order correction unit adjusts the startup order of the single cameras based on whether the vehicle is in a forward or reverse gear. When the vehicle is in a forward gear and moving forward, the startup order of the single cameras is the right-side camera, rear-side camera, left-side camera, and front-side camera. When the vehicle is in reverse gear and reversing, the startup order of the single cameras is the rear-side camera, right-side camera, left-side camera, and front-side camera. When the vehicle display screen cannot show a panoramic view, it prioritizes displaying the rear environment image to ensure reversing safety.

[0055] The first image processing module includes an image stitching unit and a single-camera image output control unit. The image stitching unit is used to receive and stitch together images captured by the front camera, rear camera, left camera, and right camera to generate a video image to be displayed to the image monitoring module. The single-camera image output control unit is used to output images captured by a single camera with high priority to the image monitoring module according to the set single-camera startup order.

[0056] The image backup module includes a frame extraction processing unit, which is used to extract a frame from the video image to be displayed stored before the second fault alarm signal is generated, as an emergency image.

[0057] The image backup module also includes an image labeling unit, which adds a red border to the edges of the vehicle body in the emergency image. The red border identifies the emergency image, allowing the driver to distinguish it from a real-time image and preventing misoperation based on the emergency image.

[0058] Working Principle: When the image displayed on the vehicle's display screen becomes incomplete due to a broken or damaged single camera, causing the panoramic image stitched together from multiple camera images output by the first image processing module to be incomplete, the vehicle's display screen will display a "distorted" image. Therefore, the fault display processing system controls the first image processing module to stop outputting the stitched panoramic image and instead display the image captured by the single camera, preserving the vehicle's display screen's function of showing the vehicle's surrounding environment while avoiding the distortion. If the image output by the image monitoring module is the same as the preset fault image for the blue screen, or if the image monitoring module does not receive the image transmitted by the first image processing module, it will send a second fault alarm signal to the MCU processor. The MCU processor will then cause the image backup module to output an emergency image to the image monitoring module, thereby enabling the vehicle's display screen to display an image and effectively preventing a blue screen.

[0059] The above description is only a preferred embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any equivalent substitutions or modifications made by those skilled in the art within the scope of the technology disclosed in the present invention, based on the technical solution and inventive concept of the present invention, should be covered within the scope of protection of the present invention.

Claims

1. A method for handling blue screen and distorted screen display faults based on an in-vehicle display screen, characterized in that, Includes the following steps: S1. The front camera, rear camera, left camera, and right camera respectively capture images of the front, rear, left, and right sides of the vehicle; S2. The first image processing module receives and stitches together the images captured by the front camera, rear camera, left camera and right camera, generates a video image to be displayed and transmits it to the image monitoring module. S3. The image monitoring module detects whether the video image to be displayed is the same as the preset fault image. If the video image to be displayed is not the same as the preset fault image, the video image to be displayed is transmitted to the vehicle display screen for display. If the video image to be displayed is the same as the preset fault image, step S4 is executed. S4. If the image monitoring module determines that the video image to be displayed is the same as the preset fault image of the screen distortion caused by the damage of a single camera, it will send the first fault alarm signal to the MCU processor. The MCU processor will control the first image processing module to execute step S5. If the image monitoring module determines that the video image to be displayed is the same as the preset fault image of the blue screen, it will send the second fault alarm signal to the MCU processor. The MCU processor will control the image backup module to execute step S6. S5. After receiving the images captured by the front camera, rear camera, left camera and right camera, the first image processing module eliminates the faulty camera, and then outputs the image captured by the highest priority single camera to the image monitoring module according to the set single camera start-up order, and then executes step S7. S6. The image backup module processes the video image to be displayed stored before the second fault alarm signal is generated into an emergency image and transmits it to the image monitoring module, and then executes step S7. S7. The image monitoring module detects images and transmits them to the vehicle display screen for display. In step S5, the single camera activation sequence is: right camera, rear camera, left camera, and front camera. In step S5, the first image processing module includes a startup order correction unit, which is used to acquire vehicle driving data and adjust the startup order of the single camera according to the vehicle driving data. The vehicle driving data includes vehicle gear data. The above fault display and processing method is implemented based on a fault display and processing system, which includes: The image acquisition module includes a front camera installed on the front side of the vehicle, a rear camera installed on the rear side of the vehicle, a left camera installed on the left side of the vehicle, and a right camera installed on the right side of the vehicle. The front camera, rear camera, left camera, and right camera respectively acquire images of the front, rear, left, and right sides of the vehicle in real time. The first image processing module is used to receive and stitch together images captured by the front camera, rear camera, left camera and right camera, generate a video image to be displayed and transmit it to the image monitoring module. The image monitoring module is used to detect whether the video image to be displayed is the same as the preset fault image. If the video image to be displayed is the same as the preset fault image, a fault alarm signal is fed back to the MCU processor. If the video image to be displayed is not the same as the preset fault image, the video image to be displayed is transmitted to the vehicle display screen for display. An image backup module is used to store the video images to be displayed generated by the first image processing module. The MCU processor is used to control the first image processing module or the image backup module to output images to the image monitoring module based on the fault alarm signal.

2. The method for handling blue screen and distorted screen display faults based on an in-vehicle display screen according to claim 1, characterized in that, The first image processing module includes an image stitching unit and a single-camera image output control unit. The image stitching unit is used to receive and stitch together images captured by the front camera, rear camera, left camera, and right camera to generate a video image to be displayed to the image monitoring module. The single-camera image output control unit is used to output images captured by a single camera with high priority to the image monitoring module according to the set single-camera startup order.

3. The method for handling blue screen and distorted screen display faults based on an in-vehicle display screen according to claim 1, characterized in that, The image backup module includes a frame extraction processing unit, which is used to extract a frame from the video image to be displayed stored before the second fault alarm signal is generated, as an emergency image.

4. The method for handling blue screen and distorted screen display faults based on an in-vehicle display screen according to claim 3, characterized in that, The image backup module also includes an image labeling unit, which is used to add red border lines to the edges of the vehicle body in the emergency image.

Images