Reversing image processing method, vehicle-mounted platform and vehicle

By integrating the main processing unit and the real-time task processing unit on the vehicle platform, the real-time operating system is used to quickly acquire and display the reverse image, the problem of long wait time for the reverse image to be displayed in the prior art is solved, and the real-time performance and the Security.

CN118945407APending Publication Date: 2024-11-12SHENZHEN PALM RUI ELECTRONICS CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410376215.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-03-29
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

The operating system of the existing vehicle platform has a long start time, which leads to a longer wait for the reversing image to be displayed, affecting the driver's real-time observation and judgment when reversing.

Method used

An electronic computing system that integrates the main processing unit and the real-time task processing unit is used to start the main operating system and the real-time operating system simultaneously through the boot loading operation. The startup time of the real-time operating system is shorter than that of the main operating system, and is used to run the reverse image processing routine. Directly obtain the image information of the camera device and generate the current reverse image information, and give priority to displaying the reverse image through the real-time operating system.

Benefits of technology

It significantly shortens the time when the reverse image is waiting for display, ensuring that the vehicle can respond quickly and display the reverse image information in a timely manner when the vehicle is backing, improving safety during the reverse process.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118945407A_ABST
    Figure CN118945407A_ABST
Patent Text Reader

Abstract

The embodiment of the invention relates to a reversing image processing method. The method comprises the following steps: starting a real-time operating system running on a real-time task processing unit through boot loading operation while starting a main operating system running on a main processing unit; running a reversing image processing routine on the real-time operating system in response to a situation in which the vehicle retreats; displaying reversing image information generated by the reversing image processing routine; wherein the reversing image processing routine is configured to directly acquire image information from the camera equipment through the real-time task processing unit, and generate current reversing image information according to the image information. According to the method, the reversing image processing routine is set to run in the real-time operating system, so that the reversing image processing routine can respond and run more quickly after cold start, the current reversing image information is generated and displayed in time in the vehicle backing process, and the waiting time of the reversing image to be displayed is effectively shortened.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of automobile electronic technology, and in particular to a method for processing a reversing image, a vehicle-mounted platform and a vehicle. Background Art

[0002] The vehicle-mounted platform can be used to assist the driver in observing the actual situation behind the vehicle when reversing, and the reversing image is transmitted to the driver through the vehicle-mounted display screen.

[0003] At present, the operating systems of vehicle-mounted platforms are mostly Linux or Android. Since the system starts slowly and the reversing image application needs to wait until the system starts before it can run, the reversing image takes a long time to be displayed. Summary of the invention

[0004] The reversing image processing method, vehicle-mounted platform and vehicle provided in the embodiments of the present application are used to reduce the time for waiting for the reversing image to be displayed.

[0005] In the first aspect, the embodiment of the present application provides a method for processing a reversing image. The method is applied to an electronic computing system integrated with a main processing unit and a real-time task processing unit, wherein the electronic computing system is configured to: in response to a power-on situation, perform a boot loading operation, and start a main operating system running on the main processing unit through the boot loading operation, including: while starting the main operating system running on the main processing unit, also start the real-time operating system running on the real-time task processing unit through the boot loading operation; in response to a vehicle reversing situation, run a reversing image processing routine on the real-time operating system that has been started; the startup time of the real-time operating system is shorter than that of the main operating system; and display the reversing image information generated by the reversing image processing routine; wherein the reversing image processing routine is configured to: directly obtain image information from a camera device through the real-time task processing unit, and generate current reversing image information based on the image information.

[0006] Optionally, the reversing image processing routine is run on the real-time operating system that has been started, specifically including: initializing several reversing image processing resources; establishing an image information transmission link between the real-time operating system and a camera device; and when the vehicle moves backward, the real-time operating system generates the current reversing image information from the image information obtained through the image information transmission link.

[0007] Optionally, the real-time operating system generates the current reversing image information from the image information obtained through the image information transmission link, specifically including: receiving the image information from the camera device based on the image information transmission link through the real-time operating system; providing the image information to the image processing device through the real-time operating system; receiving the reversing image information fed back by the image processing device through the real-time operating system. The image information transmission link can be used to receive the image information of the rear of the vehicle captured by the camera device more quickly, reducing the time it takes to wait for the reversing image to be displayed.

[0008] Optionally, the reversing image processing resources include: image display data and camera device data; wherein the image display data includes: resolution, refresh rate, color and contrast.

[0009] Optionally, the display priority of the real-time operating system is higher than that of the main operating system, so that the reversing image information is displayed first. The reversing image information processed by the real-time operating system is displayed on the display device of the vehicle in priority to the reversing image information processed by the main operating system, so as to display the reversing image information more quickly.

[0010] Optionally, the boot loading operation includes: initializing and setting a system environment; loading a driver kernel; starting and running the driver kernel.

[0011] In the second aspect, the embodiment of the present application provides a vehicle-mounted platform. The vehicle-mounted platform includes: an electronic computing system; the electronic computing system integrates a main processing unit and a real-time task processing unit; a main operating system; the main operating system runs on the main processing unit; a real-time operating system; the real-time operating system runs on the real-time task processing unit; a reversing image processing routine; the reversing image processing routine runs in the real-time operating system and is configured to: when the vehicle is reversing, directly obtain image information from the camera device through the real-time task processing unit, and generate current reversing image information based on the image information; wherein, when the power of the electronic computing system is turned on, the main operating system and the real-time operating system are started; the startup time of the real-time operating system is shorter than that of the main operating system.

[0012] Optionally, the reversing image processing routine is specifically used to: detect whether the vehicle is reversing; when the vehicle is reversing, obtain image information from a camera device; provide the obtained image information to an image processing device; receive reversing image information from the image processing device; provide the reversing image information to a display device so that the display screen of the display device is updated. By using the reversing image processing routine as a data transmission medium, obtaining image information, obtaining reversing image information after image information processing, and transmitting the reversing image information to a display device for display, the time for waiting for the reversing image to be displayed is reduced.

[0013] Optionally, the vehicle-mounted platform further includes: a virtual middle layer; wherein the virtual middle layer is configured such that: the main operating system and the real-time operating system share one or more hardware devices; the hardware devices include: a camera device, a display device, and an image processing device. Through the virtual middle layer, the hardware devices between the main operating system and the real-time operating system are shared, and the data resources of each hardware device are shared.

[0014] Optionally, the electronic computing system is configured to: when the power is turned on, perform a boot loading operation to start the main operating system and the real-time operating system; wherein the boot loading operation includes: initializing and setting the system environment; loading a driver kernel and starting and running the driver kernel.

[0015] Optionally, before the reversing image processing routine is activated, it also includes: initializing several reversing image processing resources; and establishing an image information transmission link with a camera device; wherein the reversing image processing resources include: image display data and camera device data. Through the image information transmission link, the image information of the rear of the vehicle captured by the camera device can be received more quickly, reducing the time for waiting for the reversing image to be displayed.

[0016] Optionally, the driver kernel is configured to: initialize the image display data; the image display data includes: resolution, refresh rate, color and contrast; the real-time operating system is configured to: initialize the camera device data.

[0017] In a third aspect, an embodiment of the present application provides a vehicle, the vehicle comprising: a camera device, the camera device is used to: obtain image information from the rear of the vehicle; a display device, the display device is used to: display image information; the vehicle-mounted platform as described above; wherein, when the vehicle is in a reverse state, the current reversing image information is displayed on the display device through the operation of a reversing image processing routine in a real-time operating system of the vehicle-mounted platform; the reversing image information is obtained after processing the image information from the rear of the vehicle. The image information from the rear of the vehicle is obtained through the camera device, the image information is obtained through the reversing image processing routine in the real-time operating system of the vehicle-mounted platform, the reversing image information after the image information is processed is obtained, and the reversing image information is transmitted to the display device for display, thereby reducing the time for the reversing image to wait for display.

[0018] At least one advantageous aspect of the method for processing a reversing image provided by the embodiment of the present application is that: since the startup time of a real-time operating system is significantly shortened compared to a traditional main operating system, setting the reversing image processing routine in a real-time operating system operation mode can make the reversing image processing routine respond and run more quickly after a cold start, and timely generate and display the current reversing image information during the vehicle reversing process, effectively reducing the time for the reversing image to be displayed. Moreover, unlike the traditional main operating system's image information acquisition method at the application layer, the reversing image processing routine running in the real-time operating system can also more directly obtain the image information of the camera device through the real-time task processing unit. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] One or more embodiments are exemplarily described by pictures in the corresponding drawings, and these exemplified descriptions do not constitute limitations on the embodiments. Elements with the same reference numerals in the drawings represent similar elements, and unless otherwise stated, the figures in the drawings do not constitute proportional limitations.

[0020] Figure 1 This is a typical Android system startup process diagram;

[0021] Figure 2 A schematic diagram of a process for starting a real-time operating system in a kernel provided in an embodiment of the present application;

[0022] Figure 3 A functional block diagram of the vehicle-mounted platform provided in an embodiment of the present application;

[0023] Figure 4 A functional block diagram of a vehicle provided in an embodiment of the present application;

[0024] Figure 5 A method flow chart of a method for processing a reversing image provided in an embodiment of the present application;

[0025] Figure 6 A method flow chart of a method for processing a reversing image provided in another embodiment of the present application. DETAILED DESCRIPTION

[0026] In order to facilitate the understanding of the present invention, the present invention is described in more detail below in conjunction with the accompanying drawings and specific embodiments. It should be noted that when an element is described as "fixed to" another element, it can be directly on another element or there can be one or more centered elements therebetween. When an element is described as "connected" to another element, it can be directly connected to another element or there can be one or more centered elements therebetween. The orientation or positional relationship indicated by the terms "upper", "lower", "inner", "outer", "bottom" etc. used in this specification is based on the orientation or positional relationship shown in the accompanying drawings, only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation of the present invention. In addition, the terms "first", "second", "third", etc. are only used for descriptive purposes and cannot be understood as indicating or implying relative importance.

[0027] Unless otherwise defined, all technical and scientific terms used in this specification have the same meaning as those commonly understood by those skilled in the art of the present invention. The terms used in this specification and in the specification of the present invention are only for the purpose of describing specific embodiments and are not intended to limit the present invention. The term "and / or" used in this specification includes any and all combinations of one or more of the related listed items.

[0028] In addition, the technical features involved in different embodiments of the present invention described below can be combined with each other as long as they do not conflict with each other.

[0029] With the rapid development of society, cars have become an indispensable means of transportation in people's lives. During the driving process, cars often need to reverse. During the reversing process, if the judgment of the environment behind the vehicle is inaccurate, the vehicle cannot be effectively controlled, thus causing safety accidents. Therefore, it is necessary to make a correct judgment of the environment behind the vehicle when reversing.

[0030] At present, during the reversing process, image information behind the vehicle is mainly collected by a camera installed at the rear end of the vehicle. The camera sends the collected image information to the vehicle-mounted platform, and the vehicle-mounted platform sends the image information to the vehicle's display screen, which displays the collected image information. The driver can observe and judge the actual situation behind the vehicle based on the image information displayed on the display screen, and then control the vehicle to complete the reversing operation.

[0031] However, at present, most of the operating systems of the vehicle-mounted platforms are Linux or Android. Since the startup process of Linux and Android systems is long, it takes a long time to start up, and the reversing image application needs to wait until the system startup is completed before it can run, which results in a long waiting time for the reversing image to be displayed.

[0032] Figure 1 This is a typical Android system startup process diagram. Figure 1 As shown, when the Android device is powered on, it will first start executing the boot code in the processor's on-chip read-only memory (ROM), thereby starting the ROM (Boot Rom). The on-chip ROM will search for the code of the boot loader (Boot Loader) before the system starts and load it into the memory. Subsequently, the Boot Loader starts to execute, first responsible for completing the hardware initialization, then finding the kernel (Kernel) code and loading it into the memory. The execution time of the Boot Loader is: 0 to 3 seconds. Subsequently, the Kernel starts, initializes various software and hardware environments, and loads the driver. The execution time of the Kernel is: 2 to 4 seconds. Subsequently, the first process is started: the initialize (init) process. The init process is used to initialize objects or perform some necessary settings and preparations. After the init process is completed, the zygote process is started. The Zygote process is used to: (1) call code in the virtual machine; (2) preload system classes and resources, where preloading system classes includes preloading (preload); (3) start the system server (System Sever). When the System Sever is started, a series of system services are started through the System Sever, such as power management (Power Manager Service), package management service (Package Manager Service), inter-process data exchange and network connection status service. When the System Sever is completed, the desktop launcher (Launcher) is started, and the Launcher calls the application (Application, APP). Therefore, under normal circumstances, from the power on of the Android device to the start of the reversing image application, the time required to generate the reversing image is at least 30 seconds.

[0033] In the process of implementing this application, the applicant found that after the Kernel is started, a lightweight real-time operating system (FreeRTOS) with significantly shorter startup time than the Android system can be started at the Kernel level, and the application for processing and generating reversing image information (hereinafter referred to as "reversing image processing routine" for ease of presentation) is set to run on the real-time operating system. By utilizing the characteristics of the real-time operating system such as lightweight, high efficiency, strong real-time performance and short startup time, the time required to generate reversing images can be effectively reduced, thereby reducing the time for the reversing image information to be displayed.

[0034] For example, Figure 2 As shown, the reversing image processing routine running on the real-time operating system can quickly generate and display the reversing image information. In the cold start state, the waiting time for the reversing image information to be displayed does not exceed 2 seconds, and the reversing image can be displayed faster and more real-time, significantly reducing the waiting time for the reversing image to be displayed.

[0035] Moreover, since the real-time operating system is a system running on a real-time task processing unit (for example, one of the cores of ARM, the CM4 core), the application that processes and generates the reversing image information can also directly obtain the required image information from the camera device through the real-time task processing unit at the kernel layer, without having to obtain it at the application level of the main operating system, thereby improving the efficiency of image information acquisition and shortening the time for waiting for the reversing image to be displayed.

[0036] Figure 3 The functional block diagram of the vehicle-mounted platform provided in the embodiment of the present application is as follows: Figure 3 As shown, the vehicle-mounted platform 30 includes: an electronic computing system 31 , a main operating system 32 , a real-time operating system 33 and a reversing image processing routine 34 .

[0037] The electronic computing system 31 is a machine system composed of hardware and software. The hardware is the machine system of the computer, which is the general term for all electronic and mechanical devices that constitute the electronic computer. The software is the program system of the computer, which is the general term for various programs used by the electronic computer.

[0038] The electronic computing system 31 integrates a main processing unit 311 and a real-time task processing unit 312. As an example but not a limitation, the main processing unit 311 can be a mobile chip of MediaTek (MTK), a central processing unit (CPU), or a microcontroller unit (MCU). As an example but not a limitation, the real-time task processing unit 312 can be a separate processing unit or a sub-processing unit built into the main processing unit 311, which is not limited here.

[0039] It should be noted that the real-time task processing unit 312 is not started under normal circumstances and is used less frequently. Most of the time it is used in the reversing scenario provided in the embodiment of the present application.

[0040] The main operating system 32 runs on the main processing unit 311. As an example but not a limitation, the main operating system 32 can be a Linux system, an Android system, or a dual system of Linux and Android, which is not limited here.

[0041] The real-time operating system 33 (FreeRTOS) runs on the real-time task processing unit 312. For example, the main processing unit 311 is ARM (Advanced RISC Machines), the real-time task processing unit 312 is the calculation module 4 (CM4) in ARM, and the real-time operating system 33 (FreeRTOS) runs on CM4.

[0042] It should be noted that the reversing image processing routine 34 is a piece of code with image processing function, which is equivalent to an application APP. The reversing image processing routine 34 runs in the real-time operating system 33 and is configured to: when the vehicle is reversing, directly obtain image information from the camera device through the real-time task processing unit 312, and generate current reversing image information based on the image information, and the reversing image information is displayed through the vehicle's display device.

[0043] It should be noted that when the electronic computing system 31 is powered on, the main operating system 32 and the real-time operating system 33 are started, and the startup time of the real-time operating system 33 is shorter than that of the main operating system 32 .

[0044] In some embodiments, the reversing image processing routine 34 is specifically used to: (1) detect whether the vehicle is reversing; (2) obtain image information from a camera device when the vehicle is reversing; (3) provide the obtained image information to an image processing device; (4) receive reversing image information from the image processing device; (5) provide the reversing image information to a display device so that a display screen of the display device is updated.

[0045] The camera device is arranged at the rear end of the vehicle, and is used to collect image information of the rear of the vehicle.

[0046] The image processing device is used to perform image processing on the image information from the camera device. The image processing methods include but are not limited to smoothing filtering, denoising, removing artifacts and enhancing contrast.

[0047] The display device is disposed inside the vehicle, for example, the display device is a screen on the center console.

[0048] It should be noted that the reversing image processing routine 34 runs in the real-time operating system 33, and the real-time operating system 33 serves as a transmission bridge between the reversing image processing routine 34 and the camera device, the image processing device and the display device, so that the reversing image processing routine 34 can obtain image information from the camera device, provide the obtained image information to the image processing device, receive reversing image information from the image processing device, and provide the reversing image information to the display device.

[0049] By using the reversing image processing routine in the real-time operating system as a data transmission intermediary, image information is obtained, reversing image information after image information processing is obtained, and the reversing image information is transmitted to a display device for display, thereby reducing the waiting time for the reversing image to be displayed.

[0050] In some embodiments, the vehicle-mounted platform 30 further includes: a virtual middle layer.

[0051] In order to allow different types of operating systems to run on a computing platform, the most direct technical path is virtualization (Hypervisor). Therefore, the vehicle-mounted platform 30 in the embodiment of the present application is provided with a virtual middle layer, which is used to realize the sharing of hardware devices.

[0052] The virtual middle layer is configured such that the main operating system 32 and the real-time operating system 33 share one or more hardware devices, wherein the hardware devices include: a camera device, a display device, and an image processing device.

[0053] Therefore, the main operating system 32 can also display the image information of the rear of the vehicle collected by the camera device through the camera device, the image processing device and the display device.

[0054] Through the virtual middle layer, hardware device sharing between the main operating system and the real-time operating system is achieved, and the data resources of each hardware device are shared.

[0055] In some embodiments, the electronic computing system 31 is configured to: execute a boot loading operation to start the main operating system 32 and the real-time operating system 33 when the power is turned on.

[0056] The boot loading operation includes: initializing and setting the system environment; loading the driver kernel and starting and running the driver kernel.

[0057] It should be noted that initializing and setting the system environment specifically includes: starting the ROM and starting the Boot Loader to initialize the hardware.

[0058] The kernel of the driver is Kernel. Kernel starts, initializes various software and hardware environments, and loads the driver.

[0059] In some embodiments, before the reversing image processing routine 34 is enabled, it also includes: initializing several reversing image processing resources; and establishing an image information transmission link with a camera device.

[0060] Among them, the reversing image processing resources include: image display data and camera equipment data.

[0061] The image information transmission link is used to transmit the image information of the rear of the vehicle collected by the camera device to the reversing image processing routine 34.

[0062] Through the image information transmission link, the image information of the rear of the vehicle captured by the camera equipment can be received more quickly, reducing the time waiting for the reversing image to be displayed.

[0063] In some embodiments, the driver kernel is configured to: initialize image display data; the image display data includes: resolution, refresh rate, color and contrast; the real-time operating system 33 is configured to: initialize camera device data.

[0064] As an example but not limitation, the image display data may also include: brightness and color temperature, and may also include other image display data, which are not limited here.

[0065] The camera device data includes but is not limited to: pixel frame size, pixel format, and input and output interfaces. For example, the pixel frame size is: 1080*720, and the pixel format is: RGB format.

[0066] Figure 4 A functional block diagram of a vehicle provided in an embodiment of the present application, such as Figure 4As shown, the vehicle 40 includes: a camera device 41, a display device 42 and a vehicle-mounted platform 30. The vehicle 40 also includes: an image processing device 43.

[0067] The camera device 41 is used to obtain image information behind the vehicle.

[0068] The display device 42 is used to display image information.

[0069] Specifically, when the vehicle 40 is in a reverse state, the image information from the rear of the vehicle captured by the camera device 41 is obtained through the operation of the reversing image processing routine 34 in the real-time operating system 33 of the vehicle-mounted platform 30. The reversing image processing routine 34 provides the image information from the camera device 41 to the image processing device 43, receives the reversing image information from the image processing device 43, and transmits the reversing image information to the display device 42, so that the display device 42 displays the current reversing image information, wherein the image processing device 43 is used to: process the image information from the camera device 41 into reversing image information.

[0070] Image information from the rear of the vehicle is acquired through a camera device, image information is acquired through a reversing image processing routine in a real-time operating system of the vehicle-mounted platform, reversing image information after image information processing is acquired, and the reversing image information is transmitted to a display device for display, thereby reducing the time waiting for the reversing image to be displayed.

[0071] Figure 5 The method flow chart of the method for processing the reversing image provided by the embodiment of the present application. The method for processing the reversing image is based on Figures 2 to 4 The embodiment of the present application is applied to an electronic computing system integrating a main processing unit and a real-time task processing unit, and the electronic computing system is configured to: in response to the situation where the power is turned on, perform a boot loading operation, and start the main operating system running on the main processing unit through the boot loading operation. Figure 5 As shown, the method for processing the reversing image includes the following steps:

[0072] S510. While starting the main operating system running on the main processing unit, also start the real-time operating system running on the real-time task processing unit through a boot loading operation.

[0073] In some embodiments, the boot loading operation includes: initializing and setting up the system environment; loading a driver kernel; and starting and running the driver kernel.

[0074] It should be noted that initializing and setting the system environment specifically includes: starting the ROM and starting the Boot Loader to initialize the hardware.

[0075] The kernel of the driver is Kernel. Kernel starts, initializes various software and hardware environments, and loads the driver.

[0076] S520: In response to the vehicle moving backward, a reversing image processing routine is run on the real-time operating system that has been started.

[0077] The real-time operating system (FreeRTOS) has the following characteristics: lightweight, high efficiency, strong real-time performance and short startup time. Therefore, the FreeRTOS can display the reversing image faster and more real-time in the reversing scene, and more effectively reduce the waiting time for the reversing image to be displayed.

[0078] It should be noted that the startup time of the real-time operating system is shorter than that of the main operating system.

[0079] It should be noted that the reversing image processing routine is a piece of code having the function of executing image processing.

[0080] S530: Display the reversing image information generated by the reversing image processing routine.

[0081] The reversing image processing routine is configured to directly obtain image information from the camera device through the real-time task processing unit, and generate current reversing image information according to the image information.

[0082] At least one advantageous aspect of the method for processing a reversing image provided by the embodiment of the present application is that, since the startup time of a real-time operating system is significantly shortened compared to a traditional main operating system, setting the reversing image processing routine to run in a real-time operating system can enable the reversing image processing routine to respond and run more quickly after a cold start, and timely generate and display the current reversing image information during the vehicle's reversing process, effectively reducing the time it takes for the reversing image to be displayed. Moreover, unlike the traditional main operating system's method of obtaining image information at the application layer, the reversing image processing routine running on the real-time operating system can obtain image information of the camera device more directly and quickly through the real-time task processing unit.

[0083] Figure 6 A method flow chart of a method for processing a reverse image provided by another embodiment of the present application. The present application embodiment is applied to an electronic computing system integrated with a main processing unit and a real-time task processing unit. The electronic computing system is configured to: in response to the power supply being turned on, execute a boot loading operation, and start a main operating system running on the main processing unit through the boot loading operation. Figure 6 As shown, the method for processing the reversing image includes the following steps:

[0084] S610: While starting the main operating system running on the main processing unit, also start the real-time operating system running on the real-time task processing unit through a boot loading operation.

[0085] Among them, the startup time of the real-time operating system is shorter than that of the main operating system.

[0086] The display priority of the real-time operating system is higher than that of the main operating system, so that the reversing image information is displayed first.

[0087] It is understandable that since the real-time operating system (FreeRTOS) has the characteristics of lightweight, high efficiency, strong real-time performance and short startup time, the startup time of the real-time operating system is short, while the startup time of the main operating system is long. Therefore, the startup time of the real-time operating system is shorter than that of the main operating system.

[0088] It should be noted that both the main operating system and the real-time operating system can display the reversing image information through the vehicle's display device. However, since the display priority of the real-time operating system is set higher than that of the main operating system, the reversing image information processed by the real-time operating system is displayed in the vehicle's display device in priority to the reversing image information processed by the main operating system.

[0089] S620: In response to the vehicle moving backward, initializing several reversing image processing resources.

[0090] In some embodiments, the reversing image processing resources include: image display data and camera device data; wherein the image display data includes: resolution, refresh rate, color and contrast.

[0091] As an example but not limitation, the image display data may also include: brightness and color temperature, and may also include other image display data, which are not limited here.

[0092] The camera device data includes but is not limited to: pixel frame size, pixel format, and input and output interfaces. For example, the pixel frame size is: 1080*720, and the pixel format is: RGB format.

[0093] S630: Establish an image information transmission link between the real-time operating system and the camera device.

[0094] It should be noted that the image information transmission link is used to transmit the image information of the rear of the vehicle collected by the camera device to the reversing image processing routine.

[0095] S640: When the vehicle moves backward, the real-time operating system generates current reversing image information using the image information obtained through the image information transmission link.

[0096] In some embodiments, the image information obtained through the image information transmission link is used to generate the current reversing image information through a real-time operating system, specifically including: S651, receiving image information from a camera device based on the image information transmission link through a real-time operating system; S652, providing image information to an image processing device through a real-time operating system; S653, receiving reversing image information fed back by the image processing device through a real-time operating system.

[0097] The image processing device is used to process the image information from the camera device into reversing image information.

[0098] The image processing methods used by the image processing device include but are not limited to smoothing filtering, denoising, artifact removal and contrast enhancement.

[0099] S650: Display the reversing image information generated by the reversing image processing routine.

[0100] Specifically, displaying the reversing image information generated by the reversing image processing routine specifically includes: transmitting the reversing image information to a display device of the vehicle through the reversing image processing routine, so that a display screen of the display device is updated.

[0101] At least one advantageous aspect of the method for processing a reversing image provided by the embodiment of the present application is that: since the startup time of a real-time operating system is significantly shortened compared to a traditional main operating system, setting the reversing image processing routine to run in a real-time operating system can enable the reversing image processing routine to respond and run more quickly after a cold start, initialize several types of reversing image processing resources, and timely generate and display the current reversing image information through the image information transmission link during the vehicle's reversing process, effectively reducing the length of time the reversing image waits to be displayed. Moreover, unlike the traditional main operating system's way of obtaining image information at the application layer, the reversing image processing routine running on the real-time operating system can obtain the image information of the camera device more directly and quickly through the real-time task processing unit.

[0102] It should be noted that the embodiment of the present application shows the application scenario of the backing image processing method in the backing of a vehicle for the sake of simplicity and example. However, those skilled in the art can understand that based on similar principles, the backing image processing method provided in the embodiment of the present application can also be applied to other application scenarios for fast display of images. The inventive concept disclosed in the embodiment of the present application is not limited to the application scenario of the backing image processing method in the backing of a vehicle. Figure 4 The vehicle application shown can also be used in other similar devices that require rapid image display.

[0103] The embodiment of the present application also provides a computer-readable storage medium. The computer-readable storage medium may be a non-volatile computer-readable storage medium. The computer-readable storage medium stores a computer program.

[0104] When the computer program is executed by the processor, one or more steps of the method for processing the reversing image disclosed in the embodiment of the present application are implemented. The complete computer program product is embodied in one or more computer-readable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing the computer program disclosed in the embodiment of the present application.

[0105] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit them. Under the concept of the present invention, the technical features in the above embodiments or different embodiments may also be combined, the steps may be implemented in any order, and there are many other changes in different aspects of the present invention as described above, which are not provided in detail for the sake of simplicity. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they may still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for processing a reverse image, applied to an electronic computing system integrating a main processing unit and a real-time task processing unit, wherein the electronic computing system is configured to: in response to a power-on situation, execute a boot loading operation, and start a main operating system running on the main processing unit through the boot loading operation, characterized in that: include: While starting the main operating system running on the main processing unit, also starting the real-time operating system running on the real-time task processing unit through the boot loading operation; In response to the situation that the vehicle moves backward, a reversing image processing routine is run on a real-time operating system that has been started; the startup time of the real-time operating system is shorter than that of the main operating system; Displaying the reversing image information generated by the reversing image processing routine; The reversing image processing routine is configured to directly obtain image information from a camera device through the real-time task processing unit, and generate current reversing image information according to the image information.

2. The processing method according to claim 1, characterized in that: The running of the reversing image processing routine on the started real-time operating system specifically includes: Initialize several reversing image processing resources; Establishing an image information transmission link between the real-time operating system and the camera device; When the vehicle moves backward, the real-time operating system generates the current reversing image information using the image information obtained through the image information transmission link.

3. The processing method according to claim 2, characterized in that: The step of generating the current reversing image information from the image information obtained through the image information transmission link through the real-time operating system specifically includes: Receiving the image information from the camera device via the real-time operating system based on the image information transmission link; Providing the image information to an image processing device through the real-time operating system; The reversing image information fed back by the image processing device is received through the real-time operating system.

4. The processing method according to claim 2, characterized in that: The reversing image processing resources include: image display data and camera device data; The image display data includes: resolution, refresh rate, color and contrast.

5. The processing method according to claim 1, characterized in that: The display priority of the real-time operating system is higher than that of the main operating system, so that the reversing image information is displayed first.

6. The processing method according to claim 5, characterized in that: The boot loading operation includes: Initialize and set up the system environment; Load the driver kernel; The driver kernel is started and run.

7. A vehicle-mounted platform, characterized in that: include: Electronic computing systems; The electronic computing system is integrated with a main processing unit and a real-time task processing unit; Main operating system; The main operating system runs on the main processing unit; Real-time operating system; the real-time operating system runs on the real-time task processing unit; A reversing image processing routine; the reversing image processing routine runs in the real-time operating system and is configured to: when the vehicle is reversing, directly obtain image information from the camera device through the real-time task processing unit, and generate current reversing image information according to the image information; Wherein, when the power of the electronic computing system is turned on, the main operating system and the real-time operating system are started; and the startup time of the real-time operating system is shorter than that of the main operating system.

8. The vehicle-mounted platform according to claim 7, characterized in that: The reversing image processing routine is specifically used for: Detect whether the vehicle is moving backwards; When the vehicle moves backward, obtaining image information from a camera device; providing the acquired image information to an image processing device; receiving the reversing image information from the image processing device; The reverse image information is provided to a display device so that a display screen of the display device is updated.

9. The vehicle-mounted platform according to claim 7, characterized in that: The vehicle-mounted platform also includes: a virtual middle layer; Wherein, the virtual intermediate layer is configured as follows: the main operating system and the real-time operating system share one or more hardware devices; The hardware equipment includes: a camera device, a display device and an image processing device.

10. The vehicle-mounted platform according to claim 9, characterized in that: The electronic computing system is configured to: when the power is turned on, perform a boot loading operation to start the main operating system and the real-time operating system; The boot loading operation includes: initializing and setting the system environment; loading the driver kernel and starting and running the driver kernel.

11. The vehicle-mounted platform according to claim 10, characterized in that: Before the reversing image processing routine is enabled, the method further includes: Initialization of several reversing image processing resources; and Establishing an image information transmission link with the camera device; The reversing image processing resources include: image display data and camera equipment data.

12. The vehicle-mounted platform according to claim 11, characterized in that: The driver kernel is configured to initialize the image display data; the image display data includes resolution, refresh rate, color and contrast; the real-time operating system is configured to initialize the camera device data.

13. A vehicle, characterized in that: include: A camera device, the camera device is used to: obtain image information behind the vehicle; A display device, the display device is used to: display image information; The vehicle-mounted platform as described in claims 7-12; Wherein, when the vehicle is in a reverse state, the current reverse image information is displayed on the display device through the operation of the reverse image processing routine in the real-time operating system of the vehicle-mounted platform; The reversing image information is obtained by processing the image information behind the vehicle.