Electronic rearview mirror image processing method and device, vehicle and storage medium

By integrating the image processing of the electronic rearview mirror into the vehicle domain controller and utilizing the gigabit multimedia serial link and cockpit control service frequency to process images, the problems of vehicle cost and structural complexity in existing technologies are solved, and more efficient image processing and hardware optimization are achieved.

CN120697660APending Publication Date: 2025-09-26CHONGQING SELIS PHOENIX INTELLIGENT INNOVATION TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410344685.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-03-25
Publication Date
2025-09-26

AI Technical Summary

Technical Problem

In existing electronic rearview mirror solutions, the independent processing modules of the camera and controller increase the cost and structural complexity of the vehicle.

Method used

The image processing of the electronic rearview mirror is incorporated into the vehicle domain controller, which receives real-time images through a gigabit multimedia serial link, processes them based on the cockpit control service frequency, generates target images, combines them with the cockpit control service, and sends them to the cockpit display components.

Benefits of technology

It reduces the complexity of the vehicle's structural layout and hardware complexity, reduces redundancy, and improves the efficiency of image processing and the hardware performance of the vehicle.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120697660A_ABST
    Figure CN120697660A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides an electronic rearview mirror image processing method and device, a vehicle and a storage medium. The method comprises the steps that a real-time image sent by an electronic rearview mirror is received; processing the real-time image based on the frequency of the cabin control service to generate a target image; combining the target image with the cabin control service to obtain an updated cabin control service; and sending the updated cabin control service to a cabin display component. According to the method, the electronic rearview mirror image is processed through domain control integration, the complexity of whole vehicle structure arrangement can be reduced, and meanwhile the hardware complexity and redundancy of a whole vehicle are reduced.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of vehicle electronic rearview mirrors, and in particular to an electronic rearview mirror image processing method, an electronic rearview mirror image processing device, a vehicle, and a storage medium. Background Art

[0002] An electronic rearview mirror uses a camera to capture the vehicle's rearview area, a controller to process the video, and then displays it on a display screen. Currently, mature electronic rearview mirror solutions on the market use cameras mounted on the mirror to capture the area behind the vehicle, and a separate controller to collect and process the camera data and transmit the video data to the display screen for display. Existing solutions use a separate processing module, which increases vehicle cost and complicates the overall vehicle structure and installation. Summary of the Invention

[0003] In view of the above problems, embodiments of the present invention are proposed to provide an electronic rearview mirror image processing method, an electronic rearview mirror image processing device, a vehicle and a storage medium that overcome the above problems or at least partially solve the above problems.

[0004] To solve the above problems, in a first aspect of the present invention, an embodiment of the present invention discloses an electronic rearview mirror image processing method, which is applied to a vehicle domain controller, wherein the vehicle domain controller is used to process cockpit control services and generate cockpit control information; the method comprises:

[0005] Receive real-time images sent by the electronic rearview mirror;

[0006] processing the real-time image based on the frequency of the cockpit control service to generate a target image;

[0007] combining the target image with the cockpit control service to obtain an updated cockpit control service;

[0008] The updated cockpit control service is sent to the cockpit display component.

[0009] Optionally, the vehicle domain controller is provided with a gigabit multimedia serial link, and the step of receiving the real-time image sent by the electronic rearview mirror includes:

[0010] The real-time image sent by the electronic rearview mirror is received via the gigabit multimedia serial link.

[0011] Optionally, the step of processing the real-time image based on the frequency of the cockpit control service to generate a target image includes:

[0012] caching the real-time image;

[0013] Based on the frequency of the cockpit control service, the real-time image is read and image post-processed to generate the target image.

[0014] Optionally, the step of combining the target image with the cockpit control service to obtain updated cockpit control information includes:

[0015] Synchronizing the target image with the cockpit control service to generate a synchronized image;

[0016] The synchronized image is associated with the cockpit control service to obtain the updated cockpit control information.

[0017] Optionally, the method further includes:

[0018] Detect vehicle operating parameters;

[0019] Determining a vehicle usage scenario based on the vehicle operating condition parameters;

[0020] Based on the correlation between the vehicle usage scenario and the target image;

[0021] The priority of the updated cockpit control service is determined based on the correlation degree.

[0022] Optionally, the method further includes:

[0023] determining vehicle side information based on the target image;

[0024] The vehicle side information is used for driving operations.

[0025] Optionally, the method further includes:

[0026] Perform frame extraction processing on the real-time image to update the real-time image.

[0027] In a second aspect of the present invention, an embodiment of the present invention discloses an electronic rearview mirror image processing device, which is applied to a vehicle domain controller, wherein the vehicle domain controller is used to process cockpit control services and generate cockpit control information; the device includes:

[0028] A receiving module, used for receiving real-time images sent by the electronic rearview mirror;

[0029] a target image generation module, configured to process the real-time image based on the frequency of the cockpit control service to generate a target image;

[0030] a combining module, configured to combine the target image with the cockpit control service to obtain an updated cockpit control service;

[0031] The sending module is used to send the updated cockpit control service to the cockpit display component.

[0032] In the third aspect of the present invention, an embodiment of the present invention discloses a vehicle, including a processor, a memory, and a computer program stored in the memory and capable of running on the processor, wherein the computer program implements the electronic rearview mirror image processing method as described above when executed by the processor.

[0033] In a fourth aspect of the present invention, an embodiment of the present invention discloses a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the electronic rearview mirror image processing method as described above is implemented.

[0034] The embodiments of the present invention include the following advantages:

[0035] This embodiment of the present invention receives a real-time image from an electronic rearview mirror; processes the real-time image based on the frequency of the cabin control service to generate a target image; combines the target image with the cabin control service to obtain an updated cabin control service; and transmits the updated cabin control service to the cabin display component. The real-time image from the electronic rearview mirror is used as processing information in the vehicle domain controller, which processes it in conjunction with the cabin control service. This integrates the control of the electronic rearview mirror into the domain controller, reducing the complexity of the vehicle's overall structural layout, as well as the hardware complexity and redundancy. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Figure 1 is a flowchart of an embodiment of an electronic rearview mirror image processing method of the present invention;

[0037] Figure 2 is a flowchart of another embodiment of an electronic rearview mirror image processing method of the present invention;

[0038] Figure 3 1 is a schematic diagram of an example of an electronic rearview mirror image processing method of the present invention;

[0039] Figure 4 is a schematic diagram of an execution flow of an example of an electronic rearview mirror image processing method of the present invention;

[0040] Figure 5 This is a structural block diagram of an embodiment of an electronic rearview mirror image processing device of the present invention;

[0041] Figure 6 This is a structural block diagram of a vehicle provided by an embodiment of the present invention;

[0042] Figure 7This is a structural block diagram of a storage medium provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0043] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.

[0044] Reference Figure 1 , shows a step flow chart of an embodiment of an electronic rearview mirror image processing method of the present invention, wherein the electronic rearview mirror image processing method is applied to a vehicle domain controller, which is used to process cockpit control services and generate cockpit control information.

[0045] The electronic rearview mirror image processing method may specifically include the following steps:

[0046] Step 101, receiving a real-time image sent by an electronic rearview mirror;

[0047] After the vehicle is powered on, it can receive real-time images sent by the electronic rearview mirror. The real-time images are collected and generated by the electronic rearview mirror for the side and rear area of ​​the vehicle.

[0048] Step 102: Process the real-time image based on the frequency of the cockpit control service to generate a target image;

[0049] Based on the frequency of the cockpit control service, the real-time image is processed to generate a target image so that it can be synchronized with other signals of the cockpit control service.

[0050] Step 103: combining the target image with the cockpit control service to obtain an updated cockpit control service;

[0051] The target image can be combined with the cockpit control service so that the cockpit control service can include the target image, and the vehicle domain controller can process it as its transaction. After combining the cockpit control service with the target image, an updated cockpit control service is obtained.

[0052] Step 104: Send the updated cockpit control service to the cockpit display component.

[0053] The updated cockpit control service can be processed and sent to the cockpit display component. The cockpit display component can display the image in the cockpit control service so that the user can view the image corresponding to the electronic rearview mirror on the cockpit display component, thereby realizing the function of the electronic rearview mirror.

[0054] This embodiment of the present invention receives a real-time image from an electronic rearview mirror; processes the real-time image based on the frequency of the cabin control service to generate a target image; combines the target image with the cabin control service to obtain an updated cabin control service; and transmits the updated cabin control service to the cabin display component. The real-time image from the electronic rearview mirror is used as processing information in the vehicle domain controller, which processes it in conjunction with the cabin control service. This integrates the control of the electronic rearview mirror into the domain controller, reducing the complexity of the vehicle's overall structural layout, as well as the hardware complexity and redundancy.

[0055] Reference Figure 2 , shows a step flow chart of another embodiment of an electronic rearview mirror image processing method of the present invention, wherein the electronic rearview mirror image processing method is applied to a vehicle domain controller, which is used to process cockpit control services and generate cockpit control information.

[0056] The vehicle domain controller can be a processor integrated with the domain controller, which can process the cockpit control business and generate cockpit control information. In order to protect the security of the vehicle domain controller, the system security can be protected by using authentication and authorization mechanisms, such as single sign-on, access control lists, etc. For example, single sign-on allows users to log in to multiple related but independent software systems or applications using a set of credentials (such as user name and password). With single sign-on, users only need to log in once to access all related systems without having to repeatedly enter credentials, which improves user experience and security. An access control list is a list used to control user or system access rights to resources. It limits or controls access to resources by defining who can access specific resources and how to access them. It is usually configured and managed by system administrators or resource owners and can be modified and updated as needed to ensure the security and protection of resources.

[0057] The electronic rearview mirror image processing method may specifically include the following steps:

[0058] Step 201, receiving a real-time image sent by an electronic rearview mirror;

[0059] After the electronic rearview mirror captures the real-time image, it can send the real-time image to the vehicle domain controller. The vehicle domain controller can receive the real-time image sent by the electronic rearview mirror.

[0060] The real-time image may also be sent in the form of a video stream, which is not limited in the embodiment of the present invention.

[0061] Specifically, the vehicle domain controller is provided with a gigabit multimedia serial link, and the step of receiving the real-time image sent by the electronic rearview mirror includes: receiving the real-time image sent by the electronic rearview mirror through the gigabit multimedia serial link.

[0062] Gigabit multimedia serial link is a serial communication interface technology used for high-speed data transmission. It can support data transmission at gigabits per second, meet the demand for high-speed data transmission, support multiple transmission modes and protocols, and can be configured and adjusted according to actual needs. It is suitable for different data transmission scenarios. Compared with parallel transmission methods, serial links can reduce wiring complexity, reduce system costs and power consumption.

[0063] The real-time image sent by the electronic rearview mirror can be received based on a gigabit multimedia serial link, so that the real-time image can be received in real time and with low delay.

[0064] Step 202: performing frame extraction processing on the real-time image to update the real-time image;

[0065] After obtaining the real-time image, the real-time image can be subjected to frame extraction processing. By frame extraction processing, the complexity and energy consumption of calculating the real-time image are reduced, so that it meets the conditions for electronic rearview mirror image recognition, and the image quality is enhanced, making the picture clearer and more vivid, so as to update the real-time image.

[0066] Step 203: Process the real-time image based on the frequency of the cockpit control service to generate a target image;

[0067] Based on the frequency of the cockpit control service, the real-time image can be processed, the interference information in the real-time image can be filtered out, and the target image can be obtained.

[0068] Specifically, the step of processing the real-time image based on the frequency of the cockpit control service to generate the target image includes: caching the real-time image; and reading the real-time image based on the frequency of the cockpit control service to perform image post-processing to generate the target image.

[0069] In an embodiment of the present invention, real-time images can be cached in the memory space corresponding to the vehicle domain controller. Based on the frequency of the cabin control service, the real-time images are read from the corresponding memory space for image post-processing, such as noise reduction, white balance, color correction, contrast enhancement, sharpening, etc., to improve the quality of the real-time images and generate the target image.

[0070] Image noise reduction is the process of removing noise from an image to make it clearer, easier to analyze, and easier to understand. This includes, but is not limited to, mean filtering, Gaussian filtering, and median filtering. White balance is the process of adjusting the color temperature in an image so that white objects appear true white under different light sources, avoiding color casts caused by different light source color temperatures. Color correction is the process of adjusting the color of an image so that the colors in the image more realistically and accurately reflect the colors of the original scene. Contrast enhancement is the process of adjusting the brightness differences of pixels in an image to increase the contrast of the image, making the image clearer and the details more prominent. Sharpening is the process of enhancing the edges and details in an image to make the image clearer, including, but not limited to, Laplace transforms and unsharp masking.

[0071] Step 204: combining the target image with the cockpit control service to obtain an updated cockpit control service;

[0072] The target image can then be combined with the cockpit control service so that the vehicle domain controller can process the image of the electronic rearview mirror to obtain an updated cockpit control service.

[0073] Specifically, the step of combining the target image with the cockpit control service to obtain updated cockpit control information includes: synchronizing the target image with the cockpit control service to generate a synchronized image; and associating the synchronized image with the cockpit control service to obtain the updated cockpit control information.

[0074] The target image can be synchronized with the cockpit control business to generate a synchronized image; ensure that the data of the electronic rearview mirror is consistent with the cockpit control business through real-time or periodic data synchronization operations.

[0075] The data synchronization mechanism operates as follows: Determine data synchronization requirements: First, clarify the data synchronization requirements, including the data source, target system, synchronization frequency, and synchronization method. The scope and objectives of data synchronization are then determined based on these requirements. Data extraction: Before data synchronization begins, the data to be synchronized must be extracted from the source system. This step typically includes connecting to the source system, querying data, and extracting data. Data conversion: The extracted data may require conversion, cleansing, and formatting to ensure compatibility and consistency between different systems. Data conversion can include operations such as data format conversion, data field mapping, and data cleansing. Data loading: The converted data will be loaded into the target system. During the data loading process, considerations must be made to ensure data integrity, uniqueness, and consistency in the target system. Data synchronization: Depending on the data synchronization method, the converted data is synchronized to the target system. Real-time synchronization, scheduled synchronization, and incremental synchronization can be used to ensure data synchronization and consistency between the source and target systems.

[0076] Data verification: After data synchronization is completed, the synchronized data needs to be verified to ensure the integrity and correctness of the data in the target system. Data comparison, verification, and validation can be performed.

[0077] Monitoring and management: During the data synchronization process, it is necessary to monitor the execution of synchronization tasks and the status of data synchronization, handle abnormal situations in the synchronization process in a timely manner, and manage the scheduling, configuration, and permissions of synchronization tasks.

[0078] Logging and backup: To track the history of data synchronization and fault recovery, it is necessary to record data synchronization log information and regularly back up the synchronized data. Logging and backup can help with fault recovery and data recovery during the data synchronization process.

[0079] The synchronized image is then associated with the cockpit control service to obtain updated cockpit control information.

[0080] In addition, in order to ensure data synchronization, data middleware can be set up to transmit and convert real-time images in the cockpit control business.

[0081] Furthermore, in the embodiment of the present invention, the following steps may be further included:

[0082] Step S1, detecting vehicle operating parameters;

[0083] The vehicle domain controller can collect various operating status data on the vehicle and determine the vehicle operating parameters corresponding to the current operating condition of the vehicle.

[0084] Step S2, determining a vehicle usage scenario based on the vehicle operating condition parameters;

[0085] The vehicle's current usage scenario is determined based on the vehicle's operating parameters. For example, if the speed in the vehicle's operating parameters is zero, the vehicle's usage scenario is parking. If the steering wheel angle and vehicle speed in the vehicle's operating parameters are both non-zero, the vehicle's usage scenario is turning.

[0086] Step S3, according to the correlation between the vehicle usage scene and the target image;

[0087] The importance of using the target image in the vehicle usage scenario can be determined, thereby determining the relevance. For example, when the vehicle is parked, the relevance is low because the target image does not need to be paid attention to. However, when the vehicle is turning, the relevance is high because the target image needs to be paid attention to at all times.

[0088] Step S4: determining the priority of the updated cockpit control service based on the correlation degree.

[0089] The priority of the updated cockpit control service is determined according to the corresponding correlation degree. The higher the correlation degree, the higher the priority.

[0090] Step 205: Send the updated cockpit control service to the cockpit display component.

[0091] After obtaining the updated cockpit control service, the updated cockpit control service is processed based on the processing content of the updated cockpit control service and sent to the cockpit display component for display.

[0092] Furthermore, the target image can also be used in driving services, which are services for active / load controlled vehicle movement. The method further includes:

[0093] Step S3, determining vehicle side information based on the target image;

[0094] The vehicle side information can be determined based on the image features in the target image, such as the vehicle coming from behind and the distance to other vehicles.

[0095] Step S4: Using the vehicle side information to perform driving operations.

[0096] Driving services are performed based on the obtained vehicle side information, so that the vehicle domain controller can use the images collected by the electronic rearview mirror to apply to the driving services, so that the driving services obtain more data and the business processing is more accurate.

[0097] In addition, as a core system, the vehicle domain controller needs to process a large number of requests and data, so integrating other modules may affect the performance of the system. The performance of the vehicle domain controller can be improved by optimizing algorithms, using caches, and distributed deployment. The optimization algorithm can reduce the time complexity and space complexity of the system by selecting appropriate data structures and algorithms. For example, for search algorithms, binary search can be used instead of linear search. For sorting algorithms, more efficient algorithms such as quick sort or merge sort can be selected. Efficient algorithms such as dynamic programming and greedy algorithms can be used to solve problems and reduce unnecessary calculations and memory consumption. Using cache means caching hot data in memory to reduce frequent access to databases or other resources. Memory cache can be used to improve system performance. Methods such as cache preheating and cache invalidation strategies can be used to improve cache hit rates and reduce cache penetration and cache breakdown problems.

[0098] The embodiment of the present invention receives a real-time image sent by an electronic rearview mirror; processes the real-time image based on the frequency of the cockpit control service to generate a target image; combines the target image with the cockpit control service to obtain an updated cockpit control service; and sends the updated cockpit control service to the cockpit display component. The real-time image sent by the electronic rearview mirror is used as processing information in the vehicle domain controller, and is processed by the vehicle domain controller together with the cockpit control service, thereby incorporating the control of the electronic rearview mirror into the domain control processing; reducing the complexity of the overall vehicle structure layout, while also reducing the hardware complexity and redundancy of the entire vehicle; through domain control integration, the domain control's large computing power platform is fully utilized to improve the image effect and related functional performance of the electronic exterior rearview mirror.

[0099] In order to enable those skilled in the art to update the implementation process of the embodiment of the present invention, an example is used below to illustrate:

[0100] Reference Figure 3 After the CMS (central monitoring system camera) captures the image of the side rearview area, it transmits the serial image data to the vehicle domain controller through two LVDS (low voltage differential signal) video lines; the vehicle domain controller receives the serial data image from the camera and performs frame processing, and then uses LVDS to transmit the video processing results to the display screen for display according to the requirements of the electronic rearview mirror, imaging the vehicle's external rearview area for the driver to view.

[0101] For the image processing process of the vehicle domain controller, please refer to Figure 4 The CMS camera first passes through the Gigabit Multimedia Serial Link (GMSL), then enters the image receiving link (MIPI RX), then enters the chip memory (CIM DMA), then enters the image signal processing module (ISP), and finally enters the image cropping module (PYM). After calling the chip processor (GDC) interface to complete image cropping, resizing, and dedistortion, it enters the vision_module module and finally outputs the video to the display via LVDS.

[0102] It should be noted that for the sake of simplicity, the method embodiments are described as a series of actions. However, those skilled in the art should be aware that the embodiments of the present invention are not limited by the order of the actions described, because according to the embodiments of the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in this specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

[0103] Reference Figure 5, shows a structural block diagram of an embodiment of an electronic rearview mirror image processing device of the present invention. The electronic rearview mirror image processing device is applied to a vehicle domain controller, which is used to process cockpit control services and generate cockpit control information. The electronic rearview mirror image processing device may specifically include the following modules:

[0104] Receiving module 501, for receiving real-time images sent by the electronic rearview mirror;

[0105] A target image generating module 502 is configured to process the real-time image based on the frequency of the cockpit control service to generate a target image;

[0106] A combining module 503 is configured to combine the target image with the cockpit control service to obtain an updated cockpit control service;

[0107] The sending module 504 is configured to send the updated cockpit control service to the cockpit display component.

[0108] In an optional embodiment of the present invention, the vehicle domain controller is provided with a gigabit multimedia serial link, and the receiving module 501 includes:

[0109] The receiving submodule is used to receive the real-time image sent by the electronic rearview mirror through the gigabit multimedia serial link.

[0110] In an optional embodiment of the present invention, the target image generation module 502 includes:

[0111] A cache submodule, configured to cache the real-time image;

[0112] The post-processing submodule is used to read the real-time image based on the frequency of the cockpit control service, perform image post-processing, and generate the target image.

[0113] In an optional embodiment of the present invention, the combining module 503 includes:

[0114] a synchronization submodule, configured to synchronize the target image with the cockpit control service to generate a synchronized image;

[0115] The association submodule is configured to associate the synchronized image with the cockpit control service to obtain the updated cockpit control information.

[0116] In an optional embodiment of the present invention, the device further comprises:

[0117] Working condition detection module, used to detect vehicle working condition parameters;

[0118] A vehicle usage scenario determination module, configured to determine a vehicle usage scenario based on the vehicle operating condition parameters;

[0119] a correlation determination module, configured to determine the correlation between the vehicle usage scenario and the target image;

[0120] A priority determination module is used to determine the priority of the updated cockpit control service based on the correlation degree.

[0121] In an optional embodiment of the present invention, the device further comprises:

[0122] A vehicle side information determination module, configured to determine the vehicle side information based on the target image;

[0123] A driving service processing module is used to perform driving services using the vehicle side information.

[0124] In an optional embodiment of the present invention, the device further comprises:

[0125] The frame extraction module is used to perform frame extraction processing on the real-time image to update the real-time image.

[0126] This embodiment of the present invention receives a real-time image from an electronic rearview mirror; processes the real-time image based on the frequency of the cabin control service to generate a target image; combines the target image with the cabin control service to obtain an updated cabin control service; and transmits the updated cabin control service to the cabin display component. The real-time image from the electronic rearview mirror is used as processing information in the vehicle domain controller, which processes it in conjunction with the cabin control service. This integrates the control of the electronic rearview mirror into the domain controller, reducing the complexity of the vehicle's overall structural layout, as well as the hardware complexity and redundancy.

[0127] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0128] Reference Figure 6 , an embodiment of the present invention further provides a vehicle, comprising:

[0129] A processor 601 and a storage medium 602, wherein the storage medium 602 stores a computer program executable by the processor 601. When the vehicle is running, the processor 601 executes the computer program to implement the electronic rearview mirror image processing method as described in any one of the embodiments of the present invention.

[0130] The electronic rearview mirror image processing method is applied to a vehicle domain controller, which is used to process cockpit control services and generate cockpit control information. The method includes:

[0131] Receive real-time images sent by the electronic rearview mirror;

[0132] processing the real-time image based on the frequency of the cockpit control service to generate a target image;

[0133] combining the target image with the cockpit control service to obtain an updated cockpit control service;

[0134] The updated cockpit control service is sent to the cockpit display component.

[0135] Optionally, the vehicle domain controller is provided with a gigabit multimedia serial link, and the step of receiving the real-time image sent by the electronic rearview mirror includes:

[0136] The real-time image sent by the electronic rearview mirror is received via the gigabit multimedia serial link.

[0137] Optionally, the step of processing the real-time image based on the frequency of the cockpit control service to generate a target image includes:

[0138] caching the real-time image;

[0139] Based on the frequency of the cockpit control service, the real-time image is read and image post-processed to generate the target image.

[0140] Optionally, the step of combining the target image with the cockpit control service to obtain updated cockpit control information includes:

[0141] Synchronizing the target image with the cockpit control service to generate a synchronized image;

[0142] The synchronized image is associated with the cockpit control service to obtain the updated cockpit control information.

[0143] Optionally, the method further includes:

[0144] Detect vehicle operating parameters;

[0145] Determining a vehicle usage scenario based on the vehicle operating condition parameters;

[0146] Based on the correlation between the vehicle usage scenario and the target image;

[0147] The priority of the updated cockpit control service is determined based on the correlation degree.

[0148] Optionally, the method further includes:

[0149] determining vehicle side information based on the target image;

[0150] The vehicle side information is used for driving operations.

[0151] Optionally, the method further includes:

[0152] Perform frame extraction processing on the real-time image to update the real-time image.

[0153] This embodiment of the present invention receives a real-time image from an electronic rearview mirror; processes the real-time image based on the frequency of the cabin control service to generate a target image; combines the target image with the cabin control service to obtain an updated cabin control service; and transmits the updated cabin control service to the cabin display component. The real-time image from the electronic rearview mirror is used as processing information in the vehicle domain controller, which processes it in conjunction with the cabin control service. This integrates the control of the electronic rearview mirror into the domain controller, reducing the complexity of the vehicle's overall structural layout, as well as the hardware complexity and redundancy.

[0154] The memory may include random access memory (RAM) or non-volatile memory, such as at least one disk storage. Alternatively, the memory may be at least one storage device located away from the processor.

[0155] The above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, and discrete hardware components.

[0156] Reference Figure 7 An embodiment of the present invention further provides a computer-readable storage medium 701, on which a computer program is stored. When the computer program is run by a processor, the electronic rearview mirror image processing method as described in any one of the embodiments of the present invention is executed.

[0157] The electronic rearview mirror image processing method is applied to a vehicle domain controller, which is used to process cockpit control services and generate cockpit control information. The method includes:

[0158] Receive real-time images sent by the electronic rearview mirror;

[0159] processing the real-time image based on the frequency of the cockpit control service to generate a target image;

[0160] combining the target image with the cockpit control service to obtain an updated cockpit control service;

[0161] The updated cockpit control service is sent to the cockpit display component.

[0162] Optionally, the vehicle domain controller is provided with a gigabit multimedia serial link, and the step of receiving the real-time image sent by the electronic rearview mirror includes:

[0163] The real-time image sent by the electronic rearview mirror is received via the gigabit multimedia serial link.

[0164] Optionally, the step of processing the real-time image based on the frequency of the cockpit control service to generate a target image includes:

[0165] caching the real-time image;

[0166] Based on the frequency of the cockpit control service, the real-time image is read and image post-processed to generate the target image.

[0167] Optionally, the step of combining the target image with the cockpit control service to obtain updated cockpit control information includes:

[0168] Synchronizing the target image with the cockpit control service to generate a synchronized image;

[0169] The synchronized image is associated with the cockpit control service to obtain the updated cockpit control information.

[0170] Optionally, the method further includes:

[0171] Detect vehicle operating parameters;

[0172] Determining a vehicle usage scenario based on the vehicle operating condition parameters;

[0173] Based on the correlation between the vehicle usage scenario and the target image;

[0174] The priority of the updated cockpit control service is determined based on the correlation degree.

[0175] Optionally, the method further includes:

[0176] determining vehicle side information based on the target image;

[0177] The vehicle side information is used for driving operations.

[0178] Optionally, the method further includes:

[0179] Perform frame extraction processing on the real-time image to update the real-time image.

[0180] This embodiment of the present invention receives a real-time image from an electronic rearview mirror; processes the real-time image based on the frequency of the cabin control service to generate a target image; combines the target image with the cabin control service to obtain an updated cabin control service; and transmits the updated cabin control service to the cabin display component. The real-time image from the electronic rearview mirror is used as processing information in the vehicle domain controller, which processes it in conjunction with the cabin control service. This integrates the control of the electronic rearview mirror into the domain controller, reducing the complexity of the vehicle's overall structural layout, as well as the hardware complexity and redundancy.

[0181] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0182] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, apparatus, or computer program products. Thus, embodiments of the present invention may take the form of a fully hardware embodiment, a fully software embodiment, or an embodiment combining software and hardware. Furthermore, embodiments of the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0183] The embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the process in the flowchart and / or block diagram. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0184] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.

[0185] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0186] Although the preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they become aware of the basic creative concepts. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present invention.

[0187] Finally, it should be noted that, in this document, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or terminal device that includes a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or terminal device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article, or terminal device that includes the element.

[0188] The above is a detailed introduction to an electronic rearview mirror image processing method, an electronic rearview mirror image processing device, a vehicle and a storage medium provided by the present invention. Specific examples are used herein to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea; at the same time, for general technical personnel in this field, according to the ideas of the present invention, there will be changes in the specific implementation methods and application scopes. In summary, the content of this specification should not be understood as limiting the present invention.

Claims

1. A method for processing an electronic rearview mirror image, characterized in that: Applied to a vehicle domain controller, the vehicle domain controller is used to process cockpit control services and generate cockpit control information; the method includes: Receive real-time images sent by the electronic rearview mirror; processing the real-time image based on the frequency of the cockpit control service to generate a target image; combining the target image with the cockpit control service to obtain an updated cockpit control service; The updated cockpit control service is sent to the cockpit display component.

2. The method according to claim 1, characterized in that The vehicle domain controller is provided with a gigabit multimedia serial link, and the step of receiving the real-time image sent by the electronic rearview mirror includes: The real-time image sent by the electronic rearview mirror is received via the gigabit multimedia serial link.

3. The method according to claim 1, characterized in that The step of processing the real-time image based on the frequency of the cockpit control service to generate a target image includes: caching the real-time image; Based on the frequency of the cockpit control service, the real-time image is read and image post-processed to generate the target image.

4. The method according to claim 1, wherein The step of combining the target image with the cockpit control service to obtain updated cockpit control information includes: Synchronizing the target image with the cockpit control service to generate a synchronized image; The synchronized image is associated with the cockpit control service to obtain the updated cockpit control information.

5. The method according to claim 1, wherein The method further comprises: Detect vehicle operating parameters; Determining a vehicle usage scenario based on the vehicle operating condition parameters; Based on the correlation between the vehicle usage scenario and the target image; The priority of the updated cockpit control service is determined based on the correlation degree.

6. The method according to claim 1, characterized in that The method further comprises: determining vehicle side information based on the target image; The vehicle side information is used for driving operations.

7. The method according to claim 1, characterized in that The method further comprises: Perform frame extraction processing on the real-time image to update the real-time image.

8. An electronic rearview mirror image processing device, characterized in that: Applied to a vehicle domain controller, the vehicle domain controller is used to process cockpit control services and generate cockpit control information; the device includes: A receiving module, used for receiving real-time images sent by the electronic rearview mirror; a target image generation module, configured to process the real-time image based on the frequency of the cockpit control service to generate a target image; a combining module, configured to combine the target image with the cockpit control service to obtain an updated cockpit control service; The sending module is used to send the updated cockpit control service to the cockpit display component.

9. A vehicle, characterized in that: The electronic rearview mirror comprises a processor, a memory, and a computer program stored in the memory and capable of running on the processor, wherein when the computer program is executed by the processor, the steps of the electronic rearview mirror image processing method according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the electronic rearview mirror image processing method according to any one of claims 1 to 7 are implemented.