Data processing method and device based on streaming rearview mirror system and vehicle

Abstract

The application relates to a data processing method and device based on a streaming media rearview mirror system CMS and a vehicle. The method comprises the following steps: a first domain controller receives video information collected by a streaming media rearview mirror camera; the first domain controller processes the video information to generate image data corresponding to the video information; and the first domain controller transmits the image data to a streaming media display screen for display. The scheme provided in the application can reduce system complexity and system cost and improve the processing efficiency of the video information collected by the streaming media rearview mirror camera.

Description

Technical Field

[0001] This application relates to the field of autonomous driving technology, and in particular to data processing methods, devices and vehicles based on streaming media rearview mirror systems. Background Technology

[0002] A streaming rearview mirror system (camera monitor system, CMS) uses an external camera to capture images of the traffic and road conditions behind the car and then transmits them to a real-time traffic display screen. Compared to traditional rearview mirrors, streaming rearview mirror systems avoid the narrow field of view and potential obstruction by other objects inside the car, while also providing the driver with a wider field of vision.

[0003] In related technologies, streaming media rearview mirror solutions typically consist of multiple component systems, including a CMS host, a CMS display screen, a CMS camera, an X-Pilot unit (XPU), and a central domain controller unit (CDCU). This results in a complex architecture and high cost. Therefore, reducing system complexity and cost while improving the system's processing efficiency for video information captured by the streaming media rearview mirror camera has become an urgent technical challenge. Summary of the Invention

[0004] To address or partially address the problems existing in related technologies, this application provides a data processing method, apparatus, and vehicle based on a streaming media rearview mirror system. This method utilizes a domain controller to process video information captured by a streaming media rearview mirror camera, reducing system complexity and cost while improving processing efficiency.

[0005] The first aspect of this application provides a data processing method based on a streaming media rearview mirror system, comprising: a first domain controller receiving video information captured by a streaming media rearview mirror camera; the first domain controller processing the video information to generate image data corresponding to the video information; and the first domain controller transmitting the image data to a streaming media display screen for display via the LVDS.

[0006] In the solution provided in this application, after acquiring video information, the streaming rearview mirror camera no longer transmits the acquired video information to the CMS host via the controller area network (CAN). Instead, it directly transmits the video information to the first domain controller via LVDS. The first domain controller processes the video information and transmits the processed image data to the streaming media display screen for display via LVDS. This eliminates redundant links such as CAN and redundant components such as the CMS host, reducing system complexity and cost, and improving the processing efficiency of the video information acquired by the streaming rearview mirror camera.

[0007] In conjunction with the first aspect, in one possible implementation of the first aspect, the first domain controller processes the video information according to the streaming media rearview mirror calibration algorithm and model to generate image data corresponding to the video information.

[0008] In the solution provided in this application, the first domain controller has a pre-built calibration algorithm and model for the streaming media rearview mirror. This calibration algorithm and model are specifically designed to process the video information collected by the streaming media rearview mirror. Therefore, after receiving the video information transmitted by the streaming media rearview mirror, the first domain controller can directly use the built-in calibration algorithm and model to process it and output the processing result to the display screen for display, thereby reducing system complexity and improving processing efficiency.

[0009] In conjunction with the first aspect, in one possible implementation of the first aspect, before receiving video information collected by the streaming media rearview mirror camera via LVDS, the first domain controller acquires video data collected by the left and right side rearview cameras, wherein the overlap between the acquisition range of the left and right side rearview cameras and the acquisition range of the streaming media rearview mirror camera is greater than a preset threshold; the first domain controller trains the streaming media rearview mirror calibration algorithm and model based on the video data collected by the left and right side rearview cameras.

[0010] In the solution provided in this application, for the needs of driving functions, the first domain controller needs to acquire video data collected by the left and right rearview cameras. Since the acquisition range of the left and right rearview cameras is close to that of the streaming media rearview mirror camera, that is, the overlap of their acquisition ranges is greater than a preset threshold, the first domain controller can directly use the video data acquired by the left and right rearview cameras to train the calibration algorithm and model that need to be built in, thereby avoiding the need to acquire the video data acquired by the streaming media rearview mirror camera again to train the calibration algorithm and model, reducing manual costs and improving training efficiency.

[0011] In conjunction with the first aspect, in one possible implementation of the first aspect, the first domain controller receives a first domain controller upgrade package, the first domain controller upgrade package including an upgrade package for the streaming media rearview mirror camera; the first domain controller uses the upgrade package for the streaming media rearview mirror camera to upgrade the streaming media rearview mirror camera.

[0012] In the solution provided in this application, since the first domain controller is directly connected to the streaming media rearview mirror camera via LVDS, and the first domain controller can process the video information acquired by the streaming media rearview mirror camera using its built-in calibration algorithm and model, when the streaming media rearview mirror camera needs to be upgraded, the upgrade package of the streaming media rearview mirror camera can be directly integrated into the upgrade package of the first domain controller. This reduces the Ethernet link used for upgrading the streaming media rearview mirror camera and eliminates the need to transmit the upgrade package through the CDCU, further reducing system complexity and system cost. Optionally, the first domain controller can be an XPU or a CDCU, or other domain controllers with high computing power.

[0013] A second aspect of this application provides a data processing apparatus, comprising: a receiving module for receiving video information captured by a streaming media rearview mirror camera via an LVDS; a processing module for processing the video information to generate image data corresponding to the video information; and a transmission module for transmitting the image data to a streaming media display screen via the LVDS for display.

[0014] In conjunction with the second aspect, in one possible implementation of the second aspect, the processing module processes the video information according to the streaming media rearview mirror calibration algorithm and model to generate image data corresponding to the video information.

[0015] In conjunction with the second aspect, in one possible implementation of the second aspect, the receiving module is further configured to acquire video data collected by the left and right rearview cameras, wherein the overlap between the acquisition range of the left and right rearview cameras and the acquisition range of the streaming media rearview mirror camera is greater than a preset threshold; the processing module is further configured to train the streaming media rearview mirror calibration algorithm and model based on the video data collected by the left and right rearview cameras.

[0016] In conjunction with the second aspect, in one possible implementation of the second aspect, the receiving module is further configured to receive a first domain controller upgrade package, the first domain controller upgrade package including the upgrade package of the streaming media rearview mirror camera; the processing module is further configured to upgrade the streaming media rearview mirror camera using the upgrade package of the streaming media rearview mirror camera.

[0017] A third aspect of this application provides a vehicle, comprising:

[0018] Processor; and

[0019] A memory having executable code stored thereon, which, when executed by the processor, causes the processor to perform the method described above in the first aspect and any implementation thereof in combination with the first aspect.

[0020] A fourth aspect of this application provides a computer-readable storage medium having executable code stored thereon, which, when executed by a processor of an electronic device, causes the processor to perform the method described in the first aspect and any implementation thereof.

[0021] Based on the implementation methods provided in the above aspects, this application can be further combined to provide more implementation methods.

[0022] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and do not limit this application. Attached Figure Description

[0023] The above and other objects, features and advantages of this application will become more apparent from the following description of exemplary embodiments of this application in conjunction with the accompanying drawings, wherein the same reference numerals generally represent the same components in the exemplary embodiments of this application.

[0024] Figure 1 This is a schematic diagram of the structure of the streaming media rearview mirror system shown in the embodiments of this application;

[0025] Figure 2 This is a schematic diagram illustrating an application scenario as shown in an embodiment of this application;

[0026] Figure 3 This is a schematic diagram of the structure of the data processing system shown in the embodiments of this application;

[0027] Figure 4 This is a schematic flowchart illustrating a data processing method based on a streaming media rearview mirror system according to an embodiment of this application;

[0028] Figure 5 This is a schematic diagram of the structure of the data processing apparatus shown in the embodiments of this application;

[0029] Figure 6 This is a schematic diagram of the vehicle structure shown in the embodiments of this application. Detailed Implementation

[0030] Embodiments of this application will now be described in more detail with reference to the accompanying drawings. While embodiments of this application are shown in the drawings, it should be understood that this application may be implemented in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided to make this application more thorough and complete, and to fully convey the scope of this application to those skilled in the art.

[0031] The terminology used in this application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. The singular forms “a,” “the,” and “the” used in this application and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise. It should also be understood that the term “and / or” as used herein refers to and includes any or all possible combinations of one or more of the associated listed items.

[0032] It should be understood that although the terms "first," "second," "third," etc., may be used in this application to describe various information, this information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another. For example, without departing from the scope of this application, first information may also be referred to as second information, and similarly, second information may also be referred to as first information. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of this application, "multiple" means two or more, unless otherwise explicitly specified.

[0033] First, some of the terms and related technologies used in this application will be explained to facilitate understanding by those skilled in the art.

[0034] A streaming rearview mirror system (CMS) mainly consists of a CMS host, a CMS display screen, a left streaming rearview mirror camera (LCMS), and a right streaming rearview mirror camera (RCMS). The LCMS and RCMS are typically located next to the high-mounted brake light at the rear of the vehicle, used to capture images of traffic conditions and the road behind the car and transmit the captured data to the CMS host. The CMS host, also known as the CMS electronic control unit (CMS ECU), is similar to a regular computer, consisting of a microcontroller (MCU), memory (read-only memory (ROM) and random access memory (RAM)), input / output interfaces (I / O), an analog-to-digital converter (A / D), and large-scale integrated circuits for shaping and driving. The CMS display screen includes both LCMS and RCMS displays, connected to the LCMS ECU and RCMS ECU respectively, used to display the road conditions captured by the LCMS and RCMS in real time.

[0035] An X-Pilotunit (XPU) is a domain controller that integrates multiple functions. It has strong central processing unit (CPU) computing power, graphics processing unit (GPU) computing power, and artificial intelligence (AI) computing power. It runs multiple system-on-chips (SoCs) to achieve different functions.

[0036] A system-on-chip (SoC), also known as a system-on-a-chip, is an integrated circuit with a specific purpose that contains a complete system and all the embedded software.

[0037] The Central Domain Controller Unit (CDCU) is similar to the XPU in that it is a domain controller that can integrate multiple functions. The main difference is that it is responsible for different vehicle functions, and various SoCs also run on the CDCU.

[0038] Controller Area Network (CAN) is a widely used fieldbus. The CAN bus protocol has become the standard bus for automotive computer control systems and embedded industrial control local area networks, characterized by high reliability and excellent error detection capabilities. CAN is a bus-based serial communication network, and its bus structure is divided into two layers: the physical layer and the data link layer (including the Logical Link Control (LLC) sublayer and the Media Access Control (MAC) sublayer). The LLC sublayer provides services for data transmission and remote data requests, while the MAC sublayer's main functions are transmission rules, namely, controlling frame structure, performing arbitration, error checking, error labeling, and fault determination.

[0039] Low-voltage differential signaling (LVDS) is a low-amplitude differential signaling technology that transmits data through a pair of differential PCB traces or balanced cables, enabling serial data transmission at speeds up to several thousand Mbps. Due to the low voltage signal amplitude and constant current source driving mode, it generates extremely low noise and consumes very little power. Furthermore, because LVDS transmits data differentially, it is less susceptible to common-mode noise, making it widely used in high-speed receiving systems.

[0040] Over-the-air (OTA) technology is a technology that uses SMS (Short Message Service) to remotely manage data and applications through the air interface of mobile communication. To implement OTA functionality, a server and a client are required. There is only one server, but multiple clients are possible. The server connects to the clients via a serial port. The image file to be downloaded is stored on the client. A command executor sends commands and the image file. First, the command executor controls the server to broadcast information about currently available image files. After receiving the information, the client compares it with a matching image. If a matching image is found, the client requests the data from the server. Upon receiving the request, the server requests a fixed-size block from the command executor and then transmits it point-to-point to the client. After the image transmission is complete, the client performs verification and sends a termination signal upon completion.

[0041] In the field of vehicle technology, traditional rearview mirrors are generally fixed, resulting in a narrow field of view and easy obstruction by other objects inside the vehicle, thus posing significant safety hazards during daily driving. To overcome these problems, the latest intelligent driving vehicles have installed streaming media rearview mirror systems. These systems use external cameras mounted at the rear of the vehicle to capture real-time images of the traffic and road conditions behind the car, transmitting the data to a real-time traffic display screen inside the vehicle, thereby greatly expanding the field of view of traditional rearview mirrors.

[0042] In related technologies, streaming media rearview mirror systems generally include a CMS host, a CMS display screen, a CMS camera, an XPU, and a CDCU. Their operation is accomplished through the coordinated interaction of these components. Please refer to [link / reference]. Figure 1 , Figure 1 This is a schematic diagram of the structure of a streaming media rearview mirror system shown in an embodiment of this application. Figure 1 As shown, the LCMS and RCMS cameras capture real-time images of the road conditions behind the vehicle and transmit the captured video information via LVDS to the connected LCMS ECU and RCMS ECU, respectively. Upon receiving the video information, the LCMS ECU and RCMS ECU process it using the streaming rearview mirror calibration algorithm and model pre-installed on their respective SoCs, generating relevant image data. This image data is then transmitted via LVDS to the LCMS and RCMS displays for display. In case of an emergency during driving, the XPU generates side and rear warning information and transmits it to the LCMS and RCMS ECUs via CAN, ultimately displaying it on the screens. Furthermore, when an upgrade to the streaming rearview mirror is required, the telematics box (T-BOX) receives the corresponding OTA upgrade package from the cloud. The T-BOX then transmits it to the CDCU via Ethernet, and the CDCU forwards the upgrade package to the LCMS ECU and RCMS ECU via Ethernet, completing the upgrade process.

[0043] It can be seen that, Figure 1 As shown in the system architecture, the streaming media rearview mirror system has a relatively complex architecture, involves many components, and has many communication links, which leads to insufficient processing efficiency of the video information collected by the streaming media rearview mirror camera and high cost of the entire system.

[0044] To address the aforementioned issues, this application provides a data processing method based on a streaming media rearview mirror system. This method utilizes a domain controller to process video information captured by a streaming media rearview mirror camera, reducing system complexity and cost while improving processing efficiency.

[0045] The data processing method based on a streaming media rearview mirror system provided in this application is executed by a data processing system based on a streaming media rearview mirror system. In one specific embodiment, the data processing system based on a streaming media rearview mirror system can be deployed in any electronic device involving streaming media rearview mirror data processing. For example, as... Figure 2 As shown, it can be deployed on autonomous driving equipment, which can be intelligent vehicles.

[0046] The data processing system based on the streaming media rearview mirror system processes video information captured by the streaming media rearview mirror camera, generates corresponding image data, and then displays the image data on the streaming media display screen. See also... Figure 3 , Figure 3 This is a schematic diagram of the structure of the data processing system provided in an embodiment of this application. For example... Figure 3 As shown, the data processing system 300 includes a streaming rearview mirror camera 311, a streaming rearview mirror camera 312, a first domain controller 320, and a streaming display screen 330. First, the streaming rearview mirror cameras 311 and 312 capture video information from their own perspectives and transmit the captured video information directly to the first domain controller 320 via LVDS. The first domain controller 320 integrates a streaming rearview mirror calibration algorithm and model. The first domain controller 320 processes the received video information using the integrated algorithm and model to generate corresponding image data. Then, the first domain controller 320 transmits the generated image data to the streaming display screen 330 via LVDS for display. It should be noted that the first domain controller 320 can be an XPU, CDCU, or other domain controllers with high computing power; this application does not limit this. For ease of description, the following embodiments of this application will use an XPU as an example of the first domain controller 320 unless otherwise specified.

[0047] The technical solutions of the embodiments of this application are described in detail below with reference to the accompanying drawings.

[0048] Figure 4 This is a schematic flowchart illustrating a data processing method based on a streaming media rearview mirror system, as shown in an embodiment of this application.

[0049] See Figure 4 The method includes, but is not limited to, the following steps:

[0050] S401: The first domain controller receives video information captured by the streaming rearview mirror camera.

[0051] Specifically, the left and right streaming rearview mirror cameras deployed on intelligent vehicles capture the road conditions behind the vehicle from their own perspective, collecting video information. This video information consists of video frames at different times, which are arranged in chronological order. Each video frame is an image used to reflect the condition of the geographical area being filmed at the current moment.

[0052] Furthermore, after acquiring relevant video information, the left and right streaming rearview mirror cameras no longer send it to the left and right streaming rearview mirror host via CAN, but instead transmit it directly to the first domain controller, which then processes the video information acquired by the left and right streaming rearview mirror cameras. Optionally, the first domain controller can be an XPU, CDCU, or other domain controllers with high computing power.

[0053] In one possible implementation, after acquiring relevant video information, the left and right streaming rearview mirror cameras transmit it to the first domain controller via the LVDS interface. It's easy to understand that using LVDS to transmit video information can greatly improve transmission efficiency, consume less power, is less susceptible to common-mode noise, and also improves system stability.

[0054] S402: The first domain controller processes the video information and generates the image data corresponding to the video information.

[0055] Specifically, the first domain controller has extremely strong CPU computing power, GPU computing power, and AI computing power. Therefore, the calibration algorithm and model of the left and right streaming rearview mirrors can be directly integrated on the SoC in the first domain controller. Then, the first domain controller can directly process the video information collected by the left and right streaming rearview mirror cameras to generate image data corresponding to the video information that can be directly used for user understanding and recognition. Through this image data, users can keep abreast of the road conditions behind the vehicle in real time, thereby helping users improve driving safety.

[0056] It's understandable that once the calibration algorithms and models for the left and right streaming rearview mirrors are integrated into the first domain controller, the CMS host will no longer be needed to process the video information captured by the left and right streaming rearview mirror cameras. In other words, the functions of the CMS host will be replaced by the first domain controller, thus eliminating the need for the CMS host. This simplifies the overall system structure, reduces complexity, and lowers system costs. Furthermore, since the CMS host is eliminated, the left and right streaming rearview mirrors no longer need to interact with it but are directly connected to the first domain controller. Therefore, the CAN bus between the first domain controller and the CMS can be eliminated, freeing up CAN resources, improving CAN bandwidth utilization, and simultaneously increasing the processing efficiency of the video information captured by the left and right streaming rearview mirror cameras.

[0057] In one possible implementation, the first domain controller acquires video data collected by the left and right rearview cameras. The overlap between the acquisition range of the left and right rearview cameras and the acquisition range of the streaming media rearview mirror camera is greater than a preset threshold. The first domain controller trains the streaming media rearview mirror calibration algorithm and model based on the video data collected by the left and right rearview cameras.

[0058] Specifically, when developing driving functions, the first domain controller needs to collect video data from the left and right rearview cameras, and this data is stored in the first domain controller. Furthermore, the streaming rearview mirror calibration algorithm and model, initially integrated onto the first domain controller's SoC, cannot directly process the video information collected by the streaming rearview mirror cameras. It needs to be trained using sample data (i.e., data pre-collected by the streaming rearview mirror cameras using known parameters) to enable it to process the video information in real time.

[0059] Furthermore, since the viewing angles of the left and right rearview cameras are essentially the same as those of the streaming media rearview mirror camera—meaning the overlap between their acquisition ranges is greater than a preset threshold (which can be set as needed, for example, to 95%, but this application does not limit this)—the video information acquired by the left and right rearview cameras is also largely consistent with that acquired by the streaming media rearview mirror camera. Therefore, after integrating the streaming media rearview mirror calibration algorithm and model on the SoC of the first domain controller, it is not necessary to acquire additional sample data for training. Instead, it can directly use the pre-saved video data acquired by the left and right rearview cameras as sample data for training, enabling it to process video information. It can be seen that this method improves the training efficiency of the algorithm and model and reduces manual costs.

[0060] In another possible implementation, the first domain controller receives a first domain controller upgrade package containing an upgrade package for the streaming rearview mirror camera, and the first domain controller uses the streaming rearview mirror camera upgrade package to upgrade the streaming rearview mirror camera.

[0061] Specifically, since the first domain controller of this application integrates the streaming media rearview mirror calibration algorithm and model to replace the CMS host, compared with related technologies, when upgrading the streaming media rearview mirror camera, it is not necessary to rely on the CDCU to receive the upgrade package of the streaming media rearview mirror camera sent from the cloud from the T-BOX, and then the CDCU transmits the received upgrade package to the CMS host through the Ethernet link to complete the upgrade of the streaming media rearview mirror camera. Instead, the upgrade package of the streaming media rearview mirror camera can be directly integrated into the upgrade package of the first domain controller. The first domain controller receives the upgrade package of the streaming media rearview mirror camera at the same time as receiving its own upgrade package, thus directly completing the upgrade process of the streaming media rearview mirror camera. This eliminates the need for a dedicated Ethernet link for upgrading the streaming media rearview mirror camera, saves network resources, further simplifies the system structure, and reduces system complexity and cost.

[0062] S403: The first domain controller transmits image data to the streaming media display for display.

[0063] Specifically, the first domain controller processes the received video information using a streaming media rearview mirror calibration algorithm and model to generate corresponding image data that can be directly recognized by the user. Then, the image data is transmitted to the streaming media display screen in the vehicle via LVDS for display. The user can operate and adjust according to the image displayed on the streaming media display screen, thereby ensuring driving safety.

[0064] Corresponding to the aforementioned application function implementation method embodiments, this application also provides a data processing device and a vehicle, and corresponding embodiments thereof.

[0065] Figure 5 This is a schematic diagram of the structure of the data processing apparatus shown in the embodiments of this application.

[0066] See Figure 5 The data processing device 500 includes a receiving module 510, a processing module 520, and a transmission module 530.

[0067] The receiving module 510 is used to receive video information captured by the streaming media rearview mirror camera.

[0068] The processing module 520 is used to process the acquired video information and generate image data corresponding to the video information.

[0069] The transmission module 530 is used to transmit image data to a streaming media display screen for display.

[0070] As can be seen from this embodiment, the device provided in this application can reduce system complexity and system cost, while also improving the efficiency of video information processing.

[0071] In one possible implementation, the processing module 520 processes the video information according to the streaming media rearview mirror calibration algorithm and model to generate image data corresponding to the video information.

[0072] In another possible implementation, the receiving module 510 is further configured to acquire video data collected by the left and right side rearview cameras, wherein the overlap between the acquisition range of the left and right side rearview cameras and the acquisition range of the streaming media rearview mirror camera is greater than a preset threshold; the processing module 520 is further configured to train the streaming media rearview mirror calibration algorithm and model based on the video data collected by the left and right side rearview cameras.

[0073] In another possible implementation, the receiving module 510 is further configured to receive a first domain controller upgrade package, which includes an upgrade package for a streaming media rearview mirror camera; the processing module 520 is further configured to upgrade the streaming media rearview mirror camera using the upgrade package for the streaming media rearview mirror camera.

[0074] The modules mentioned above can transmit data to each other through communication channels. It should be understood that the modules included in the data processing device 500 can be software units, hardware units, or a combination of both.

[0075] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated further here.

[0076] Figure 6 This is a schematic diagram of the vehicle structure shown in the embodiments of this application.

[0077] See Figure 6 The vehicle 600 includes a memory 610 and a processor 620.

[0078] The processor 620 can be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor.

[0079] Memory 610 may include various types of storage units, such as system memory, read-only memory (ROM), and permanent storage devices. ROM may store static data or instructions required by the processor 620 or other modules of the computer. Permanent storage devices may be read-write storage devices. Permanent storage devices may be non-volatile storage devices that retain stored instructions and data even when the computer is powered off. In some embodiments, permanent storage devices use mass storage devices (e.g., magnetic or optical disks, flash memory) as permanent storage devices. In other embodiments, permanent storage devices may be removable storage devices (e.g., floppy disks, optical drives). System memory may be a read-write storage device or a volatile read-write storage device, such as dynamic random access memory. System memory may store some or all of the instructions and data required by the processor during operation. Furthermore, memory 610 may include any combination of computer-readable storage media, including various types of semiconductor memory chips (e.g., DRAM, SRAM, SDRAM, flash memory, programmable read-only memory), and disks and / or optical disks may also be used. In some embodiments, memory 610 may include a removable storage device that is readable and / or writable, such as a laser disc (CD), a read-only digital multifunction optical disc (e.g., DVD-ROM, dual-layer DVD-ROM), a read-only Blu-ray disc, an ultra-high density optical disc, a flash memory card (e.g., SD card, mini SD card, Micro-SD card, etc.), a magnetic floppy disk, etc. Computer-readable storage media do not contain carrier waves or transient electronic signals transmitted wirelessly or via wired connections.

[0080] The memory 610 stores executable code, which, when processed by the processor 620, can cause the processor 620 to execute part or all of the methods described above.

[0081] Furthermore, the method according to this application can also be implemented as a computer program or computer program product, which includes computer program code instructions for performing some or all of the steps in the method described above.

[0082] Alternatively, this application may be implemented as a computer-readable storage medium (or a non-transitory machine-readable storage medium or a machine-readable storage medium) storing executable code (or computer program or computer instruction code) thereon, which, when executed by a processor of an electronic device (or server, etc.), causes the processor to perform part or all of the steps of the methods described above according to this application.

[0083] The various embodiments of this application have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principles, practical application, or improvement of the technology in the market, or to enable others skilled in the art to understand the embodiments disclosed herein.

Claims

1. A data processing method based on a streaming media rearview mirror system CMS, characterized in that, include: The first domain controller acquires video data collected by the left and right rearview cameras, and the overlap between the acquisition range of the left and right rearview cameras and the acquisition range of the streaming media rearview mirror camera is greater than a preset threshold. The first domain controller trains the streaming media rearview mirror calibration algorithm and model based on the video data collected by the left and right rearview cameras; The first domain controller receives video information captured by the streaming rearview mirror camera through a low-voltage differential signal (LVDS) interface; wherein, the first domain controller integrates the streaming rearview mirror calibration algorithm and model; The first domain controller processes the video information to generate image data corresponding to the video information; The first domain controller transmits the image data to the streaming media display screen for display. The first domain controller processes the video information to generate image data corresponding to the video information, including: The first domain controller processes the video information according to the streaming media rearview mirror calibration algorithm and model to generate image data corresponding to the video information.

2. The method according to claim 1, characterized in that, The method further includes: The first domain controller receives a first domain controller upgrade package, which includes an upgrade package for the streaming media rearview mirror camera; The first domain controller upgrades the streaming rearview mirror camera using the upgrade package for the streaming rearview mirror camera.

3. A data processing apparatus, characterized in that, include: The receiving module is used to acquire video data collected by the left and right rearview cameras, wherein the overlap between the acquisition range of the left and right rearview cameras and the acquisition range of the streaming media rearview mirror camera is greater than a preset threshold. And receive video information captured by the streaming media rearview mirror camera via the Low Voltage Differential Signaling (LVDS) interface; The processing module is used to train the streaming media rearview mirror calibration algorithm and model based on the video data collected by the left and right rearview cameras; and to process the video information based on the streaming media rearview mirror calibration algorithm and model to generate image data corresponding to the video information. The transmission module is used to transmit the image data to the streaming media display screen for display.

4. The apparatus according to claim 3, characterized in that, The receiving module is further configured to receive a first domain controller upgrade package, wherein the first domain controller upgrade package includes an upgrade package for the streaming media rearview mirror camera; The processing module is also used to upgrade the streaming media rearview mirror camera using the upgrade package of the streaming media rearview mirror camera.

5. A vehicle, characterized in that, include: processor; as well as A memory having executable code stored thereon, which, when executed by the processor, causes the processor to perform the method as described in claim 1 or 2.

6. A computer-readable storage medium having executable code stored thereon, which, when executed by a processor of an electronic device, causes the processor to perform the method as claimed in claim 1 or 2.

Images