Implementation method of built-in automobile data recorder

Abstract

The invention relates to the technical field of intelligent cabins, and provides an implementation method of a built-in automobile data recorder, which comprises the following steps: providing an SOC mainboard; providing an SOC daughter board; the SOC mainboard and the SOC daughter board are connected; a camera and an SD card are provided, one end of the SOC daughter board is connected with the SOC mainboard, the other end of the SOC daughter board is connected with the camera and the SD card, the camera is responsible for collecting video data, and the SD card is responsible for storing the video data; according to software system architecture design, a modular design idea is adopted, a software system of the automobile data recorder is divided into a main control module and a function extension module, the main control module and the function extension module run on an SOC mainboard and an SOC daughter board respectively, and data interaction and cooperative work are carried out through interfaces. According to the invention, different SOC daughter boards are added, so that the functions of the automobile data recorder can be flexibly expanded, and the requirements of different application scenes are met; function expansion can be realized only by adding the corresponding SOC daughter board, so that the hardware cost is reduced; and the SOC daughter board shares the operation pressure of the master control SOC chip, so that the overall performance of the automobile data recorder is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of intelligent cockpits, and particularly to a method for implementing an in-vehicle driving recorder. Background Art

[0002] Nowadays, with the development of the economy, more and more people own their own cars. The complex traffic environment makes the driving recorder increasingly indispensable for vehicle use.

[0003] A driving recorder is a device that records images, sounds and other relevant information during vehicle driving. The video images and sounds stored by the driving recorder during the entire process of vehicle driving can provide evidence for traffic accidents. People who like self-driving tours can also use it to record the process of conquering difficulties and dangers. When driving, it records videos while moving, and at the same time records the time, speed, and location in the video, which is quite like a "black box".

[0004] With the continuous development of automotive electronics technology, the functions of driving recorders are becoming increasingly rich, and the requirements for hardware performance and software functions are also getting higher and higher. However, traditional driving recorders usually adopt a single SOC chip solution. Limited by the performance and resources of the chip itself, it is difficult to meet the growing functional requirements. When users need to add functions to the driving recorder, they often need to replace the SOC chip with higher performance. This method has a high cost and requires re-designing the hardware circuit and software system, with a long development cycle. Summary of the Invention

[0005] The present invention provides a method for implementing an in-vehicle driving recorder, aiming to solve the problem that existing driving recorders are difficult to meet the growing functional requirements.

[0006] The present invention is implemented as follows. A method for implementing an in-vehicle driving recorder includes:

[0007] Providing an SOC main board, on which basic functional units are integrated. The basic functional units include a main control SOC chip, a power management module, a storage module, and an interface module, which are used to implement the basic functions of the driving recorder.

[0008] Providing an SOC daughter board, on which an auxiliary SOC chip and a function expansion module are integrated, which are used to implement the expansion functions of the driving recorder.

[0009] Connecting the SOC main board and the SOC daughter board. The SOC main board is connected to the SOC daughter board through a high-speed interface for data transmission. The high-speed interface includes a MIPI CSI interface, an I2C interface, and a USB 2.0 interface.

[0010] A camera and an SD card are provided. One end of the SOC daughter board is connected to the SOC main board, and the other end is connected to the camera and the SD card. The camera is responsible for collecting video data, and the SD card is responsible for storing video data.

[0011] For the software system architecture design, the modular design concept is adopted. The software system of the driving recorder is divided into a main control module and a function expansion module, which run on the SOC main board and the SOC daughter board respectively, and perform data interaction and collaborative work through interfaces.

[0012] Furthermore, a pluggable connection is adopted between the SOC main board and the SOC daughter board, which is convenient for users to flexibly replace and upgrade the daughter board according to their needs.

[0013] Furthermore, multiple types of cameras are adopted, including wide-angle cameras or infrared cameras, to meet the shooting requirements of different scenarios.

[0014] Furthermore, the SD card adopts a high-capacity and high-speed memory card to meet the storage requirements of high-definition videos. The write speed of the SD card needs to meet:

[0015]

[0016] where W speed is the write speed of the SD card, and V and A are the real-time bit rates of video and audio respectively.

[0017] Furthermore, the software system of the driving recorder includes:

[0018] Main control module: Runs on the SOC main board and is responsible for the basic functions of the driving recorder;

[0019] Interface module: Responsible for data interaction and communication between the main control module and the function expansion module;

[0020] Function expansion module: Runs on the SOC daughter board and is responsible for the expansion functions of the driving recorder.

[0021] Furthermore, the SOC daughter board includes a driver layer and a hardware abstraction layer for data interaction and collaborative work;

[0022] The driver layer is used to receive the data collected by the camera and transmit the data to the hardware abstraction layer;

[0023] The hardware abstraction layer includes a watermark processing module, a multimedia recording management module, and an RTP server. After receiving the data source of the camera, the hardware abstraction layer transmits the camera data source to the watermark processing module. After adding a watermark through the watermark processing mechanism, it is integrated with the audio data and then transmitted to the multimedia recording management module and the RTP server respectively after audio-visual encoding. The multimedia recording management module uses the Gstreamer-V412 media framework and the Gstreamer-alsa media framework to record and manage the received encoded data, and transmits the encoded data to the SD card. The RTP server transmits the received encoded data to the SOC main board through the interface module.

[0024] Further, the watermark processing module is used to add a watermark to the video. The content of the watermark includes time, location, and the driver. The location is positioned through the vehicle-mounted GPS, and the driver is identified by collecting the facial information of the driver through the camera or collecting the voiceprint through the vehicle-mounted voice interaction module. The display position and whether to display the watermark content are set by the user himself.

[0025] Further, the watermark processing module embeds the watermark into the luminance component of the video frame through the following formula:

[0026] Y'(x,y) = Y(x,y) + α × W(x,y)

[0027] Where Y(x,y) is the original luminance value, W(x,y) is the watermark signal, α is the embedding strength factor, and Y'(x,y) is the luminance value after embedding the watermark.

[0028] Further, the storage time T of the multimedia recording management module is calculated by the following formula:

[0029]

[0030] Where S is the storage capacity of the SD card, V is the video bit rate, and A is the audio bit rate.

[0031] Compared with the prior art, the beneficial effects of the present invention are:

[0032] 1. Flexible expansion: By adding different SOC daughter boards, the functions of the driving recorder can be flexibly expanded to meet the needs of different application scenarios;

[0033] 2. Cost reduction: There is no need to replace the high-performance SOC chip. Only by adding the corresponding SOC daughter board can the function be expanded, reducing the hardware cost;

[0034] 3. Performance improvement: By sharing the computing pressure of the main control SOC chip by the SOC daughter board, the overall performance of the driving recorder can be improved. Brief Description of the Drawings

[0035] To more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for the embodiments will be briefly introduced below. It should be understood that the following accompanying drawings only show some embodiments of the present invention and should not be regarded as limiting the scope. For those of ordinary skill in the art, without creative efforts, other related accompanying drawings can also be obtained based on these drawings.

[0036] Figure 1 is the hardware structure diagram of the embodiments of the present invention;

[0037] Figure 2 is the method implementation flowchart of the embodiments of the present invention;

[0038] Figure 3 is the software system architecture and data flow transmission diagram of the embodiments of the present invention. Detailed implementation manners

[0039] To more fully understand the technical content of the present invention, the technical solutions of the present invention will be further introduced and described below in combination with specific embodiments, but not limited thereto. The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, rather than all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the scope of protection of the present invention.

[0040] Referring to Figure 1 , the hardware structure of the built-in driving recorder includes:

[0041] An SOC main board, an SOC sub-board, a camera, and an SD card. The SOC main board and the SOC sub-board are connected through a high-speed interface for data transmission and communication. The SOC sub-board is connected to the camera and the SD card. The high-speed interface includes an MIPI CSI interface, an I2C interface, and a USB 2.0.

[0042] Referring to Figure 2 , the implementation method of the built-in driving recorder includes:

[0043] Provide an SOC main board, on which basic functional units such as a main control SOC chip, a power management module, a storage module, and an interface module are integrated to implement the basic functions of the driving recorder, such as video acquisition, encoding, storage, playback, etc.

[0044] Provide an SOC sub-board, on which an auxiliary SOC chip, a function expansion module, etc. are integrated to implement the expansion functions of the driving recorder, such as AI operation, image processing, data encryption, etc.

[0045] Connect the SOC main board and the SOC daughter board. The SOC main board is connected to the SOC daughter board through the MIPI CSI interface, I2C interface, and USB 2.0 interface for data transmission.

[0046] Furthermore, the SOC main board and the SOC daughter board can be connected in a plug-and-play manner, which is convenient for users to flexibly replace and upgrade the daughter board according to their needs.

[0047] Provide a camera and an SD card. One end of the SOC daughter board is connected to the SOC main board, and the other end is connected to the camera and the SD card. The camera is responsible for collecting video data, and the SD card is responsible for storing video data.

[0048] Furthermore, the camera can be of various types, such as a wide-angle camera, an infrared camera, etc., to meet the shooting requirements in different scenarios.

[0049] Furthermore, the SD card can be a high-capacity and high-speed memory card to meet the storage requirements of high-definition videos. The write speed of the SD card needs to meet:

[0050]

[0051] where W speed is the write speed of the SD card, and V and A are the real-time bitrates of video and audio respectively.

[0052] For the software system architecture design, the modular design concept is adopted. The software system of the dashcam is divided into a main control module and a function expansion module, which run on the SOC main board and the SOC daughter board respectively, and interact with each other and cooperate through interfaces.

[0053] Reference Figure 3 The software system of the dashcam includes:

[0054] Main control module: Runs on the SOC main board and is responsible for the basic functions of the dashcam, such as video acquisition, encoding, storage, playback, etc.;

[0055] Interface module: Responsible for data interaction and communication between the main control module and the function expansion module.

[0056] Function expansion module: Runs on the SOC daughter board and is responsible for the expansion functions of the dashcam, such as AI operation, image processing, data encryption, etc.;

[0057] The SOC daughter board includes a driver layer and a hardware abstraction layer, which perform data interaction and collaborative work. The driver layer is used to receive the data collected by the camera and transmit the data to the hardware abstraction layer; after receiving the camera data source, the hardware abstraction layer transmits the camera data source to the watermark processing module. After adding watermarks such as time through the watermark processing mechanism, it is integrated with the audio data and then transmitted to the multimedia recording management module and the Real-Time Transport Protocol (RTP) server respectively after audio-visual encoding. The multimedia recording management module uses the Gstreamer-V412 media framework and the Gstreamer-alsa media framework to record and manage the received encoded data, and transmits the encoded data to the SD card. The RTP server transmits the received encoded data to the SOC main board through the interface module. The hardware abstraction layer implements all basic functions, including audio / video recording, system status monitoring, TF card operation, etc.

[0058] Further, the watermark processing module is used to add watermarks to the video. The content of the watermark can include time, location, driver, etc. The location can be located by the in-vehicle GPS, and the driver can be identified by collecting the driver's facial information through the camera or collecting the voiceprint through the in-vehicle voice interaction module. The display position and whether to display the watermark content can be set by the user.

[0059] Further, the watermark processing module embeds the watermark into the luminance component of the video frame through the following formula:

[0060] Y'(x,y) = Y(x,y) + α × W(x,y)

[0061] where Y(x,y) is the original luminance value, W(x,y) is the watermark signal, α is the embedding strength factor, and Y'(x,y) is the luminance value after embedding the watermark.

[0062] Further, the storage time T of the multimedia recording management module is calculated by the following formula:

[0063]

[0064] where S is the storage capacity of the SD card, V is the video bit rate, and A is the audio bit rate.

[0065] Further, the SOC daughter board can be customized according to actual needs. For example:

[0066] AI acceleration daughter board: Integrate high-performance AI chips for algorithm acceleration of functions such as ADAS and DMS;

[0067] Image processing daughter board: Integrate high-performance image processing chips for functions such as image enhancement and distortion correction;

[0068] Data Encryption Daughter Board: Integrated with a security chip to implement functions such as data encryption and identity authentication.

[0069] Working Principle of the Present Invention:

[0070] 1. The camera captures video data and transmits the data to the SOC daughter board.

[0071] 2. The SOC daughter board processes the video data, such as image enhancement, AI analysis, etc.

[0072] 3. The processed video data is transmitted to the SOC main board through a high-speed interface.

[0073] 4. The SOC main board encodes and stores the video data.

[0074] 5. The user can playback the stored video data through the SOC main board.

[0075] The above-described embodiments are only a part of the embodiments of the present invention, but the protection scope of the present invention is not limited thereto. Any person of ordinary skill in the art within the technical scope disclosed by the present invention, according to the technical solution and inventive concept of the present invention, makes equivalent substitutions or changes, and should be covered by the protection scope of the present invention.

Claims

1. A method for implementing a built-in driving recorder, characterized in that: The implementation method of the built-in driving recorder includes: Provide a SOC mainboard, on which a basic functional unit is integrated, the basic functional unit including a main control SOC chip, a power management module, a storage module and an interface module, for realizing the basic functions of the driving recorder; Providing a SOC daughter board, on which an auxiliary SOC chip and a function expansion module are integrated, for realizing the extended functions of the driving recorder; Connecting the SOC main board and the SOC sub-board, wherein the SOC main board is connected to the SOC sub-board through a high-speed interface and performs data transmission, wherein the high-speed interface includes a MIPI CSI interface, an I2C interface, and a USB 2.0 interface; Provide a camera and an SD card. One end of the SOC sub-board is connected to the SOC main board, and the other end is connected to the camera and the SD card. The camera is responsible for collecting video data, and the SD card is responsible for storing video data. The software system architecture design adopts a modular design concept, dividing the software system of the driving recorder into a main control module and a function expansion module, which run on the SOC main board and SOC sub-board respectively, and perform data interaction and collaborative work through interfaces.

2. The method for implementing the built-in driving recorder according to claim 1, characterized in that: The SOC main board and the SOC sub-board are connected in a plug-in manner, so that users can flexibly replace and upgrade the sub-board according to their needs.

3. The method for implementing the built-in driving recorder according to claim 1, characterized in that: The camera may be of various types, including a wide-angle camera or an infrared camera, to meet the shooting requirements of different scenes.

4. The method for implementing the built-in driving recorder according to claim 1, characterized in that: The SD card uses a high-capacity, high-speed memory card to meet the storage requirements of high-definition video. The writing speed of the SD card needs to meet the following requirements: Among them, W speed is the writing speed of the SD card, V and A are the real-time bit rates of the video and audio respectively.

5. The method for implementing the built-in driving recorder according to claim 1, characterized in that: The software system of the driving recorder includes: Main control module: runs on the SOC mainboard and is responsible for the basic functions of the driving recorder; Interface module: responsible for data interaction and communication between the main control module and the function expansion module; Function expansion module: runs on the SOC daughter board and is responsible for the extended functions of the driving recorder.

6. The method for implementing the built-in driving recorder according to claim 5, characterized in that: The SOC sub-board includes a driver layer and a hardware abstraction layer for data interaction and collaborative work; The driver layer is used to receive data collected by the camera and transmit the data to the hardware abstraction layer; The hardware abstraction layer comprises a watermark processing module, a multimedia record management module and an RTP server. After receiving the data source of the camera, the hardware abstraction layer transmits the camera data source to the watermark processing module. After adding the watermark through the watermark processing mechanism, the watermark is integrated with the audio data and transmitted to the multimedia record management module and the RTP server respectively after audio and video encoding. The multimedia record management module adopts the Gstreamer-V412 media framework and the Gstreamer-alsa media framework to record and manage the received encoded data, and transmits the encoded data to the SD card. The RTP server transmits the received encoded data to the SOC mainboard through the interface module.

7. The method for implementing the built-in driving recorder according to claim 6, characterized in that: The watermark processing module is used to add a watermark to the video. The content of the watermark includes time, location and driver. The location is located by the vehicle-mounted GPS, and the driver's facial information is collected by the camera or the voice print is collected by the vehicle-mounted voice interaction module for identification. The watermark content is set by the user to display the location and whether to display it.

8. The method for implementing the built-in driving recorder according to claim 7, characterized in that: The watermark processing module embeds the watermark into the brightness component of the video frame using the following formula: Y'(x,y)=Y(x,y)+α×W(x,y) Among them, Y(x,y) is the original brightness value, W(x,y) is the watermark signal, α is the embedding lightness factor, and Y'(x,y) is the brightness value after embedding the watermark.

9. The method for implementing the built-in driving recorder according to claim 6, characterized in that: The storage time T of the multimedia record management module is calculated by the following formula: Among them, S is the storage capacity of the SD card, V is the video bit rate, and A is the audio bit rate.

Images