ADAS control equipment, intelligent driving interaction system and intelligent driving equipment

Abstract

The utility model provides ADAS control equipment, an intelligent driving interaction system and intelligent driving equipment. The ADAS control equipment comprises a camera interface, a recording control device, a random access memory, a passive triggering device and a nonvolatile memory. The recording control device is configured to control the ADAS camera to collect camera data of an environment where the ADAS camera is located; the random access memory is configured to temporarily store camera data of the environment; the passive triggering device is configured to receive a disk falling instruction so as to trigger the recording control device to intercept camera data in a preset time period; the nonvolatile memory is configured to store imaging data for the preset time period. Therefore, only small camera data is stored in the nonvolatile memory, so that the requirement on the nonvolatile memory is reduced, the frequency of deleting and writing data is reduced, and the service life of the memory is prolonged.

Description

Technical Field

[0001] The present application relates to the technical field of electric vehicles, and specifically provides an ADAS control device, an intelligent driving interaction system, and an intelligent driving device. Background Art

[0002] With the rapid development of the automotive industry, the need to record various video and other data while driving is increasing. For example, when a vehicle emergency occurs, video recording can more intuitively document the entire process and cause of the emergency, providing a basis for accident prevention and property damage prevention. Another example is encountering various novel scenes on the road or the funny expressions of friends and family in the car, which you may want to share in real time on social media.

[0003] Typically, driving camera data can be recorded in the following ways:

[0004] 1. Recording via independent driving recorder or related recording equipment.

[0005] 2. Recorded by the cockpit or parking controller through the surround view camera.

[0006] 3. Inside the integrated controller, the ADAS camera's video data is diverted to the cockpit controller through the deserializer for recording.

[0007] However, no matter which of the above methods is used, the amount of captured data is large, and the frequency of deleting and writing data is high, which can easily damage the memory. Utility Model Content

[0008] In order to overcome the above-mentioned defects, the present application is proposed to provide an ADAS control device, an intelligent driving interaction system and an intelligent driving device that solve or at least partially solve the technical problems of large amounts of shooting data, high frequencies of data deletion and writing, and easy damage to the memory.

[0009] In a first aspect, the present application provides an ADAS control device, the ADAS control device comprising:

[0010] Camera interface, communicating with ADAS camera;

[0011] a recording control device, electrically connected to the camera interface, and configured to control the ADAS camera to collect video data of the environment;

[0012] A random access memory, electrically connected to the recording control device, and configured to store the video data of the environment;

[0013] a passive trigger device electrically connected to the recording control device and configured to receive a disk-drop instruction to trigger the recording control device to capture video data of a preset time period; the preset time period is a time period including the time point of the disk-drop instruction;

[0014] The non-volatile memory is communicatively connected to the random access memory and is configured to store the camera data of the preset time period.

[0015] Furthermore, the above-mentioned ADAS control device further includes:

[0016] a timer, electrically connected to the recording control device;

[0017] The recording control device is further configured to receive the timing time of the timer and delete the video data in the random access memory that exceeds the set time length.

[0018] Furthermore, the above-mentioned ADAS control device further includes:

[0019] a motion detection device, electrically connected to the passive trigger device and configured to send the disk placement instruction to the passive trigger device;

[0020] The disk drop instruction is an instruction generated when the amount of motion detected by the motion detection device exceeds a preset threshold.

[0021] Furthermore, the above-mentioned ADAS control device further includes:

[0022] a communication interface, communicatively connected to the recording control device, and configured to send the video data of the preset time period to a data receiving device;

[0023] The recording control device is further configured to receive a notification of completion of reception fed back by the data receiving device and delete the video data of the preset time period; or, upon receiving an abnormal signal from the data receiving device, resend the video data of the preset time period after the abnormality is resolved by the data receiving device.

[0024] Furthermore, in the above-mentioned ADAS control device,

[0025] The communication interface is electrically connected to the data receiving device via a bus; or

[0026] The communication interface is directly electrically connected to the data receiving device via Ethernet; or

[0027] The communication interface is electrically connected to the data receiving device via Ethernet and a switch.

[0028] In a second aspect, the present application provides an intelligent driving interaction system, which includes:

[0029] An ADAS control device as described in any one of the above;

[0030] The smart cockpit is communicatively connected to the ADAS control device and is configured to receive the camera data of a preset time period sent by the ADAS control device and store the camera data of the preset time period.

[0031] Furthermore, in the above-mentioned intelligent driving interaction system, the intelligent cockpit includes:

[0032] The external memory interface is configured to send the required camera data to the external memory connected thereto.

[0033] Furthermore, in the above-mentioned intelligent driving interaction system, the intelligent cockpit further includes:

[0034] The multimedia interface is configured to display the required video data via a display device connected thereto.

[0035] Furthermore, the above-mentioned intelligent driving interaction system further includes:

[0036] A vehicle controller, communicatively connected to the ADAS control device, and configured to send a disk placement instruction to the ADAS control device;

[0037] an active triggering device, electrically connected to the vehicle controller, and configured to send the disk placement instruction to the vehicle controller, so that the vehicle controller sends the disk placement instruction to the ADAS control device after receiving the disk placement instruction;

[0038] The data sensing device is electrically connected to the vehicle controller and is configured to send sensing data to the vehicle controller so that the vehicle controller generates the disk placement instruction based on the sensing data.

[0039] In a third aspect, the present application provides an intelligent driving device, comprising any of the intelligent driving interaction systems described above.

[0040] The above one or more technical solutions of this application have at least one or more of the following beneficial effects:

[0041] In the technical solution of the present application, the camera data of the environment in which the ADAS camera is located is stored in real time through a random access memory, and when a disk drop instruction is received through a passive trigger device, the recording control device is triggered to intercept the camera data of a preset time period, and the camera data of the preset time period is stored in a non-volatile memory. In this way, the non-volatile memory only stores camera data with smaller data, which reduces the requirements for the non-volatile memory, reduces the frequency of deleting and writing data, and extends the service life of the memory. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] The disclosure of this application will be more easily understood with reference to the accompanying drawings. Those skilled in the art will readily appreciate that these drawings are for illustrative purposes only and are not intended to limit the scope of protection of this application. Furthermore, similar numbers in the figures represent similar components, where:

[0043] Figure 1 is a schematic diagram of the main structure of an ADAS control device according to an embodiment of the present application;

[0044] Figure 2 It is a schematic diagram of the main structure of an intelligent driving interaction system according to an embodiment of the present application. DETAILED DESCRIPTION

[0045] Some embodiments of the present application are described below with reference to the accompanying drawings. Those skilled in the art should understand that these embodiments are only used to explain the technical principles of the present application and are not intended to limit the scope of protection of the present application.

[0046] In the description of this application, "module" and "processor" may include hardware, software, or a combination of both. A module may include hardware circuitry, various suitable sensors, communication ports, and memory. It may also include software components, such as program code, or a combination of software and hardware. A processor may be a central processing unit, a microprocessor, an image processor, a digital signal processor, or any other suitable processor. A processor has data and / or signal processing capabilities. A processor may be implemented in software, hardware, or a combination of both. Non-transitory computer-readable storage media include any suitable medium capable of storing program code, such as magnetic disks, hard disks, optical disks, flash memory, read-only memory, random access memory, etc. The term "A and / or B" refers to all possible combinations of A and B, such as only A, only B, or both A and B. The terms "at least one of A or B" or "at least one of A and B" have similar meanings to "A and / or B" and may include only A, only B, or both A and B. The singular forms "a" and "the" may also include the plural forms.

[0047] Currently, there are more and more scenarios where video and other shooting data are recorded while driving. This is especially true for vehicles equipped with Advanced Driver Assistance Systems (ADAS). For example, collisions in urban traffic are becoming more and more frequent. In many cases, there is a lack of records of the first scene of the accident, making it difficult to determine the cause and responsibility of the accident. In this case, if the video recorded during driving can be used to determine the cause and responsibility of the accident, the efficiency of accident handling can be greatly improved. For example, you may encounter various novel scenes on the road or various interesting expressions of friends and family in the car, which you want to share in real time on social circles.

[0048] However, the amount of recorded shooting data in the related art is large, and the frequency of data deletion and writing is high, which can easily cause damage to the memory.

[0049] Therefore, in order to solve the above technical problems, this application provides the following technical solutions:

[0050] See attached Figure 1 , Figure 1 FIG. 1 is a schematic diagram of the main structure of an ADAS control device according to an embodiment of the present application. Figure 1 As shown, the ADAS control device 1 in the embodiment of the present application may include a camera interface (not shown in the figure), a recording control device 11, a random access memory 12, a passive trigger device 13, and a non-volatile memory 14. The camera interface, the random access memory 12, and the passive trigger device 13 are electrically connected to the recording control device 11. The random access memory 12 is communicatively connected to the non-volatile memory 14.

[0051] In a specific implementation process, the ADAS camera in the vehicle can be connected to the camera interface, and the recording control device controls the ADAS camera to collect video data of the environment in real time, and transmits the data to the recording control device 11 through the camera interface. The ADAS camera may include a rearview camera, a right front view camera, a right rear view camera, a front view camera, a left front view camera, a left rear view camera, a surround view camera, etc. installed on the vehicle body. In this way, the ADAS camera can be reused to record various video, image and other video data without the need for additional related acquisition equipment, thereby reducing vehicle costs. The field of view is wide and the range is longer, which makes the video integrity better and the usability better.

[0052] The recording control device 11 continuously receives the camera data of the environment captured by the ADAS camera, and temporarily stores the camera data of the environment captured by all ADAS cameras in real time in the random access memory 12, and records the timestamp of each frame of the camera data of the environment. Among them, the random access memory 12 can be read and written at any time and is very fast. It is usually used as a temporary data storage medium for the operating system or other running programs. The camera data of the environment can be a video stream, which can be compressed into H265 / H264 format and temporarily stored in the random access memory 12.

[0053] In a specific implementation process, the passive trigger device 13 can detect in real time whether a disk drop instruction is received, and after receiving the disk drop instruction, it can trigger the recording control device 11 to intercept the video data of a preset time period; the preset time period is the time period including the time point of the disk drop instruction.

[0054] In a specific implementation process, such as Figure 1 As shown, a motion detection device 15 can be provided in the ADAS control device 1. The motion detection device 15 is used to collect the vehicle's motion in real time and compare the collected motion with a preset threshold to generate a drop instruction. The motion detection device 15 can include an inertial measurement unit (IMU), which can reuse the vehicle's existing IMU to reduce costs. Correspondingly, the vehicle's motion can include a change in acceleration state. When the change in acceleration state exceeds a preset threshold, the vehicle may experience an emergency event such as a collision. Since the data in the random access memory 12 is lost when the device is powered off, in order to intuitively record the entire process and cause of the emergency, and provide a basis for accident prevention and property damage, a drop instruction can be generated and sent to the passive trigger device 13, so that the passive trigger device 13 can trigger the recording control device 11 to capture video data for a preset time period. For example, the time point of the drop instruction can be used as a reference point to capture video data for a preset time period, a period of time forward (e.g., 10 seconds) and a period of time backward (e.g., 10 seconds) as the preset time period.

[0055] In a specific implementation process, the passive trigger device 13 can also be connected to the vehicle controller through a CAN bus, Ethernet or other communication. The vehicle controller is connected to various sensors and other data sensing devices. The vehicle controller collects the perception data of the vehicle during the formation process through the data sensing device, and analyzes the perception data to determine whether the vehicle has or is about to have an emergency event such as a collision. When it is determined that the vehicle has or is about to have an emergency event such as a collision, a disk drop instruction is generated and sent to the passive trigger device 13, so that the passive trigger device 13 can trigger the recording control device 11 to intercept the camera data of the preset time period. Among them, the data sensing device is installed on the outside of the vehicle body, and multiple data sensing devices can be installed on different parts of the vehicle body to perform detection from different positions of the vehicle to reduce the existence of blind spots.

[0056] In a specific implementation process, the vehicle controller can also be electrically connected to the active trigger device. The active trigger device may include but is not limited to a physical switch, a microphone, a touchpad, and a touch screen. The active trigger device can be installed inside the vehicle, such as in the steering wheel or the center console, to facilitate user operation. The user can actively record a specific event. At this time, the user can send a drop disk instruction to the vehicle controller through the active trigger device. After receiving the drop disk instruction, the vehicle controller sends the drop disk instruction to the passive trigger device 13 in the ADAS control device 1, so that the passive trigger device 13 can trigger the recording control device 11 to intercept the video data of the preset time period.

[0057] In a specific implementation process, after the passive trigger device 13 triggers the recording control device 11 to intercept the video data of a preset time period, the random access memory 12 can transmit the video data of the preset time period to the non-volatile memory 14, and the non-volatile memory 14 stores the video data of the preset time period, thereby realizing the writing of the video data of the preset time period to the disk, avoiding data loss after power off, and providing the user with the required video data.

[0058] In a specific implementation, the ADAS control device 1 may further include a timer (not shown). The timer is electrically connected to the recording control device 11 and transmits the timed value to the recording control device 11. After receiving the timed value, the recording control device 11 calculates the storage duration of the stored video data based on the duration of the stored video data. Video data whose storage duration exceeds the set duration is deleted. This prevents older video data from occupying space in the non-volatile memory 14.

[0059] The ADAS control device of this embodiment stores the video data of the environment collected by the ADAS camera in real time through the random access memory 12, and when receiving the disk-writing instruction through the passive trigger device 13, triggers the recording control device 11 to intercept the video data of a preset time period, and stores the video data of the preset time period in the non-volatile memory 14. In this way, the non-volatile memory 14 only stores video data with relatively small data, which reduces the requirements for the non-volatile memory 14, reduces the frequency of deleting and writing data, and extends the service life of the memory.

[0060] In a specific implementation process, in order to facilitate the user to obtain the required data, a communication interface 16 can be set in the ADAS control device 1. The communication interface 16 is communicatively connected to the recording control device 11. The recording control device 11 can send the camera data of the preset time period to the data receiving device through the communication interface 16, so that the user can search and obtain the data he needs from the data receiving device. The data receiving device can be set in an intelligent cockpit. The communication interface 16 is electrically connected to the data receiving device through a bus; or, the communication interface 16 is directly electrically connected to the data receiving device through Ethernet; or, the communication interface 16 is electrically connected to the data receiving device through Ethernet and a switch. In this way, the bus, Ethernet, etc. can be reused for data transmission, and there is no need to set up a deserializer for ADAS, and there is no need to reserve hardware paths in the early stage, which reduces the difficulty of circuit board layout.

[0061] In a specific implementation process, after the data receiving device receives the video data of a preset time period, it can feedback a notification of completion of reception to the recording control device 11. After the recording control device 11 receives the notification of completion of reception fed back by the recording control device 11, it can delete the video data of the preset time period, or, upon receiving an abnormal signal (restart signal or power-off signal) from the data receiving device, resend the video data of the preset time period after the abnormality is resolved by the data receiving device.

[0062] Furthermore, the present application also provides an intelligent driving interaction system.

[0063] See attached Figure 2 , Figure 2 This is a schematic diagram of the main structure of the intelligent driving interaction system according to an embodiment of the present application. Figure 2As shown, the intelligent driving interaction system in the embodiment of the present application may include an intelligent cockpit 2 and the ADAS control device 1 of the above embodiment. Among them, the intelligent cockpit 2 is communicatively connected to the communication interface 16 in the ADAS control device 1. The intelligent cockpit 2 is configured to receive the video data of a preset time period sent by the ADAS control device 1, and store the video data of the preset time period. The specific implementation process can be described here with reference to the above-mentioned relevant records. Among them, the intelligent cockpit 2 may include a data receiving device 22 and a non-volatile memory (not shown in the figure) to store the video data of the preset time period.

[0064] In a specific implementation process, such as Figure 2 As shown, the smart cockpit 2 may include an external memory interface 21, such as a USB interface. The external memory interface 21 is configured to send the required camera data to an external memory device connected thereto. In other words, when the required camera data is needed from the smart cockpit 2, an external storage device can be inserted into the external memory interface 21 to obtain the required camera data.

[0065] In a specific implementation process, such as Figure 2 As shown, the smart cockpit 2 may also include a multimedia interface 23, such as an HDIM interface. This multimedia interface 23 is configured to display the requested video data via a connected display device 3. In other words, the display device 3 can be connected to the multimedia interface 23 via a corresponding communication bus, allowing the user to select the requested video data for display. Specifically, a corresponding file can be generated for the video data of a preset time period and displayed on a designated interface of the display device. After selecting the requested file, the display device 3 plays the requested video data corresponding to the file.

[0066] like Figure 2 As shown, the intelligent driving interaction system may further include a vehicle controller 4 , an active triggering device 5 and a data sensing device 6 .

[0067] an active triggering device 5 electrically connected to the vehicle controller 4 and configured to send the disk placement instruction to the vehicle controller 4, so that the vehicle controller 4 sends the disk placement instruction to the ADAS control device 1 after receiving the disk placement instruction;

[0068] The data sensing device 6 is electrically connected to the vehicle controller 4 and is configured to send sensing data to the vehicle controller 4 so that the vehicle controller 4 generates the disk placement instruction based on the sensing data.

[0069] The process of generating the above-mentioned disk placement instruction can be referred to the relevant records above and will not be repeated here.

[0070] It should be noted that Figure 2 The illustrated embodiment is described by taking the example of including the smart cockpit 2, the vehicle controller 4, etc. at the same time. In actual application, it may also include only the smart cockpit 2, or only the parts related to the vehicle controller 4. Examples will not be given one by one here.

[0071] In a specific implementation process, a specific interaction process of the intelligent driving interaction system is as follows:

[0072] 1. The ADAS control device 1 is physically connected to the camera and IMU module. The camera and IMU module can both be already on the vehicle. This allows for reuse of the camera and IMU, reducing costs.

[0073] 2. After the recording control device 11 is turned on, it receives the video streams of all cameras in real time and compresses them into H265 / H264 format, saves the compressed video data in the random access memory, and maintains the data of the historical set time in the random access memory. When the set time is exceeded, the recording control device 11 actively discards the old historical data to avoid random access memory overrun.

[0074] 3. The passive trigger device 13 in the ADAS monitors the vehicle collision signal status and IMU acceleration status in real time. If the vehicle collision signal is detected, the acceleration change exceeds a set threshold, or a user-triggered write command is detected, the recording control device 11 is notified to write the video to disk. After receiving the write command, the recording control device 11 continues recording the video stream for the set time and ultimately writes the historical data before the trigger time and the data after the trigger time to the local disk. While recording the video, the recording control device 11 records the timestamp of each video and saves it to the timestamp file.

[0075] 4. After the recording control device 11 completes the video transfer, it sends the video file and timestamp file to the video receiving module of the smart cockpit 2 via Ethernet. After receiving the complete data, the video receiving module notifies the recording control device 11 that the file transfer is complete. After confirming the file transfer is complete, the recording control device 11 immediately deletes the local video file and timestamp file. If the ADAS control device 1 or smart cockpit 2 is restarted or powered off during the transfer, the recording control device 11 will resend the video file and timestamp file to the smart cockpit 2 upon the next power-on.

[0076] 5. After receiving the video file and timestamp file, the smart cockpit 2 determines the video recording time based on the timestamp file and provides it to the user for associating with specific driving events.

[0077] 6. The smart cockpit 2 displays the emergency video file through a designated interface, and the user can play the video as needed to obtain the video before and after the collision event.

[0078] Furthermore, the present invention also provides an intelligent driving device, which includes the intelligent driving interaction system of the above embodiment.

[0079] Those skilled in the art will appreciate that the various modules in the motor control device can be adaptively split or merged. Such splitting or merging of specific modules does not cause the technical solution to deviate from the principles of this application. Therefore, the technical solutions after splitting or merging will fall within the scope of protection of this application.

[0080] It should be noted that the relevant user personal information that may be involved in the various embodiments of this application is strictly in accordance with the requirements of laws and regulations, follows the principles of legality, legitimacy and necessity, and is based on the reasonable purposes of business scenarios to process personal information that users actively provide during the use of products / services or generated due to the use of products / services, as well as personal information obtained with the user's authorization.

[0081] The user personal information processed by this application will vary depending on the specific product / service scenario and must be based on the specific scenario in which the user uses the product / service. This may involve the user's account information, device information, driving information, vehicle information, or other related information. This application will treat the user's personal information and its processing with a high degree of diligence.

[0082] This application attaches great importance to the security of user personal information and has taken reasonable and feasible security protection measures that comply with industry standards to protect user information and prevent personal information from being accessed, disclosed, used, modified, damaged or lost without authorization.

[0083] Thus far, the technical solutions of the present application have been described in conjunction with the preferred embodiments shown in the accompanying drawings. However, it is readily understood by those skilled in the art that the scope of protection of the present application is obviously not limited to these specific embodiments. Without departing from the principles of the present application, those skilled in the art may make equivalent changes or substitutions to the relevant technical features, and the technical solutions after such changes or substitutions will fall within the scope of protection of the present application.

Claims

1. An ADAS control device, characterized in that: include: Camera interface, communicating with ADAS camera; a recording control device, electrically connected to the camera interface, and configured to control the ADAS camera to collect video data of the environment; A random access memory electrically connected to the recording control device and configured to temporarily store the video data of the environment; a passive trigger device electrically connected to the recording control device and configured to receive a disk-drop instruction to trigger the recording control device to capture video data of a preset time period; the preset time period is a time period including the time point of the disk-drop instruction; The non-volatile memory is communicatively connected to the random access memory and is configured to store the camera data of the preset time period.

2. The ADAS control device according to claim 1, characterized in that: Also includes: a timer, electrically connected to the recording control device; The recording control device is further configured to receive the timing time of the timer and delete the video data in the random access memory that exceeds the set time length.

3. The ADAS control device according to claim 1, characterized in that: Also includes: a motion detection device, electrically connected to the passive trigger device and configured to send the disk placement instruction to the passive trigger device; The disk drop instruction is an instruction generated when the amount of motion detected by the motion detection device exceeds a preset threshold.

4. The ADAS control device according to any one of claims 1 to 3, characterized in that: Also includes: a communication interface, communicatively connected to the recording control device, and configured to send the video data of the preset time period to a data receiving device; The recording control device is further configured to receive a notification of completion of reception fed back by the data receiving device and delete the video data of the preset time period; or, upon receiving an abnormal signal from the data receiving device, resend the video data of the preset time period after the abnormality is resolved by the data receiving device.

5. The ADAS control device according to claim 4, characterized in that: The communication interface is electrically connected to the data receiving device via a bus; or The communication interface is directly electrically connected to the data receiving device via Ethernet; or The communication interface is electrically connected to the data receiving device via Ethernet and a switch.

6. An intelligent driving interactive system, characterized in that: include: The ADAS control device according to any one of claims 1 to 5; The smart cockpit is communicatively connected to the ADAS control device and is configured to receive the camera data of a preset time period sent by the ADAS control device and store the camera data of the preset time period.

7. The intelligent driving interaction system according to claim 6, characterized in that: The smart cockpit includes: The external memory interface is configured to send the required camera data to the external memory connected thereto.

8. The intelligent driving interaction system according to claim 6, characterized in that: The smart cockpit also includes: The multimedia interface is configured to display the required video data via a display device connected thereto.

9. The intelligent driving interaction system according to claim 6, characterized in that: Also includes: A vehicle controller, communicatively connected to the ADAS control device, and configured to send a disk placement instruction to the ADAS control device; an active triggering device, electrically connected to the vehicle controller, and configured to send the disk placement instruction to the vehicle controller, so that the vehicle controller sends the disk placement instruction to the ADAS control device after receiving the disk placement instruction; The data sensing device is electrically connected to the vehicle controller and is configured to send sensing data to the vehicle controller so that the vehicle controller generates the disk placement instruction based on the sensing data.

10. An intelligent driving device, characterized in that: An intelligent driving interaction system comprising any one of claims 6 to 9.

Images