Data recording apparatus, electronic control apparatus, and data recording method

The data recording device in vehicles optimizes memory usage by dynamically reducing data for repeated scenes, ensuring efficient storage and preventing memory overflow, allowing for more scenes to be recorded within limited capacity.

WO2024246978A1PCT designated stage expired Publication Date: 2024-12-05ASTEMO LTD

Patent Information

Application Number
PCT/JP2023/019651
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-26
Publication Date
2024-12-05

AI Technical Summary

Technical Problem

The limited memory capacity in vehicles' data recording devices makes it difficult to continuously record large amounts of data, especially when the same scenes are repeatedly encountered, leading to memory exhaustion and potential data loss.

Method used

A data recording device that dynamically determines whether to record data based on comparisons with past recordings, reducing data amount by executing data amount reduction processes such as reducing bit rate or not recording data when the same scene has been previously recorded, thereby optimizing storage capacity and preventing memory overflow.

Benefits of technology

This approach allows for the recording of multiple scenes within the same storage capacity, reducing memory write frequency and preventing data loss, while maintaining data quality and accuracy by dynamically adjusting data recording based on available memory space.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2023019651_05122024_PF_FP_ABST
    Figure JP2023019651_05122024_PF_FP_ABST
Patent Text Reader

Abstract

The present invention provides a data recording apparatus comprising a computation apparatus that performs computation processing and a storage unit accessible by the computation apparatus. The computation apparatus includes: a data recording trigger determination unit that determines a difference between external world recognition information indicating a recognized object and map data relating to a periphery of the position of the own vehicle and determines, as difference data to be recorded, attribute information which includes a data recording trigger representing the object causing the difference and video data relating to the difference; a data amount reduction condition determination unit that compares the attribute information of the difference data to be recorded and the attribute information of the difference data recorded in the past to determine whether the same scene has been recorded in the past; and a data recording unit that, when the same scene has been recorded in the past, performs data amount reduction processing to reduce the data amount of the difference data.
Need to check novelty before this filing date? Find Prior Art

Description

Data recording device, electronic control device, and data recording method

[0001] The present invention relates to a data recording device.

[0002] Vehicles are equipped with data recording devices that record vehicle control data in the event of an accident or breakdown, occupant operation data, video data acquired by sensors, etc. In recent years, the frequency of requests for data recording while driving is increasing, as vehicles are equipped with map data used for autonomous driving functions, and the map data is compared with real-world data acquired by sensing, and the differences between these data are recorded and used to update the map data.

[0003] Patent Literature 1 (JP 2016-161456 A) is a background technology in this field. Patent Literature 1 describes a map data processing device in which a map data calculation unit calculates second map data based on the recognition results of the surrounding environment and the vehicle's driving state, and an update data calculation unit calculates update data from the map data calculated by the map data calculation unit based on reliability. An update determination unit compares the map data in a map database DB with the update data, and if the error between the two is greater than or equal to a determination value, determines whether to update based on the number of deviations and the reliability, thereby accurately grasping the difference between a detailed map database used for driving control and actual road conditions and environment and maintaining the database up to date.

[0004] JP 2016-161456 A

[0005] As described above, map data can be updated to the latest state using real-world data collected from each vehicle. Patent Document 1 describes a technology for quantitatively evaluating differences between a map database and actual road conditions and environments in order to grasp the differences and maintain the database up to date. However, the memory capacity for data recording installed in a vehicle is limited, making it difficult to continuously record large amounts of data for long periods of time. Even when data is uploaded to a server upon network connection and the recorded data is erased, a large amount of data is recorded before the network connection is established, resulting in memory depletion. Therefore, a technology for reducing the amount of data to be recorded is desired.

[0006] A representative example of the invention disclosed in the present application is as follows: That is, a data recording device includes a calculation device that executes calculation processing and a storage unit accessible by the calculation device, wherein the calculation device determines a difference between external environment recognition information indicating a recognized object and map data around a vehicle position, and defines attribute information including a data recording trigger that indicates the object causing the difference and video data related to the difference as difference data to be recorded, a data amount reduction condition determination unit that compares the attribute information of the difference data to be recorded with attribute information of difference data recorded in the past, and determines whether the same scene has been recorded in the past, and a data recording unit that executes data amount reduction processing to reduce the data amount of the difference data if the same scene has been recorded in the past.

[0007] According to one aspect of the present invention, many scenes can be recorded in the same storage capacity.Objects, configurations and effects other than those described above will become apparent from the following description of the embodiments.

[0008] FIG. 1 is a block diagram showing a data recording device according to a first embodiment. FIG. 2 is a diagram showing an overview of a vehicle system having a data recording device according to the first embodiment. FIG. 3 is a flowchart showing processing executed in the data recording device according to the first embodiment. FIG. 4 is a flowchart showing processing executed in step S105 of FIG. 3. FIG. 5 is a diagram showing an example of the configuration of a data table that holds attribute information associated with a difference data body according to the first embodiment. FIG. 6 is a diagram showing an example of the configuration of a data amount reduction processing table according to a second embodiment. FIG. 7 is a diagram showing an example of the configuration of a data table that holds attribute information associated with a difference data body according to a third embodiment.

[0009] The following describes embodiments of the present invention. Note that the embodiments described below are preferred examples, and the present invention is not limited to the embodiments described below. The configuration of each part can be appropriately added, changed, or deleted without departing from the spirit of the present invention.

[0010] In the following embodiments, the present invention is applied to a vehicle system. In general, systems installed in vehicles are often limited in the storage capacity of the installed memory, unlike information processing systems installed in buildings such as servers.

[0011] Because the storage capacity of the installed memory is limited, the system narrows the data recording requirements to prevent the free memory capacity from being depleted, which raises the concern that data that should have been recorded may be missed. For this reason, the data recording device according to the first embodiment of the present invention uses the configuration and processing described below to, for example, dynamically change the amount of data to be recorded, thereby suppressing the recording of the same scene and enabling more scenes to be recorded with the same memory capacity.

[0012] <First Embodiment> A data recording device according to a first embodiment of the present invention will be described below with reference to FIGS.

[0013] FIG. 1 is a block diagram showing a data recording device 1 according to the first embodiment.

[0014] The data recording device 1 includes a processor 2, a memory 3, a non-volatile memory 4, and an I / O (Input / Output) device 5. The processor 2, the memory 3, the non-volatile memory 4, and the I / O device 5 are connected via an interconnect 6 to transmit and receive data.

[0015] The processor 2 is an arithmetic device that executes programs stored in the memory 3. The processor 2 executes various programs to realize each functional unit of the data recording device 1. Note that some of the processing performed by the processor 2 by executing the programs may be executed by another arithmetic device (for example, hardware such as an ASIC or FPGA).

[0016] The I / O device 5 transmits and receives data to and from other devices connected via a network link 21. For example, a controller area network (CAN), Ethernet, or camera serial interface 2 (CSI-2) is used as the network link 21. Multiple network links 21 may be connected as necessary, and different protocols may be used.

[0017] The memory 3 includes a high-speed, volatile storage element such as a dynamic random access memory (DRAM) and temporarily stores programs executed by the processor 2 and data used during program execution. Specifically, programs for executing an operating system (OS) 17, a recognition unit 7, a difference determination unit 8, a data recording trigger determination unit 9, a data amount reduction condition determination unit 10, a data recording unit 11, a vehicle position determination unit 12, and a communication unit 13 are loaded into the memory 3. The processor 2 is a computing device that executes these programs. Map data 14, recognition data 15, difference data 16, and video data 22 are also loaded into the memory 3, and the processor 2 references each piece of data. In the following description, for convenience, each unit will be described as the entity performing the processing, but the actual entity performing each process is the processor 2.

[0018] The nonvolatile memory 4 includes a ROM or flash memory, which is a nonvolatile storage element, and stores unchanging programs (for example, BIOS) and the like.

[0019] The recognition unit 7, difference determination unit 8, data recording trigger determination unit 9, data amount reduction condition determination unit 10, data recording unit 11, vehicle position determination unit 12, and communication unit 13 are software that runs on OS 17.

[0020] In the data recording device 1 configured as described above, the difference determination unit 8 compares recognition data 15 indicating an object recognized from video data 22 by the recognition unit 7 with information obtained from the vehicle position identification unit 12 and map data 14. The data recording trigger determination unit 9 determines whether data recording is necessary based on the comparison result by the difference determination unit 8. The data amount reduction condition determination unit 10 determines an appropriate data amount reduction process. The data recording unit 11 saves the data in difference data 16 in accordance with the appropriate data amount reduction process determined by the data amount reduction condition determination unit 10.

[0021] The data recording device 1 may be configured as a dedicated device, or a part of a vehicle control device may have the functions of the data recording device 1.

[0022] FIG. 2 is a diagram showing an outline of a vehicle system 18 having a data recording device 1 according to this embodiment.

[0023] The vehicle system 18 has a data recording device 1 inside the vehicle.

[0024] The communication device 20 performs wireless communication with the outside of the vehicle system 18. For example, the communication device 20 communicates using protocols such as mobile phone communication, wireless local area network (LAN), wide area network (WAN), and C2X (Car to X: vehicle-to-vehicle or vehicle-to-infrastructure communication). Through these communications, the communication device 20 acquires information about the outside world (infrastructure, other vehicles, and maps) and transmits and receives information about the vehicle, map data, and difference data. The communication device 20 also receives radio waves from satellites using the global navigation satellite system (GNSS).

[0025] Sensors 19 are connected to the data recording device 1. The sensors 19 include external sensors such as cameras, radar, LiDAR, and ultrasonic sensors, as well as dynamic system sensors that recognize the state of the vehicle system 18 (motion state, position information, acceleration, wheel speed, etc.), but some of the types of sensors listed above may also be implemented as the sensors 19. These sensors 19 acquire and output information (video data 22) input from the outside world.

[0026] FIG. 3 is a flowchart of the process executed by the data recording device 1 according to the present embodiment.

[0027] First, the vehicle position identifying unit 12 refers to information from the sensor 19 to identify the vehicle position and the lane in which the vehicle is traveling (step S101).

[0028] Next, the recognition unit 7 acquires the video data 22 output from the sensor 19, processes the video data 22 to recognize the object, generates external environment recognition information indicating the recognized object, and stores the information in the recognition data 15 (step S102).

[0029] The data recording trigger determination unit 9 then acquires map data 14 for the vicinity of the vehicle position, compares the acquired map data with the external environment recognition information, and determines whether there is a difference between the map data and the external environment recognition information. If there is a difference, the data recording trigger determination unit 9 selects video data relating to the difference as difference data and defines a data recording trigger representing the object causing the difference (step S103), and determines whether the difference exceeds a predetermined threshold (step S104). For example, if a sign not included in the map data 14 is recognized, the data recording trigger is determined to be greater than the threshold, and the sign becomes the data recording trigger. Also, if a lane marking not included in the map data 14 is recognized, the data recording trigger is determined to be greater than the threshold, and the lane marking becomes the data recording trigger. If the difference is greater than or equal to the threshold (step S104: Yes), the process proceeds to step S105. If the difference is not greater than or equal to the threshold (step S104: No), the process ends.

[0030] If the difference is equal to or greater than the threshold (step S104: Yes), the data amount reduction condition determination unit 10 refers to the difference data 16, compares the position where the difference was recorded and the data recording trigger, and determines whether the same scene has been recorded in the past (step S105). Details of step S105 will be described with reference to FIG. 4. If the same scene has been recorded (step S106: Yes), the process proceeds to step S107, and if the same scene has not been recorded (step S106: No), the process proceeds to step S108.

[0031] If the same scene has been recorded in the past (step S106: Yes), the data recording unit 11 executes a predetermined data amount reduction process (step S107). The data amount reduction process may include, for example, "reducing the bit rate of the video to be saved," "recording only the date and time, location information, and data recording trigger type," or "not recording any data."

[0032] Finally, the data recording unit 11 stores the data in the difference data 16, and the process ends.

[0033] FIG. 4 is a flowchart showing the process executed in step S105 of FIG.

[0034] First, the data amount reduction condition determination unit 10 acquires the vehicle position and the corresponding data recording trigger type (step S201).

[0035] Next, the data amount reduction condition determination unit 10 starts a loop for referring to previously recorded data from the difference data 16 (step S202).

[0036] It is determined whether the data recording trigger type of the data to be recorded is the same as the data recording trigger type of the previously recorded data (step S203). If the data recording trigger types are the same (step S203: Yes), proceed to step S204; if the data recording trigger types are different (step S203: No), repeat the processing of steps S202 to S207.

[0037] Based on the location information of the location where the data to be recorded was acquired and the location information of the location where previously recorded data was acquired, it is determined whether the position difference between the two is equal to or less than a predetermined threshold (step S204).If the position difference is equal to or less than the threshold (step S204: Yes), proceed to step S205; if the position difference is not equal to or less than the threshold (step S204: No), repeat the processing of steps S202 to S207.

[0038] Furthermore, it is determined whether the traveling direction is the same from the traveling lane information derived from the position information of the position where the data to be recorded was acquired and the traveling lane information of the position where the previously recorded data was acquired (step S205). If the traveling direction is the same (step S205: Yes), proceed to step S206; if the traveling direction is different (step S205: No), repeat the processing of steps S202 to S207.

[0039] If there is a past recording that satisfies all the conditions of steps S203 to S205, it is determined that the same scene has been recorded in the past, the data amount reduction flag for the data to be recorded is enabled, and the loop ends (step S206). Note that the determinations of steps S203 to S205 may be made using one or more of the conditions, rather than using all of them. In particular, even if the data recording trigger types are different, it may be determined that the same scene has been recorded if the positions are close and the traveling direction is the same.

[0040] When the comparison with all past records is completed, the loop ends (step S207).

[0041] 5 is a diagram showing an example of the configuration of a data table that holds attribute information associated with the difference data body recorded in the difference data 16. That is, the difference data 16 includes the data table (attribute information) shown in FIG.

[0042] 5, a record of attribute information is created for each recorded difference data. The data table includes fields for a recorded data ID indicating the correspondence with the recorded difference data itself, the date and time when the difference data was recorded, the location information (latitude, longitude) where the difference data was recorded, a lane ID indicating the lane the vehicle was traveling in when the difference data was recorded, and a data recording request trigger ID indicating the type of data recording request trigger.

[0043] The data amount reduction condition determination unit 10 accesses this data table and checks the past data.

[0044] As described above, according to the first embodiment of the present invention, when a data recording request is issued, previously recorded data is compared to determine whether the same scene as the data to be recorded has been recorded in the past, and the amount of data to be recorded is dynamically changed to avoid recording the same scene or reduce the amount of data for the same scene. This allows more scenes to be recorded in the same storage capacity, improving the optimization efficiency of map data. Furthermore, since the number of times data is written to the memory 3 is reduced, deterioration of the memory 3 can be suppressed.

[0045] <Second Example> Next, a data recording device according to a second example of the present invention will be described with reference to Fig. 6. The second example differs from the first example described above in the data volume reduction process. In the second example, differences from the first example will be mainly described, and the configuration of the data recording device 1 and the configuration of the vehicle system 18 having the data recording device 1 are the same as those in the first example, so a description of these will be omitted.

[0046] FIG. 6 is a diagram showing an example of the configuration of a data amount reduction process table according to the second embodiment of the present invention.

[0047] The data amount reduction process table shown in FIG. 6 is referenced in step S107 of the flowchart in FIG.

[0048] When performing the data volume reduction process, the data recording unit 11 monitors the free space in the difference data storage area and dynamically changes the data volume reduction method according to the monitoring results. The data volume reduction process table records the type of data to be recorded and the data specifications corresponding to the free space in the difference data storage area. Note that the capacity of the difference data storage area may be fixed or may change dynamically.

[0049] In the example shown in FIG. 6 , available memory space is divided into five levels, and for each level, the necessity of text data such as location information (ON = record, OFF = not record) and the specifications of the video data (length, bit rate) are recorded. When the available space in the difference data storage area becomes low, the amount of data recorded is controlled to be reduced. For example, if the available space in the difference data storage area is 80% or more, the video data and text data (data in the data table shown in FIG. 5 ) output from the sensor 19 are recorded as is. If the available space in the difference data storage area is between 80% and 50%, the video data and text data output from the sensor 19 are converted to a low bit rate and recorded. If the available space in the difference data storage area is between 50% and 30%, one frame of video data (i.e., a still image) and text data are recorded instead of video data. If the available space in the difference data storage area is between 30% and 15%, no video data is recorded, and only text data is recorded. If the available space in the difference data storage area is less than 15%, the difference data is not recorded.

[0050] According to the second embodiment of the present invention, when there is sufficient free space in the difference data storage area, the execution of the data volume reduction process is prevented, thereby improving the accuracy and quality of the difference data when there is sufficient free space in the difference data storage area.

[0051] <Third Example> Next, a data recording device according to a third example of the present invention will be described with reference to Fig. 7. In the third example, the data table differs from that of the first example. In the third example, the differences from the first example will be mainly described, and the configuration of the data recording device 1 and the configuration of the vehicle system 18 having the data recording device 1 are the same as those of the first example, so a description of these will be omitted.

[0052] FIG. 7 is a diagram showing an example of the structure of a data table that holds attribute information associated with the difference data body recorded in the difference data 16 according to the third embodiment of the present invention.

[0053] 7 holds attribute information associated with the difference data body recorded in the difference data 16, and records attribute information of data recorded by the own vehicle and attribute information of data recorded by other vehicles. That is, in the third embodiment, the difference data 16 includes the data table (attribute information) shown in FIG. 7 and the difference data body.

[0054] 7, a record of attribute information is created for each recorded difference data. The data table includes fields for a recorded data ID indicating correspondence with the recorded difference data itself, the date and time when the difference data was recorded, location information (latitude, longitude) where the difference data was recorded, a lane ID indicating the lane the vehicle was traveling in when the difference data was recorded, a data recording request trigger ID indicating the type of data recording request trigger, and a vehicle ID. The vehicle ID is set to 0 for the subject vehicle, and for other vehicles, identification information assigned to the vehicle is recorded.

[0055] The attribute information of the data recorded by the other vehicle is acquired at any timing via the communication unit 13 through vehicle-to-vehicle communication or communication with a data center.

[0056] The data amount reduction condition determination unit 10 of the third embodiment accesses the data table shown in Fig. 7 and checks previously recorded data. Therefore, by checking the previously recorded data, it is possible to determine whether the same scene as the data to be recorded has been recorded in the subject vehicle or another vehicle in the past, thereby making it possible to avoid recording the same scene in multiple vehicles or reduce the amount of data for the same scene.

[0057] The data table in the third embodiment may be stored in a data center instead of in the memory of the vehicle. When the data table is stored in the data center, the data amount reduction condition determination unit 10 accesses the data center via the communication unit 13 and acquires information for comparison with past data.

[0058] According to the third embodiment of the present invention, data duplication can be avoided more efficiently between vehicles recording past scenes, reducing memory consumption and improving the accuracy and quality of difference data.

[0059] The present invention is not limited to the above-described embodiments, and includes various modifications and equivalent configurations within the spirit of the appended claims. For example, the above-described embodiments have been described in detail to clearly explain the present invention, and the present invention is not necessarily limited to configurations including all of the described configurations. Furthermore, part of the configuration of one embodiment may be replaced with the configuration of another embodiment. Furthermore, the configuration of another embodiment may be added to the configuration of one embodiment. Furthermore, part of the configuration of each embodiment may be added, deleted, or replaced with other configurations.

[0060] Furthermore, the aforementioned configurations, functions, processing units, processing means, etc. may be realized in part or in whole in hardware, for example by designing them as integrated circuits, or may be realized in software by having a processor interpret and execute a program that realizes each function.

[0061] Information such as programs, tables, and files that realize each function can be stored in a storage device such as a memory, hard disk, or SSD (Solid State Drive), or in a recording medium such as an IC card, SD card, or DVD.

[0062] In addition, the control lines and information lines shown are those that are considered necessary for explanation, and do not necessarily represent all the control lines and information lines that are necessary for implementation. In reality, it can be assumed that almost all components are interconnected.

Claims

1. A data recording device comprising: a calculation device that executes calculation processing; and a memory unit accessible to the calculation device; the calculation device determines a difference between external recognition information indicating a recognized object and map data around the vehicle position, and determines attribute information including a data recording trigger that indicates the object that causes the difference and video data related to the difference as difference data to be recorded; the calculation device compares the attribute information of the difference data to be recorded with attribute information of difference data recorded in the past, and determines whether the same scene has been recorded in the past; and a data recording unit that executes a data amount reduction process to reduce the data amount of the difference data if the same scene has been recorded in the past.

2. A data recording device as described in claim 1, characterized in that the data amount reduction condition determination unit determines that the same scene has been recorded in the past when the difference between the position where the difference data to be recorded was obtained and the position where the previously recorded difference data was obtained is within a predetermined threshold, and the traveling direction of the vehicle where the difference data to be recorded was obtained is the same as the traveling direction of the vehicle where the previously recorded difference data was obtained.

3. A data recording device as described in claim 1, characterized in that the data amount reduction condition determination unit determines that the same scene has been recorded in the past when the difference between the position at which the difference data to be recorded was obtained and the position at which the previously recorded difference data was obtained is within a predetermined threshold, the direction of travel of the vehicle at which the difference data to be recorded was obtained is the same as the direction of travel of the vehicle at which the previously recorded difference data was obtained, and the data recording trigger type of the difference data to be recorded is the same as the data recording trigger type of the previously recorded difference data.

4. A data recording device as described in claim 1, characterized in that the data recording unit reduces the amount of data of the difference data if the free space in the area of ​​the memory unit for recording the difference data to be recorded is less than a predetermined threshold value.

5. A data recording device as described in claim 1, wherein the calculation device has a communication unit which acquires attribute information of the difference data recorded by other vehicles, the memory unit stores attribute information of the difference data recorded by the vehicle itself and attribute information of the difference data recorded by other vehicles, and the data amount reduction condition determination unit compares the attribute information of the difference data to be recorded with the attribute information of the difference data recorded by the vehicle itself and the attribute information of the difference data recorded by other vehicles to determine whether the same scene has been recorded in the past.

6. An electronic control device mounted on a vehicle, comprising: a calculation device that executes calculation processing; and a memory unit accessible to the calculation device; wherein the calculation device determines a difference between external recognition information indicating a recognized object and map data around the vehicle's position, and defines attribute information including a data recording trigger that indicates the object that causes the difference and video data related to the difference as difference data to be recorded; a data amount reduction condition determination unit in which the calculation device compares the attribute information of the difference data to be recorded with attribute information of data recorded in the past, and determines whether the same scene has been recorded in the past; and a data recording unit in which the calculation device executes a data amount reduction process to reduce the data amount of the difference data if the same scene has been recorded in the past.

7. A data recording method executed by a data recording device, the data recording device having a calculation device that executes calculation processing and a memory unit accessible by the calculation device, the data recording method comprising: a data recording trigger determination step in which the calculation device determines a difference between external recognition information indicating a recognized object and map data around the vehicle position, and defines attribute information including a data recording trigger that indicates the object causing the difference and video data related to the difference as difference data to be recorded; a data amount reduction condition determination step in which the calculation device compares attribute information of the difference data to be recorded with attribute information of data recorded in the past, and determines whether the same scene has been recorded in the past; and a data recording step in which the calculation device executes a data amount reduction process to reduce the data amount of the difference data if the same scene has been recorded in the past.

Citation Information

Patent Citations

  • Map data processor for vehicle

    JP1999065435A

  • Navigation device, updating system of map data, and updating method of map data

    JP2006275778A

  • Map distribution server for car navigation device, map data distribution system, and road difference data generation method

    JP2014130232A

  • Information processing device and program

    JP2021135380A

Cited By

  • Travel route management system

    US12624955B2

  • Travel route management system

    US20250020477A1