Methods, error management devices, computer programs, and computer program products for error management of vehicles.
By combining camera units and managing the temporal correlation between image data and error entries within the vehicle, the problem of insufficient utilization of image data in the vehicle error management system is solved, improving error cause assessment and security, and reducing costs.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-05-29
- Publication Date
- 2026-03-10
AI Technical Summary
Existing vehicle error management systems struggle to effectively utilize image data for error assessment and analysis, resulting in high costs for problem elimination and system optimization, as well as insufficient safety.
By installing camera units in vehicles, requesting and assigning image data combined with error entries to form temporal correlations, and utilizing existing infrastructure for image data storage and analysis, the efficiency and security of error cause assessment can be improved.
It enables clear assessment of vehicle error states, reduces the cost of problem elimination and system optimization, and improves vehicle safety and maintenance efficiency.
Smart Images

Figure CN113874873B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to a method for error management in vehicles. It also relates to an apparatus for error management in vehicles. Furthermore, it relates to a computer program and computer program product for error management in vehicles. Background Technology
[0002] Errors may occur in the vehicle. If an error is detected, it can be handled by the error management device. Summary of the Invention
[0003] The objective of this invention is to contribute to accurate error management of vehicles.
[0004] The task is solved by the features of the present invention.
[0005] According to a first aspect, the present invention is characterized by a method for error management of vehicles.
[0006] The vehicle has at least one camera unit configured to provide image data.
[0007] According to the first aspect, if a corresponding error state regarding the vehicle is detected, a corresponding error entry is created based on the detected error state. The corresponding error entry represents information about the detected error state. Based on the detected error state, corresponding image data from the at least one camera unit is requested. This request for image data from the at least one camera unit is time-correlated with the detected error state. The requested image data is then assigned to the corresponding error entry.
[0008] Therefore, the requested image data can be used as supplementary information for the corresponding error entries, leveraging the vehicle's existing infrastructure. This is advantageous, for example, for assessing the cause of the detected error state. For instance, the cause of the detected error state can be clearly assessed. Furthermore, this facilitates, for example, the analysis of the problem situation and / or reduces costs.
[0009] For example, this can facilitate the elimination of vehicle problems and / or system optimization. Furthermore, vehicle safety can be improved, for example, if the cause of the error can be clearly assigned to the corresponding detected error state through additional information in the form of requested image data. For example, this can help identify clear misuse by the user and / or vehicle driver, such as the use of a mobile phone affecting the field of view of the vehicle's camera unit. For example, the requested image data assigned to the corresponding error entry can be read along with the corresponding error entry during repair and / or evaluation in the workshop or similar location, to facilitate, for example, eliminating the problem and / or evaluating the cause of the corresponding detected error state and / or resolving the cause of the error and / or explaining repair costs. For example, the requested image data assigned to the corresponding error entry can also be advantageously used in the development of the vehicle along with the corresponding error entry.
[0010] For example, the at least one camera unit is a camera and / or an infrared camera or the like. For example, the at least one camera unit is located inside and / or outside the vehicle. For example, the at least one camera unit is configured for facial recognition of the vehicle driver. For example, the at least one camera unit is configured to provide image data via the vehicle's bus system or network connection. For example, the bus system is a Controller Area Network (CAN) bus system. For example, the network connection is particularly configured as a wireless connection or an optical network connection.
[0011] The corresponding error states are, for example, errors in any vehicle function. For instance, corresponding error states could be a malfunction in the vehicle's electronic window regulators and / or an error in the driver's facial recognition and / or a malfunction in the vehicle's trailer hitch and / or a malfunction in the area surrounding the vehicle, or similar malfunctions.
[0012] For example, when a malfunction occurs in the vehicle's electronic window regulator, a corresponding error status is detected.
[0013] The corresponding error entries may include information in text form, such as time information and / or vehicle status and / or other information. Text-based information specifically includes text and / or numbers and / or any symbols or similar symbols. For example, the corresponding error entries may specifically be vehicle error memory entries. If necessary, the corresponding error entries may not contain corresponding image data.
[0014] The temporal correlation between the corresponding image data and the corresponding detected error state includes, for example, a predetermined time range before and after the time point when the corresponding error state was detected. The temporal correlation also includes the time point when the corresponding error state was detected.
[0015] For example, requesting corresponding image data from at least one camera unit for a predetermined time range and / or a predetermined time point. For example, the predetermined time range and / or predetermined time point depends on the type of the corresponding error state. For example, the predetermined time range and / or predetermined time point are specifically predetermined by user input. For example, the requested image data provides information for assessing the cause of the error in the corresponding detected error state.
[0016] For example, requesting corresponding image data for a predetermined time point, such that the predetermined time point is before the time point when the corresponding error state is detected. Alternatively, requesting corresponding image data for a predetermined time point, such that the predetermined time point is after the time point when the corresponding error state is detected. Or, requesting corresponding image data for a predetermined time point, such that the predetermined time point corresponds specifically to the time point when the corresponding error state is detected.
[0017] For example, the requested image data can be assigned to the corresponding error entry based on the name and / or part information and / or code or similar information. Assignment can be done, for example, in chronological order or independently of time.
[0018] According to one alternative implementation, corresponding image data of the at least one camera unit is requested from an image data buffer based on a detected error state. The image data buffer contains previously stored image data of the at least one camera unit.
[0019] Therefore, image data already stored in the vehicle's existing infrastructure can be used for allocation.
[0020] For example, image data from at least one camera unit is cached in an image data buffer for different time ranges. This can be the case if they have already been used by the vehicle's functions. For example, different time points have predetermined time ranges and / or predetermined time points and are therefore available for allocation.
[0021] For example, an image data buffer is a central data storage device for a vehicle. Alternatively, an image data buffer can be a distributed data storage device, such as one disposed within a structural unit having at least one camera unit.
[0022] According to another alternative implementation, corresponding image data of the at least one camera unit is requested from the at least one camera unit based on the corresponding detected error state.
[0023] Therefore, the corresponding image data can be requested directly from the at least one camera unit.
[0024] For example, image data can be requested from the at least one camera unit by requesting image data for a predetermined time range and / or a predetermined time point. For example, the at least one camera unit can be activated if necessary to generate the requested image data.
[0025] According to another alternative implementation, the corresponding error entries are stored in an error entry memory. Thus, the vehicle's existing infrastructure can be used to store the corresponding error entries. Furthermore, the corresponding error entries can be stored independently of the requested image data.
[0026] For example, error entry memory, especially vehicle error memory, is constructed to store error memory entries.
[0027] For example, error entry storage can also be located outside the vehicle.
[0028] According to another alternative implementation, the image data of the at least one camera unit requested is stored in an image data memory.
[0029] Therefore, the vehicle's existing infrastructure can be used to store the requested image data. Furthermore, the requested image data can be stored independently of the corresponding error entries.
[0030] For example, image data storage is the central data storage of a vehicle. Image data storage also corresponds to error entry storage.
[0031] For example, image data storage devices can also be located outside the vehicle.
[0032] According to another alternative implementation, the vehicle includes a plurality of camera units. A subset of the plurality of camera units is selected based on a corresponding detected error state. Image data corresponding to the subset of the plurality of camera units is requested based on the corresponding detected error state. This request for the corresponding image data of the subset of the plurality of camera units ensures that the corresponding image data is temporally correlated with the corresponding detected error state.
[0033] Therefore, image data can be requested based on the corresponding detected error state. Furthermore, image data can be requested based on the type and / or location of the corresponding detected error state.
[0034] For example, a subset can be predefined based on user input. Alternatively, a subset can be determined automatically. Another example is a subset that depends on the detected error state.
[0035] For example, the multiple camera units are installed in different areas of the vehicle. For example, the image data of a subset of the multiple camera units are correlated with the corresponding detected error states.
[0036] According to a second aspect, the present invention features an error management device for a vehicle, the vehicle including at least one camera unit configured to provide image data. The error management device has an error entry memory configured to store corresponding error entries. Furthermore, the error management device has an image data memory configured to store image data requested accordingly. The error management device is configured to perform a method for error management of the vehicle.
[0037] For example, an error management device is installed in a structural unit within the vehicle.
[0038] For example, error management devices may be located in different structural units. For example, an error management device may include a first sub-error management device and a second sub-error management device. For example, the first sub-error management device may include a first communication interface. For example, the second sub-error management device may include a second communication interface. For example, the first communication interface may be configured to receive data from the second communication interface. For example, the second communication interface may be configured to receive data from the first communication interface. For example, the first sub-error management device may be located inside the vehicle, and the second sub-error management device may be located outside the vehicle. For example, the second sub-error management device may be located, particularly at the rear end of the vehicle or in the cloud. For example, the data may include corresponding error entries and / or corresponding requested image data.
[0039] For example, the first communication interface and the second communication interface are interconnected via a network connection.
[0040] For example, the first sub-error management device includes an error entry memory and the second sub-error management device includes an image data memory, and vice versa. For example, the second sub-error management device includes both an error entry memory and an image memory.
[0041] According to another aspect, the present invention is characterized by a computer program comprising instructions that, when executed by a computer, cause the computer to perform a method for error management of a vehicle when executed on a data processing device.
[0042] According to another aspect, the present invention is characterized by a computer program product comprising executable program code that, when executed by a data processing device, performs a method for error management of a vehicle.
[0043] Computer program products, in particular including media readable by data processing devices, on which program code is stored. Attached Figure Description
[0044] The embodiments of the present invention are described in detail below with reference to the schematic diagrams. The accompanying drawings are as follows:
[0045] Figure 1 A schematic diagram of the vehicle is shown;
[0046] Figure 2 A schematic diagram of the first type of distributed system is shown;
[0047] Figure 3 A schematic diagram of the second type of distributed system is shown;
[0048] Figure 4 A schematic diagram of the third type of distributed system is shown;
[0049] Figure 5 A flowchart is shown for the error management procedure used for vehicles. Detailed Implementation
[0050] Figure 1 A schematic diagram of vehicle 10 is shown. Vehicle 10 has multiple camera units 21, 23, and 25 configured to provide image data. Furthermore, vehicle 10 has an error management device 30 configured to request image data from the multiple camera units 21, 23, and 25. The error management device 30 has an error entry memory 40 configured to store corresponding error entries FE. Additionally, the error management device 30 has an image data memory 50 configured to store the corresponding requested image data ABD.
[0051] For example, the multiple camera units 21, 23, 25 and the error management device 30 are interconnected via the vehicle's bus system or network connection. For example, the bus system is a Controller Area Network (CAN) bus system. For example, the network connection is particularly a wireless connection or an optical network connection.
[0052] For example, the multiple camera units 21, 23, and 25 may also include more than three camera units.
[0053] Figure 2 A schematic diagram of a first type of distributed system is shown. The first distributed system includes a vehicle 10. The vehicle 10 has the plurality of camera units 21, 23, and 25. Furthermore, the vehicle 10 has a first sub-error management device 30a. The first sub-error management device 30a has a first communication interface 33a. The distributed system also includes a second sub-error management device 30b disposed outside the vehicle 10. For example, the second sub-error management device 30b is particularly disposed at the rear end of the vehicle or in the cloud. The second sub-error management device 30b has a second communication interface 33b. The second sub-error management device 30b includes an error entry memory 40. Furthermore, the second sub-error management device 30b includes an image data memory 50.
[0054] For example, the second communication interface 33b is configured to receive the corresponding error entry FE and / or the corresponding requested image data ABD from the first communication interface 33a.
[0055] For example, the first communication interface 33a and the second communication interface 33b are interconnected via a network connection.
[0056] Figure 3 A schematic diagram of a second type of distributed system is shown. The second type of distributed system has the same features as the first type of distributed system, wherein the first sub-error management device 30a includes an error entry memory 40 and the second sub-error management device 30b includes an image data memory 50.
[0057] Figure 4 A schematic diagram of a third type of distributed system is shown. The third type of distributed system has the same features as the first type of distributed system, wherein the first sub-error management device 30a includes an image data storage 50 and the second sub-error management device 30b includes an error entry storage 40.
[0058] Figure 5 A flowchart is shown for an error management program for vehicle 10, which is stored in a program and / or data memory and can be run by a computing unit. For example, an error management device 30 for vehicle 10 includes a program and / or data memory and a computing unit that runs the program to process measurement data recordings.
[0059] The program begins in step S101, in which variables are initialized if necessary.
[0060] The program continues in step S103. In step S103, it is determined whether a corresponding error state FZ regarding vehicle 10 is detected. If a corresponding error state FZ regarding vehicle 10 is detected, processing continues in step S105. Otherwise—if necessary, after a predetermined waiting duration—processing continues again in step S103.
[0061] For example, the corresponding error status is an error during vehicle driver facial recognition.
[0062] In step S105, a corresponding error entry FE is created based on the detected error state DFZ. The corresponding error entry FE represents information about the detected error state DFZ.
[0063] For example, the corresponding error entries, especially the vehicle's error memory entries, represent errors during facial recognition.
[0064] After step S105, the program continues in step S107. In step S107, a subset TM of the plurality of camera units 21, 23, and 25 is selected according to the corresponding detected error state DFZ.
[0065] For example, camera unit 21 is an interior space camera mounted on the vehicle's rearview mirror, and its field of view includes the vehicle's driver's seat. For example, camera unit 23 is another interior space camera, and its field of view includes the vehicle's driver's seat. For example, camera unit 25 is an interior space camera, and its field of view does not include the vehicle's driver's seat.
[0066] To address errors in facial recognition, such as those caused by user input, the subset TM is predefined such that the subset TM includes camera units 21 and 23.
[0067] Following step S107, the program continues in step S109. In step S109, the corresponding image data BD of a subset TM of the plurality of camera units 21, 23, and 25 is requested according to the corresponding detected error state DFZ. This request for the image data BD of the subset TM of the plurality of camera units 21, 23, and 25 ensures that the corresponding image data BD is temporally correlated with the corresponding detected error state DFZ.
[0068] Optionally, in step S109, the corresponding image data BD of a subset TM of the plurality of camera units 21, 23, 25 is requested from the image data buffer according to the corresponding detected error state DFZ. The image data buffer has the already stored image data of the subset TM of the plurality of camera units 21, 23, 25.
[0069] Optionally, in step S109, the corresponding image data BD of the subset TM of the plurality of camera units 21, 23, 25 is requested from the subset TM of the plurality of camera units 21, 23, 25 according to the corresponding detected error state DFZ.
[0070] For example, in response to errors during facial recognition, a request is made for the corresponding image data BD, including a subset TM of camera units 21 and 23, and the corresponding image data is provided via the vehicle's bus system. For example, the image data BD of camera unit 21 is already stored in an image data buffer and is requested from the image data buffer. For example, camera unit 23 is activated to generate the corresponding image data BD, and the corresponding image data BD is requested directly from camera unit 23.
[0071] For example, request the corresponding image data BD of a subset TM for the time point when an error in face recognition is detected.
[0072] After step S109, the process continues in step S111. In step S111, the requested image data ABD is assigned to the corresponding error entry FE.
[0073] After step S111, the program continues in step S113. In step S113, the corresponding error entry FE is stored in the error entry memory 40.
[0074] For example, an error entry memory is a vehicle's configuration used to store error memory entries.
[0075] Following step S113, the program continues in step S115. In step S115, the requested image data ABD of the subset TM of the plurality of camera units 21, 23, and 25 is stored in the image data memory 50.
[0076] For example, the image data memory is an error memory. For example, the image data ABD of a subset TM including camera units 21 and 23 requested in response is stored in the error memory along with the error memory entry.
[0077] The program then terminates in step S117 and may restart in step S101 if necessary.
Claims
1. Method for error management of a vehicle (10), the vehicle having a plurality of camera units (21, 23, 25) configured for providing image data, wherein: - if a respective error state (FZ) with respect to the vehicle (10) is detected, wherein the error state is an error state of a vehicle function, - a respective error entry (FE) is created depending on the respective detected error state (DFZ), the error entry representing information with respect to the respective detected error state (DFZ), - a subset (TM) of the plurality of camera units (21, 23, 25) is selected depending on the respective detected error state (DFZ), the subset of the plurality of camera units having a relevance to the respective detected error state, - respective image data (BD) of the subset (TM) of the plurality of camera units (21, 23, 25) is requested depending on a type and / or a location of the respective detected error state (DFZ) such that the respective image data (BD) has a temporal relevance to the respective detected error state (DFZ), - the respective requested image data (ABD) is assigned to the respective error entry (FE) in order to use the respective requested image data as additional information of the respective error entry, and wherein the respective image data (BD) of the subset (TM) of the plurality of camera units (21, 23, 25) is requested depending on the respective detected error state (DFZ) from an image data buffer, the image data buffer having already stored image data of the subset (TM) of the plurality of camera units (21, 23, 25), and the image data of the subset (TM) of the plurality of camera units (21, 23, 25) requested from the image data buffer is already stored in the image data buffer.
2. The method of claim 1, wherein, The respective image data (BD) of the subset (TM) of the plurality of camera units (21, 23, 25) is requested depending on the respective detected error state (DFZ).
3. The method of claim 1 or 2, wherein, The respective error entry (FE) is stored in an error entry storage (40).
4. The method of claim 1 or 2, wherein, The respective requested image data of the subset (TM) of the plurality of camera units (21, 23, 25) is stored in an image data storage (50).
5. The method of claim 1 or 2, wherein, The respective error state is a malfunction of an electronic window lifter of the vehicle and / or an error during a face recognition of a driver of the vehicle and / or a malfunction of a trailer coupler of the vehicle.
6. Error management device (30) for a vehicle (10), the vehicle comprising a plurality of camera units (21, 23, 25) configured for providing image data, the error management device (30) having: - an error entry storage (40) configured for storing a respective error entry (FE), - an image data storage (50) configured for storing respective requested image data, and the error management device (30) is configured to perform the method according to any one of claims 1 to 5.
7. Computer program product comprising executable program code, wherein The program code, when executed by the data processing device, performs the method according to any one of claims 1 to 5.
Citation Information
Patent Citations
Designated driving service vehicle monitoring system and monitoring method
CN105023318A
Intelligent informing-police method and device for vehicle
CN106891845A
Discretization facilities for vehicle event data recorders
US20080147266A1
Multimedia recording device for resolving memory error for vehicle
WO2012165675A1