Object recognition technology for vehicle treatment systems and plant control
The integration of AI-driven object recognition and distributed data processing in vehicle treatment systems addresses the limitations of existing systems by enabling automated detection and handling of exceptional conditions, enhancing usability and reducing damage risks.
Patent Information
- Authority / Receiving Office
- DE · DE
- Patent Type
- Utility models
- Current Assignee / Owner
- OTTO CHRIST
- Filing Date
- 2024-12-03
- Publication Date
- 2026-04-23
AI Technical Summary
Existing vehicle treatment systems are limited in their ability to handle vehicles with impermissible shapes or attachments, often requiring manual user intervention and lacking optimal automated detection and handling of exceptional conditions.
An object recognition technology using AI modules and environmental sensing systems to detect interaction errors and exceptional vehicle conditions, enabling automated adaptation or interruption of treatment processes, and distributing data processing across local and remote systems for efficient management.
Enhances the usability of vehicle treatment systems by allowing automatic detection and handling of complex exceptional conditions, reducing potential damage, and improving the efficiency of vehicle treatment operations.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[0001] The present invention relates to the field of controlling vehicle treatment systems and the use of object recognition techniques before and during vehicle treatment.
[0002] Existing vehicle treatment systems are generally limited to ensuring that vehicle treatment can be carried out flawlessly if the vehicle to be treated does not have an impermissible shape. This means, for example, that the vehicle parts (relevant for carrying out the treatment) should be in a predetermined standard position. Most vehicle treatment systems, for instance, stipulate that antennas must be retracted and side mirrors folded in. Furthermore, vehicle treatment is usually impossible or only possible with limitations if one or more attachments, such as luggage racks or bicycle carriers, are fitted to the vehicle. Checking whether these conditions are met is generally the responsibility of a user, such as a customer using a self-service vehicle treatment system, and / or a system operator or employees of the operating company.
[0003] In practice, it is also known to use image processing techniques for the recognition of vehicle contours.
[0004] DE 20 20219 105 667 U1 discloses a monitoring device for securing a vehicle treatment system. If the opening of a vehicle door is detected, an emergency stop of the vehicle treatment system is triggered.
[0005] US patent 2024 / 0375619A1 discloses a self-adapting capability for car wash equipment. A LiDAR sensor can capture multiple points that together define the vehicle's contour. These points can also define accessories such as a grille. A vehicle can be classified by type and model year (e.g., 2006 BMW M3) to load a corresponding 3D model containing the vehicle's contour.
[0006] From the subsequently published WO 2025 / 091 013 A1, an intelligent collision avoidance system for car washes is known, in which the rear of a vehicle driving ahead and the front of a following vehicle are detected in a car wash.
[0007] Further detection techniques for car washes are known from DE 20 2019 105 667 U1 and CN 1 10 901 597 A.
[0008] The vehicle treatment systems and their control systems known to date are not optimally designed.
[0009] The object of the present invention is to demonstrate an improved object recognition technology and an improved system control for vehicle treatment systems.
[0010] The invention solves this problem through the features of the independent claims.
[0011] The present disclosure comprises a number of aspects which, individually or collectively, contribute to solving the aforementioned problem. These aspects can each be used individually or in any combination.
[0012] The advantages of these aspects can be either individual or combined, that ▪ Interaction error states are detected that may occur or are about to occur between the vehicle treatment system, in particular a machine part, and the vehicle to be treated - this allows previously undetected error states to be avoided, detected or (semi-)automatically treated; ▪ Automatic detection and handling of exceptional conditions takes place, in particular with a distinction between permissible and impermissible exceptional conditions - this enables automatic vehicle treatments for situations that were previously reserved for manual or human-assisted treatment; ▪ a computer-readable, ordered data structure is output that defines an exceptional characteristic of a vehicle to be treated in such a way that a plant control system can perform appropriate actions - this makes it possible to represent a plurality of exceptional characteristics and any existing sub-states in a computer-processable form, so that their consideration in automated treatment is made possible; ▪ the automated detection of vehicle parts of a vehicle to be treated and / or attachments on a vehicle to be treated is made possible, in particular with a distinction between various permissible and impermissible conditions - this significantly increases the number of automatically manageable exception conditions, which improves the usability of the treatment system; ▪ a distributed execution of process steps for object recognition on the one hand and process steps for controlling a treatment plant on the other hand is enabled on different data processing systems, in particular on a local data processing device at the treatment plant and a remote data processing device, e.g. a server; ▪ enables particularly fast and / or accurate detection of exceptional conditions with differentiation of several possible vehicle sub-objects, in particular with differentiation of vehicle parts and / or attachments - this makes it possible to manage even complex exceptional conditions with a plurality of parts to be considered for plant control; ▪ Damage that could be caused by an exceptional condition can be avoided if this exceptional condition occurs or is detected before or directly at the start of vehicle treatment. ▪ Consequential damages that could be caused by an interaction error condition and / or an exceptional condition are avoided or limited if this interaction error condition / exceptional condition only occurs or is detected subsequently, i.e. during vehicle treatment. ▪ Object recognition can be performed in a particularly resource-efficient manner.
[0013] A separate aspect of the present disclosure describes a vehicle treatment system control unit that includes an environmental sensing system which obtains environmental sensing data (directly or indirectly) from at least one sensor. The environmental sensing data includes, at least temporarily, a representation of at least one vehicle to be treated and a representation of at least one machine part of the vehicle treatment system. The environmental sensing system further includes a trained AI module that analyzes, within the current environmental sensing data, an interaction between the vehicle treatment system and the at least one vehicle to be treated and / or detects an interaction error state. Alternatively or additionally, it may be provided that the vehicle treatment system control unit receives a detected interaction error state, which is detected in particular by a remote system, via a communication interface.
[0014] The vehicle treatment system control system preferentially controls the activation of the vehicle treatment system based on the detected interaction error state.
[0015] The vehicle treatment system control can, in particular, adapt and continue an ongoing operation of the vehicle treatment system, OR interrupt an ongoing operation of the vehicle treatment system; AND / OR execute a mitigation program, in particular a predefined mitigation program or an ad-hoc mitigation program that is formed situation-specifically from at least two mitigation steps.
[0016] An interaction error state can be defined arbitrarily. Possible interaction error states include: A treatment brush getting stuck to a vehicle; AND / OR An impermissible misorientation of a treatment brush relative to a surface of the vehicle to be treated, in particular an impermissible angle of inclination of a treatment brush; AND / OR An impermissible impending or already completed contact between a machine part and the vehicle to be treated, in particular an impermissible contact with a remote treatment unit that is not normally intended for contact with the vehicle.
[0017] One or more interaction error states can be detected, for example, if the side roller is tilted because it has become entangled in the trailer hitch. A mitigation program can then be executed to free the side roller. Alternatively or additionally, it can be detected that a (additional) vehicle not intended for treatment has entered or is entering the treatment area (intended for another vehicle). A mitigation program can then be executed, for example, to remove at least one machine component from an expected collision position.
[0018] Another interaction error condition can detect that a roof roller is hanging at an angle relative to the horizontal direction, for example because a guide element has broken, and / or that a side roller or a washing brush is lying on the ground, for example because a suspension / fastening has failed.
[0019] Another aspect of the disclosure relates to an object recognition method for supporting plant control in a vehicle treatment plant. The object recognition method is preferably designed as a computer-implemented method. It can be executed on a data processing device, in particular on a plant control system, or on an external computing device, in particular a server. The object recognition method according to this aspect comprises the following steps: Acquisition of environmental data acquired by at least one sensor on the vehicle treatment system. The environmental data includes, at least temporarily, a representation of at least one vehicle to be treated and a representation of at least one machine part of the vehicle treatment system; using a trained AI module: analysis of an interaction between the vehicle treatment system and the at least one vehicle to be treated and / or detection of an interaction error state; output of a (detected) interaction error state.
[0020] An independent aspect of the present disclosure provides that a vehicle treatment system control (i.e., in particular, a system control for a vehicle treatment system) includes an environment sensing system that obtains environment sensing data from at least one sensor, wherein the environment sensing data includes, at least temporarily, a representation of a vehicle to be treated, wherein the environment sensing system further includes a trained AI module that analyzes a characteristic of the vehicle to be treated within the instantaneous environment sensing data and recognizes an exceptional characteristic of the vehicle relevant to the treatment intervention, wherein the vehicle treatment system control further prevents the start of the vehicle treatment or adapts and starts a treatment program for the vehicle treatment based on the recognized exceptional characteristic of the vehicle to be treated.
[0021] Another independent aspect of the present disclosure provides that a vehicle treatment system control includes an environment sensing system which obtains environment sensing data from at least one sensor, wherein the environment sensing data includes at least a temporary representation of a vehicle to be treated, wherein the environment sensing system further includes a trained AI module which analyzes a characteristic of the vehicle to be treated within the current environment sensing data and recognizes an exceptional characteristic of the vehicle relevant for the treatment intervention, wherein the vehicle treatment system control further interrupts an ongoing vehicle treatment or adapts and continues an ongoing treatment program of the vehicle treatment based on the recognized exceptional characteristic of the vehicle to be treated.
[0022] The aforementioned aspects can be combined in a preferred design.
[0023] The vehicle treatment system control and / or the environment detection and / or the process control can be individually or jointly designed to classify a detected exceptional condition as permissible or impermissible, in particular as permissible or impermissible for an adaptation of a treatment program.
[0024] The detection of an exceptional characteristic of the vehicle to be treated can be carried out in any manner. Preferably, the detection is performed by at least one AI module. The AI module can have any configuration and arrangement. For example, the at least one AI module can be integrated with a sensor and / or be located in a system control unit and / or be implemented by a separate (local or remote) data processing device / service. Preferably, the AI module can analyze a characteristic of the vehicle to be treated and / or detect an exceptional characteristic of the vehicle (relevant to the treatment intervention) within instantaneous acquisition data obtained from at least one sensor at the treatment system, which at least temporarily includes a representation of the vehicle to be treated.The analysis can include at least one element from the following group: recognizing a vehicle object, recognizing a vehicle sub-object, identifying a vehicle sub-object as a (specific) vehicle part, identifying a vehicle sub-object as a (specific) add-on part, classifying an exception property, estimating a sub-object location, estimating a sub-object extent, identifying a key point, and identifying damage to the vehicle being treated. The AI module can include one or more separate structures for performing the analysis, in particular one or more separate neural networks.
[0025] Another aspect of the present disclosure relates to a control system for a vehicle treatment plant, wherein the control system receives a detected exceptional characteristic of a vehicle to be treated, which is detected in particular by an external means, e.g., by a remote data processing device or an object recognition procedure executed therein, and wherein the exceptional characteristic is present or received in a computer-readable form as an ordered data structure. The control system adapts a treatment program based on the detected exceptional characteristic and executes the adapted treatment program (and / or resumes an interrupted vehicle treatment with the adapted treatment program). The adaptation can be carried out in any manner. Through adaptation, it can be achieved that a vehicle treatment can be executed or completed (despite the presence of the detected exceptional characteristic).
[0026] An adaptation can preferably be specific to a sub-object of the vehicle to be treated (i.e., a vehicle sub-object), to an exception property (defined in the detected exception condition), and / or to a sub-object localization (defined in the detected exception condition).
[0027] An adaptation may provide that a modified treatment intervention is carried out on a vehicle sub-object (defined in the recognized exceptional condition), in particular on a vehicle part of the vehicle to be treated or on an attachment part on the vehicle, or that a treatment intervention is omitted locally (in each case compared to the regular treatment intervention without adaptation), AND / OR that an alternative treatment intervention is carried out by a different treatment unit.
[0028] An adaptation may provide that at least one treatment unit of the vehicle treatment system (compared to the regular treatment intervention without adaptation) is actuated with a program change, and furthermore, in particular, that at least one treatment unit is moved with an adapted movement path and / or increased sensitivity. Alternatively or additionally, an adaptation may provide that at least one treatment unit, in particular a contact treatment unit of the vehicle treatment system, is moved with a locally reduced physical treatment intervention or locally without any physical treatment intervention.Alternatively or additionally, an adaptation may provide that a regularly planned treatment with a first treatment unit is replaced by an alternative treatment with a different treatment unit, wherein in particular the first treatment unit may be a contacting treatment unit and furthermore in particular the other treatment unit may be a remote treatment unit.
[0029] Another aspect of the present disclosure relates to an ordered data structure, which is stored on a data carrier and transmitted or received via a communication interface. The ordered data structure defines an exceptional characteristic of a vehicle to be processed in a computer-readable form and comprises at least one recognized vehicle sub-object. Preferably, the ordered data structure further comprises a recognized exceptional characteristic of a recognized sub-object and / or a sub-object location. The ordered data structure is preferably generated by an object recognition method according to the present disclosure and / or output by an environment detection system according to the present disclosure.The ordered data structure can be obtained and processed by a tax procedure according to the present disclosure and / or by a plant control system according to the present disclosure, in particular for the (adapted) control of the treatment of a vehicle in a vehicle treatment plant.
[0030] Another aspect of the present disclosure relates to an object detection technique, in particular an object detection method for supporting the control system in a vehicle treatment plant. The object detection method is preferably executable as a computer-implemented method on a data processing device, in particular on the control system of a vehicle treatment plant. Alternatively, the object detection method can be executed remotely from a vehicle treatment plant and, for example, obtain sensor data (environmental detection data) from a vehicle treatment plant and / or output a detected exception.
[0031] The object recognition process preferably includes the following steps: Obtaining environmental data acquired by at least one sensor on a vehicle treatment system, wherein the environmental data includes at least a temporary representation of a vehicle to be treated.
[0032] Using a (trained) AI module: Analyzing the characteristics of the vehicle to be treated within the current environmental data and recognizing an exceptional characteristic of the vehicle relevant for the treatment intervention of the vehicle treatment system.
[0033] Output of the detected exceptional characteristic of the vehicle, wherein the detected exceptional characteristic defines at least one vehicle sub-object and preferably also its sub-object localization and / or an exceptional property of the vehicle sub-object in computer-readable form.
[0034] The detected exception characteristic is preferably an ordered data structure that includes, in particular, an aggregation, more preferably a list of detected vehicle sub-objects (possible numerical values 0, 1, 2 and more), and more preferably at least one associated sub-object localization and / or exception property.
[0035] If no exception is detected, it can be assumed that a standard configuration is present. Alternatively, an ordered data structure for a vehicle configuration can be provided, defining either a detected exception or a detected standard configuration.
[0036] A vehicle sub-object can preferably be an add-on part attached to the vehicle contour and / or a vehicle part of the vehicle to be treated.
[0037] For a recognized attachment, a localization of the attachment is preferably recorded in addition and further preferably defined as a component of the diseased exceptional condition.
[0038] For a recognized vehicle part, its vehicle part location and / or an exceptional property of the vehicle part is preferably recognized and further preferably defined as a component of the exceptional property.
[0039] A recognized standard configuration can also include at least one vehicle part and its vehicle part location, as well as, if applicable, a standard property of the vehicle part.
[0040] Another aspect of the present disclosure relates to a control procedure for a vehicle treatment plant, wherein the control procedure refers to a recognized exceptional characteristic of a vehicle to be treated, which may in particular be output by an object recognition procedure according to the aforementioned aspect, wherein the control procedure further comprises a process control which, on the basis of the referred or recognized exceptional characteristic of the vehicle to be treated, adapts a treatment program for the vehicle treatment and starts the vehicle treatment.
[0041] Alternatively or additionally, the process control can interrupt an ongoing vehicle treatment based on a (subsequently) recognized or acquired exceptional characteristic of the vehicle to be treated, or adapt an ongoing treatment program based on the exceptional characteristic and continue it in a modified manner.
[0042] It is still possible that the process control prevents the start of vehicle treatment based on a detected exceptional condition.
[0043] The process control can output at least one command value that can be communicated to a treatment system, where the command value defines an adapted control of the treatment system based on the detected exception, in particular an adaptation of a treatment program. The process control can be executed on a local data processing device at a treatment system, in particular on a system controller, or on a remote data processing device.
[0044] An exceptional condition can be identified, issued, and / or obtained as an initial exceptional condition before the start of treatment. Alternatively or additionally, the exceptional condition can be identified, issued, and / or obtained as a subsequent exceptional condition after the start of treatment or during ongoing vehicle treatment.
[0045] In other words, the object recognition process can perform an admissibility classification for a detected exception characteristic. This admissibility classification can be performed, in particular, based on at least one type of detected vehicle sub-object and / or on at least one detected exception characteristic of a vehicle sub-object.
[0046] According to an independent feature that can be combined with any aspect of this disclosure, a recognized exception characteristic can be classified as either permissible or impermissible. Permissibility or impermissibility can be predefined for specific vehicle sub-objects, specific exception characteristics of vehicle sub-objects, or specific sub-object locations, in particular by means of a permissibility database. The permissibility database can be accessible directly or via a communication interface in any manner. A permissibility database can be part of a local or remote data processing device, in particular part of an environmental sensing system or part of a plant control system.
[0047] An exception may be permissible if vehicle treatment is possible with an adaptation of the treatment program. This permissibility may depend on the equipment of a specific vehicle treatment facility, particularly the number and type of treatment units. An exception may be impermissible if carrying out a planned vehicle treatment has (or is likely to have) an impermissible parasitic consequence and / or no suitable adaptation is available (at the respective vehicle treatment facility).
[0048] A classification as a permissible or impermissible exceptional condition can be made individually for a specific vehicle treatment facility, in particular based on the equipment of this vehicle treatment facility.
[0049] It is particularly preferred that the prevention of a start of vehicle treatment is based on an initial exceptional condition, and furthermore, in particular, on an initial impermissible exceptional condition.
[0050] Furthermore, it is preferably provided that an adaptation of a treatment program for vehicle treatment and a starting of the vehicle treatment is carried out on the basis of an initial exceptional condition, and in particular on the basis of an initial permissible exceptional condition.
[0051] Furthermore, it is preferably provided that an adaptation of an ongoing treatment program and a continuation of the vehicle treatment is carried out on the basis of a subsequent exceptional condition, and in particular on the basis of a subsequently permissible exceptional condition.
[0052] Furthermore, it is preferably provided that an interruption of an ongoing vehicle treatment is carried out on the basis of a subsequent exceptional condition, and in particular on the basis of a subsequent inadmissible exceptional condition.
[0053] An object recognition process and a control process can be implemented or executed by a shared data processing unit or by separate data processing units. The one or more data processing units can have any configuration. They can be part of a plant control system and / or a vehicle handling system. Alternatively or additionally, a remote data processing unit, not part of a vehicle handling system, can be provided and connected to a vehicle handling system via a communication interface. Through this communication interface, input and output data of the object recognition process and / or the control process can be exchanged between the vehicle handling system and the remote data processing unit.The exchanged data may include, in particular, environmental data, a detected exception condition, and / or command values for controlling the execution of a vehicle treatment. Command values may also be used, in particular, for preventing the start of a vehicle treatment, for adapting a treatment program and starting the vehicle treatment, for interrupting an ongoing vehicle treatment, and / or for adapting an ongoing treatment program and resuming the vehicle treatment.
[0054] Another aspect of the present disclosure relates to a software product for controlling a vehicle treatment system. The software product is preferably stored on a data carrier or transmitted via a data interface. It comprises instructions which, when implemented on a (local or remote) data processing device, execute an object recognition method and / or a control method according to the present disclosure.
[0055] Another aspect of the present disclosure relates to a control system for a vehicle treatment plant (vehicle treatment plant control system). The control system can be designed as a control device, in particular in the form of a data processing device. The control system comprises an environmental sensing unit and / or a sequence control unit. The environmental sensing unit and / or the sequence control unit can each be designed separately or together. The environmental sensing unit can be an environmental sensing device. The sequence control unit can be a sequence control device.
[0056] The environmental detection system is preferably designed and configured for the execution of an object recognition procedure according to the present disclosure.
[0057] The process control is preferably designed and configured for the execution of a tax procedure in accordance with the present disclosure.
[0058] Alternatively, environmental perception or process control can have a different training.
[0059] The environmental sensing system acquires environmental data from at least one sensor, whereby the environmental data includes, at least temporarily, a representation of a vehicle to be processed. The environmental sensing system can be connected directly or via a (remote) communication interface to the at least one sensor.
[0060] The sequence control system manages the treatment units of the vehicle treatment system to carry out vehicle treatment. The sequence control system can be connected directly or via a (remote) communication interface to the treatment system and / or at least one treatment unit.
[0061] It is preferably intended that the environmental perception includes a trained AI module that analyzes the characteristics of the vehicle to be treated within the current environmental perception data and identifies an exceptional characteristic of the vehicle relevant to the treatment intervention.
[0062] Furthermore, it is preferably provided that the recognized exceptional characteristic of the vehicle defines at least one vehicle sub-object and, more preferably, its sub-object localization and / or an exceptional property of the vehicle sub-object in computer-readable form, wherein the recognized exceptional characteristic is preferably formed by an ordered data structure.
[0063] Furthermore, it is preferably intended that the process control system manages the planned vehicle treatment by the vehicle treatment system based on the detected exceptional characteristics of the vehicle. This control can be achieved directly or indirectly via command values.
[0064] A preferred embodiment provides that the environmental perception and / or the process control are formed or executed by at least one local data processing unit. Alternatively, at least part of the environmental perception or the process control can be formed or executed by a remote data processing unit.
[0065] The process control can preferably adapt and start a treatment program for the vehicle treatment based on a recognized or related exceptional characteristic of the vehicle to be treated, or adapt and continue an ongoing treatment program for the vehicle treatment.
[0066] Alternatively or additionally, preventing the start of vehicle treatment and / or interrupting ongoing vehicle treatment may be provided for.
[0067] It is particularly preferred that the process control system manages a planned vehicle treatment based on the (recognized / classified) permissibility of a recognized exceptional characteristic.
[0068] Further advantageous embodiments of the invention are specified in the dependent claims.
[0069] The invention is illustrated in the drawings in an exemplary and schematic manner. These show: Fig. 1, Fig. 2: a vehicle treatment plant with a plant control system according to the present disclosure in an oblique view and a side view; Fig. 3: Example representations of environment detection data as a total environment dataset, as well as a vehicle environment dataset and a vehicle sub-object environment dataset; Fig. 4: An exemplary representation of environmental perception with a possible development of an AI module.
[0070] Fig. 1 and Fig. Figure 2 shows a vehicle treatment system 1. In this example, the vehicle treatment system 1 is designed as an automatic car wash. The car wash, in the example shown, includes a movable portal 2, which can be moved relative to a treatment area 6A in a controlled manner. A plurality of treatment units 3, 4, 5 are arranged on the portal. The portal 2 is one possible configuration of a unit carrier for supporting and, if necessary, controlling the movement of at least one treatment unit 3, 4, 5. Instead of a portal 2, any other configuration of a unit carrier can be provided in single or multiple versions. In other words, the vehicle treatment system includes at least one unit carrier 2 with at least one treatment unit 3, 4, 5.
[0071] The vehicle treatment system may optionally include a movement device for at least one vehicle to be treated, in particular a towing device.
[0072] At least one sensor 10, 11 is provided that acquires environmental perception data 9. The at least one sensor 10, 11 can have any configuration. In particular, it can be an imaging sensor, and furthermore, in particular, a camera. The at least one sensor 10, 11 can alternatively or additionally acquire depth information, in particular distance values. In particular, it can be configured as a 3D camera.
[0073] The environmental sensing data 9 can be directly acquired data from a sensor 10,11 or fused data from a plurality of sensors.
[0074] Preferably, the environmental perception data comprises a multitude of data elements in a structured arrangement, most preferably in a grid arrangement. For example, the environmental perception data can include nine data elements in a two-dimensional or three-dimensional structure, such as an array or a vector. A data element can comprise one or more channels. A channel can be designated for a specific type of information. For example, a first channel can be designated for a brightness value and a second channel for a distance value. Alternatively, a first channel can be designated for a first color value, a second channel for a second color value, and possibly at least one further channel for a correspondingly further color value.
[0075] The following explanation assumes, by way of example, that the environmental detection data 9 is available as image data in a two-dimensional data structure. The image data can be stored as pixels with one or more channels, in particular with an RGB channel layout and possibly an additional distance value channel.
[0076] The at least one sensor 10, 11 is directed with a detection range towards the plant environment 6. The plant environment 6 can preferably comprise a treatment area 6a and optionally additionally an access area 6b and / or an exit area 6c.
[0077] Preferably, at least two sensors 10,11 with a respective detection range are directed from different directions towards the plant environment 6 and in particular towards an at least overlapping common section of the plant environment 6.
[0078] In the embodiment according to Fig. 1 and Fig. 2. A plant control system 7, in particular a vehicle handling plant control system 7, is provided, which is designed and configured to execute, either alone or through corresponding subcomponents, an object recognition method and / or a control method according to the present disclosure. The execution of the various steps or sub-steps of these methods can be distributed in any way across one or more data processing units 30, 30', wherein the one or more data processing units 30, 30' can be connected by at least one communication interface.
[0079] A first preferred embodiment provides that the vehicle handling system control 7 includes a local data processing unit 30 which embodies or implements the environmental sensing 8 and / or the sequence control 13.
[0080] An alternative implementation variant provides that at least part of the environmental perception and / or process control is embodied or implemented by a remote data processing unit 30'.
[0081] Between a local data processing unit 30 and a remote data processing unit 30', at least one element of the following group can be exchanged in any direction, comprising environment sensing data 9, a detected exception condition KS and at least one command value for controlling the execution of a vehicle treatment.
[0082] The following description assumes, by way of example, that all process steps are carried out locally.
[0083] The environmental perception 8 preferably comprises a trained AI module 14 that analyzes a characteristic of the vehicle 80 to be treated within the current environmental perception data 9 and recognizes an exceptional characteristic KS of the vehicle relevant to the treatment intervention. The AI module 14 can have any training. Various advantageous training types for an AI module 14 are described below with reference to Fig. 4 explained.
[0084] The identified exception condition KS of the vehicle defines at least one vehicle sub-object 21 and preferably also its sub-object localization 22 and / or an exception property LS of the vehicle sub-object 21 in computer-readable form.
[0085] A vehicle sub-object 21 and a sub-object localization 22 and / or an exception property LS are preferred elements of the following list: An attachment 24 mounted on the vehicle contour and preferably its attachment location 24a; A vehicle part 23 and optionally its vehicle part localization 23a and / or an exception property LS of the vehicle part 23.
[0086] A vehicle part 23 of the vehicle 80 to be treated and an optionally assigned exception property LS can preferably be elements from the following list: - A towbar with an exceptional feature: unfolded; - A towbar with exceptional features: Tilt; - A spoiler with an exceptional feature: extended; - An antenna with an exceptional feature: extended; - A radiator mascot with an exceptional feature: an impermissibly high protrusion; - A charging port with an exceptional feature: charging cable plugged in; - A flap with an exceptional feature: flap open; - A lid with an exceptional feature: lid open; - A vehicle door with an exceptional feature: door open; - A vehicle window with an exceptional property: window open; - A bodywork gap with an exceptional characteristic: gap open; - A windshield wiper with an exceptional feature: Windscreen wipers in upright position; - A windshield wiper with an exceptional feature: Windscreen wipers in motion; - A windshield wiper with an exceptional feature: lifted from the windshield; - A sill with an exceptional feature: vehicle lowered; - A sill with an exceptional feature: vehicle raised; - A fender with an exceptional feature: fender overhang; - A wheel with an exceptional feature: wheel in cornering position; - A vehicle mirror (81) with an exceptional feature: mirror extended.
[0087] An attachment and / or a classifiable attachment type can be an element of the following list: - A roof rack; - A rear carrier; - A transport box; - A spare wheel; - A trailer hitch; - A bicycle; - Ski equipment; - A snowboard; - A rooftop tent; - A ladder; - A spoiler; - A window gap cap;
[0088] Further below are explained actions that may be provided for in the case of a particular identified exceptional condition (AC), in particular actions to adapt a treatment program in the case of a permissible identified exceptional condition and / or actions to interrupt operations in the case of an impermissible identified exceptional condition.
[0089] In the example of Fig. 1 and Fig. Figure 2 shows a luggage rack as an attachment 24 in the rear area of the vehicle 80 to be treated, and the vehicle 80 to be treated includes a retractable antenna as a vehicle part 23 with the exception property LS "antenna extended".
[0090] The environmental sensing system 8, and in particular the AI module 14, is preferably designed and / or trained to classify and preferably output at least one exception property LS for a vehicle sub-object 21, especially for a vehicle part 23. The exception property LS can be particularly relevant for carrying out vehicle treatment and may be defined in contrast to a standard property LB of this vehicle part.
[0091] A particularly preferred embodiment may provide that certain exception properties LS are defined as permissible for vehicle treatment and other exception properties LS as impermissible for vehicle treatment.
[0092] In other words, the environmental detection and / or a permissibility database preferably comprises a list of predefined vehicle sub-objects 21, in particular vehicle parts 23, and assignable exception properties LS. The list can be extensible. Preferably, the list can also include at least one assignable standard property LB. Alternatively or additionally, a permissibility for vehicle handling can be defined for at least one, and preferably each, exception property LS.
[0093] In other words, an exception property LS is preferably defined in contrast to a standard property LB of a vehicle part 23.
[0094] The environmental detection system 8, and in particular the AI module 14, can preferably be designed and / or trained to detect the presence of at least one attachment 24 and, in particular, to classify a detected attachment with a specific attachment type (TA). The attachment 24 and / or the classified attachment type can preferably be output, in particular as a component of a detected exceptional characteristic KS.
[0095] The environmental sensing system 8, and in particular the AI module 14, is preferably configured to perform cascaded detection. The detection cascade can be implemented in any way. A preferred embodiment provides that, first, a vehicle object 20 is detected within the current environmental sensing data 9, and subsequently, a vehicle sub-object 21 is detected within a portion of the environmental sensing data 9 that can be attributed to the vehicle object 20. Simultaneously or preferably subsequently, within a portion of the environmental sensing data 9 that can be attributed to a detected vehicle sub-object 21, a property of the vehicle sub-object, in particular an exception property LS, can be detected, and / or a sub-object localization 22 can be detected.
[0096] Cascaded detection enables a particularly resource-efficient rapid detection of vehicle sub-objects on the one hand and of exception properties and / or sub-object localization on the other.
[0097] The environment detection 8 and in particular the AI module 14 can be trained to recognize the representation 12 of a vehicle 80 to be treated and to define in the current environment detection data 9 that part of the data as a vehicle environment data set 9a in which the representation 12 of the vehicle to be treated is present.
[0098] This can be achieved in particular by selecting the data portion or by enabling the selection of the data portion.
[0099] The environment detection 8 and in particular the AI module 14 is preferably designed to recognize a vehicle sub-object 21 and to define in the current environment detection data 9 that part of the data in which the representation of the associated vehicle sub-object 21 is present, in particular the representation of a vehicle part 22 or an add-on part 23, as a vehicle sub-object environment data set 9b.
[0100] Fig. Figure 3 shows an example image in the upper section that corresponds to current environmental data 9. It includes a representation 12 of a vehicle 80. The vehicle 80 can be recognized as a vehicle object 20.
[0101] The parts of the environment detection data 9 that can be assigned to the vehicle object 20 can be defined as a separate data part, in particular as a vehicle environment data set 9a.
[0102] The definition of a vehicle environment data set 9a can be done in any way.
[0103] A first preferred embodiment provides for the definition of a vehicle bounding box B1 within the current environment sensing data 9, wherein the bounding box can be defined in particular as an axis-parallel bounding box or as an oriented bounding box. Fig. Figure 3 illustrates an axis-parallel boudning box whose edges are aligned parallel to the axes of the environment sensing data 9, here the two-dimensional image file.
[0104] An alternative or additional implementation provides for tracking a vehicle bounding box B1 within previous and current environment detection data 9, furthermore in particular as an axis-parallel bounding box or as an oriented bounding box.
[0105] Another alternative or additional implementation involves performing semantic segmentation of the environment perception data. Semantic segmentation allows for the determination of whether a majority, and in particular all, of the current environment perception data 9 belong to the scene background or to a vehicle object 20.
[0106] According to an example, the vehicle environment data set 9a can include only those data elements that are assigned to the vehicle object, or possibly additional internal data elements that can be added to form a coherent group of data elements.
[0107] Alternatively, a vehicle environment data set 9a can be generated by excluding such data elements that lie preferably in a direct extent between a boundary of the environment detection data 9 and a group of data elements that are assigned to the vehicle object.
[0108] Alternatively or additionally, a vehicle environment data set 9a can be defined by excluding such data elements that are assigned to the background.
[0109] Fig. Figure 4 shows an example of an AI module 14. Current environmental data 9 are fed to the environment sensing system 8 and, in particular, to the AI module 14. The environmental data 9 can, at least temporarily, include a representation of a vehicle 80 to be processed and, furthermore, at least one representation of a vehicle part 23 and / or at least one representation of an add-on part 24. The environment sensing system 8, and in particular the AI module 14, can output a detected exception condition KS. The exception condition KS can (preferably) include at least one detected vehicle sub-object 21 and, further preferably, its sub-object location 22 and / or an exception property LS of the vehicle sub-object 21.
[0110] In the example of Fig. 4. A windshield wiper is recorded as a vehicle part 23. Furthermore, a roof rack and / or a rear rack can, for example, be recorded as an add-on part 24.
[0111] The AI module 14 preferably includes at least one neural network 15.
[0112] According to a preferred embodiment, the AI module 14 can be configured as a detection network 25 with a plurality of subnets 26a, 26b, 26c. More preferably, at least two subnets can each perform a dedicated subtask of detecting an exceptional characteristic KS.
[0113] For example, a first subnet 26a, 26b can pass an intermediate result of the recognition process, such as the recognition of a vehicle object 20 and / or the definition of a vehicle bounding box B1, to another subnet 26b, 26c. Alternatively, such a transfer of intermediate results can be omitted, or a different method of transferring intermediate results can be implemented.
[0114] The AI module 14 preferably comprises at least one filter section 27,27' that identifies features in the supplied environmental sensing data 9. The filter section 27,27' can be present one or more times and can have any configuration. Preferably, a filter section 27,27' comprises several chained filter levels.
[0115] The at least one neural network 15 can, according to a preferred embodiment, be configured as a convolutional neural network either on its own or in conjunction with at least one filter section 27,27'.
[0116] In the example of Fig. 4. There are at least two subnets 26a, 26b that are connected to a common part of the filter section 27, and / or that jointly process the determined features of a filter section 27.
[0117] A first neural network 15 or a first subnetwork 26a can be configured for the recognition of a vehicle 80 to be processed. It can, in particular, be a vehicle object identifier. A further, and preferably separate, neural network 15 can be provided for the recognition of a vehicle sub-object 21. It can, in particular, be a vehicle sub-object identifier 26b.
[0118] The (trained) AI module, or a further and preferably separate neural network 15 or subnetwork 26c, can be provided for determining a sub-object localization 22, in particular a vehicle part localization 23a and / or an add-on part localization 24a.
[0119] Alternatively or additionally, the AI module 14, or preferably a separate neural network 15, in particular a subnetwork 26c, can be provided for the classification of an exception property LS and / or a standard property LW.
[0120] According to a preferred embodiment, the AI module 14 may comprise at least one element from the group consisting of an object identifier, a state classifier, a position estimator, and an extent estimator. The at least one element is further defined, in particular, by a separate structure of the AI module 14, specifically by a separate neural network or a subnetwork 26a, 26b, 26c.
[0121] According to further details, this can be at least one element: - At least one vehicle object identifier; AND / OR - At least one vehicle sub-object identifier, in particular an add-on part identifier and / or a vehicle part identifier; AND / OR - a keypoint identifier; AND / OR - a property classifier; AND / OR - a sub-object location estimator; AND / OR - a sub-object extent estimator.
[0122] A preferred embodiment provides that the detection of a vehicle sub-object 21 takes place (exclusively) within a vehicle environment data set 9a.
[0123] In the example of Fig. Figure 3, as the middle representation, shows a section of the image data in which the vehicle 80 to be treated is represented, as a vehicle environment data set 9a.
[0124] A preferred embodiment provides that the environment detection 8 and in particular the AI module 14, further in particular a vehicle identifier, is designed to recognize the representation 12 of the vehicle 80 to be processed and to define the vehicle environment data set 9a and to pass it on as an intermediate result.
[0125] In the example of Fig. 3. By defining the vehicle bounding box B1, parts of the current environment detection data 9 are selected and defined as the vehicle environment detection data 9a.
[0126] According to a preferred embodiment, the environment detection 8, in particular the AI module 14 and further in particular a vehicle sub-object identification, is configured to recognize a vehicle part 22 as a vehicle sub-object and / or to recognize an add-on part 23 as a vehicle sub-object 21.
[0127] Alternatively or additionally, the training may provide to define in the current environment detection data 9, and in particular in the vehicle environment data set 9a, that part of the data as a vehicle sub-object environment data set 9b in which the representation of the associated vehicle sub-object 21, in particular the representation of the associated vehicle part 22 and / or the representation of the associated attachment part 24 is present.
[0128] A vehicle sub-object environment data record 9b can be defined in any way. One possible implementation involves defining a vehicle sub-object bounding box B2, which can be defined as either an axis-parallel bounding box or an oriented bounding box.
[0129] An alternative or additional embodiment provides for tracking a vehicle sub-object bounding box B2 within previous and current environment sensing data 9, in particular as an axis-parallel bounding box or as an oriented bounding box. The acquisition of a sub-object localization 22 can be carried out in any way, particularly preferably by a possibly separate neural network 15. A sub-object localization 22 can be a vehicle part localization 23a and / or an add-on part localization 24a.
[0130] A sub-object localization 22 can, according to a preferred embodiment, define a spatial position and, in particular, a spatial extent of an associated vehicle part 23 or add-on part 24 in a computer-readable form. The classification of an exception property LS can be carried out in any way, in particular with a preferably separate neural network 15, and further, in particular, with a property classifier.
[0131] A preferred embodiment provides that the environment detection 8, in particular the AI module 14, is further in particular a key point identifier, is configured to identify at least one key point P,P1, and more preferably at least two key points P1,P2 on a vehicle sub-object 21.
[0132] According to a preferred embodiment, it is provided that an exception property LS of a vehicle sub-object 21, in particular a vehicle part 23, is based on a relative position of at least two key points P1,P2 on the vehicle part 23 and the classification of an exception property LS based thereon can be carried out in any way.
[0133] According to a preferred embodiment, a first key point is identified at a dorsal (towards the vehicle body) end or at an articulation section of the vehicle part 23, and at least one further key point P2, P3, P4 is identified at a dorsal (away from the vehicle body) end of the vehicle part 23.
[0134] A preferred embodiment provides that the detection of an exception property LS of a vehicle part 23 takes place exclusively within a vehicle sub-object environment data set 9b and / or on the basis of key points present there.
[0135] Particularly preferably, the detection of a sub-object localization 22 takes place within a vehicle sub-object environment data set 9b and / or on the basis of the definition of a vehicle sub-object bounding box B2.
[0136] Particularly preferably, the detection of a sub-object location 22 is based on at least one key point P, which is preferably assigned to a vehicle sub-object. In particular, a sub-object location 22 can be estimated based on at least one key point on a dorsal section of a vehicle sub-object 21. Alternatively or additionally, a sub-object extent can be estimated based on at least one key point P on a distal section of the vehicle sub-object 21.
[0137] The detection of a sub-object location 22 can preferably be performed by at least one separate neural network 15, in particular by a sub-object position estimator and / or a sub-object size estimator. This can optionally be implemented as a preferably separate subnetwork. Various modifications of the invention are possible. In particular, all components or steps of a plant control system described above can be corresponding components or steps of an object detection method or a control method, or vice versa. The features disclosed for the exemplary embodiments can be combined with one another or substituted for one another in any way.
[0138] The system control 7, and in particular the environmental sensing 8, can preferably be configured to check for a detected exceptional condition KS. The check can be performed in any way, in particular by determining a model type of the vehicle 80 to be processed and comparing the current environmental sensing data 9 with reference data 28 for a vehicle of this model type in a previously known standard configuration KB.
[0139] An adaptation of a treatment program for vehicle treatment can be carried out in any way and from any part of the vehicle treatment system or the system control.
[0140] A preferred embodiment provides that a treatment program is adapted such that in the area of a detected sub-object localization 22, in particular in the area of the vehicle part localization 23a and / or in the area of the detected add-on part localization 24a at least one of the following changes is made.
[0141] At least one treatment unit 3,4,5 of the vehicle treatment system 1 is moved with an adapted movement path and / or increased sensitivity.
[0142] Alternatively or additionally: At least one treatment unit 3,4,5, in particular a contacting treatment unit 3,4 of the vehicle treatment system 1, is moved with a locally reduced physical treatment intervention or locally without physical treatment intervention.
[0143] Alternatively or additionally: A regularly scheduled treatment with a first treatment unit 3, 4, 5 is replaced by an alternative treatment with a different treatment unit 3, 4, 5. The first treatment unit can, in particular, be a contact treatment unit 3, 4, and the other treatment unit can, in particular, be a remote treatment unit 5.
[0144] A permissible exception may be (classified or) provided for AND / OR an adaptation of a treatment program may be provided for certain vehicle sub-objects, in particular vehicle parts (23), especially for: ▪ A trailer hitch, especially if the exceptional characteristic is present: extended; ▪ A trailer hitch, especially if the exceptional characteristic of tilting is present; ▪ A spoiler, especially if the exceptional characteristic is present: extended; ▪ One charging port if the exceptional characteristic is present: Charging cable plugged in; ▪ A flap with an exceptional property: flap open; ▪ A lid with an exceptional feature: lid open; ▪ A bodywork gap, especially on the hood, with the exceptional characteristic: gap open; ▪ A windshield wiper, especially if the exceptional characteristic is present: windshield wiper in an upright position; ▪ A windshield wiper, especially if the exceptional property is present: windshield wiper in motion; ▪ A windshield wiper, especially if the exceptional characteristic is present: lifted from the windshield; ▪ A sill in case of the exceptional characteristic: vehicle lowered; ▪ A sill, if the exceptional characteristic is present: raised; ▪ A fender in the presence of the exceptional characteristic: fender overhang; ▪ A wheel in the presence of the exceptional property: wheel in cornering position; ▪ A vehicle mirror (81) when the exceptional characteristic is present: Mirrors extended;
[0145] A permissible exception may be (classified or) provided for AND / OR A permissible exception may be (classified or) provided for AND / OR an adaptation of a treatment program may be provided for any vehicle sub-objects, in particular add-on parts (24), especially for: ▪ A roof rack, especially if the exceptional characteristic is present: no load; ▪ A rear carrier, especially if the exceptional characteristic is present: no loading; ▪ A transport box, especially if the exceptional characteristic is: closed; ▪ A spare wheel; ▪ A window gap cap;
[0146] A permissible exception may be (classified or) provided for AND / OR the prevention of the start of a treatment program and / or the interruption of an ongoing treatment program may be provided for any vehicle sub-objects, in particular vehicle parts (23), especially for: ▪ An antenna with an exceptional characteristic: extended; ▪ A radiator mascot with an exceptional feature: an impermissibly high protrusion; ▪ A vehicle door with an exceptional feature: door open; ▪ A vehicle window with an exceptional property: window open; ▪ Preventing a treatment program from starting and / or interrupting a running treatment program can be provided for any vehicle sub-objects, in particular for: A permissible exception may be (classified or) provided for AND / OR the prevention of the start of a treatment program and / or the interruption of an ongoing treatment program may be provided for any vehicle sub-objects, in particular add-on parts (24), especially for: ▪ A roof rack, especially if it has the exceptional characteristic: with a load; ▪ A rear carrier, especially if the exceptional characteristic is present: with load; ▪ A transport box, especially if the exceptional characteristic is present: open; ▪ A bicycle; ▪ Ski equipment; ▪ A snowboard; ▪ A rooftop tent;
[0147] The vehicle treatment system can be configured in any way according to all the embodiments and aspects described in this disclosure. In particular, it can be configured as a washing system or a polishing system. It can have the design of a portal system or a treatment line.
[0148] The environmental data can also include a representation of at least one section and / or machine part of the vehicle handling system.
[0149] The environmental data may also include a representation of the environment of the vehicle treatment facility, in particular an entry area and / or an exit area. Reference sign 1 vehicle treatment facility 2 aggregate carriers / portal 3 Treatment unit (contacting) / Side brush 4 Treatment unit (contacting) / roof brush 5 Treatment unit (contactless) / remote treatment unit / jet cleaning device 6 Plant environment 6a Treatment area 6b Access area 6c Exit area 7 Plant control / Vehicle handling plant control 8 Environmental perception 9 Environmental data / Total environmental data set 9a Vehicle environment data set 9b Vehicle Sub-Object Environment Data Set / Vehicle Part Environment Data Set / Add-on Part Environment Data Set 10 Sensor 11 Sensor 12 Representation of a vehicle 13 Process control 14 AI Module 15 Neural network 20 Vehicle Object 21 Vehicle Sub-object 22 Sub-object localization 22a Sub-object extension 23 Vehicle part 23a Vehicle Part Localization 24 Attachment part 24a Add-on component localization 25 Recognition Network 26a Subnetwork / Vehicle Identifier 26b Subnet / Vehicle Sub-Object Identifier 26c Subnet / Property Classifier 27.27' Filter section 28 reference data 30 Data processing equipment 40 Representation of a part of the vehicle treatment facility 80 Vehicle (to be treated) 81 Vehicle mirrors / side mirrors B1 Vehicle Bounding Box B2 Vehicle Sub-object Bounding Box KB Standard Configuration KS Exceptional condition, detected / Data structure LB Standard property LS exception property P, Pi Key-point TA attachment type QUOTES INCLUDED IN THE DESCRIPTION
[0000] This list of documents cited by the applicant was automatically generated and is included solely for the reader's convenience. The list is not part of the German patent or utility model application. The DPMA accepts no liability for any errors or omissions. Cited patent literature
[0000] DE 20 20219 105 667 U1
[0004] US 2024 / 0 375 619 A1
[0005] WO 2025 / 091 013 A1
[0006] DE 20 2019 105 667 U1
[0007] CN 1 10 901 597 A
[0007]
Claims
[1] Vehicle treatment plant control (7) for a vehicle treatment plant (1), wherein The vehicle treatment system control (7) comprises an environment sensing unit (8) which obtains environment sensing data (9) from at least one sensor (10, 11), wherein the environment sensing data (9) at least temporarily includes a representation (12) of at least one vehicle (80) to be treated and a representation of at least one machine part of the vehicle treatment system (1), wherein the environment sensing unit (8) further comprises a trained AI module (14) which analyzes an interaction between the vehicle treatment system (1) and the at least one vehicle (80) to be treated within the instantaneous environment sensing data (9) and detects an interaction fault condition, and wherein the vehicle treatment system control (7) further controls an actuation of the vehicle treatment system (1) based on the detected interaction fault condition. characterized by , that The interaction error state includes: - A treatment brush getting stuck to the vehicle; AND / OR - An impermissible misorientation of a treatment brush relative to a surface of the vehicle being treated, in particular that a roof roller is tilted relative to the horizontal direction and / or that a side roller or a washing bristle is lying on the ground; AND / OR - Unauthorized contact between the machine part and the vehicle to be treated, in particular unauthorized contact with a remote treatment unit that is not normally intended for contact with the vehicle. [2] Vehicle treatment system control (7) according to the preceding claim, wherein the vehicle treatment system control (7) - adapts and continues an ongoing operation of the vehicle treatment system (1); OR - interrupts an ongoing operation of the vehicle treatment system (1); AND / OR - executes a mitigation program, in particular ▪ a predefined mitigation program; or ▪ an ad-hoc mitigation program that is situation-specific and consists of at least two mitigation steps. [3] Data processing equipment set up to execute an object recognition procedure to support plant control (7) in a vehicle treatment plant (1), wherein the object recognition procedure is executed as a computer-implemented procedure on the data processing equipment (30), in particular on a plant control (7), and comprises the following steps: - Obtaining environment sensing data (9) acquired by at least one sensor (10, 11) at the vehicle treatment system (1), wherein the environment sensing data (9) at least temporarily comprise a representation (12) of at least one vehicle (80) to be treated and a representation of at least one machine part of the vehicle treatment system (1); - using a trained AI module (14): Analyzing an interaction between the vehicle treatment system (1) and the at least one vehicle to be treated (80) and detecting an interaction error state; - Outputting the interaction error state; characterized by , that the interaction error state includes: - A treatment brush getting stuck to the vehicle; AND / OR - An impermissible misorientation of a treatment brush relative to a surface of the vehicle being treated, in particular that a roof roller is tilted relative to the horizontal direction and / or that a side roller or a washing bristle is lying on the ground; AND / OR - Unauthorized contact between the machine part and the vehicle to be treated, in particular unauthorized contact with a remote treatment unit that is not normally intended for contact with the vehicle. [4] Vehicle treatment plant control (7) for a vehicle treatment plant (1), wherein - the vehicle treatment system control (7) has an environment detection system (8) that obtains environment detection data (9) from at least one sensor (10, 11), wherein the environment detection data (9) at least temporarily includes a representation (12) of a vehicle (80) to be treated, wherein the environment detection system (8) further includes a trained AI module (14) that analyzes a characteristic of the vehicle to be treated within the current environment detection data (9) and recognizes an exceptional characteristic (AC) of the vehicle relevant for the treatment intervention, wherein the vehicle treatment system control (7) adapts and continues an ongoing treatment program of the vehicle treatment based on the recognized exceptional characteristic (AC), characterized by , that the adaptation is specific to a recognized vehicle sub-object (21), namely an add-on part (24) according to the following list: - A roof rack, especially if the exceptional characteristic applies: no load; - A rear carrier, especially if the exceptional characteristic is present: no loading; - A transport box, especially if the exceptional characteristic is: closed; - A window gap cap. [5] Vehicle treatment system control (7) according to one of the preceding claims, wherein an adaptation of a treatment program for a detected exception property (LS) of a vehicle sub-object (22) is carried out, wherein the exception property (LS) is classified and / or detected in particular in contrast to a standard property (LB) of the vehicle sub-object (21). [6] Vehicle treatment system control (7) according to one of the preceding claims, wherein an adaptation of a treatment program for a detected sub-object localization (22) and / or a detected sub-object extent (23) is performed. [7] Vehicle treatment system control (7) according to one of the preceding claims, wherein an adaptation provides that on a vehicle sub-object (21), - a modified treatment procedure is performed; or - a local treatment intervention is omitted; and / or that - an alternative treatment technique is performed using a different treatment unit. [8] Vehicle treatment system control (7) according to one of the preceding claims, wherein an adaptation provides that at least one treatment unit (3, 4, 5) of the vehicle treatment system (1) is actuated with a program change. [9] Vehicle treatment system control (7) according to one of the preceding claims, wherein an adaptation provides that - at least one treatment unit (3, 4, 5) is moved with an adapted movement path and / or increased sensitivity; AND / OR that - at least one treatment unit, in particular a contacting treatment unit of the vehicle treatment system, is moved with a locally reduced physical treatment intervention or locally without physical treatment intervention; AND / OR that - a regularly planned treatment with a first treatment unit (3, 4, 5) is replaced by an alternative treatment with another treatment unit (3, 4, 5), wherein in particular the first treatment unit is a contacting treatment unit (3, 4) and furthermore in particular the other treatment unit is a remote treatment unit (5). [10] Vehicle treatment system control (7) according to the preamble of claim 4 or according to one of the preceding claims, wherein an adaptation for a vehicle sub-object (21), namely a vehicle part (23) according to the following list is made: - A trailer hitch, especially if the exceptional characteristic is present: extended; - A trailer hitch, especially if the exceptional characteristic of tilting is present; - A spoiler, especially if the exceptional characteristic is present: extended; - A charging port if the exceptional characteristic is present: Charging cable plugged in; - A flap with an exceptional feature: flap open; - A lid with an exceptional feature: lid open; - A bodywork gap, especially on the hood, with the exceptional characteristic: gap open; - A windshield wiper, especially if the exceptional characteristic is present: windshield wiper in an upright position; - A windshield wiper, especially if the exceptional characteristic is present: windshield wiper in motion; - A windshield wiper, especially if the exceptional characteristic is present: windshield wiper lifted from windshield; - A sill in case of the exceptional characteristic: vehicle lowered; - A sill in case of the exceptional characteristic: vehicle raised; - A fender with the exceptional characteristic: fender overhang; - A wheel in the presence of the exceptional property: wheel in cornering position; - A vehicle mirror (81) when the exceptional characteristic is present: mirror unfolded; [11] Vehicle treatment system control (7) according to one of the preceding claims, wherein the start of a treatment program is prevented or a running treatment program is interrupted for a vehicle sub-object (21) according to the following list: - An antenna with an exceptional feature: extended; - A radiator mascot with an exceptional feature: an impermissibly high protrusion; - A vehicle door with an exceptional feature: door open; - A vehicle window with an exceptional property: window open; [12] Vehicle treatment system control (7) according to one of the preceding claims, wherein the start of a treatment program is prevented or a running treatment program is interrupted for a vehicle sub-object (21) according to the following list: - A roof rack, especially if the exceptional characteristic is present: with a load; - A rear carrier, especially if the exceptional characteristic is present: with load; - A transport box, especially if the exceptional characteristic is present: open; - A bicycle; - Ski equipment; - A snowboard; - A rooftop tent; [13] Vehicle treatment system control (7) according to one of the preceding claims, wherein an adaptation of a treatment program provides for a program change in the area of a detected sub-object localization (22), in particular in the area of a detected vehicle part localization (23a) and / or in the area of a detected add-on part localization (24a). [14] Vehicle treatment system control according to one of the preceding claims, wherein the vehicle treatment system control (7), in particular the environment detection (8), checks for a detected exceptional condition (CS) by: - Determination of a model type of the vehicle to be treated (80) and comparison of the current environment detection data with reference data (28) for a vehicle of this model type in a previously known standard configuration (KB). [15] Vehicle treatment plant (1) for treating at least one vehicle (80) with one or more treatment units (3, 4, 5), characterized by, that the vehicle treatment system (1) comprises a vehicle treatment system control unit (7) according to one of the preceding claims. [16] Data processing equipment set up to execute an object recognition method to support plant control (7) in a vehicle treatment plant (1), wherein the object recognition method is executed as a computer-implemented method on a data processing equipment (30), in particular on the plant control (7), and comprises the following steps: - Obtaining environment detection data (9) acquired by at least one sensor (10, 11) at the vehicle treatment system (1), wherein the environment detection data (9) at least temporarily includes a representation (12) of a vehicle to be treated; - using a trained AI module (14): Analyzing a characteristic of the vehicle to be treated (80) within the current environment data (9) and recognizing an exceptional characteristic (AC) of the vehicle relevant for the treatment intervention; - Issuing the identified exceptional condition (CS) of the vehicle, characterized by , that the identified exception condition (CS) defines at least one vehicle sub-object (21) and furthermore its sub-object localization (22) and / or an exception property (SP) of this vehicle sub-object (22) in computer-readable form, namely an attachment part (24) attached to the vehicle contour and in particular its attachment part localization (24a). [17] Data processing device, configured to execute a control procedure for a vehicle treatment plant, wherein the control procedure comprises an object recognition procedure according to the preceding claim and further a process control comprising the following steps: based on the recognized exceptional characteristic (AC) of the vehicle to be treated - Preventing the start of vehicle treatment, in particular based on an initial exceptional condition, further in particular based on an initial impermissible exceptional condition; AND / OR - Adapting a treatment program for vehicle treatment and initiating vehicle treatment, particularly based on an initial exceptional condition, further particularly based on an initial permissible exceptional condition; AND / OR - Interrupting ongoing vehicle treatment, particularly based on a subsequent exceptional circumstance, and further, particularly based on a subsequent impermissible exceptional circumstance; AND / OR - Adapting an ongoing treatment program and continuing vehicle treatment, in particular on the basis of a subsequent exceptional condition, and further in particular on the basis of a subsequently permissible exceptional condition. [18] Software product for a vehicle treatment system control (7), wherein the software product is stored on a data carrier or transmitted via a data interface, and wherein the software product comprises instructions which, when implemented on a data processing device (30), execute an object recognition method or a control method according to any of the preceding claims. [19] Vehicle treatment plant control (7) for a vehicle treatment plant (1) comprising - An environment sensing system (8) which obtains environment sensing data (9) from at least one sensor (10, 11), wherein the environment sensing data (9) at least temporarily includes a representation (12) of a vehicle to be treated; - A sequence control unit (13) that controls the treatment units (3, 4, 5) of the vehicle treatment system (1) to carry out a vehicle treatment; characterized by , that - the environmental perception (8) includes a trained AI module (14) which analyzes a characteristic of the vehicle (80) to be treated within the current environmental perception data (9) and identifies an exceptional characteristic (AC) of the vehicle relevant for the treatment intervention; and wherein - the identified exceptional characteristic (AC) of the vehicle defines at least one vehicle sub-object (21) and its sub-object localization (22) in a computer-readable form; and wherein - the process control (13) controls a planned vehicle treatment by the vehicle treatment system (1) on the basis of the detected exceptional condition (CS) of the vehicle. characterized by , that - the AI module (14) is trained to detect the presence of at least one attachment (24) and, in particular, to classify a detected attachment with a specific attachment type (TA) and / or that - the vehicle sub-object (21) and an associated sub-object localization (22) are: an attachment part mounted on the vehicle contour and its attachment part localization. [20] Vehicle treatment system control according to claim 19, wherein a further vehicle sub-object (21) and an associated sub-object localization (22) are elements of the following list: - A vehicle part with an existing exceptional property and its vehicle part location. [21] Vehicle treatment system control according to one of the preceding claims wherein the detected exceptional characteristic (AC) - is recognized as an initial exceptional condition that exists prior to the start of vehicle treatment; AND / OR - is recognized as a subsequent exceptional condition that only occurs after the start of vehicle treatment or that shows a change compared to the initial exceptional condition. [22] Vehicle treatment system control according to one of the preceding claims, wherein the vehicle treatment system control (7), in particular the environment detection (8) and / or the sequence control (13), is configured to classify a detected exceptional condition (CS) as permissible or impermissible, in particular as permissible or impermissible for an adaptation of a treatment program. [23] Vehicle treatment system control according to one of the preceding claims, wherein the sequence control (13) is based on the detected exceptional condition (CS) of the vehicle to be treated. ▪ prevents the start of vehicle treatment, in particular based on an initial exceptional condition, furthermore in particular based on an initial impermissible exceptional condition; AND / OR ▪ a treatment program for vehicle treatment adapted and started, in particular on the basis of an initial exceptional condition, further in particular on the basis of an initial permissible exceptional condition; AND / OR ▪ interrupts ongoing vehicle treatment, in particular on the basis of a subsequent exceptional condition, furthermore in particular on the basis of a subsequent impermissible exceptional condition; AND / OR ▪ adapts and continues an ongoing treatment program for vehicle treatment, in particular on the basis of a subsequent exceptional condition, and further in particular on the basis of a subsequently permissible exceptional condition. [24] Vehicle treatment system control according to one of the preceding claims, wherein the exception property (LS) is decisive for the execution of a vehicle treatment and is defined in particular in contrast to a standard property (LB) of this vehicle part. [25] Vehicle treatment system control according to one of the preceding claims, wherein a vehicle part (23) of the vehicle (80) to be treated and an associated exception property (LS) are elements of the following list: - A towbar with an exceptional feature: unfolded; - A towbar with exceptional features: Tilt; - A spoiler with an exceptional feature: extended; - An antenna with an exceptional feature: extended; - A radiator mascot with an exceptional feature: an impermissibly high protrusion; - A charging port with an exceptional feature: charging cable plugged in; - A flap with an exceptional feature: flap open; - A lid with an exceptional feature: lid open; - A vehicle door with an exceptional feature: door open; - A vehicle window with an exceptional property: window open; - A bodywork gap, especially on the hood, with the exceptional characteristic: gap open; - A windshield wiper with an exceptional feature: Windscreen wipers in upright position; - A windshield wiper with an exceptional feature: Windscreen wipers in motion; - A windshield wiper with an exceptional feature: lifted from the windshield; - A sill with an exceptional feature: vehicle lowered; - A sill with an exceptional feature: vehicle raised; - A fender with an exceptional feature: fender overhang; - A wheel with an exceptional feature: wheel in cornering position; - A vehicle mirror (81) with an exceptional feature: mirror extended. [26] Vehicle treatment system control according to one of the preceding claims, wherein a classifiable attachment type (TA) is an element of the following list: - A roof rack; - A rear carrier; - A transport box; - A spare wheel; - A trailer hitch; - A bicycle; - Ski equipment; - A snowboard; - A rooftop tent; - A ladder; - A window gap cap; [27] Vehicle treatment system control according to one of the preceding claims, wherein the AI module (14) is designed as a recognition network (25) with a plurality of subnets (26a, 26b, 26c), wherein at least two subnets each perform a dedicated subtask of recognizing an exceptional condition (CW), and wherein a first subnet (26a, 26b) passes an intermediate result of the recognition to another subnet (26b, 26c). [28] Vehicle treatment system control according to one of the preceding claims, wherein the AI module (14) comprises a filter section (27) that determines features in the supplied environment detection data (9), and wherein the filter section (27) in particular has several linked filter levels. [29] Vehicle treatment system control according to one of the preceding claims, wherein at least two subnetworks (26a, 26b) of the detection network (25) are connected to a common part of the filter section (27) and / or jointly process the detected features. [30] Vehicle treatment system control according to one of the preceding claims, wherein the AI module (14) is trained to determine (and output) the sub-object localization (22), in particular a vehicle part localization (23a) and / or an add-on part localization (24a). [31] Vehicle treatment system control according to one of the preceding claims, wherein a vehicle part localization (23a) and / or an attachment part localization (24a) defines a spatial position and in particular a spatial extent of the associated vehicle part (23) or attachment part (24) in computer-readable form. [32] Vehicle treatment system control according to one of the preceding claims, wherein the sequence control (13) adapts a treatment program for vehicle treatment in the event of a detected exceptional condition (CS) such that in the area of the detected sub-object localization (22), in particular in the area of the vehicle part localization (23a) and / or in the area of the detected add-on part localization (24a) - at least one treatment unit (3, 4, 5) of the vehicle treatment system (1) is moved with an adapted movement path and / or increased sensitivity; AND / OR - at least one treatment unit (3, 4, 5), in particular a contacting treatment unit (3, 4), which is moved by the vehicle treatment system (1) with a locally reduced physical treatment intervention or locally without physical treatment intervention; AND / OR - a regularly planned treatment with a first treatment unit (3, 4, 5) is replaced by an alternative treatment with another treatment unit (3, 4, 5), wherein in particular the first treatment unit is a contacting treatment unit (3, 4) and furthermore in particular the other treatment unit is a remote treatment unit (5). [33] Vehicle treatment system control according to one of the preceding claims, wherein the (trained) AI module (14) comprises at least one neural network (15), in particular at least one convolutional neural network. [34] Vehicle treatment system control according to one of the preceding claims, wherein the (trained) AI module (14) is configured to perform cascaded recognition, wherein a vehicle object (20) is first recognized within the current environment detection data (9), and subsequently a vehicle sub-object (21), in particular a vehicle part (23) and / or an add-on part (24), is recognized within a part of the environment detection data (9) that can be assigned to the vehicle object (20), and further, in particular subsequently, within a part of the environment detection data (9) that can be assigned to the recognized vehicle sub-object (21), a property of the vehicle sub-object, in particular an exception property (LS), is recognized and / or a sub-object localization (22) is recognized. [35] Vehicle treatment system control according to one of the preceding claims, wherein the (trained) AI module (14) comprises at least one element from the group consisting of object identifier, state classifier, position estimator, extent estimator, which are formed in particular by separate structures of the AI module (14), further in particular - At least one vehicle object identifier; AND / OR - At least one vehicle sub-object identifier, in particular an add-on part identifier and / or a vehicle part identifier; AND / OR - a keypoint identifier; AND / OR - a property classifier; AND / OR - a sub-object location estimator; AND / OR - a sub-object extent estimator; AND / OR - an autoencoder for detecting abnormal behavior of the vehicle treatment system. [36] Vehicle treatment system control according to one of the preceding claims, wherein the (trained) AI module (14) is configured to recognize the representation (12) of a vehicle (80) to be treated and to define (in particular select) in the current environment perception data (9) that part of the data as a vehicle environment data set (9a) in which the representation (12) of the vehicle to be treated is present, wherein the recognition of the vehicle to be treated is carried out in particular with a first neural network, in particular with a vehicle object identifier. [37] Vehicle treatment system control according to one of the preceding claims, wherein the determination of a vehicle environment data set (9a) is carried out by: - Definition of a vehicle bounding box (B1) within the current environment detection data (9), in particular as an axis-parallel bounding box or as an oriented bounding box; - Tracking of a vehicle bounding box (B1) within previous and current environment sensing data (9), in particular as an axis-parallel bounding box or as an oriented bounding box; - Performing a semantic segmentation of the environment perception data, in which it is determined for a majority and in particular all data elements of the current environment perception data (9) whether they belong to the scene background or a vehicle object, wherein the vehicle environment data set (9a) in particular ▪ includes only those data elements that are assigned to the vehicle object, or possibly additional internal data elements that are supplemented to form a coherent data element group; AND / OR ▪ is generated by excluding such data elements that preferably lie in direct extension between a boundary of the environment perception data and a group of data elements assigned to the vehicle object; AND / OR ▪ by excluding such data elements that are assigned to the background. [38] Vehicle treatment system control according to one of the preceding claims, wherein the (trained) AI module (14) is configured to recognize a vehicle sub-object (21) and to define in the current environment detection data (9) that part of the data set as a vehicle sub-object environment data set (9b) in which the representation of the associated vehicle sub-object (21) is present, in particular the representation of a vehicle part (22) or attachment part (23). [39] Vehicle treatment system control according to one of the preceding claims, wherein the (trained) AI module (14) is configured to - to recognize a vehicle part (22) as a vehicle sub-object (21) and to define in the current environment perception data (9) that data part as a vehicle part environment data record (9b) in which the representation of the associated vehicle part (22) is present; AND / OR - to recognize an add-on part (23) as a vehicle sub-object (21) and to define in the current environment perception data (9) that part of the data as an add-on part environment data set (9b) in which the representation of the associated add-on part is present. [40] Vehicle treatment system control according to one of the preceding claims, wherein the determination of a vehicle sub-object environment data set (9b) is carried out by - Definition of a vehicle sub-object bounding box (B2), in particular as an axis-parallel bounding box or as an oriented bounding box; AND / OR - Tracking of a vehicle sub-object bounding box (B2) within previous and current environment sensing data (9), in particular as an axis-parallel bounding box or as an oriented bounding box; [41] Vehicle treatment system according to one of the preceding claims, wherein the recognition of a vehicle sub-object (21) takes place initially or exclusively within a vehicle environment data set (9a). [42] Vehicle treatment system according to one of the preceding claims, wherein the recognition of a vehicle sub-object (21) is carried out by at least one preferably separate neural network (15), in particular by a vehicle sub-object identifier (26b). [43] Vehicle treatment system according to one of the preceding claims, wherein the (trained) AI module (14) is configured to classify at least one exception property (LS) of a vehicle part (23) in contrast to a standard property (LB) of the vehicle part (23). [44] Vehicle treatment system control, wherein the classification of an exception property (LS) is carried out using a preferably separate neural network (15), and further in particular using a property classifier (26c). [45] Vehicle treatment system control, wherein the (trained) AI module is trained to identify at least one key point (P1), more preferably at least two key points (P1, P2) on a vehicle sub-object (21). [46] Vehicle treatment plant, wherein an exception property (LS) of a vehicle part (23) is classified on the basis of a relative position of at least two key points (P1, P2) on the vehicle part (23). [47] Vehicle treatment system control, wherein a first key-point (P1) is identified at a distal end or at an articulation section of the vehicle part (23) and a second key-point (P2) is identified at a dorsal end of the vehicle part (23). [48] Vehicle treatment system according to one of the preceding claims, wherein the detection of an exception property (LS) of a vehicle part (23) takes place exclusively within a vehicle sub-object environment data set (9b). [49] Vehicle treatment system according to one of the preceding claims, wherein the detection of a sub-object localization (22), in particular a vehicle part localization (23a) and / or an add-on part localization (24a) is carried out by at least one preferably separate neural network (15), in particular by a sub-object position estimator and / or a sub-object extent estimator. [50] Vehicle treatment system according to one of the preceding claims, wherein the detection of a sub-object localization (22), in particular a vehicle part localization (23a) and / or an attachment part localization (24a) - within a vehicle sub-object environment data set (9b); AND / OR - based on the definition of a vehicle sub-object bounding-box (B2). [51] Vehicle treatment system according to one of the preceding claims, wherein the recognition of a sub-object localization (22), in particular a vehicle part localization (23a) and / or an add-on part localization (24a), is based on at least one key point (P1, P2) that is assigned to the vehicle sub-object, wherein in particular - A sub-object localization (22) is estimated based on at least one key point on a dorsal section of the vehicle sub-object (21); AND / OR - A sub-object extent is estimated based on at least one key point on a distal section of the vehicle sub-object (21). [52] Vehicle treatment system control according to one of the preceding claims, wherein the vehicle treatment system control (7), in particular the environment detection (8), checks for a detected exceptional condition (CS) by: - Determination of a model type of the vehicle to be treated (80) and comparison of the current environment detection data with reference data (28) for a vehicle of this model type in a previously known standard configuration (KB). [53] Vehicle treatment plant (1) for treating at least one vehicle (80) with one or more treatment units (3, 4, 5), characterized by , that the vehicle treatment system (1) comprises a vehicle treatment system control unit (7) according to one of the preceding claims.
Citation Information
Patent Citations
Intelligent unmanned vehicle washing method based on machine vision
CN110901597A
Camera-based safety system for vehicle treatment facilities
DE202019105667U1
Methods and apparatuses for self-adjusting car wash equipment within a car wash tunnel
US20240375619A1
Servers and systems for an intelligent Anti-collision vehicle wash
WO2025091013A1
CN000110901597A