Method for checking at least one vehicle and electronic computing device

The use of mobile devices for wireless data collection and AI-driven analysis in vehicles addresses the limitations of existing systems, allowing continuous monitoring and optimization by integrating simple, widely available devices for efficient vehicle diagnostics.

DE102018009451B4Active Publication Date: 2025-01-30MERCEDES BENZ GROUP AG

Patent Information

Application Number
DE102018009451
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Filing Date
2018-12-04
Publication Date
2025-01-30
Estimated Expiration
2038-12-04

AI Technical Summary

Technical Problem

Existing vehicle diagnostic systems are limited to complex measurement technologies available only in workshops, restricting widespread use and efficient analysis of acoustic and vibration-related phenomena, especially during product development, production, and customer use, lacking comprehensive data evaluation options.

Method used

A procedure using mobile devices like smartphones to record and transmit measurement data wirelessly to an electronic computing device for evaluation, enabling early detection of vehicle malfunctions without requiring workshop visits, and integrating artificial intelligence for precise analysis.

Benefits of technology

Enables continuous, precise vehicle monitoring and optimization throughout its life cycle, enhancing efficiency and product quality by utilizing simple, widely available devices for data collection and analysis, and facilitating early detection of malfunctions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

Method for checking at least one vehicle (34) in which: - by means of a measuring device (10) different from the at least one vehicle (34) at least an acceleration and / or at least a noise and / or at least an image of at least a part of the at least one vehicle (34) is recorded; - at least one input made by a person is received by means of the measuring device (10); - the detected acceleration and / or the detected noise and / or the detected image is assigned a description by means of the measuring device (10) depending on the input; and - for checking the at least one vehicle (34) by means of the measuring device (10) an electronic computing device (20) which is external to the at least one vehicle (34) and to the measuring device (10) and which is different from the at least one vehicle (34) and from the measuring device (10) shall provide measurement data which characterize the detected acceleration and / or the detected noise and / or the detected image, wherein the measurement data also characterize the description and a position of the at least one vehicle (34) on the earth.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The invention relates to a method for checking at least one vehicle and an electronic computing device. WO 2017 / 048892 A1 discloses a method for collecting data from sensors of a vehicle. Furthermore, a vehicle network management system is known from CN 105610850 A.

[0002] Furthermore, KR 101513084 B1 discloses a vehicle information system. A vehicle-related diagnostic system is known from US 2018 / 0315260 A1. US 2014 / 0277902 A1 discloses a method for programmatically diagnosing vehicle problems. Furthermore, DE 10 2017 204 941 A1 discloses a method for detecting a special operating state of a motor vehicle that deviates from a normal operating state.

[0003] The object of the present invention is to provide a method and an electronic computing device so that at least one vehicle can be checked in a particularly advantageous manner.

[0004] This object is achieved by a method having the features of patent claim 1 and by an electronic computing device having the features of patent claim 8. Advantageous embodiments with expedient further developments of the invention are specified in the remaining claims.

[0005] A first aspect not belonging to the invention is disclosed, which relates to a method for checking at least one vehicle designed, for example, as a motor vehicle, in particular as a car, wherein the previous and following statements regarding the vehicle can readily be applied to other devices such as, for example, mechanical and / or electrical machines or apparatuses and / or corresponding complex systems, and vice versa. The other devices can, for example, be, in particular, simple technical apparatuses. In particular, the other devices can be drive systems, individual motors, electric motors and / or household appliances such as, for example, washing machines, hairdryers, toothbrushes, etc. The devices can also be tools such as drills, saws, etc.

[0006] In the method, measurement data are received by means of an electronic computing device that is external to the at least one vehicle and different from the at least one vehicle, which is, for example, a central electronic computing unit and / or is also referred to as a server, backend or backend server and, for example, provides or forms a data cloud, also referred to as a cloud or data cloud, which is or will be provided by at least one measuring device that is different from the at least one vehicle and from the electronic computing device.

[0007] The feature that the electronic computing device, also simply referred to as computing device, is an electronic computing device that is external to the at least one vehicle and different from the at least one vehicle, is to be understood that the electronic computing device is not a component or part of the vehicle, but is provided in addition to the vehicle and is therefore different from the vehicle, so that the electronic computing device and the vehicle, designed for example as a motor vehicle, in particular as a motor vehicle and preferably as a passenger car, are respective, individual and separate devices or units.The feature that the preferably mobile measuring device is a measuring device different from the at least one vehicle and from the electronic computing device is to be understood that the measuring device is neither a component of the vehicle nor a component of the computing device, so that the measuring device is provided in addition to the vehicle and in addition to the electronic computing device.

[0008] The electronic computing device, the vehicle, and the preferably mobile measuring device, which can be configured, for example, as a mobile terminal, are thus separate and individual units or devices. The measuring device is preferably a mobile radio device, in particular a mobile telecommunications terminal, which can receive and / or transmit or provide data, for example, wirelessly or wirelessly and thus, for example, via radio. For example, the preferably mobile measuring device is a mobile terminal such as a mobile telephone, also referred to as a cell phone or smartphone.

[0009] The measurement data characterize at least one acceleration detected by the measuring device and / or at least one noise detected by the measuring device and / or at least one image of at least one partial area of ​​the at least one vehicle detected by the measuring device. In other words, the measurement data characterize at least one measured variable that is or was detected by the measuring device. The measuring device provides the measurement data, in particular wirelessly, so that, for example, the measurement data is transmitted, in particular wirelessly, from the measuring device to the electronic computing device. The aforementioned measured variable comprises the at least one acceleration detected by the measuring device and / or the at least one noise detected by the measuring device and / or the image detected by the measuring device.The acceleration is an acceleration of the vehicle, or the noise is a noise of the vehicle, i.e., a noise emitted by the vehicle, or the image is an image of at least a partial area of ​​the vehicle. The acceleration was or is recorded, for example, using at least one acceleration sensor of the measuring device. Alternatively or additionally, the noise is or was recorded, for example, using at least one microphone of the measuring device. Alternatively or additionally, the image of the partial area of ​​the vehicle is or was recorded using at least one camera of the measuring device.

[0010] Furthermore, the method provides for the received measurement data to be evaluated by the electronic computing device. In other words, the electronic computing device receives the measurement data, and the electronic computing device evaluates the measurement data. Furthermore, the method provides for the at least one vehicle to be checked, in particular for at least one malfunction, based on the evaluation of the measurement data by the electronic computing device. In other words, the measurement data and thus the measured variable are analyzed and compared, for example, with target data or target values.If, for example, the measured data, which are used in particular as actual data, deviate from the target data or if a deviation of the measured data from the target data exceeds a particularly predetermined or predeterminable threshold, the electronic computing device is used to conclude, for example, that the at least one vehicle has an error or malfunction. However, if the measured data correspond to the target data or if the possible deviation falls below the threshold, the electronic computing device is used to conclude that there is no error or malfunction in the at least one vehicle.

[0011] The method is therefore a method for analyzing the vehicle, in particular for error analysis, so that any malfunctions of at least one vehicle can be detected at an early stage in a particularly simple and precise manner. For this purpose, the vehicle does not have to be taken to a workshop or similar facility; rather, within the scope of the method, it is possible to use objects that are already present in everyday life, such as a measuring device designed as a person's mobile end device, to check or analyze the vehicle. The method is therefore a platform or enables the realization of a platform for the particularly mobile analysis of, for example, acoustic and / or vibration phenomena that can be generated or provided by the vehicle and recorded by the measuring device.This means that the previously described measured variable can be or characterize, for example, an acoustic and / or mechanical phenomenon. By detecting the measured variable, the phenomenon is detected and characterized by the measurement data, so that the phenomenon can be analyzed using the electronic computing device. It is then possible to determine whether the phenomenon is a malfunction or not. In particular, it can be determined whether the acceleration or the noise or at least one feature contained in the image results from an error or a malfunction of the at least one vehicle or, for example, is part of the fault-free functioning of the at least one vehicle.

[0012] In principle, it is conceivable that the measuring device itself already processes or processes the measured quantity or the measured data, so that, for example, the measured data is subjected to a mathematical transformation by the measuring device, especially before it is received by the electronic computing device. As part of this mathematical transformation, the measured data is processed, for example, to convert a time or a time base into at least one or more frequencies or frequency ranges.

[0013] The electronic computing device enables the realization of a particularly central data cloud, also referred to as a data cloud, in which the measurement data characterizing at least one vehicle can be collected and, in particular, stored. Furthermore, for example, further measurement data characterizing several other vehicles can be collected and stored. The central data cloud also enables the connection of measurement data that was or is being generated by complex measurement systems and / or results from at least one or more simulations. Furthermore, the central data cloud enables the connection of data from production and / or field and / or service diagnostics, as well as, alternatively or additionally, data from a customer operation.These data form, for example, a data pool and can be analyzed or evaluated as described above, for example to check at least one vehicle.

[0014] Using this method, it is possible to test at least one vehicle throughout its entire product life cycle, i.e., from the beginning to the end of the vehicle's service life, and to create a product-related platform applicable for this purpose, thereby ensuring and continuously optimizing the desired vehicle characteristics. This platform offers centralized and consistent applicability of digital methods throughout the entire product life cycle and generates significant potential for increasing efficiency, process quality, and product quality through the advantageous use of hardware and capacity resources. Furthermore, the method enables a potential reduction in development times and an understanding of complex interrelationships to improve product design and decision-making processes.It is also possible to use the platform in a customer environment, where, for example, people can interact or communicate with the platform via a software application, also known as an app, application, software app or software application, which is executed on the measuring device.

[0015] The method is based in particular on the following findings: Functional data which, for example, characterise acoustic and / or vibration phenomena of a vehicle, are usually only recorded and analysed using complex measurement technology. This only allows application to a limited group of users and vehicles, particularly within the context of a development process. Only experts are used, and an analysis of such phenomena in areas outside of development is not or hardly possible. As a result, vehicle resources are not used efficiently and comprehensively during a development phase, which also applies to production and service, i.e. maintenance. To date, statistical measurement data on, for example, acoustic and / or vibration phenomena of a vehicle are not widely available, especially during a product development process.This also applies to the scope of production and service, including customer data from the field. The corresponding measurement data is not yet suitable for automated analysis. Therefore, a logical analysis option is also not available.

[0016] The method now makes it possible to overcome the disadvantages and problems mentioned above. To this end, the method enables the creation of a central data storage facility for storing and evaluating all possible data sources from testing, simulation, production, and customer operations. In other words, it is possible to receive and evaluate the measurement data provided by the measuring device during a product development process, and thus to analyze it and incorporate it into a product development process in order to guarantee or improve desired properties. To this end, the method does not use, or only uses, complex measuring technologies that are only available in workshops or developing countries, but rather uses simple measuring devices, for example in the form of mobile devices, which can be designed as cell phones, smartphones, or the like.The measuring device provides the measurement data, in particular wirelessly, so that the measurement data, in particular from several measuring devices, can be received and in particular stored centrally by means of the electronic computing device, in particular wirelessly.

[0017] In addition to the applicability of the platform or method to acoustic and vibrational phenomena, it is also possible to apply it to all other phenomena that can be detected in particular by means of available sensors such as a microphone and / or an acceleration sensor and / or an optical camera.

[0018] The measuring device preferably has a device by means of which the noise and / or the image and / or the acceleration can be recorded. Alternatively or additionally, the measuring device has a user interface, in particular a graphical user interface, which is for example an integrated user interface. A person, i.e. a user of the measuring device, can use the user interface to make inputs into the measuring device and thus interact with the measuring device. The aforementioned phenomena that can be recorded by the measuring device are generally dependent on static and / or statistical phenomena and / or complex relationships, whereby these phenomena can be analyzed by the electronic computing device by the electronic computing device collecting the measurement data.The phenomena include, for example, phenomena for analyzing ride and suspension comfort and driving dynamics, phenomena for analyzing component and surface tolerances, phenomena for analyzing gap dimensions in assemblies, phenomena for analyzing location and position properties, particularly of components in assemblies, and / or phenomena for analyzing changes and wear characteristics during operation and / or other phenomena. The idea underlying the method is the use of many available vehicles or every available vehicle, in particular every test vehicle, and in particular, by extension, every production and customer vehicle in the field, to perform data generation and phenomenon analysis.For this purpose, respective phenomena of the available vehicles are recorded using respective, particularly mobile, measuring devices, and measurement data characterizing the recorded phenomena are provided, which are then received and evaluated by the electronic computing device. Based on the received measurement data, at least one vehicle or vehicles can be monitored particularly precisely and continuously in order to incorporate insights from the evaluation of the measurement data into a development process and / or into an improvement of the respective vehicle.

[0019] The measuring device is preferably a commonly used measuring device, such as a smartphone, by means of which the measurement data is captured or recorded. The measuring device preferably has an integrated user interface. The user interface is also referred to as a user interface or interface. The measuring device preferably has a mobile connection to the vehicle or the measurement object and / or to an object database and / or to general object status data and / or to environmental data.

[0020] A second aspect belonging to the invention relates to a method for checking at least one vehicle. In the method according to the second aspect, at least one acceleration and / or at least one noise and / or at least one image of at least a partial area of ​​the at least one vehicle is recorded by means of a measuring device that is different from the at least one vehicle and is designed, for example, as a mobile terminal, in particular as a mobile radio device. Furthermore, at least one input made by a person is received by means of the measuring device. The person is a user of the measuring device, wherein the person makes the input, for example, via the aforementioned user interface and enters it into the measuring device. In the method according to the second aspect, a description of the recorded acceleration and / or the recorded noise and / or the recorded image is assigned by means of the measuring device depending on the input.Assigning the description to the measurement data is also referred to as labeling the measurement data. The description characterizes, for example, a type and / or a verbal name of the measured quantity, i.e., the acceleration and / or the sound and / or the image.

[0021] The second aspect further provides that, for checking the at least one vehicle using the measuring device, measurement data characterizing the detected measured variable (acceleration and / or noise and / or image) are provided to an electronic computing device that is external to the at least one vehicle and the measuring device and different from the at least one vehicle and the measuring device, wherein the measurement data also characterize the description. Advantages and advantageous embodiments of the first aspect are to be regarded as advantages and advantageous embodiments of the second aspect, and vice versa.

[0022] A third aspect of the invention relates to an electronic computing device configured to perform a method according to the second aspect. Advantages and advantageous embodiments of the first and second aspects are to be regarded as advantages and advantageous embodiments of the third aspect, and vice versa.

[0023] While the first aspect thus targets the electronic computing device, the second aspect targets the measuring device, which, for example, provides the measurement data described in relation to the first aspect. The second aspect is also based on the idea of ​​using a commonly used everyday object in the form of a measuring device, for example a cell phone, smartphone or tablet PC, to record the measured variable and subsequently provide the measurement data so that the at least one vehicle can be comprehensively and continuously checked using the measurement data. Continuous checking is to be understood as meaning that the at least one vehicle can be checked at least almost throughout its entire service life, in particular during respective, temporally spaced time intervals, in order to ensure or even optimize a desired function of the at least one vehicle.

[0024] In addition, the measurement data characterize a position of at least one vehicle on Earth.

[0025] In an advantageous embodiment of the invention, the measurement data characterize a state of at least one vehicle. As a result, the state or the position is assigned to the measurement data or the measured variable recorded by the measuring device, so that the boundary conditions under which the measurement data or the measured variable were recorded can be taken into account. The state is, for example, a, in particular current, driving state, wherein the vehicle has or had the state when the measured variable was recorded by the measuring device. Alternatively or additionally, the position is determined, for example, by means of a navigation device of the measuring device, in particular satellite-based.

[0026] In particular, it is conceivable that the measuring device is or will be connected to the vehicle via at least one data connection and / or wirelessly, so that, for example, the measuring device receives status data which is provided by the vehicle and, for example, characterizes the status of the vehicle. The status of the vehicle includes, for example, a speed and / or a temperature of the vehicle and / or a temperature prevailing in an environment of the vehicle. In particular, it is provided that the measuring device assigns the status or the position to the measurement data, whereby the at least one vehicle can be checked particularly precisely. Furthermore, it is conceivable that the measuring device receives, in particular wirelessly, position data which is provided by the vehicle and, for example, characterizes the position of the vehicle.The position is or was determined, for example, by means of the vehicle, in particular by satellite.

[0027] A further embodiment is characterized in that, based on the measurement data, an artificial intelligence is trained by means of the electronic computing device, in particular with regard to determining the at least one malfunction. The training of the electronic computing device takes place, for example, in such a way that the measurement data as training data characterize a malfunction, in particular an actually existing one, of the vehicle or that the measurement data do not characterize a malfunction of the vehicle. Furthermore, the electronic computing device is informed that the training data characterize the malfunction or no malfunction. The electronic computing device is thereby trained such that the electronic computing device can distinguish between measurement data that characterize a malfunction and measurement data that do not characterize a malfunction.This allows the electronic computing device to determine with a very high degree of probability whether or not at least one vehicle is malfunctioning. This allows the at least one vehicle to be inspected with great precision. Artificial intelligence can, for example, be used to perform analytical analysis. Alternatively or additionally, machine learning, artificial intelligence, and big data approaches can be used for analysis.

[0028] In order to be able to check the at least one vehicle particularly precisely, it is provided in a further embodiment of the invention that further measurement data are received by means of the electronic computing device which is external to a further vehicle provided in addition to the vehicle and which is different from the further vehicle. These measurement data are provided by at least one further measuring device which is different from the further vehicle and from the electronic computing device and which characterize at least one further measurement variable recorded by the further measuring device, such as an acceleration and / or a noise and / or an image of at least one further partial area of ​​the further vehicle.The received further measurement data are received and evaluated by the electronic computing device, wherein, depending on the evaluation of the further measurement data and depending on the evaluation of the first measurement data by the electronic computing device, the at least one vehicle and preferably also the further vehicle is or are checked for the at least one malfunction or malfunctions. The background to this embodiment is to create data aggregation and, for this purpose, to receive and store the measurement data from a large number of separate measuring devices, wherein the respective measurement data characterizes respective, separate vehicles. As a result, the electronic computing device can be used to determine particularly precisely whether the measured variable characterizes a malfunction or a normal state of the vehicle.

[0029] It has proven particularly advantageous if the first measurement data are assigned to a first component of at least one vehicle, and the further measurement data are assigned to a second component of the further vehicle that is identical to the first component, with at least the first component being checked for the at least one malfunction. This makes it possible to compare identical components of the respective vehicles with each other. This makes it possible to determine with a very high degree of probability whether the respective component is functional or malfunctioning.

[0030] In a particularly advantageous embodiment of the invention, result data resulting from the evaluation are provided to the measuring device by means of the electronic computing device. In other words, the electronic computing device provides the result data resulting from the evaluation of the measurement data. The result data is, for example, transmitted from the electronic computing device to the measuring device and received by the measuring device. On an electronic display of the measuring device, also referred to as an electronic screen, on whose display, for example, the user interface can be displayed or is displayed, at least one piece of information characterizing the result data is displayed, in particular visually, as a function of the result data.This allows, for example, the aforementioned user of the measuring device to determine from the displayed information whether the at least one vehicle is malfunctioning or error-free. Providing the result data thus provides feedback to the measuring device, allowing the user of the measuring device to determine from the feedback whether the electronic computing device has detected a malfunction in the at least one vehicle or not.

[0031] In order to be able to check the at least one vehicle particularly comprehensively and precisely, it is provided in a further embodiment of the invention that simulation data which characterize a simulation of at least one part of the at least one vehicle, and / or production data which characterize a manufacture of the at least one vehicle, and / or maintenance data which characterize a maintenance or service of the at least one vehicle, and / or test bench data which characterize a test of the at least one vehicle carried out by means of a test bench are received by means of the electronic computing device, wherein the at least one vehicle is checked for the at least one malfunction by means of the electronic computing device as a function of the simulation data and / or the production data and / or the maintenance data and / or the test bench data.The simulation, the test bench and / or a device by means of which, for example, the maintenance data and / or other data characterizing the at least one vehicle are determined and provided, based on which the at least one vehicle can be checked, is, for example, an expert system. In addition to the measuring device and / or the respective expert system, existing vehicle sensors of the at least one vehicle can be used, in particular directly. The vehicle sensor system comprises at least one vehicle sensor, which can be designed as a microphone, an acceleration sensor or an optical recording device such as a camera. The phenomenon is detected, for example, by means of the acceleration sensor, and the vehicle sensor provides vehicle sensor data characterizing the phenomenon, based on which the at least one vehicle can be checked.The vehicle sensor data are read out from at least one vehicle, for example wirelessly and thus via a remote control or remote system, or are transmitted to and / or received from the server, whereby a particularly advantageous analysis can be presented.

[0032] Finally, a fourth aspect not belonging to the invention relates to a method for checking at least one vehicle. As will be explained in more detail below, the fourth aspect is directed both at the electronic computing device and at the measuring device and thus at a system which comprises both the measuring device and the electronic measuring device. In the fourth aspect, at least one acceleration and / or at least one noise and / or at least one image of at least one partial region of the at least one vehicle is recorded by means of a measuring device which is different from the at least one vehicle. The measuring device provides measurement data which characterize the recorded acceleration and / or the recorded noise and / or the recorded image.Furthermore, in the fourth aspect, the measurement data provided by the measuring device are received by an electronic computing device that is external to the at least one vehicle and the measuring device and different from the at least one vehicle and the measuring device. The received measurement data are evaluated by the electronic computing device, and the at least one vehicle is checked for at least one malfunction by the electronic computing device depending on the evaluation of the measurement data. Advantages and advantageous embodiments of the first aspect, the second aspect, and the third aspect are to be regarded as advantages and advantageous embodiments of the fourth aspect, and vice versa.

[0033] The aspects can be summarized as follows: First, the measured variable is recorded, for example, by the measuring device commonly used in everyday life, which has the integrated user interface and, for example, a mobile connection to at least one vehicle and / or to an object database and / or to general object status data and / or to environmental data. The measuring device generates, for example, the previously described measurement data from the recorded measured variable. Furthermore, the previously described labeling of the measurement data takes place via the user interface, in particular for the subsequent training of the artificial intelligence. The training of the artificial intelligence takes place, for example, within the framework of supervised learning.The measurement data, in particular provided with the description, are transmitted, for example, in a mobile manner, to the electronic computing device, in particular including an object structure and / or including state and / or environmental data that characterize the state or position and thus the environment of the vehicle. For example, the measurement data are transmitted to a data cloud formed by the electronic computing device. Alternatively or additionally, the measurement data are transmitted, in particular in a mobile manner, to a data cloud for analysis, in particular including the previously described object structure and / or including the state and / or environmental data. In addition, the measurement data are further processed in or by the electronic computing device, in particular for training the artificial intelligence and / or through machine analysis using analytical methods and artificial intelligence.

[0034] In particular, by evaluating the measurement data, the measurement data and thus the measured variable are assigned to at least one or more phenomena and subsequently to the system components of the at least one vehicle that cause the phenomenon or phenomena. In other words, for example, by evaluating using the electronic computing device, at least one component of the at least one vehicle, also referred to as a system component, is determined, wherein the component, in particular with a certain probability, causes or causes the phenomenon or the measured variables and thus the acceleration and / or the noise and / or the image. Preferably, moreover, the previously described feedback is sent to the measuring device and in particular to the user interface as a result of the check, also referred to as analysis, preferably in real time.Furthermore, for example, an additional evaluation of the measurement data and / or an additional evaluation of already analyzed data is carried out, in particular in pre- and post-processing, in particular with the help of a data management tool.

[0035] The aforementioned central data cloud also enables the connection of measurement data, particularly data generated by complex measurement systems and / or from simulation data, as well as data from production and field and service diagnostics, as well as customer operations, if applicable. A corresponding evaluation of the entire data pool, as described above, is possible. This provides a product-supporting platform applicable throughout the entire product lifecycle, from design to end-of-life, to ensure desired properties and their continuous optimization.The platform offers a central, consistent applicability of digital methods throughout the entire product life cycle and generates high potential for increasing efficiency, process quality, and product quality through optimal use of hardware and capacity resources, shortening development times, and understanding complex interrelationships to improve product design and decision-making processes.

[0036] The measuring device preferably has a device via which the measuring device can be connected to the at least one vehicle, in particular via a signal connection or via a data connection. Alternatively or additionally, the measuring device can be connected via the data connection to a sensor system that is external to the measuring device and / or to the vehicle. The external sensor system or the at least one vehicle can provide data that, for example, characterizes the at least one vehicle and is received by the measuring device. The data is linked, for example, to the measurement data so that the electronic computing device can check the at least one vehicle based on the measurement data and the data linked thereto. The data is provided, for example, by at least one sensor or by several sensors of the vehicle.

[0037] The measuring device executes, for example, a software application, also referred to as an application, app or software application, which is executed, for example, by a central processor unit of the measuring device. By running the software application, the graphical user interface in particular is shown on the electronic display of the measuring device. The software application in particular provides an option for a person to make at least one input into the measuring device via the graphical user interface. Through this input, the measurement data can be assigned the aforementioned description so that the measurement data can be labeled. Subsequently, the labeled measurement data is transmitted, for example, via a mobile device to the computing device and thus, for example, to the data cloud.

[0038] For example, the mobile measuring device is networked with online status and / or environmental data as well as with databases containing information on the vehicle's structure, whereby this data is assigned to the measurement data, particularly via the application. Furthermore, artificial intelligence is trained using the transmitted and received measurement data, including labeling, for example, as part of supervised learning. Furthermore, phenomena are recognized and classified through machine evaluation of the measurement data, particularly in real time on the electronic computing device, particularly using analytical methods and artificial intelligence.Furthermore, integrated vehicle- and phenomenon-specific feature engineering is carried out, for example, using the electronic computing device to optimize the probability of detection by the artificial intelligence. Furthermore, the results of the phenomenon detection from the artificial intelligence are fed back from the electronic computing device to the online measuring device, particularly in real time. A data manager is preferably provided on the electronic computing device for further structured analysis of the measurement data before and / or after analysis by the artificial intelligence.

[0039] Alternatively or additionally, the central data cloud or the central electronic computing device, including the analysis capability described above, can be expanded to include all measurement data sources of the entire product life cycle from design to the end of its service life, so that, for example, at least one vehicle is checked as a function of vehicle test bench and road measurement data using complex expert measurement systems and / or as a function of simulations and / or as a function of production and / or as a function of diagnostic and service data and / or as a function of data from a customer operation.

[0040] Further advantages, features, and details of the invention will become apparent from the following description of a preferred embodiment and from the drawings. The features and combinations of features mentioned above in the description, as well as the features and combinations of features mentioned below in the description of the figures and / or shown alone in the figures, can be used not only in the respective specified combinations, but also in other combinations or on their own, without departing from the scope of the invention.

[0041] The drawing shows: Fig. 1 is a diagram illustrating a method according to the invention; Fig. 2 another diagram illustrating the process; Fig. 3 another diagram illustrating the process; Fig. 4 a schematic representation of a graphical user interface displayed on an electronic display of a measuring instrument used in the method; Fig. 5 another schematic representation of the graphical user interface; Fig. 6 another schematic representation of the graphical user interface; and Fig. 7 another schematic representation of the graphical user interface.

[0042] In the figures, identical or functionally identical elements are provided with the same reference numerals.

[0043] Fig. 1 shows a schematic diagram, wherein a method for checking at least one vehicle is described below with reference to the figure. The method uses an electronic measuring device 10 which, in the exemplary embodiment illustrated in the figures, is designed as a mobile terminal and, in this case, as a mobile radio device in the form of a smartphone. The measuring device 10 has a central processor unit which can execute or executes a software application, also referred to as an app or application, which is also referred to as an application or software application. The measuring device 10 also has an electronic display 12, also referred to as a screen or electronic screen, on which a graphical user interface 14 of the software application is displayed.The graphical user interface is also referred to as a surface, interface, or user interface. The display 12 is designed, for example, as a touch-sensitive screen, so that a person, i.e., a user, of the measuring device 10 can enter inputs into the measuring device 10 via the user interface 14 and the touch-sensitive screen.

[0044] The measuring device 10 also has a detection device 16, which comprises, for example, at least one camera and / or at least one microphone and / or at least one acceleration sensor of the measuring device 10. Within the scope of the method, at least one measured variable is detected by means of the detection device 16 using the measuring device 10, which is different from the at least one vehicle, wherein the measured variable is at least one acceleration and / or at least one noise of the at least one vehicle. Alternatively or additionally, the measured variable comprises at least one image of at least a partial area of ​​the at least one vehicle. The acceleration of the at least one vehicle is detected, for example, using the acceleration sensor. Alternatively or additionally, the noise emitted by the vehicle is detected, for example, using the microphone of the measuring device 10. Alternatively or additionally, the image is detected using the camera of the measuring device 10.In addition, the measuring device receives at least one input made by a person via the user interface 14. Depending on the input, a description is assigned to the recorded measured variable by the measuring device 10. This assignment of the description to the measured variable is also referred to as labeling, so that the measured variable is labeled. As shown in . Fig. 1 by an arrow 18, the measuring device 10 provides the measurement data, preferably provided with the description, in particular wirelessly. An electronic computing device 20 which is external to the at least one vehicle and to the measuring device 10 and different from the at least one vehicle and the measuring device 10 and which is also referred to as a server or backend and, for example, has a database and / or forms a neural network or is a component of the neural network, receives the measurement data provided by the measuring device 10. The measurement data is stored, for example, in a database. The received measurement data is evaluated by the electronic computing device 20. Depending on the evaluation of the measurement data, the at least one vehicle is checked by the electronic computing device 20, in particular for a malfunction.

[0045] As in Fig. 1 by an arrow 22, the electronic computing device 20 provides, for example, result data resulting from the evaluation. The result data is transmitted from the computing device 20 to the measuring device 10 and received by the measuring device 10, in particular wirelessly. The transmission of the result data to the measuring device 10 thus constitutes feedback, in particular regarding phenomena identified based on the evaluation. This means that by evaluating the measurement data, at least one or more phenomena can be determined that are responsible for the measured variable or that cause the measured variable.Furthermore, it can be determined, for example, whether the phenomenon is associated with a malfunction or a functional state of the at least one vehicle, so that by evaluating the measurement data it can be determined whether the at least one vehicle has a malfunction or does not have a malfunction and is therefore functional.

[0046] The measuring device 10 is connected to the at least one vehicle, for example via a wireless data connection illustrated by an arrow 24, in particular via Bluetooth and / or radio. The measuring device 10 receives, for example, driving data provided by the at least one vehicle via the in particular wireless data connection. The driving data characterize, for example, a state, in particular a driving state, of the at least one vehicle, wherein the driving data are assigned to the measured data or linked to the measured data. As a result, the driving data are also transmitted to the electronic computing device 20, in particular as part of the measured data, so that, for example, the electronic computing device 20 can also check the at least one vehicle depending on the driving data or depending on the state of the vehicle.

[0047] As further illustrated by an arrow 26, the measuring device 10 can receive sensor data from an external sensor system, in particular via a wireless data connection, which is, for example, an integrated and / or additionally provided sensor system, in particular of a vehicle. The sensor data characterizes, for example, at least one further state of the at least one vehicle. As further illustrated by an arrow 28, the measuring device 10 receives, for example, in particular via a wireless data connection, measurement technology data which characterizes, for example, acoustic phenomena or noises, in particular of the at least one vehicle.As further illustrated by an arrow 30, the measuring device 10 receives, for example via a wireless data connection, metadata which characterizes a construction status and / or special equipment and / or other variables of the at least one vehicle, wherein the metadata originates, for example, from one or more vehicle databases 32. The sensor data and / or the measurement technology data and / or the metadata are, for example, linked to the measurement data and, as part of the measurement data, are transmitted from the measuring device 10 to the electronic computing device 20 and received by the electronic computing device 20, such that the electronic computing device 20 can also check the at least one vehicle depending on the measurement technology data and / or metadata and / or depending on the sensor data.By evaluating the measurement data, the driving data and / or the sensor data and / or the measurement technology data and / or the metadata are also evaluated and, based on these, at least one vehicle is checked.

[0048] The measurement data transmitted from the measuring device 10 to the electronic computing device 20 and received by the electronic computing device 20 are used, for example, to populate the database and / or to train an artificial intelligence such as a neural network, particularly with regard to detecting a malfunction of the at least one vehicle. Artificial intelligence is also referred to as AI.

[0049] Fig. Figure 2 shows a diagram to further illustrate the method. The measurement data is used, for example, to perform feature recognition using artificial intelligence (AI). Within the scope of feature recognition, at least one phenomenon is identified from which the measured variable results. By identifying the phenomenon, it can be determined whether the measured variable results from a malfunction or from a fault-free condition of the at least one vehicle. The phenomenon is thus a result of the evaluation of the measurement data, whereby the result - as in Fig. 2 is illustrated by the arrow 22 - is transmitted back to the measuring device 10.

[0050] The measured variable is determined, for example, by a test driver during a test drive, with the measured data being, for example, NVH measurement data (NVH - Noise Vibration Harshness) and thus characterizing at least one noise or noises of the at least one vehicle. In order to record the measured variable during the test drive and ultimately transmit the measured data accordingly via the measuring device 10 to the electronic computing device 20, a test drive mode of the software application is set and selected, for example, in particular via the user interface 14.

[0051] For example, a noise expert carries out another test of the Fig. 2 with 34, so that the measurement data are, for example, NVH training data. The NVH training data, also simply referred to as training data, are used, for example, in a training mode of the software application, also referred to as learning mode, to train the electronic computing device 20 with regard to determining a respective phenomenon causing the measured variable based on the training data.

[0052] Alternatively or additionally, for example, Fig. 2 databases designated 36 are provided, in which data records are stored that characterize respective noises or noise behavior of the vehicle 34. The data records are also transmitted to and received by the electronic computing device 20, for example, so that the electronic computing device 20 can check the vehicle 34 depending on the data records from the databases 36. For example, the data records are extracted manually from the databases 36.

[0053] As in Fig. 2 by an arrow 38, the artificial intelligence AI is trained using the measurement data, in particular using the training data, in order to achieve a particularly high recognition rate. The recognition rate characterizes a probability with which the artificial intelligence AI or the computing device 20 can correctly recognize a respective phenomenon responsible for the respective measured variable or causing the respective measured variable. By correctly recognizing the phenomenon causing the measured variable, it can be determined from the evaluation of the measurement data whether the measured variable results from an error or a malfunction of the vehicle 34 or from a fault-free state of the vehicle 34.

[0054] Fig. 3 shows a further diagram illustrating the method. The measurement data are, for example, driving data determined during a journey of the vehicle 34. Furthermore, the measurement data can include the aforementioned measurement technology data, which is determined using, in particular, stationary measurement technology. Alternatively or additionally, the measurement data can include test bench data determined using a test bench used to test the vehicle 34. The aforementioned data sets are, for example, inventory data provided by the databases 36. Alternatively or additionally, simulation data can be provided, on the basis of which the electronic computing device 20 checks the vehicle 34.The measurement data, i.e., the driving data, the measurement technology data, the test bench data, the inventory data, and the simulation data, are transmitted to and received by a data cloud 40 and thus the electronic computing device 20, for example, so that central data access to the aforementioned data is possible. Using artificial intelligence (AI), the measurement data is used to determine whether the acceleration and / or the noise and / or the image result from a fault-free or faulty state of the vehicle 34, thereby enabling the vehicle 34 to be checked effectively and efficiently.Furthermore, it is conceivable to take into account maintenance data which characterize a maintenance or service of the vehicle 34 and / or production data which characterize a manufacture of the vehicle 34 and / or customer data which characterize a customer operation of the vehicle 34 in order to check the at least one vehicle 34 by means of the electronic computing device 20.

[0055] Fig. 4 shows a schematic representation of a first menu of the graphical user interface 14. The measuring device 10 is connected, for example, via a wireless data connection such as Bluetooth and thus wirelessly to the vehicle 34. Then, for example, the aforementioned person selects a control element 42 of the user interface 14, wherein the control element 42 in this case is a partial area of ​​the user interface 14. The person touches the touch-sensitive screen in an area in which the partial area is displayed on the touch-sensitive screen. This starts the aforementioned learning mode of the software application. Thereafter, for example, a control element 44 of the user interface 14 is displayed on the touch-sensitive screen according to Fig. 5. If the person actuates the control element 44 by touching the area of ​​the touch-sensitive screen in which the control element 44 is displayed, the recording of the measured variable by means of the measuring device 10 begins, for example.

[0056] Based on Fig. The labeling process mentioned above is illustrated in Figure 6. To perform the labeling, another menu of the user interface 14 is displayed on the touch-sensitive screen. The additional menu according to Fig. 6 comprises further operating elements 46a-e. The respective operating element 46a-e corresponds to a respective description that can be assigned to the previously recorded measured variable. If the measured variable is, for example, a sound, the respective description can be used to assign a designation to the sound, which can, for example, be used to verbally describe the sound by a person. The person assigns the description to the measured variable by touching the area of ​​the touch-sensitive screen in which the operating element 46a-e is displayed, which corresponds to the description to be assigned to the measured variable. The description is thus a type that characterizes the measured variable.

[0057] In the learning mode, measurement data characterizing the measured variables and thus the phenomena that cause the measured variables can be communicated to the electronic computing device 20. As a result, the electronic computing device 20 can distinguish between those measured variables or phenomena that occur during a fault-free state of the vehicle 34 and those measured variables or phenomena that result from malfunctions of the vehicle 34.

[0058] For example, if the person does not want to use the learning mode but wants to perform a test run, the person touches the area of ​​the touch-sensitive screen in which a Fig. 4 is displayed. Like the control element 42, the control element 48 is also an area or partial area of ​​the user interface 14. By activating the normal test run, the measured variable is recorded by the measuring device 10, and the measured data is transmitted to the computing device 20, which can then determine whether the measured variable results from a malfunction or from a fault-free state of the vehicle 34. To this end, the computing device 20 can, for example, compare the measured data received during the test run with the measured data that the computing device 20 received during the learning mode. Since, for example, the measured data resulting from the learning mode characterizes a malfunction, the computing device 20 can compare the measured data from the test run with the measured data from the learning mode.For example, if the measurement data from the test drive correspond to the measurement data from the learning mode, the computing device 20 can conclude that the vehicle 34 is malfunctioning. However, if the measurement data from the test drive deviate from the measurement data from the learning mode, the computing device 20 can conclude that the vehicle 34 is fault-free.

[0059] Fig. 7 shows another menu of the user interface 14. The further menu according to Fig. 7 comprises further operating elements 48a-f, by means of which further descriptions of the respective measured variable or measured data can be assigned.

Claims

[1] Method for checking at least one vehicle (34), in which: - at least one acceleration and / or at least one noise and / or at least one image of at least one partial area of the at least one vehicle (34) is detected by means of a measuring device (10) which is different from the at least one vehicle (34); - at least one input made by a person is received by means of the measuring device (10); - a description is assigned to the detected acceleration and / or the detected noise and / or the detected image by means of the measuring device (10) depending on the input; and - for checking the at least one vehicle (34) by means of the measuring device (10), an electronic computing device (20) which is external to the at least one vehicle (34) and to the measuring device (10) and different from the at least one vehicle (34) and the measuring device (10) is provided with measurement data which characterize the detected acceleration and / or the detected noise and / or the detected image, wherein the measurement data also characterize the description and a position of the at least one vehicle (34) on the earth. [2] Method according to claim 1, characterized by that the measurement data characterize a state of the at least one vehicle (34). [3] Method according to claim 1 or 2, characterized by that an artificial intelligence (AI) is trained on the basis of the measurement data by means of the electronic computing device (20), in particular with regard to determining at least one malfunction. [4] Method according to one of the preceding claims, characterized by , that: - by means of the computing device (20) which is external to a further vehicle and different from the further vehicle, further measurement data are received which are provided by at least one further measuring device which is different from the further vehicle and from the electronic computing device (20) and which characterise at least one further acceleration detected by the further measuring device and / or at least one further noise detected by the further measuring device and / or at least one further image of at least one further partial area of the further vehicle which is detected by the further measuring device; - the further measurement data received are evaluated by means of the electronic computing device (20); and - depending on the evaluation of the measurement data and depending on the evaluation of the further measurement data by means of the electronic computing device (20), the at least one vehicle (34) is checked for at least one malfunction. [5] Method according to claim 4, characterized by that the measurement data are assigned to a first component of the at least one vehicle (34) and the further measurement data are assigned to a second component of the further vehicle that is identical in construction to the first component, wherein at least the first component is checked for the at least one malfunction. [6] Method according to one of the preceding claims, characterized by that the measuring device (10) is provided with result data resulting from the evaluation by means of the electronic computing device (20). [7] Method according to one of the preceding claims, characterized by that by means of the electronic computing device (20): - simulation data characterizing a simulation of at least a part of the at least one vehicle (34), and / or production data characterizing a manufacture of the at least one vehicle (34), and / or maintenance data characterizing a maintenance of the at least one vehicle (34), and / or test bench data characterizing a test of the at least one vehicle (34) carried out by means of a test bench are received; and - the at least one vehicle (34) is checked for at least one malfunction by means of the electronic computing device (20) as a function of the simulation data and / or the production data and / or the maintenance data and / or the test bench data. [8] Electronic computing device (20) which is designed to carry out a method according to one of the preceding claims.

Citation Information

Patent Citations

  • Vehicle service and management system based on internet of vehicles

    CN105610850A

  • Method for detecting a special operating state of a motor vehicle, mobile device, computer program product and collection of reference noises

    DE102017204941A1

  • Method and system for providing information to a vehicle by using environmental information

    KR101513084B1

  • System and method for crowdsourcing vehicle-related analytics

    US20140277902A1

  • Automotive diagnostics using supervised learning models

    US20180315260A1

Cited By

  • Procedures for assessing the condition of a motor vehicle as well as motor vehicles

    DE102024208670A1