A method for providing a motor vehicle related information for a user of a motor vehicle, a computer program product

Abstract

A method for providing motor vehicle related information 14 for a user 16 of the motor vehicle 10 by an information system 12 of the vehicle 10. A question of the user 16 related to the vehicle 10 is captured by a capturing device 18 of the information system 12. An electronic computing device 20 of the information system 12 analyses the question and an artificial intelligence of the electronic computing device 20 generates an answer. Preferably, the answer is generated depending on a digital manual 26 of the vehicle 10. The generated answer is output as motor vehicle related information 14 for the user 16 by an output device 22 of the information system 12. The question may be voice input and the answer may be voice output. Video and / or audio concerning the motor vehicle related information 14 may also be output, e.g. step by step instructions for changing a tire.

Description

[0001] The present invention relates to the field of automobiles. More specifically, the present invention relates to a method for providing a motor vehicle related information for a user of the motor vehicle by an information system of the motor vehicle. Furthermore, the present invention relates to a corresponding computer program product, a corresponding non-transitory computer-readable storage medium, as well as to a corresponding information system. BACKGROUND INFORMATION

[0002] According to the state of the art it takes a long time to look through a driver’s manual to find the issue at hand, and it may be difficult to understand the instructions written, especially if there exists a language barrier, and users are more likely to manually locate and use, for example, videos or visual guides. SUMMARY OF THE INVENTION

[0003] It is an object of the present invention to provide a method, a corresponding computer program product, a corresponding non-transitory computer-readable storage medium, as well as a corresponding information system, by which a user can be provided with a motor vehicle related information in an easier way.

[0004] This object is solved by a method, a corresponding computer program product, a corresponding non-transitory computer-readable storage medium, as well as a corresponding information system.

[0005] One aspect of the present invention relates to a method for providing a motor vehicle related information for a user of the motor vehicle by an information system of the motor vehicle. A question of the user related to the motor vehicle is captured by a capturing device of the information system. The question is analyzed by an electronic computing device of the information system. An answer depending on the question is generated by an artificial intelligence of the electronic computing device. The generated answer is output as the motor vehicle related information for the user by an output device of the information system.

[0006] Therefore, a quicker and more efficient way in extracting information for a user is provided. Furthermore, it has the possibility to expand the knowledge based on the artificial intelligence model to include situations which are not commonly found in a manual because the artificial intelligence model may perform a greater robust identification and determination of instructions for particular situations, and the output of the artificial intelligence modal may be easier to understand due to different methods of presenting information, for example audio presentation and visual presentation instead of a text base. The instructions can also be accessed at times with low internet activity, for example an advantage over an internet-based video platform.

[0007] In particular, the present invention removes the need of internet-based video platforms and issues by integrating the solution into the motor vehicle instead. Also, official recommendations can be provided by the manufacturer for any instructions on the experience as opposed to relying on external third party video locks or blocks.

[0008] In particular, a conversion of the driver’s manual and / or visual experience may be provided. If the user wants to solve a problem, they can ask the vehicle instead of reading the manual. For example, how to change a tire, the response from the motor vehicle may be that an audio response from the car. A video or step by step image response on the screen may be provided. Furthermore, also video illustrations are offered, and interactive experiences for a user to engage with real-time data on the vehicle in order to further learn the aspects of the motor vehicle may be provided.

[0009] According to an embodiment, a voice input of the user is captured as the question.

[0010] In another embodiment, a voice output is generated by the output device.

[0011] In another embodiment additionally an image concerning to the motor vehicle related information and / or a video concerning to the motor vehicle related information is outputted.

[0012] In another embodiment, the answer is generated depending on a digital manual of the motor vehicle.

[0013] In particular, the method is a computer-implemented method. Therefore, another aspect to the invention relates to a computer program product comprising program code means for performing a method according to the preceding aspect.

[0014] Furthermore, the present invention relates to a non-transitory computer-readable storage medium comprising at least the computer program product according to the preceding aspect.

[0015] Furthermore, the present invention relates to an information system for providing a motor vehicle related information for a user of the motor vehicle, comprising at least one capturing device, one electronic computing device, and one output device, wherein the information system is configured for performing a method according to the preceding aspect. In particular, the method is performed by the information system.

[0016] Furthermore, the present invention relates to a motor vehicle comprising at least the information system.

[0017] Advantageous embodiments of the method are to be regarded as advantageous embodiments of the computer program product, the non-transitory computer-readable storage medium, the information system, as well as the motor vehicle. The information system as well as the motor vehicle therefore comprises a means for performing the method according to the preceding aspect.

[0018] A computing unit / electronic computing device may in particular be understood as a data processing device, which comprises processing circuitry. The computing unit can therefore in particular process data to perform computing operations. This may also include operations to perform indexed accesses to a data structure, for example a look-up table, LUT.

[0019] In particular, the computing unit may include one or more computers, one or more microcontrollers, and / or one or more integrated circuits, for example, one or more application-specific integrated circuits, ASIC, one or more field-programmable gate arrays, FPGA, and / or one or more systems on a chip, SoC. The computing unit may also include one or more processors, for example one or more microprocessors, one or more central processing units, CPU, one or more graphics processing units, GPU, and / or one or more signal processors, in particular one or more digital signal processors, DSP. The computing unit may also include a physical or a virtual cluster of computers or other of said units.

[0020] In various embodiments, the computing unit includes one or more hardware and / or software interfaces and / or one or more memory units.

[0021] A memory unit may be implemented as a volatile data memory, for example a dynamic random access memory, DRAM, or a static random access memory, SRAM, or as a non-volatile data memory, for example a read-only memory, ROM, a programmable read-only memory, PROM, an erasable programmable read-only memory, EPROM, an electrically erasable programmable read-only memory, EEPROM, a flash memory or flash EEPROM, a ferroelectric random acc.

[0022] Further advantages, features, and details of the present invention derive from the following description of preferred embodiments as well as from the drawings. The features and feature combinations previously mentioned in the description as well as the features and feature combinations mentioned in the following description of the figures and / or shown in the figures alone can be employed not only in the respectively indicated combination but also in any other combination or taken alone without leaving the scope of the invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] The novel features and characteristic of the present disclosure are set forth in the appended claims. The accompanying drawings, which are incorporated in and constitute a part of this disclosure, illustrate exemplary embodiments and together with the description, serve to explain the disclosed principles. The same numbers are used throughout the figures to reference like features and components. Some embodiments of system and / or methods in accordance with embodiments of the present subject matter are now described below, by way of example only, and with reference to the accompanying figures.

[0024] The drawings show in:

[0025] Fig. 1 a schematic side view according to an embodiment of a motor vehicle comprising an embodiment of an information system;

[0026] Fig. 2 a schematic flow chart according to an embodiment of the method;

[0027] Fig. 3 another schematic flow chart according to an embodiment of the method; and

[0028] Fig. 4 another schematic flow chart according to an embodiment of the method.

[0029] In the figures the same elements or elements having the same function are indicated by the same reference signs. DETAILED DESCRIPTION

[0030] In the present document, the word "exemplary" is used herein to mean "serving as an example, instance, or illustration". Any embodiment or implementation of the present subject matter described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments.

[0031] While the present disclosure is susceptible to various modifications and alternative forms, specific embodiments thereof have been shown by way of example in the drawing and will be described in detail below. It should be understood, however, that it is not intended to limit the disclosure to the particular forms disclosed, but on the contrary, the disclosure is to cover all modifications, equivalents, and alternatives falling within the scope of the disclosure.

[0032] The terms “comprises”, “comprising”, or any other variations thereof, are intended to cover a non-exclusive inclusion so that a setup, device or method that comprises a list of components or steps does not include only those components or steps but may include other components or steps not expressly listed or inherent to such setup or device or method. In other words, one or more elements in a system or apparatus preceded by “comprises” or “comprise” does not or do not, without more constraints, preclude the existence of other elements or additional elements in the system or method.

[0033] In the following detailed description of the embodiment of the disclosure, reference is made to the accompanying drawing that forms part hereof, and in which is shown by way of illustration a specific embodiment in which the disclosure may be practiced. This embodiment is described in sufficient detail to enable those skilled in the art to practice the disclosure, and it is to be understood that other embodiments may be utilized and that changes may be made without departing from the scope of the present disclosure. The following description is, therefore, not to be taken in a limiting sense.

[0034] Fig. 1 shows a schematic side view according to an embodiment of a motor vehicle 10 comprising an embodiment of an information system 12. The information system 12 is configured for providing motor vehicle related information 14 for a user 16 of the motor vehicle 10. A question of the user 16 related to the motor vehicle 10 is captured by a capturing device 18 of the information system 12. The question is analyzed by an electronic computing device 20 of the information system 12. An answer is generated depending on the question by an artificial intelligence model of the electronic computing device 20 and the generated answer is outputted as the motor vehicle related information 14 for the user 16 by an output device 22 of the information system 12.

[0035] In particular, a voice input of the user 16 is captured as the question. Furthermore, a voice output is generated by the output device 22.

[0036] Additionally, an image concerning to the motor vehicle 10 related information 14 and / or a video concerning to the motor vehicle related information 14 is outputted by the output device 22, for example, on a display device 24 of the motor vehicle 10.

[0037] Furthermore, the answer is generated depending on a digital manual of the motor vehicle 10.

[0038] Fig. 2 shows schematic flow chart according to an embodiment of a method. In particular, in a first step S1 data is obtained. Therefore, for example data from a manual 26 of the motor vehicle 10, drawings 28 labeled with actions, books, journals, papers, websites, articles or furthermore, which are shown with reference sign 30 and / or after training, the voluntary use of data provided by the user 16 may be used, which is shown with reference signs 32.

[0039] In a second step S2, the obtained data are preprocessed. In a third step S3, a generative adversarial network approach is used. After the third step S3, a fourth step S4 may be performed, where, for example, 80% of training data may be used to train the generative adversarial network and a discriminative network. Alternatively or additionally, a fifth step S5 is performed, wherein 20% of the test data may be used to check if the instructions are displayed correctly. After the fourth step S4 and the fifth step S5, a sixth step S6 may be performed, wherein the user question is answered by the information system 12. Furthermore, if the question is manual related, correct images based on text to assist an instruction are generated by the electronic computing device 20. The sixth step S6 may be utilized as the testing phase of the artificial intelligence model.

[0040] Fig. 3 shows another schematic flow chart according to an embodiment of the method. In particular, in a seventh step S7, a user input, for example a question of the user 16, is captured. In an eighth step S8, the question is inputted in the generative adversarial network, in particular as the artificial intelligence. After the eighth step S8, a ninth step S9 may be performed, for example, if it is related to a manual from the manufacturer. If not, a tenth step S10 may be performed, wherein it is checked, that the question is not related to the manufacturer. After the ninth step S9, an eleventh step S11 is performed, wherein instructions are generated, and images to solve the issues are generated by the artificial intelligence model. After the eleventh step S11, a twelfth step S12 is performed, wherein the output specific to the motor vehicle 10 is outputted by the output device 22. After the tenth step S10, a thirteenth step S13 may be performed, wherein an audio response can be used.

[0041] Fig. 4 shows another schematic flow chart according to an embodiment of the method. After the user 16 enters an input for the capturing device 18 to detect at the seventh step S7, there may be two options. The first option allows for the question to be inputted in the generative adversarial network, in particular as the artificial intelligence model that may be developed by the manufacturer as shown in the eighth step S8. The Generative Al model, which may be responsible for converting the prompt into a video, and the video guide on solving manual-related problems of the motor vehicle 10 may be viewed be the user 16.

[0042] Alternatively, at the fifteenth step S15, the question may be inputted into an alternative artificial intelligence model that a manufacturer may modify and / or train based on manufacturer specific knowledge. When a manufacturer-specific question is asked, the question would be may be routed or re-routed to the eighth step S8 instead of the fifteenth stepS15.

[0043] At the sixteenth step S16, the artificial intelligence model from S8 or S15 may output a textual and audio response that would be fed into one of three options. At the seventeenth step S17, the electronic computing device 20 may convert the text to a video output, and at the eleventh step S11, the electronic computing may generate information 14 such as instructions and images to solve the issues.

[0044] At the eighteenth step S18, the electronic computing device 20 may search a database of videos with common instructions. The database may include pre-created videos generated and other comparable data for determining the information 14. The search may be conducted based on keywords generated from the input from the user 16, and the keywords may be outputted to the display device 24. At the nineteenth step S19, the electronic computing device 20 may identify a video to depict the information 14 such as a pre-recorded video on how to open the hood of the motor vehicle 10. After the eleventh steps S11 or nineteenth step S19, the output device 22 may display the information 14 such as a a short clip detailing the instruction to be performed, which would be displayed on the display device 24.

[0045] Alternatively, the information 14 may be outputted via an audio medium instead of a visual medium at the thirteenth step S13. An audio response may be utilized at S13.

[0046] One advantage of the present invention is to eliminate the need for a physical copy of the manual, and instead convert it into artificial intelligence system, which gives the user 16 both an audio and / or visual guide for solving an issue. Any of the options presented at S17, S18, or S13 may eliminate, or at least reduce the need for, a physical copy of the manual resulting in a more efficient and a more reliable system. Reference signs 10 motor vehicle 12 information system 14 information 16 user 18 capturing device 20 electronic computing device 22 output device 24 display device 26 manual 28 drawings 30 books 32 voluntarily information provided user data S1 to S20 steps of the method

Claims

1. A method for providing a motor vehicle (10) related information (14) for a user (16) of the motor vehicle (10) by an information system (12) of the motor vehicle (10), comprising the steps of:- capturing a question of the user (16) related to the motor vehicle (10) by a capturing device (18) of the information system (12);- analyzing the question by an electronic computing device (20) of the information system (12);- generating an answer depending on the question by an artificial intelligence of the electronic computing device (20); and- outputting the generated answer as the motor vehicle (10) related information (14) for the user (16) by an output device (22) of the information system (12).

2. The method according to claim 1, characterized in thata voice input of the user (16) is captured as the question.

3. The method according to claim 1 or 2, characterized in thata voice output is generated by the output device (22).

4. The method according to any one of claims 1 to 3, characterized in thatadditionally an image concerning to the motor vehicle (10) related information (14)and / or a video concerning to the motor vehicle (10) related information (14) is outputted.

5. The method according to any one of claims 1 to 4, characterized in thatthe answer is generated depending on a digital manual (26) of the motor vehicle (10).

6. A computer program product comprising program code means for performing a method according to any one of claims 1 to 5.

7. A non-transitory computer-readable storage medium comprising at least the computer program product according to claim 6.

8. An information system (12) for providing a motor vehicle (10) related information (14) for a user (16) of the motor vehicle (10), comprising at least one capturing device (18), one electronic computing device (20), and one output device (22), wherein the information system (12) is configured for performing a method according to any one of claims 1 to 5.

Images