Method and system for evaluating a function implemented by an embedded system of a vehicle
The method and system leverage a large language model to aggregate user feedback for embedded vehicle systems, addressing the limitations of traditional evaluation methods by enabling real-world testing and interactive corrections.
Patent Information
- Authority / Receiving Office
- FR · FR
- Patent Type
- Patents
- Current Assignee / Owner
- STELLANTIS AUTO SAS
- Filing Date
- 2024-07-24
- Publication Date
- 2026-06-26
AI Technical Summary
Existing methods for evaluating vehicle embedded systems are time-consuming and not representative of real-world conditions, leading to potential issues in production and customer dissatisfaction.
A method and system utilizing a large language model (LLM) to aggregate user feedback from multiple vehicles, enabling real-world testing and interactive correction of embedded system functions through a human-machine interface and wireless communication.
Facilitates real-world feedback aggregation for embedded system functions, allowing for interactive corrections and improved evaluation under actual usage conditions.
Smart Images

Figure 00000018_0000 
Figure 00000018_0001 
Figure 00000018_0002
Abstract
Description
Title of the invention: Method and system for evaluating a function implemented by an embedded system of a vehicle. Technical field
[0001] The invention relates to methods and systems for evaluating a function or service implemented by an embedded system of a vehicle, particularly but not exclusively of a motor vehicle. The invention also relates to a method and device for data processing to automatically correct the function implemented by the embedded system of a vehicle. Technological background
[0002] Modern vehicles consist of a large number of components, organs, and embedded systems configured to assist the driver in operating the vehicle or to accompany the driver and passengers during journeys. To this end, each embedded system or component implements one or more functions or services in the form of software modules. During the development of a new function, it must be tested during the development phase before being deployed in series production on vehicles and before the marketing of vehicles equipped with this new function. These tests make it possible to detect malfunctions or bugs.
[0003] The testing or evaluation of a new function is carried out internally by the car manufacturer, which sometimes uses a panel of users selected, for example, from among its customers. Such a test campaign is therefore time-consuming, and the tests performed are not representative of real-world implementation of the function. This partly explains why new functions deployed on vehicles can encounter problems once in production, leading to customer dissatisfaction and a safety risk for the vehicle and its passengers. Summary of the present invention
[0004] One object of the present invention is to solve at least one of the problems of the technological background described above.
[0005] Another object of the present invention is, for example, to improve the evaluation of a function implemented by an embedded system of a vehicle.
[0006] According to a first aspect, the present invention relates to a method for evaluating a function implemented by an embedded system of a vehicle, the method being implemented by a set of processors and comprising the following steps: - receiving first data representative of a request to display a second graphic content of a human-machine interface, known as HMI; - control of display of the second graphic content of the HMI on a display screen with touch interface, called touch screen, following the reception of the first data, the second graphic content being representative of a form for collecting second data representative of a result of a test of the function; - transmission of the second data to a remote device via a wireless connection; - aggregation, by a large language model, called LLM, of the second data with third data representative of test results of said function implemented by a set of embedded systems of a set of other vehicles; - evaluation of the function by the LLM based on fourth data points representative of an aggregation result; and - receipt of instructions to correct the function, the correction instructions being based on a result of the evaluation of the function by the LLM.
[0007] Using a form in a user interface displayed on a screen allows for easy feedback from a user on tests performed on a function of a vehicle's embedded system, for example, a function installed for beta testing on the vehicle. Transmitting the test feedback to a remote device allows this feedback to be aggregated with a set of feedback obtained from other users testing the same function on their vehicles via a Learning Management System (LMS) that can evaluate the function based on the aggregated test feedback. The evaluation of this feedback by the LMS generates a corrective action to be sent back to the vehicle, for example, to perform further tests on the corrected function. Such a testing process allows for obtaining real-world feedback on a function to make corrections interactively.
[0008] According to one variant, the first data is generated by a touch press on a graphic object displayed on the touch screen in a first determined graphic content of the HMI.
[0009] According to another variant, a set of parameters being associated with the function, the correction instructions include a correction of at least a part of the parameter set, the correction being obtained by refining the parameter set according to the fourth data according to a reinforcement learning method.
[0010] According to yet another variant, the process further includes a step of processing the second data by a natural language processing method, a result of the processing being provided as input to the LLM to generate the third data.
[0011] According to another variant, the second data includes: - representative text data describing the test result; and / or - representative image data illustrating the test result; and / or - representative data of a function score in the test result.
[0012] According to a further variant, the LLM implements an augmented generation of retrieval to aggregate the second and third data.
[0013] According to yet another variant, the process further includes a vehicle identification step.
[0014] According to another variant, the HMI is implemented via an interactive application embedded in the vehicle or via a mobile application running on a mobile communication device.
[0015] According to a second aspect, the present invention relates to a function evaluation system implemented by an embedded system of a vehicle, the system comprising a data processing device and a remote device connected in communication to the data processing device, the data processing device and the remote device each comprising at least one memory associated with at least one processor, the system being configured for the implementation of the steps of the process according to the first aspect of the present invention.
[0016] According to a third aspect, the present invention relates to a computer program which includes instructions adapted for the execution of the steps of the process according to the first aspect of the present invention, in particular when the computer program is executed by at least one processor.
[0017] Such a computer program may use any programming language, and be in the form of source code, object code, or an intermediate form between source code and object code, such as in a partially compiled form, or in any other desirable form.
[0018] According to a fourth aspect, the present invention relates to a computer-readable recording medium on which is recorded a computer program comprising instructions for carrying out the steps of the process according to the first aspect of the present invention.
[0019] On the one hand, the recording medium can be any entity or device capable of storing the program. For example, the medium can include a storage means, such as a ROM, a CD-ROM or a microelectronic circuit-type ROM, or a magnetic recording means or a hard disk drive.
[0020] On the other hand, this recording medium can also be a transmissible medium such as an electrical or optical signal, such a signal being able to be transmitted via an electrical or optical cable, by conventional or radio frequency, by self-directing laser beam, or by other means. The computer program according to the present invention can, in particular, be downloaded from an Internet-type network.
[0021] Alternatively, the recording medium may be an integrated circuit in which the computer program is incorporated, the integrated circuit being adapted to execute or to be used in the execution of the process in question. Brief description of the figures
[0022] Other features and advantages of the present invention will become apparent from the description of the particular and non-limiting embodiments of the present invention below, with reference to the attached Figures 1 to 4, in which:
[0023] [Fig.1] schematically illustrates a data communication environment, according to a particular and non-limiting embodiment of the present invention;
[0024] [Fig.2] schematically illustrates a process of evaluating a function implemented by an embedded system of a vehicle in the communication environment of [Fig.1], according to a particular and non-limiting example of the present invention;
[0025] [Fig.3] illustrates a device configured to evaluate a function implemented by an embedded system of a vehicle in the communication environment of [Fig.1], according to a particular and non-limiting embodiment of the present invention.
[0026] [Fig.4] illustrates a flowchart of the different stages of a process for evaluating a function implemented by an embedded system of a vehicle in the communication environment of [Fig.1], according to a particular and non-limiting example of the present invention. Description of examples of achievements
[0027] A method and device for evaluating a function implemented by an embedded system of a vehicle will now be described in what follows with joint reference to Figures 1 to 4. The same elements are identified with the same reference signs throughout the description that follows.
[0028] The terms "first," "second" (or "firsts," "seconds"), etc., are used in this document by arbitrary convention to allow for the identification and distinction of different elements (such as operations, means, etc.) implemented in the embodiments described below. Such elements may be distinct or correspond to a single element, depending on the embodiment.
[0029] Fig. 1 schematically illustrates a communication environment 1, according to a particular and non-limiting embodiment of the present invention.
[0030] According to a first embodiment, the communication environment 1 comprises a vehicle 10. The vehicle 10 corresponds, for example, to a vehicle with an internal combustion engine, with electric motor(s), or even a hybrid vehicle with an internal combustion engine and one or more electric motors. The vehicle 10 corresponds for example to a land vehicle, for example a car, a truck, a bus, a motorcycle.
[0031] The vehicle 10 corresponds to a so-called connected vehicle in that it carries a communication system configured to communicate with one or more remote devices 101 via a wireless communication network infrastructure. The remote device 101 corresponds, for example, to a server or a computer in the "cloud" 100.
[0032] The communication system of a connected vehicle includes, for example, one or more communication antennas connected to a telematic control unit (TCU), which is itself connected to one or more computers of the connected vehicle's embedded system. The antenna(s), the TCU, and the computer(s) form, for example, a multiplexed architecture for providing various services useful for the proper functioning of the connected vehicle and for assisting the driver and / or passengers of the connected vehicle in controlling the vehicle and / or for diagnosing the operation of one or more components of the connected vehicle.The computer(s) and the TCU communicate and exchange data with each other via one or more computer buses, for example a CAN (Controller Area Network), CAN FD (Controller Area Network Flexible Data-Rate), FlexRay (according to ISO 17458) or Ethernet (according to ISO / IEC 802-3) type communication bus.
[0033] According to a second embodiment, the environment 1 comprises a data processing device 11 corresponding, for example, to a mobile communication device such as a smartphone or tablet. According to another embodiment, the data processing device 11 corresponds to a laptop or computer.
[0034] The data processing device 11 is advantageously configured to communicate with the remote device(s) 101 via the wireless communication network infrastructure.
[0035] Environment 1 further comprises an assembly 12 including one or more connected vehicles such as vehicle 10 and / or one or more data processing devices such as device 11. The connected vehicles of assembly 12 are identical or similar to vehicle 10 in that they carry one or more embedded systems identical or similar to those carried in vehicle 10.
[0036] The mobile communication infrastructure enabling wireless data communication between, on the one hand, the vehicle 10 and / or the data processing device 11 (as well as the vehicle(s) and / or the data processing device(s) of the set 12) and on the other hand each of the remote devices 101 includes for example one or more communication devices 102 of the relay antenna type (cellular network). In a communication mode using such a network architecture, the data is for example transmitted by the vehicle connected to the remote device 101 of the "cloud" 100 via a relay antenna 102 (the antenna 102 being for example connected to the "cloud" 100 via a wired link and the remote device 101 being itself connected to the network infrastructure of the "cloud" 100 via a wired and / or wireless network).
[0037] The wireless communication system enabling the exchange of data between, on the one hand, the connected vehicle 10 and / or the data processing device 11 and, on the other hand, the remote device 101 corresponds, for example, to: - a vehicle-to-infrastructure (V2I) communication system, for example based on the 3GPP LTE-V or IEEE 802.1 lp standards of ITS G5; or - a cellular network communication system, for example an LTE (Long-Term Evolution) network, LTE-Advanced (also called LTE 3G, 4G or 5G); or - a Wifi type communication system according to IEEE 802.11, for example according to IEEE 802.1 In or IEEE 802.1 lac.
[0038] A process for evaluating a function implemented by an embedded system of the vehicle 10 is described with reference to [Fig. 2]. The term "embedded system" encompasses any system, component, or part of the vehicle 10. The term "function" encompasses any function, service, or feature offered in the vehicle 10 and implemented by a software module of the embedded system. For example, the software module is downloaded to the vehicle 10 via an OTA (Over The Air) connection to be installed in the vehicle for execution by a computer-type processing unit of the vehicle 10's embedded network, which is responsible for controlling the embedded system offering this function.The installation of the function allows a user to test or evaluate it under real-world vehicle usage conditions to provide feedback on the evaluation results, with a view to correcting any problems encountered or developing the function further, as described opposite [Fig.2].
[0039] This application also relates to a process for communicating data relating to tests or evaluation of function.
[0040] The process is implemented, for example, in a system comprising the vehicle 10, for example by one or more processors of one or more computers such as, for example, the computer of the vehicle's infotainment system, referred to as the computer IVI (from the English "In-Vehicle Infotainment" or in French "Infodivertissement épédoncé"), and the remote device 101, for example one or more processors of the remote device 101, the vehicle 10 and the remote device 101 being connected in communication, for example via the communication network infrastructure of environment 1. According to an alternative embodiment, the process is implemented in a system comprising the data processing device 11, for example one or more processors of this data processing device 11, and the remote device 101, for example one or more processors of the remote device 101, the vehicle 10 and the remote device 101 being connected in communication, for example via the communication network infrastructure of environment 1.
[0041] The communication of evaluation data is implemented via an interactive application (widget) executed by the computer, and more specifically via a human-machine interface (HMI) associated with the interactive application and displayed on a touchscreen of the vehicle 10 under the control of the IVI computer, for example. According to alternative embodiments, part of the operations of the problem data communication process is implemented by the remote device 101 or in conjunction with the remote device 101.
[0042] When the process is implemented by the system comprising the data processing device 11, the communication of evaluation data is carried out via an application (for example, a mobile application when the data processing device is a mobile communication device), and more specifically via a human-machine interface (HMI) associated with this application and displayed on a touchscreen of the data processing device 11. In one embodiment, the application is an internet browser, for example, when the data processing device is a computer. In other embodiments, part of the operations of the problem data communication process is carried out by or in conjunction with the remote device 101.
[0043] The interactive application of the vehicle 10 and the application, for example mobile, of the data processing device 11 are linked in communication to the remote device 101 via the wireless communication network infrastructure for the exchange of data within the framework of the generation of each request, as explained below in more detail.
[0044] Fig. 2 schematically illustrates a data communication process relating to a problem of an embedded system of vehicle 10, according to particular and non-limiting embodiments of the present invention.
[0045] The process is implemented, for example, by a system comprising one or more processors of one or more computers of the vehicle 10 or by one or several processors of a data processing unit of the data processing device 11, and one or more processors of the remote device 101. In the remainder of the description of the process, reference will be made to a processing device corresponding to a system of the vehicle 10 comprising one or more computers when the process is implemented in a system comprising the vehicle 10 and the remote device 101 or corresponding to the data processing device 11 when the process is implemented in a system comprising the data processing device 11 and the remote device 101.
[0046] In a first operation 21 of the process, the user wishing to communicate the result of the tests or evaluation of the function to be tested implemented via a computer controlling the embedded system executing the function starts an interaction with the processing device, and optionally with the remote device 101 according to certain particular embodiments described below.
[0047] The interaction is initiated, for example, by touching an icon on the home page of the HMI displayed on the touchscreen of the processing device. The touchscreen triggers, for example, the execution of the application (interactive application, mobile application, thin or thick client, web browser) enabling the interaction.
[0048] The touch press thus triggers, for example, the display of graphic content corresponding to a home page of the application's HMI, offering, for example, the execution of one or more services by pressing on a graphic object or an icon associated with each of these services.
[0049] According to one embodiment, the initiation of the interaction is triggered by the acquisition of a voice command spoken by the user via a microphone on board the vehicle 10 or a microphone of the data processing device 11. The microphone is connected to or is part of a voice interface of the processing device.
[0050] According to another embodiment, the initiation of the interaction is triggered by the user pressing a physical button arranged in the passenger compartment of the vehicle 10, for example on the dashboard or steering wheel of the vehicle 10.
[0051] In a second operation 22 of the process, identification of the user and / or vehicle 10 is required. Such an operation 202 is optional and, for example, required when a request is first submitted or when the application is first executed by the processing device.
[0052] To this end, the processing device triggers the display of graphic content requiring the identification of the vehicle 10. The identification graphic content includes, for example, two text areas, for example, a first area for entering an identifier and a second area for entering a password. The entry of The username and password are implemented via the touchscreen interface on which the graphical identification content is displayed.
[0053] The identifier corresponds for example to a telephone number or an email address associated with the owner of the vehicle 10. Such an identifier is associated with an account of the user of the vehicle 10, the account including a set of information on the vehicle 10 allowing the vehicle 10 to be identified, for example the unique identifier number of the vehicle, called VIN (from the English "Vehicle Identification Number").
[0054] According to another example, the identifier corresponds to the vehicle identification number, known as the VIN.
[0055] An authentication request including identification data (username and password) is transmitted to the remote device 101 which in turn transmits (to the processing device) an authorization to execute the service of generating and transmitting the embedded system improvement request.
[0056] During subsequent uses of the application, identification is done automatically at the start of the application with, for example, the transmission of identification data of the identified processing device to the processing device during the first connection.
[0057] In a third operation 23 of the process, first data representing a request to display a second graphic content of a human-machine interface, called HMI, are received.
[0058] The initial data is, for example, generated by (or representative of) a touch input by the user on a graphic object displayed in a first defined graphic content (corresponding, for example, to a home page) of the application's user interface on the touchscreen of (or associated with) the processing device. This data is received following a touch input by the user on this graphic object. This graphic object corresponds, for example, to an icon or pictogram associated with the communication service for a problem observed on an embedded system.
[0059] A touch press on the graphic object sends information to the processing device so that the latter implements one or more functions associated with the command corresponding to the touch press.
[0060] The first representative data of the touch press are received for example via one or more data buses linking the touch interface of the screen and the processing device.
[0061] Touch support corresponds for example to a short or brief touch support in which the duration of the press on the graphic object is less than a threshold duration (for example equal to 500 or 1000 ms).
[0062] According to one embodiment, the first data are generated by (or representative of) a specific voice command, spoken by the user, acquired by the microphone.
[0063] According to the first data are generated by (or representative of) a press on a physical button arranged in the passenger compartment of the vehicle 10, for example on the dashboard or steering wheel of the vehicle 10.
[0064] In a fourth operation 24 of the process, the reception of the first data triggers the control of the display of the second graphical content of the HMI on the touch screen. This second graphical content corresponds to a specific content of the HMI, which is representative of a form for collecting second data representing a test result of the function configured so that the user can enter or fill in second data representing the result of the tests or evaluation performed.
[0065] The form includes, for example, a set of fields, for example, one or more fields allowing the selection of a theme from a proposed list and / or one or more fields for entering free text, uploading one or more photos and / or videos to describe and illustrate the problem.
[0066] The form thus corresponds, for example, to a questionnaire with: - one or more questions to target a particular theme or area (for example, the type of embedded system being tested or the function being tested, the subject of the test (for example, ergonomics of the function, speed of execution, compliance with specifications, etc.)), with answers to these questions being guided (via a suggested answer from a list of predetermined answers) or free-text via a free text box; and / or - a free text field for the user to provide further details to the answers previously given, if applicable, and / or to describe in detail the result of the test or any problems encountered; and / or - one or more fields to upload one or more screenshots and / or videos showing the test results or problems encountered; and / or - one or more fields to enter a rating of the function or a level of satisfaction (or a rating per test area (ergonomics, speed of execution, etc.), this or these fields being free or guided via a multiple choice list.
[0067] The user enters the second data via the touchscreen interface. According to one embodiment, the second data, or part of it, is entered via a voice interface, with the HMI generating an audio rendering of the questions or a description of the fields by speech synthesis, and the HMI filling in the fields by acquiring the user's spoken answers via a microphone.
[0068] A display control for graphic content, such as a graphic object, the first graphic content, or the second graphic content, includes rendering the graphic content or graphic object. Such rendering corresponds to a set of operations performed by one or more processors on the pixels of one or more images of the graphic content to be displayed on the screen. For example, rendering consists of associating pixel data (for example, color data expressed in an RGB (Red, Green, Blue) color space) with each graphic object.
[0069] The display control of each graphic content or object thus includes the transmission of control signals to the screen to modify the values associated with the screen pixels at the location intended to display the graphic content.
[0070] In a fifth operation 25 of the process, the second data 251, 252 are transmitted via a wireless connection to the remote device 101.
[0071] The second data representing the description of the problem thus includes one or more of the following data, according to all possible combinations: - data 251 representing answers to one or more questions; and / or - data 251 representing a text describing the result of the test; and / or - data 251 representing one or more images or screenshots illustrating the result of the test and / or the problems or bugs identified; and / or - data 251 representing one or more videos or sequence(s) of images illustrating the result of the test and / or the problems or bugs identified; and / or - data 252 representing a score of the function as a result of the test, for example calculated automatically from several entered scores (for example one score per test domain).
[0072] In a sixth operation 26, the remote device 101 aggregates the second data with third data representative of test results of said function implemented by a set of embedded systems from a set of other vehicles. The aggregation is implemented by an artificial intelligence module for processing the second data, referred to as the AI module, such an AI module being implemented, for example, in the form of one or more neural networks.
[0073] The AI module advantageously implements a large language model, called LLM (from the English "Large Language Model"), configured to analyze and then aggregate the second data received as input to the LLM with third data representative of test results of said function implemented by a set of embedded systems of a set of other vehicles.
[0074] The third data is received by the remote device 101 of the assembly 12 comprising one or more vehicles and / or one or more processing devices data each configured to enter the test result of the same function also implemented in these other vehicles.
[0075] The second and third aggregated data points correspond to data obtained from tests performed on a version of the function, the function's version level being received, for example, as metadata along with the second and third data points. According to a particular embodiment, the second and third data points received are filtered based on the version level to retain only the second and third data points relating to the same version of the source code software to be executed to implement the function.
[0076] The second and third data items are, for example, first processed or analyzed using a natural language processing method, known as NLP (Natural Language Processing), to understand the text entered by the user in the form and to make this text interpretable by the AI module. When the second data items include images and / or videos, the second data items relating to these images and / or videos are processed to extract features from these images and / or videos in order to classify these images and / or videos according to their content.
[0077] The second and third input data provided to the LLM correspond to raw (unprocessed) data or to data processed according to NLP. Such an LLM is also called a generative LLM agent. Such a generative LLM is, for example, implemented in the form of a neural network, as understood by a person skilled in the art.
[0078] According to a particular embodiment, the LLM is associated with an augmented generation retrieval module to generate responses to improve the relevance and quality of the processing of second and third data as well as to improve the relevance and quality of the aggregation by types of test result or by types of tests performed.
[0079] Retrieval Augmented Generation, or RAG (from the English "Retrieval Augmented Generation"), is a method known to those skilled in the art, for example described in the article "Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks", by Patrick Lewis et al., published in NeurIPS in 2020.
[0080] RAG allows the exploitation of data sources related to the vehicle domain, for example, which makes it possible to use a generic LLM model without needing to retrain the LLM model. Data sources include, for example, vehicle manufacturer databases, vehicle blogs, vehicle news feeds, etc.
[0081] In a seventh operation 27, the function is evaluated by the LLM as a function of fourth data representing a result of the aggregation of the second and third data by the LLM.
[0082] The evaluation includes, for example, the determination of an overall score for the function being evaluated based on a set of determined criteria, which depend, for example, on the type of function being evaluated.
[0083] The AI module advantageously includes a reinforcement learning module configured to optimize the source code or parameters of the evaluated function, based on the overall score resulting from the evaluation.
[0084] Reinforcement learning is implemented for example by LLM which automatically generates correction instructions to correct certain defects of the evaluated version or to optimize the code instructions of the version of the evaluated function.
[0085] According to one embodiment, the correction instructions include a correction of at least part of a set of parameters of the evaluated function, the correction being obtained by refining the set of parameters as a function of the fourth data via the reinforcement learning method.
[0086] The correction instructions are transmitted by the remote device 101 to the vehicle 10 (and to each of the vehicles in the assembly 12 equipped with the function being evaluated). The vehicle 10 receiving the correction instructions, for example via OTA wireless communication, executes the received correction instructions to update the software associated with the function. The version being evaluated is thus updated via the received correction instructions, and a new version number is assigned to the updated function.
[0087] Such a process allows for an interactive evaluation of a function, under real-world conditions of use with a real-time corrective update via the use of artificial intelligence, in particular LLM, and reinforcement learning.
[0088] Figure 3 schematically illustrates a device 3 of a system configured for evaluating a function implemented by an embedded system of a vehicle, for example, vehicle 10, according to a particular and non-limiting embodiment of the present invention. The device 3 corresponds, for example, to a device embedded in the vehicle, such as a computer. According to another example, the device 3 corresponds to a data processing device, such as a mobile communication device. According to yet another example, the device 3 corresponds to a server.
[0089] Device 3 is, for example, configured to carry out the operations described opposite Figures 1 to 2 and / or the steps of the process described opposite [Fig. 4]. Examples of such a device 3 include, but are not limited to, embedded electronic equipment such as a vehicle's on-board computer, an electronic control unit such as an ECU (Electronic Control Unit), a A smartphone, a tablet, a laptop, a computer, a server. The elements of device 3, individually or in combination, can be integrated into a single integrated circuit, into several integrated circuits, and / or into discrete components. Device 3 can be implemented as electronic circuits or software (or computer) modules, or a combination of electronic circuits and software modules.
[0090] The device 3 comprises one (or more) processor(s) 30 configured to execute instructions for carrying out the steps of the process and / or for executing instructions from the software embedded in the device 3. The processor 30 may include integrated memory, an input / output interface, and various circuits known to those skilled in the art. The device 3 further comprises at least one memory 31, for example, volatile and / or non-volatile memory, and / or includes a memory storage device that may include volatile and / or non-volatile memory, such as EEPROM, ROM, PROM, RAM, DRAM, SRAM, flash, magnetic disk, or optical disk.
[0091] The computer code of the embedded software(s) including the instructions to be loaded and executed by the processor is for example stored on memory 31.
[0092] According to a particular and non-limiting embodiment, the device 3 comprises a block 32 of interface elements for communicating with external devices such as connected vehicles and / or measuring devices. The interface elements of the block 32 comprise one or more of the following interfaces: - radio frequency RF interface, for example of the Wi-Fi® type (according to IEEE 802.11), for example in the 2.4 or 5 GHz frequency bands, or of the Bluetooth® type (according to IEEE 802.15.1), in the 2.4 GHz frequency band, or of the Sigfox type using UBN (Ultra Narrow Band) radio technology, or LoRa in the 868 MHz frequency band, LTE (Long-Term Evolution), LTE-Advanced; - USB interface (from the English "Universal Serial Bus" or "Universal Serial Bus" in French); - HDMI interface (from the English "High Definition Multimedia Interface", or "High Definition Multimedia Interface" in French); - LIN interface (from the English "Local Interconnect Network", or in French "Réseau interconnecté local").
[0093] According to another particular and non-limiting embodiment, the device 3 includes a communication interface 33 which enables communication with other devices (such as other servers, databases) via a communication channel 330. The communication interface 33 corresponds, for example, to a A transmitter configured to transmit and receive information and / or data via communication channel 330. The communication interface 33 corresponds, for example, to a wired Ethernet network (standardized by ISO / IEC 802-3).
[0094] According to a particular, non-limiting embodiment, the device 3 can provide output signals to one or more external devices, such as a display screen 340, touchscreen or not, one or more loudspeakers 350, and / or other peripherals 360 (projection system), respectively, via output interfaces 34, 35, and 36. In one variant, one or more of the external devices is integrated into the device 3.
[0095] Figure 4 illustrates a flowchart of the different steps in a method for evaluating a function implemented by an embedded system of a vehicle, for example vehicle 10, according to a particular and non-limiting embodiment of the present invention. The method is implemented, for example, by one or more processors of a system comprising a processing device connected in communication to the remote device 101, i.e., by a set of devices such as device 3 in Figure 3.
[0096] In a first step 41, first data representing a request to display a second graphic content of a human-machine interface, called HMI, are received.
[0097] In a second step 42, the display of the second graphic content of the HMI is controlled so that this second graphic content is displayed on a touch interface display screen, called a touch screen, following the reception of the first data, the second graphic content being representative of a form for collecting second data representative of a result of a test of the function.
[0098] In a third step 43, the second data is transmitted to a remote device via a wireless connection.
[0099] In a fourth step 44, the second data are aggregated with third data by a large language model, called LLM, the third data being representative of test results of the function implemented by a set of embedded systems of a set of other vehicles.
[0100] In a fifth step 45, the function is evaluated by the LLM as a function of fourth data representative of an aggregation result.
[0101] In a sixth step 46, instructions for correcting the function are received, the correction instructions being a function of a result of the evaluation of the function by the LLM.
[0102] According to one variant, the variants and examples of the operations described in relation to one of Figures 1 to 2 apply to the steps of the process in [Fig.4].
Claims
Demands
1. A method for evaluating a function implemented by an embedded system of a vehicle (10), said method being implemented by at least one processor and comprising the following steps: - receiving (41) first data representing a request to display a second graphic content of a human-machine interface, referred to as the HMI; - controlling (42) the display of said second graphic content of said HMI on a touchscreen display, referred to as the touchscreen, following the reception of said first data, said second graphic content being representative of a form for collecting second data representing a result of a test of said function; - transmitting (43) said second data to a remote device (101) via a wireless connection;- aggregation (44), by a large language model, called LLM, of said second data with third data representative of test results of said function implemented by a set of embedded systems of a set of other vehicles; - evaluation (45) of said function by said LLM as a function of fourth data representative of a result of the aggregation; and - reception (46) of correction instructions for said function, the correction instructions being a function of a result of said evaluation (45) of said function by said LLM.
2. A method according to claim 1, wherein said first data is generated by a touch press on a graphic object displayed on said touch screen in a first determined graphic content of the HMI.
3. A method according to claim 1 or 2, wherein, a set of parameters being associated with said function, said correction instructions include a fix for at least a part of said parameter set, said fix being obtained by refining said parameter set as a function of said fourth data according to a reinforcement learning method.
4. A method according to any one of claims 1 to 3, wherein said second data comprise: - representative text data describing the test result; and / or - representative image data illustrating the test result; and / or - representative data of a function score as a test result.
5. A method according to any one of claims 1 to 4, wherein said LLM implements an augmented generation of retrieval to aggregate said second and third data.
6. A method according to any one of claims 1 to 5, further comprising a step of identifying said vehicle (10).
7. A method according to any one of claims 1 to 6, wherein said HMI is implemented via an interactive application embedded in said vehicle (10) or via a mobile application running on a mobile communication device (11).
8. A computer program comprising instructions for carrying out the method according to any one of the preceding claims, when such instructions are executed by a processor.
9. A function evaluation system implemented by an embedded system of a vehicle (10), said system comprising a data processing device and a remote device connected in communication to said data processing device, said data processing device and said remote device each comprising at least one memory (31) associated with at least one processor (30), said system being configured for the implementation of the steps of the method according to any one of claims 1 to 7.