Reminding method and related product

Abstract

A reminding method and related products are applied to the technical field of vehicle control. In the application, after obtaining the state of the vehicle and the to-be-executed operation in response to the state, the reminding device outputs the information of the state and the information for confirming the execution of the to-be-executed operation. Therefore, on one hand, the state of the vehicle can be reminded to people or equipment through the output state information, so that people or equipment can know the state of the vehicle in time, and further response to the state of the vehicle is facilitated. On the other hand, the process of executing the to-be-executed operation can be simplified by confirming the execution of the to-be-executed operation through the information for confirming the execution of the to-be-executed operation, and the to-be-executed operation comprises the operation of the response state, so that the operation process of the response state of people or equipment can be simplified by outputting the information for confirming the execution of the to-be-executed operation; and thus, a quick response state way can be provided for people or equipment.

Description

Technical Field

[0001] The present application relates to the field of vehicle control technology, and in particular to a reminder method and related products. Background Art

[0002] Vehicles, as a common means of transportation in daily life, bring convenience to people and improve their quality of life. During vehicle use, the vehicle's status changes in real time. If people or equipment fail to respond to these changes in status, it may affect normal operation and even endanger vehicle safety. Therefore, providing a way to quickly respond to vehicle status is an urgent problem to be solved. Summary of the Invention

[0003] The present application provides a reminder method and related products. On the one hand, the method can output information about the vehicle's status to alert a person or device to the vehicle's status. On the other hand, when the pending operation includes an operation that responds to the vehicle's status, the method can output information confirming the execution of the pending operation to simplify the process for the person or device to respond to the status, thereby providing a way for the person or device to quickly respond to the status.

[0004] In a first aspect, a reminder method is provided, the reminder method comprising:

[0005] Get the vehicle's status and pending operations, including operations in response to the status.

[0006] Output status information and information used to confirm the execution of pending operations.

[0007] In the first aspect, the reminder method is performed by a reminder device. The reminder device can be any electronic device. Optionally, the reminder device can be one of the following: a central processing unit (CPU), an electronic control unit (ECU), or a domain controller.

[0008] The vehicle may be any vehicle. For example, the vehicle may be a sedan or a sport utility vehicle (SUV). Another example may be a gasoline-powered vehicle or an electric-powered vehicle.

[0009] The vehicle's status includes: vehicle faults, the vehicle's environment, the state of the vehicle's passenger compartment, and the vehicle's energy consumption. For example, a vehicle fault might include high tire temperature. The vehicle's environment might include poor visibility ahead. The state of the vehicle's passenger compartment might include whether the rear seat is unoccupied. The vehicle's energy consumption includes the vehicle's electricity consumption per 100 kilometers or the vehicle's fuel consumption per 100 kilometers.

[0010] In one possible implementation, the vehicle's state is detected by a sensing device. In another possible implementation, the vehicle's state is detected based on a network model, wherein the network model includes an artificial intelligence model. Optionally, the network model includes a large language model (LLM), a neural network, or a deep learning model.

[0011] The pending operations include operations responsive to the vehicle's status. Optionally, the vehicle's status includes a vehicle malfunction, and the operations responsive to the vehicle's status include operations to address the malfunction. For example, a vehicle malfunction may include high vehicle temperature. On the one hand, decelerating and stopping the vehicle reduces friction between the tires and the road, thereby lowering tire temperature. On the other hand, the air conditioning compressor may increase engine load, indirectly affecting tire heat dissipation. Furthermore, high-temperature tires exposed to cold water may cause tread deformation or rubber degradation, or even cause a blowout. Therefore, operations to address the vehicle's malfunction include turning off the air conditioning, slowing down and stopping the vehicle smoothly, and avoiding immediately touching the tires or pouring water to cool them down. Optionally, the vehicle's status includes the vehicle's environment, and the operations responsive to the vehicle's status include driving operations responsive to the vehicle's environment. For example, if the vehicle's environment includes low visibility ahead, driving operations responsive to low visibility may include turning on the fog lights, position lights, and low beams. Optionally, the vehicle's status includes conditions within the vehicle's passenger compartment, and the operations responsive to the vehicle's status include operations responsive to conditions within the passenger compartment. For example, if the vehicle's environment includes no passengers in the rear seat, operations responsive to no passengers in the rear seat may include turning off the rear air conditioning. Optionally, the vehicle status includes energy consumption of the vehicle, and the operation in response to the energy consumption includes an operation to reduce energy consumption. For example, energy consumption can be saved by turning off the air conditioner.

[0012] In one possible implementation, the reminder device determines the operation to be performed based on the state of the vehicle. In another possible implementation, the operation to be performed is determined based on a network model and a network model. In yet another possible implementation, the operation to be performed is determined based on the vehicle's historical vehicle usage data. For example, based on the vehicle's historical vehicle usage data, it can be determined that when the volume of the conversation of the rear passengers is greater than or equal to a first threshold, the impact of the conversation of the rear passengers on the front passengers is usually reduced based on the privacy sound shield technology. Therefore, when the state of the vehicle includes the volume of the conversation of the rear passengers being greater than or equal to the first threshold, it can be determined that the operation to be performed includes reducing the impact of the conversation of the rear passengers on the front passengers based on the privacy sound shield technology.

[0013] After obtaining the vehicle's status and the pending operations corresponding to the status, the reminder device outputs status information and information confirming the execution of the pending operations. This output of status information notifies a person or device of the vehicle's status, enabling them to promptly learn the vehicle's status and facilitate further responses to the vehicle's status. Furthermore, since confirming the execution of the pending operations through the confirmation of the pending operations information simplifies the process for executing the pending operations, and pending operations include operations corresponding to the status, outputting information confirming the execution of the pending operations simplifies the process for a person or device to respond to the status, providing a way for the person or device to quickly respond to the status.

[0014] In one possible embodiment, the reminder device outputs status information and information for confirming the execution of the operation to be performed by performing the following steps: controlling the display status and the first control, the first control is used to confirm the execution of the operation to be performed, so that a person or device can know the status of the vehicle and the message confirming the execution of the operation to be performed by viewing the displayed status and the first control.

[0015] The device that displays the vehicle status and the first control can be any device with a display function. Optionally, the reminder device controls a display component of the vehicle to display the vehicle status and the first control, wherein the display component includes any one or more of the following: a screen, a head-up display (HUD), a headlight, and a projection device.

[0016] Optionally, the display component includes a touch screen. Since the touch screen allows interaction with the first control, and interaction with the first control allows confirmation of execution of the pending operation, controlling the display of the first control on the touch screen facilitates a person or device confirming execution of the pending operation via the touch screen. For example, by clicking the first control on the touch screen, interaction with the first control can be achieved, thereby confirming execution of the pending operation.

[0017] In one possible embodiment, the reminder device outputs status information and information for confirming the execution of the operation to be performed by performing the following steps: controlling the output of voice, the voice including status information and information for confirming the execution of the operation to be performed, so that people or devices can know the status of the vehicle and the message confirming the execution of the operation to be performed by listening to the voice.

[0018] In this embodiment, the reminder device can control any device with a voice output function to output voice. For example, the reminder device can control the vehicle's center console speakers to output voice. For another example, the reminder device can control the vehicle's headrest speakers to output voice.

[0019] In one possible implementation, the vehicle status includes a fault, and the pending operation includes an operation for resolving the fault. In this implementation, the reminder device can output fault information to alert a person or device of the vehicle fault, thereby enabling the person or device to promptly be notified of the vehicle fault. By outputting information confirming the execution of the operation for resolving the fault, the reminder device can simplify the operational process for the person or device to resolve the fault, thereby providing a method for the person or device to quickly resolve the fault.

[0020] In one possible implementation, the operation to be performed is based on a safety determination of the vehicle.

[0021] Optionally, the impact of the fault handling operation on vehicle safety can be assessed based on the vehicle's driving state, and the operation to be performed can be determined based on the vehicle's driving state. Optionally, the impact of the fault handling operation on vehicle safety can be assessed based on the vehicle's driving environment, and the operation to be performed can be determined based on the vehicle's driving environment. Optionally, the impact of the fault handling operation on vehicle safety can be assessed based on a network model, and the operation to be performed can be determined based on the network model.

[0022] Considering that the reminder device, by outputting a message confirming execution of the pending operation, provides a way for a person or device to quickly execute the pending operation. Therefore, if the pending operation is determined based on vehicle safety, executing the pending operation can reduce the impact on vehicle safety. This can reduce the impact of outputting the message confirming execution of the pending operation on vehicle safety.

[0023] In one possible implementation, the reminder device obtains pending operations for the vehicle by performing the following steps: obtaining at least one candidate operation, where the candidate operation is an operation for resolving a fault; and obtaining a pending operation based on an operation in a whitelist of the at least one candidate operation, where the operations in the whitelist are determined based on vehicle safety.

[0024] Because the operations in the whitelist are determined based on vehicle safety, the reminder device determines the pending operation based on at least one candidate operation that is on the whitelist. This allows the pending operation to be determined based on vehicle safety, thereby improving the safety of executing the pending operation. Optionally, the reminder device selects at least one candidate operation that is on the whitelist as the pending operation. For example, at least one candidate operation includes smooth deceleration and stopping and turning off the air conditioning. The whitelist includes turning off the air conditioning, but the whitelist does not include smooth deceleration and stopping. Therefore, the pending operation is turning off the air conditioning.

[0025] In one possible implementation, at least one candidate operation is obtained based on the network model and input data of the network model, where the input data includes one of the following: a fault, and detection information, wherein the detection information includes information obtained by detecting the vehicle.

[0026] In one possible implementation, the input data includes a fault, and at least one candidate operation is obtained based on the network model and the fault. In another possible implementation, the input data includes detection information, and at least one candidate operation is obtained based on the network model and the detection information.

[0027] In one possible implementation, the network model is deployed on a server. The reminder device sends input data from the network model to the server, and the server receives the input data from the reminder device. The server inputs the input data into the network model, obtains at least one candidate operation output by the network model, and then sends the at least one candidate operation to the reminder device. The reminder device receives the at least one candidate operation from the server.

[0028] In another possible implementation, the network model is deployed in a reminder device, and the reminder device inputs input data into the network model to obtain at least one candidate operation output by the network model.

[0029] The detection information includes any information obtained by detecting the vehicle. In one possible implementation, the detection information includes fault codes obtained by the ECU through detection of the vehicle. In another possible implementation, the detection information includes information obtained by detecting the vehicle based on sensors.

[0030] The network model's ability to derive at least one candidate operation based on input data is acquired through training. Because the training data can be updated in real time and covers a wide range of data, the knowledge learned by the network model through training about deriving at least one candidate operation based on the input data can also be updated in real time and covers a wide range of data. This improves the accuracy of deriving at least one candidate operation based on the network model and input data.

[0031] In one possible implementation, the reminder device obtains at least one candidate operation by performing the following steps: obtaining a first text generated by the network model based on input data, wherein the first text includes descriptive information about an operation for resolving the fault; and determining at least one candidate operation based on the first text.

[0032] In this implementation, the network model can generate text based on input data. For example, if the network model is an LLM, the network model can determine an action to address the fault based on the input data and then generate a first text that includes a description of the action to address the fault. For example, if the vehicle fault is high temperature, the first text may include the following: Please decelerate smoothly, stop the vehicle, and turn off the air conditioning.

[0033] In one possible implementation, the network model is deployed on a server. The reminder device sends input data from the network model to the server, and the server receives the input data from the network model. The server inputs the input data into the network model, obtains a first text output by the network model, and then sends the first text to the reminder device, which in turn receives the first text from the server.

[0034] In another possible implementation, the network model is deployed in a reminder device, and the reminder device inputs input data into the network model to obtain a first text output by the network model.

[0035] Because the first text includes descriptive information about the operation for handling the fault, the reminder device can determine at least one candidate operation based on the first text after obtaining the first text. In one possible implementation, the reminder device extracts at least one operation for handling the fault from the first text to obtain at least one candidate operation.

[0036] In one possible implementation, the reminder device further controls the display of a second control, wherein the second control is used to confirm and display any one or more of the following: a process for executing the operation to be executed, and a cause of the fault.

[0037] The process for executing the pending operation can be used to guide a person or device in executing the pending operation. The cause of the fault may include a detailed analysis of the cause of the fault. This can assist a person or device in troubleshooting the fault. The reminder device controls the display of a second control, allowing a person or device to interact with the second control to confirm the displayed process for executing the pending operation, thereby guiding the person or device in executing the pending operation. A person or device can also interact with the second control to confirm the displayed cause of the fault, thereby assisting in troubleshooting.

[0038] In one possible implementation, the process of executing the operation to be executed is a second text obtained based on the network model and the input data of the network model, wherein the second text includes descriptive information of the process of executing the operation to be executed, and the input data includes one of the following: fault, detection information, and the detection information includes information obtained by detecting the vehicle.

[0039] In the process of obtaining the process for executing the pending operation, the network model can generate text based on the input data. For example, if the network model is an LLM, the network model can determine the process for executing the pending operation based on the input data and then generate a second text that includes descriptive information about the process for executing the pending operation. For example, if the vehicle fault is high temperature and the pending operation is to turn off the air conditioning, the second text may include the following: Find the air conditioning off switch on the center console and then use it to turn it off.

[0040] In one possible implementation, the network model is deployed on a server. The reminder device sends input data from the network model to the server, and the server receives the input data from the network model. The server inputs the input data into the network model, obtains a second text output by the network model, and then sends the second text to the reminder device, which in turn receives the second text from the server.

[0041] In another possible implementation, the network model is deployed in a reminder device, and the reminder device inputs input data into the network model to obtain a second text output by the network model.

[0042] The network model's ability to generate a process for executing fault handling operations based on input data is acquired through training. Because the training data can be updated in real time and covers a wide range of data, the knowledge learned by the network model through training about generating a process for executing fault handling operations based on input data can also be updated in real time and covers a wide range of data. This improves the accuracy of the process for executing pending operations based on the network model and input data.

[0043] In one possible implementation, the cause of the fault is a third text obtained based on the network model and the input data of the network model, wherein the third text includes descriptive information of the cause of the fault, and the input data includes one of the following: fault, detection information, and the detection information includes information obtained by detecting the vehicle.

[0044] In the process of obtaining the cause of the fault described above, the network model can generate text based on the input data, for example, the network model is LLM. The network model can determine the cause of the fault based on the input data, and then generate a third text including descriptive information of the cause of the fault. For example, the fault of the vehicle is high temperature, and the third text includes the following content: 1. Long-term high-speed / heavy-load driving causes the tires to continuously roll at high speed and generate heat due to friction, and the heat dissipation is not timely. Relevant scenarios include: long-term high-speed driving, overloading or towing heavy objects. 2. Abnormal tire pressure. Specifically, abnormal tire pressure includes excessively high tire pressure or too low tire pressure, among which excessively high tire pressure reduces the contact area between the tire and the ground, and concentrated friction causes heating, while too low tire pressure causes aggravated deformation of the tire sidewall and frictional heat of the internal structure. 3. Brake system failure. Specifically, the brake cylinder is stuck and the brake pad does not return to its position, resulting in continuous friction between the brake pad and the wheel hub (heat is transferred to the tire).

[0045] In one possible implementation, the network model is deployed on a server. The reminder device sends input data from the network model to the server, and the server receives the input data from the network model. The server inputs the input data into the network model, obtains a third text output by the network model, and then sends the third text to the reminder device, which in turn receives the third text from the server.

[0046] In another possible implementation, the network model is deployed in a reminder device, and the reminder device inputs input data into the network model to obtain a third text output by the network model.

[0047] The network model's ability to generate fault causes based on input data is acquired through training. Because the training data can be updated in real time and covers a wide range of data, the knowledge learned by the network model through training about fault causes based on input data can also be updated in real time and covers a wide range of data. This improves the accuracy of fault cause predictions based on the network model and input data.

[0048] In one possible implementation, the fault includes high tire temperatures, and the to-be-performed action includes shutting down the vehicle's air conditioning. In this embodiment, the reminder device can output a message indicating the high tire temperatures to alert a person or device of the high tire temperatures, thereby enabling the person or device to promptly be notified of the high tire temperatures. By outputting a message indicating shutting down the vehicle's air conditioning, the reminder device can simplify the process for the person or device to handle the high tire temperatures, thereby providing a quick way for the person or device to address the high tire temperatures.

[0049] In one possible implementation, the fault includes a faulty component in the vehicle. The reminder device further controls the display of a vehicle model, with the faulty component in the model displayed in a preset manner, wherein the preset manner indicates the presence of a fault. This allows the vehicle model to intuitively demonstrate that the fault has occurred in the faulty component of the vehicle.

[0050] In one possible implementation, the status includes energy consumption, and the pending operation includes an energy-saving operation. The energy-saving operation includes turning off the vehicle's air conditioning, reducing the vehicle's speed, and closing the vehicle's windows while the air conditioning is on. In this embodiment, the reminder device can output a message about the vehicle's energy consumption to alert a person or device to the vehicle's energy consumption, thereby enabling the person or device to promptly monitor the vehicle's energy consumption. By outputting a message confirming the execution of the energy-saving operation, the reminder device can simplify the process for the person or device to execute the energy-saving operation, thereby providing a method for the person or device to quickly save the vehicle's energy consumption.

[0051] In one possible implementation, the pending operation includes an operation determined based on the vehicle's historical usage data. This allows a user or device to quickly execute an operation that matches the vehicle's historical usage data by outputting a message confirming the execution of the pending operation, thereby improving the vehicle user experience.

[0052] In a possible implementation, the reminder device further performs the following steps: receiving an instruction, wherein the instruction is used to confirm execution of the pending operation; and controlling execution of the pending operation based on the instruction.

[0053] In this implementation, after receiving the instruction, the reminder device can control the vehicle's actuator to perform the operation to be performed, or it can control the vehicle's actuator to perform the operation to be performed through the vehicle's ECU, thereby completing the response to the vehicle's status.

[0054] In a second aspect, a reminder device is provided, comprising: a unit for executing the above-mentioned first aspect or any one of the implementations of the first aspect.

[0055] In a third aspect, a reminder device is provided, which includes a processor and a memory, the memory is used to provide storage space, the storage space is used to store computer instructions, and the processor is used to call the computer instructions stored in the memory so that the above-mentioned first aspect or any one of the implementation methods of the first aspect is executed.

[0056] In a fourth aspect, a vehicle is provided, comprising the reminder device of the second aspect and the reminder device of the third aspect.

[0057] In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, which is used to store a computer program. When the computer program is executed, the above-mentioned first aspect or any one of the implementations of the first aspect is executed.

[0058] In a sixth aspect, embodiments of the present application provide a computer program product, which includes computer language code or computer instructions. When the computer program product is executed by a processor, the first aspect or any one of the implementations of the first aspect is executed.

[0059] The technical effects of the second to sixth aspects of this application can refer to the technical effects of the technical solution of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0060] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following briefly introduces the drawings required for use in the embodiments of the present application. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0061] Figure 1 A flowchart of a reminder method provided in an embodiment of the present application;

[0062] Figure 2 A schematic diagram of a reminder interface provided in an embodiment of the present application;

[0063] Figure 3 A method provided in the embodiment of this application Figure 2 Schematic diagram of the second control being clicked;

[0064] Figure 4 A schematic structural diagram of a reminder device provided in an embodiment of the present application;

[0065] Figure 5 A schematic structural diagram of another reminder device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0066] In order to make the purpose, technical solutions and advantages of this application clearer, the embodiments of this application will be described below in conjunction with the drawings in the embodiments of this application.

[0067] The terms "first" and "second" in the specification, claims, and drawings of this application are used to distinguish different objects, not to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or device that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units that are not listed, or may optionally include other steps or units that are inherent to the process, method, product, or device.

[0068] The “embodiment” mentioned herein means that the specific features, structures or characteristics described in conjunction with the embodiment may be included in at least one embodiment of the present application. The appearance of this phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It can be understood explicitly and implicitly by those skilled in the art that in the various embodiments of the present application, unless otherwise specified and there is a logical conflict, the terms and / or descriptions between the various embodiments are consistent and can be referenced to each other, and the technical features in different embodiments can be combined to form a new embodiment according to their inherent logical relationship.

[0069] It should be understood that in the present application, "at least one (item)" refers to one or more, "more than one" refers to two or more, "at least two (items)" refers to two or three and more than three, and "and / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following items" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.

[0070] Before introducing the embodiments of the present application, the terms that may be used in the embodiments of the present application are first introduced.

[0071] 1. Controls are various elements in the user interface used to interact with users. They provide users with ways to operate and input, and can also be used to display information. The main function of controls is to enable interaction between users and computer programs. Users can pass instructions to the program by interacting with controls, and the program performs corresponding operations based on the instructions passed by the controls based on the interaction between the user and the controls. Controls include: buttons, text boxes, drop-down menus, check boxes, radio buttons, list boxes, and sliders. In one possible implementation, the control that performs the operation includes a button, and the user can perform the corresponding operation by clicking the button. In another possible implementation, the control that performs the operation includes a text box, and the user can enter the desired operation in the text box through voice.

[0072] 2. The vehicle model may reflect the overall appearance of the vehicle. In one possible implementation, the vehicle model includes a two-dimensional model. In another possible implementation, the vehicle model includes a three-dimensional model.

[0073] As mentioned in the background, if a person or device fails to respond promptly to a vehicle's status changes, it may affect the vehicle's normal operation and even endanger its safety. In one possible scenario, the vehicle's status includes a fault, and responding to the vehicle's status includes resolving the fault. For example, during vehicle use, mechanical wear, aging of electronic components, and environmental factors can cause faults that are difficult to completely avoid. If the driver fails to address the fault promptly, it may affect the vehicle's normal operation and even endanger its safety.

[0074] In another possible implementation scenario, the vehicle's state includes energy-related conditions, and responding to the vehicle's state includes executing an energy-saving action. For example, if the rear seat of a vehicle is unoccupied but the air conditioning is on, failing to promptly turn it off could result in wasted energy.

[0075] In another possible implementation scenario, responding to the vehicle's status includes determining an action that matches the vehicle's status based on historical vehicle usage data. For example, based on the vehicle's historical vehicle usage data, it may be determined that if the volume of a rear passenger's conversation is greater than or equal to a first threshold, the Privacy Shield technology may be used to reduce the impact of the rear passenger's conversation on the front passenger. Accordingly, if the vehicle's status includes the volume of a rear passenger's conversation being greater than or equal to the first threshold, the Privacy Shield technology may be used to reduce the impact of the rear passenger's conversation on the front passenger, thereby improving the front passenger's driving experience.

[0076] Current technology typically responds to vehicle status changes by providing notifications. However, this approach lacks a quick way to respond to vehicle status changes. Instead, a person or device must perform actions based on the vehicle's status, leading to a complex process for responding to vehicle status changes. For example, if a vehicle malfunctions, the ECU may output a notification, but it lacks a quick way to address the malfunction, requiring further action by a person or device.

[0077] Based on this, an embodiment of the present application provides a reminder method that can both provide timely reminders of the vehicle's status and provide a way to quickly respond to the vehicle's status. The reminder method is performed by a reminder device, which can be one of the following: a vehicle's on-board chip, a vehicle's on-board computer, or a vehicle's ECU. On-board chips include the following: a CPU, an ECU, or a domain controller.

[0078] Specifically, the reminder device can, by executing the reminder method, output status information and information for confirming the execution of the pending operation after obtaining the vehicle status and the pending operation in response to the status. This can, on the one hand, alert a person or device to the vehicle status by outputting the status information, thereby enabling the person or device to promptly learn the vehicle status, which is conducive to further responding to the vehicle status. On the other hand, since confirming the execution of the pending operation by confirming the execution of the pending operation information can simplify the process of executing the pending operation, and the pending operation includes the operation in response to the status, outputting the information for confirming the execution of the pending operation can simplify the operational process of the person or device responding to the status, thereby providing a way for the person or device to quickly respond to the status.

[0079] The reminder method of the embodiment of the present application will be described in detail below with reference to the accompanying drawings. Figure 1, Figure 1 A flowchart of a reminder method provided in an embodiment of the present application.

[0080] 101. Obtain the vehicle status and pending operations, where the pending operations include operations in response to the status.

[0081] The aforementioned vehicle can be any vehicle. The vehicle status includes: vehicle malfunction, the vehicle's environment, the state of the vehicle's passenger compartment, and the vehicle's energy consumption. For example, a vehicle malfunction may include high vehicle temperature. The vehicle's environment may include poor visibility ahead. The state of the vehicle's passenger compartment may include no one in the rear seat. The vehicle's energy consumption includes the vehicle's electricity consumption per 100 kilometers or the vehicle's fuel consumption per 100 kilometers.

[0082] In one possible implementation, the state of the vehicle is obtained by sensing the state of the vehicle through a sensing device. Optionally, the sensing device includes: a camera, a sensor, and a radar. For example, a sensor for detecting whether the vehicle has a fault can be used to determine whether the vehicle has a fault. For another example, a radar for sensing the environment in which the vehicle is located can be used to determine the environment in which the vehicle is located. For another example, a camera installed in the passenger compartment of the vehicle is used to photograph the interior of the passenger compartment of the vehicle, and based on the captured images and / or videos, the state of the interior of the passenger compartment of the vehicle can be determined. The reminder device can obtain the state of the vehicle by receiving the state of the vehicle from the sensing device.

[0083] In another possible implementation, the state of the vehicle is obtained based on a network model, wherein the network model includes an artificial intelligence model.

[0084] The state of the vehicle is obtained based on the network model and the perception data, wherein the perception data is the input to the network model, and the perception data includes information obtained by perceiving the state of the vehicle, and the perception data includes: data collected by the vehicle's sensors, data collected by the radar, and images and / or videos collected by the camera. For example, the perception data includes the vehicle's fault code. After obtaining the vehicle's fault code, the vehicle's fault code is input into the network model so that the network model determines the vehicle's fault. For another example, the perception data includes radar data obtained by the radar when perceiving the environment in which the vehicle is located. After obtaining the radar data, the radar data is input into the network model so that the network model determines the environment in which the vehicle is located. For another example, the perception data includes an image obtained by the camera of the vehicle's passenger compartment. After obtaining the image, the image is input into the network model so that the network model determines the state of the vehicle's passenger compartment.

[0085] Optionally, the network model is deployed on a server, and the reminder device sends the perception data to the server. The server then receives the perception data from the reminder device. After determining the vehicle's status based on the network model and the perception data, the server sends the vehicle's status to the reminder device. The reminder device then obtains the vehicle's status from the vehicle's status received from the server.

[0086] Optionally, the network model is deployed in a reminder device, and the reminder device can obtain the status of the vehicle based on the network model and the perception data.

[0087] The operation to be performed includes an operation in response to the state of the vehicle. In one possible implementation, the reminder device determines the operation to be performed based on the state of the vehicle.

[0088] In another possible implementation, the operation to be performed is determined based on the network model and the network model. For example, the reminder device inputs the state into the network model and obtains the operation to be performed output by the network model. In yet another possible implementation, the operation to be performed is determined based on the historical vehicle usage data of the vehicle. In yet another possible implementation, the reminder device determines the operation to be performed in response to the state of the vehicle based on the mapping relationship between the state of the vehicle and the operation. For example, in the mapping relationship between the state of the vehicle and the operation, the operation having a mapping relationship with high temperature includes turning off the air conditioner. Accordingly, when the state of the vehicle includes a high temperature of the vehicle, the reminder device can determine that the operation to be performed includes turning off the air conditioner. Optionally,

[0089] 102. Output status information and information for confirming execution of pending operations.

[0090] The reminder device can remind the vehicle of its status by outputting status information. The reminder device can output information for confirming the execution of pending operations, thereby simplifying the process of executing pending operations by confirming the execution of pending operations in response to the output information.

[0091] In an implementation method of outputting status information and information confirming execution of a pending operation, a reminder device outputs status information and information for confirming execution of a pending operation by controlling a display status and a first control, wherein the first control is used to confirm execution of the pending operation.

[0092] The device that displays the vehicle status and the first control can be any device with a display function. Optionally, the reminder device controls a display component of the vehicle to display the vehicle status and the first control, wherein the display component includes any one or more of the following: a screen, a head-up display (HUD), a headlight, and a projection device.

[0093] The screen includes the vehicle's central control screen, instrument panel display, ceiling screen, headrest-mounted display, rearview mirror display, streaming media display, and electronic rearview mirror. The HUD can display the content to be displayed by projecting it onto a displayable object. Optionally, the displayable object includes: the vehicle's windshield. The headlights include any headlight of the vehicle. Optionally, the headlights display the content to be displayed by projecting it onto the ground, so that the displayed content can be known outside the vehicle. The projection device can be any projection device of the vehicle. Optionally, the projection device includes a projection device installed in the rear row of the vehicle. The projection device installed in the rear row can project onto a screen in the passenger compartment of the vehicle, and the rear passengers can view the content displayed on the screen.

[0094] In a scenario of controlling a display status and a first control, the reminder device includes an ECU, and the display component includes a screen in the vehicle's cabin. The ECU controls the display status of the screen in the vehicle's cabin and the first control, so that the passengers in the vehicle's cabin can promptly learn about the status through the screen in the cabin, and confirm the execution of pending operations by interacting with the first control in the screen in the cabin. For example, the status includes that the vehicle's temperature is high, the operation to be executed includes turning off the air conditioner, and the screen in the vehicle's cabin includes the vehicle's central control screen. While the passenger in the passenger seat learns that the vehicle's temperature is high through the central control screen, he or she can interact with the first control in the central control screen by clicking on it, and then confirm the execution of the operation of turning off the air conditioner. This simplifies the operation of turning off the air conditioner.

[0095] In another scenario of controlling the display status and the first control, the reminder device includes an ECU, and the display component includes a HUD. The ECU controls the vehicle's HUD to display the status and the first control on the windshield in front of the driver, so that the driver can promptly know the status of the vehicle through the windshield, and confirm the execution of the pending operation by interacting with the first control. For example, the vehicle's status includes a high vehicle temperature, and the pending operation includes turning off the air conditioner. While the driver knows that the vehicle's temperature is high through the windshield, he can interact with the first control in the windshield through voice to confirm the execution of the operation to turn off the air conditioner. In this way, the driver can complete the execution of the pending operation without taking his eyes off the windshield, thereby reducing the risk caused by the driver taking his eyes off the windshield.

[0096] In another scenario involving controlling the display status and a first control, the reminder device includes an ECU, and the display component includes a headlight. The ECU controls the vehicle's headlights to display the status and the first control on the ground, so that other vehicles around the vehicle can promptly learn of the status through the ground and confirm the execution of pending operations by interacting with the first control. For example, the status may include low tire pressure, requiring the vehicle to smoothly decelerate and stop to address the low tire pressure issue. To reduce the probability of a collision between the vehicle and other vehicles around the vehicle due to smooth deceleration and stopping, other vehicles around the vehicle must perform operations to reduce the probability of a collision (e.g., other vehicles behind the vehicle can slow down or change lanes in advance). Accordingly, the pending operations include performing operations to reduce the probability of a collision. Other vehicles around the vehicle can interact with the first control by emitting light toward the first control, thereby informing the vehicle that other vehicles have confirmed the execution of operations to reduce the probability of a collision. In this case, smooth deceleration and stopping of the vehicle can reduce the probability of a collision between the vehicle and other vehicles around the vehicle.

[0097] In another scenario involving controlling the display status and a first control, the reminder device includes an ECU, and the display component includes a projection device. The ECU controls the projection device to display the status and the first control on a screen, allowing rear passengers to promptly learn the status through the screen and confirm the execution of pending actions by interacting with the first control. For example, the status may include a high vehicle temperature, and the pending action may include turning off the air conditioning. While the rear passengers learn the high vehicle temperature through the screen, they can then interact with the first control on the screen through voice commands to confirm the execution of the action to turn off the air conditioning. This simplifies the process of turning off the air conditioning.

[0098] In another implementation method of outputting status information and information confirming the execution of the operation to be performed, the reminder device outputs status information and information for confirming the execution of the operation to be performed by controlling the output voice, wherein the voice includes status information and information for confirming the execution of the operation to be performed.

[0099] In one scenario of controlling voice output, the reminder device includes an ECU. The reminder device controls a device within the vehicle's cabin to output voice. For example, the vehicle's status may include high temperature, and the pending action may include turning off the air conditioning. The reminder device controls the voice output from speakers within the vehicle's cabin to include the following: The high vehicle temperature may affect safe driving, and it is recommended to lower tire temperature by turning off the air conditioning.

[0100] In another embodiment of outputting status information and information confirming execution of a pending operation, the reminder device outputs the status information and the information confirming execution of the pending operation by displaying and outputting voice messages, respectively. Optionally, the reminder device controls the display of the status and outputs a second voice message, wherein the second voice message includes information confirming execution of the pending operation. Optionally, the reminder device controls the display of the first control and outputs a third voice message, wherein the third voice message includes the status information.

[0101] Optionally, when the number of operations to be performed is greater than 1, the reminder device also outputs the priority of each operation to be performed. Optionally, the priority of the operation to be performed is determined based on the response effect of the operation to be performed on the state. For example, the state includes a fault, and the response effect to the state includes the effect of handling the fault. Optionally, the priority of the operation to be performed is determined based on the selection rate of the operation to be performed. For example, the state includes a fault, wherein the fault includes a high temperature, and the operations to be performed for handling the high temperature include turning off the air conditioner and slowing down and stopping. When selecting the operation for handling the high temperature fault, the selection rate of turning off the air conditioner is higher than the selection rate of slowing down and stopping, so the priority of turning off the air conditioner is higher than the priority of slowing down and stopping.

[0102] In an embodiment of the present application, after obtaining the status of the vehicle and the pending operations in response to the status, the reminder device outputs status information and information for confirming the execution of the pending operations. In this way, on the one hand, the status of the vehicle can be reminded to the person or device by outputting the status information, so that the person or device can be informed of the status of the vehicle in a timely manner, which is conducive to further responding to the status of the vehicle. On the other hand, since confirming the execution of the pending operations by confirming the execution of the pending operations can simplify the process of executing the pending operations, and the pending operations include the operations in response to the status, the output of the information for confirming the execution of the pending operations can simplify the operational process of the person or device responding to the status, thereby providing a way for the person or device to quickly respond to the status.

[0103] As an optional implementation, after receiving the instruction, the reminder device controls the execution of the operation to be executed based on the instruction, wherein the instruction is used to confirm the execution of the operation to be executed.

[0104] In one possible implementation, the reminder device controls the display of a first control to output information for confirming execution of the pending operation. The instruction includes an instruction generated by interacting with the first control. For example, the first control is displayed on the central control screen, and the instruction can be generated by clicking the first control, or by interacting with the first control through voice, thereby generating an instruction to confirm execution of the pending operation.

[0105] In another possible implementation, the reminder device outputs information confirming execution of the pending operation via voice. The instruction includes a voice-generated instruction. For example, the voice may include the following: "High vehicle temperature may affect safe driving. It is recommended to turn off the air conditioning to reduce tire temperature." The driver's voice response to the voice may include the following: "Please turn off the air conditioning." The instruction then includes a voice-generated instruction based on the voice response: "Turn off the air conditioning."

[0106] After receiving the instruction, the reminder device can control the vehicle's actuators to perform the pending operation, or it can control the vehicle's actuators to perform the pending operation through the vehicle's ECU, thereby responding to the vehicle's status. For example, the reminder device includes the vehicle's ECU, and the pending operation includes turning off the air conditioner. The ECU can control the air conditioner actuator to perform the shutdown operation. In another example, the reminder device includes a vehicle-mounted chip, and the pending operation includes turning off the air conditioner. The vehicle-mounted chip can send an instruction to the vehicle's ECU to control the air conditioner actuator to perform the shutdown operation. Upon receiving the instruction, the ECU controls the air conditioner actuator to perform the shutdown operation.

[0107] Optionally, the reminder device also outputs suggestions for the response status, wherein the suggestions include operations for the response status, so that a summary suggestion for the response status can be given. In one possible implementation, the status includes a fault, and the suggestions for the response status include operations for handling the fault. For example, the fault includes high temperature, and the suggestions for the response status include: please slow down and stop the car smoothly and turn off the air conditioner. In the suggestions for the response status, slowing down and stopping the car smoothly and turning off the air conditioner are both operations for handling the fault. In another possible implementation, the status includes energy consumption, and the suggestions for the response status include operations for saving energy. For example, energy consumption includes the vehicle's electricity consumption per 100 kilometers, and the suggestions for the response status include: please maintain a steady speed and turn off the air conditioner. In the suggestions for the response status, maintaining a steady speed and turning off the air conditioner are both operations for saving energy.

[0108] As shown in step 101, the state of the vehicle includes: vehicle faults, the environment in which the vehicle is located, the state of the vehicle's passenger compartment, and the vehicle's energy consumption. The operations to be performed include: operations to handle faults, driving operations in response to the environment in which the vehicle is located, operations in response to the state of the passenger compartment, and operations to save energy. On the one hand, the method of determining the operations to be performed may be different for different states. On the other hand, in order to better remind people or equipment of information related to the state and / or the operations to be performed, the reminder device may output other information related to the state and / or the operations to be performed while outputting the state information and the information for confirming the execution of the operations to be performed. The method of outputting other information related to the state and / or the operations to be performed may also be different for different states and operations to be performed.

[0109] The following describes how the reminder device determines the pending operation and outputs other information related to the status and / or the pending operation for the following two situations:

[0110] 1. The vehicle status includes vehicle faults, and the pending operations include operations to handle the faults.

[0111] 2. The vehicle status includes the vehicle's energy consumption, and the operations to be performed include operations to save energy.

[0112] The following will first describe the first situation, that is, the vehicle status includes a vehicle fault, and the to-be-performed operation includes an operation for handling the fault.

[0113] In one possible implementation, the operation to be performed can be determined based on the safety of the vehicle. Optionally, the impact of the operation to handle the fault on the safety of the vehicle can be evaluated based on the driving state of the vehicle, so the operation to be performed can be determined based on the driving state of the vehicle. For example, if the fault is high temperature, the operation to handle high temperature includes the following two operations: smooth deceleration and parking, and turning off the air conditioner. If the driving state of the vehicle includes a vehicle speed of 100 kilometers per hour. On the one hand, due to the high speed of the vehicle, smooth deceleration and parking may cause a traffic accident. On the other hand, the high speed of the vehicle indicates that the vehicle is very likely on a highway, at which point smooth deceleration and parking will affect the safety of the vehicle. Therefore, based on the driving state of the vehicle, it can be determined that the operation of smooth deceleration and parking has a greater impact on the safety of the vehicle, while the operation of turning off the air conditioner has a smaller impact on the safety of the vehicle. Therefore, based on the driving state of the vehicle, it can be determined that the operation to be performed is to turn off the air conditioner. Optionally, the reminder device determines the operation to be performed based on the driving state of the vehicle.

[0114] Optionally, based on the vehicle's driving environment, the impact of the operation of handling the fault on the safety of the vehicle can be evaluated, and thus the operation to be performed can be determined based on the vehicle's driving environment. For example, if the fault is high temperature, the operation to handle the high temperature includes the following two operations: smooth deceleration and parking, and turning off the air conditioner. If the vehicle's driving environment includes a close distance between the vehicle and the following vehicle, then smooth deceleration and parking may cause the following vehicle to rear-end the vehicle. Therefore, based on the vehicle's driving environment, it can be determined that the operation of smooth deceleration and parking has a greater impact on the safety of the vehicle, while the operation of turning off the air conditioner has a smaller impact on the safety of the vehicle. Therefore, based on the vehicle's driving state, it can be determined that the operation to be performed is turning off the air conditioner. Optionally, the reminder device determines the operation to be performed based on the vehicle's driving environment.

[0115] Optionally, the network model can be used to assess the impact of fault-handling operations on vehicle safety, and thus the pending operation can be determined based on the network model. For example, if the fault is high temperature, the operations to handle the high temperature include the following two: smooth deceleration and parking, and turning off the air conditioning. The network model is LLM. Based on the LLM, it can be determined that smooth deceleration and parking has a greater impact on vehicle safety, while turning off the air conditioning has a smaller impact. Therefore, based on the network model, the pending operation can be determined to be turning off the air conditioning. Optionally, the reminder device determines the pending operation based on the network model.

[0116] Optionally, the reminder device obtains pending operations for the vehicle by performing the following steps: obtaining at least one candidate operation, wherein the candidate operation is an operation for resolving a fault. Determining the pending operation based on a whitelist of operations among the at least one candidate operation, wherein the operations in the whitelist are determined based on vehicle safety. Specifically, a whitelist of operations may be pre-configured based on their impact on vehicle safety, wherein the operations in the whitelist are operations with minimal impact on vehicle safety. For example, for a vehicle, turning off the air conditioning is an operation with minimal impact on safety, and therefore the whitelist may include turning off the air conditioning.

[0117] Because the operations in the whitelist are determined based on vehicle safety, the reminder device determines the pending operation based on at least one candidate operation that is on the whitelist. This allows the pending operation to be determined based on vehicle safety, thereby improving the safety of executing the pending operation. Optionally, the reminder device selects at least one candidate operation that is on the whitelist as the pending operation. For example, at least one candidate operation includes smooth deceleration and stopping and turning off the air conditioning. The whitelist includes turning off the air conditioning, but the whitelist does not include smooth deceleration and stopping. Therefore, the pending operation is turning off the air conditioning.

[0118] Optionally, at least one candidate operation is obtained based on the network model and input data of the network model, wherein the input data includes one of the following: fault, detection information, and the detection information includes information obtained by detecting the vehicle.

[0119] The detection information includes any information obtained by detecting the vehicle. In one possible implementation, the detection information includes fault codes obtained by the ECU through detection of the vehicle. In another possible implementation, the detection information includes information obtained by detecting the vehicle based on sensors.

[0120] Optionally, the reminder device obtains at least one candidate operation by performing the following steps: obtaining a first text generated by the network model based on input data, wherein the first text includes descriptive information of an operation for handling a fault; and determining at least one candidate operation based on the first text.

[0121] As an optional embodiment, in the first scenario, the reminder device further controls the display of a second control, wherein the second control is used to confirm the display of any one or more of the following: the process of executing the pending operation, the cause of the fault. By interacting with the second control, the display of any one or more of the following: the process of executing the pending operation, the cause of the fault, can be confirmed, and further, any one or more of the following: the process of executing the pending operation, the cause of the fault, can be displayed.

[0122] Optionally, after receiving the first instruction, the reminder device controls the display of any one or more of the following: the process for executing the pending operation, or the cause of the fault. The first instruction is used to confirm the display of any one or more of the following: the process for executing the pending operation, or the cause of the fault. For example, a second control is displayed on the screen, and the driver can generate the first instruction by clicking the second control. After receiving the first instruction, the reminder device confirms the display of any one or more of the following: the process for executing the pending operation, or the cause of the fault.

[0123] The process for executing a pending action can be used to guide people or devices in executing the pending action. For example, the pending action is a smooth deceleration and stop. The process for executing the pending action includes: activating the hazard lights, slowly releasing the accelerator, and avoiding braking or sudden steering. Parking should be done on a cool, flat surface, such as in the emergency lane on a highway before a class. If the driver does not confirm the pending action to execute the action, they can complete the smooth deceleration and stop using the process.

[0124] Optionally, the process of executing the operation to be executed is a second text obtained based on the network model and input data of the network model, wherein the second text includes description information of the process of executing the operation to be executed.

[0125] The network model's ability to generate a process for executing fault handling operations based on input data is acquired through training. Because the training data can be updated in real time and covers a wide range of data, the knowledge learned by the network model through training about generating a process for executing fault handling operations based on input data can also be updated in real time and covers a wide range of data. This improves the accuracy of the process for executing pending operations based on the network model and input data.

[0126] The cause of the fault may include a detailed analysis of the cause of the fault. The cause of the fault helps people or equipment to troubleshoot the fault. For example, if the fault is high temperature, the causes of the fault include: 1. Long-term high-speed / heavy-load driving, resulting in continuous high-speed rolling friction and heat generation of the tires, and untimely heat dissipation. Related scenarios include: long-term high-speed driving, overloading, or towing heavy objects. 2. Abnormal tire pressure. Specifically, abnormal tire pressure includes excessively high tire pressure or too low tire pressure. Among them, excessively high tire pressure reduces the contact area between the tire and the ground, and concentrated friction causes heating. Too low tire pressure causes the tire sidewall to deform more severely, and the internal structure generates heat through friction. 3. Brake system failure. Specifically, the brake cylinder is stuck and the brake pads do not return to their position, resulting in continuous friction between the brake pads and the wheel hub (heat is transferred to the tire).

[0127] Optionally, the cause of the fault is a third text obtained based on the network model and input data of the network model, wherein the third text includes descriptive information of the cause of the fault.

[0128] The network model's ability to generate fault causes based on input data is acquired through training. Because the training data can be updated in real time and covers a wide range of data, the knowledge learned by the network model through training about fault causes based on input data can also be updated in real time and covers a wide range of data. This improves the accuracy of fault cause predictions based on the network model and input data.

[0129] Optionally, if the pending operation is part of at least one candidate operation, the second control can also be used to confirm and display the at least one candidate operation. In this case, the second control can be used to confirm and display any one or more of the following: the process for executing the pending operation, the cause of the fault, and at least one candidate operation. This allows a person or device to be aware of candidate operations in addition to the pending operation.

[0130] As an optional embodiment, the fault includes a faulty component in the vehicle, i.e., the faulty component in the vehicle causes the fault. For example, if the fault includes an elevated temperature on the left front tire, the faulty component is the left front tire. For another example, if the fault includes a position marker light not operating properly, the faulty component includes the position marker light.

[0131] Optionally, the vehicle fault includes a faulty component. For example, if the fault determined by the ECU based on the fault code includes a high temperature of the vehicle's left front tire, the faulty component in this case is the left front tire. For another example, if the network model determines based on the fault code that the vehicle fault includes a high temperature of the vehicle's left front tire, the faulty component in this case is the left front tire.

[0132] In this embodiment, the reminder device further controls the display of a vehicle model, wherein the faulty component in the vehicle model is displayed in a preset manner, and the preset manner indicates the presence of a fault. In this way, the fault can be intuitively displayed in the faulty component of the vehicle through the vehicle model.

[0133] In one possible implementation, the preset method includes rendering the faulty component based on a color halo of a preset color. For example, if the preset color is red, then the faulty component is rendered based on a color halo of red.

[0134] In another possible implementation, the preset method includes: the color of the faulty component is a preset color. For example, for the faulty component, the color is red. In another possible implementation, the preset method includes: using text to indicate the fault around the faulty component, and making the text point to the faulty component. For example, for the faulty component, a text box is displayed around it, wherein the text box includes text describing the fault, and the text box points to the faulty component. In yet another possible implementation, the preset method includes: rendering the faulty component according to the change in shape and / or color of the component caused by the fault. For example, if the fault is low tire pressure, and low tire pressure may cause a flat tire, the tire in the model is rendered as flat accordingly. For another example, if the fault is a broken left rearview mirror, the left rearview mirror in the model is rendered as broken.

[0135] Optionally, due to the display viewing angle, some parts of the vehicle model cannot be displayed due to being blocked. If the parts that cannot be displayed include faulty parts, then it will not be possible to visually display the faulty parts of the vehicle through the vehicle model. Therefore, when the reminder device determines that the faulty parts cannot be displayed due to being blocked, it controls the vehicle model to be displayed in a transparent manner, so that the blocked faulty parts can be displayed, and the faulty parts of the vehicle can be visually displayed through the vehicle model.

[0136] Optionally, after the reminder device stops outputting the fault information and the information for confirming the execution of the pending operation to handle the fault, if a person or device expects the reminder device to output the fault information and the information for confirming the execution of the pending operation to handle the fault again, a second instruction may be generated by interacting with the fault component in the vehicle model, wherein the second instruction is used to confirm the re-output of the fault information and the information for confirming the execution of the pending operation to handle the fault. For example, after the reminder device controls the display of the fault and the first control, a person or device may input a third instruction to the reminder device, wherein the third instruction is used to confirm the cessation of the display of the fault and the first control. After receiving the third instruction, the reminder device stops displaying the fault and the first control. If, after stopping displaying the fault and the first control, the person or device expects to review the fault and the first control, a second instruction may be generated by interacting with the fault component in the vehicle model (such as clicking on the fault component in the vehicle model), thereby causing the reminder device to control the display of the fault and the first control again.

[0137] Optionally, the reminder device also controls the output of a message confirming the rescue call, allowing the user to quickly call for help. In one possible implementation, the reminder device controls the display of a third control to output the message confirming the rescue call, where the third control is used to confirm the rescue call. In another possible implementation, the reminder device controls the output of a voice message that also includes the message confirming the rescue call.

[0138] Optionally, the reminder device also controls the output fault level, wherein the higher the fault level, the greater the impact of the fault on the safety of the vehicle.

[0139] See also Figure 2 , Figure 2 A schematic diagram of a reminder interface provided in an embodiment of the present application. Figure 2 The reminder interface shown is used to display faults, pending operations, information related to the faults, and information related to the pending operations. The reminder device can display faults, pending operations, information related to the faults, and information related to the pending operations by controlling the display of the reminder interface.

[0140] like Figure 2 As shown, the reminder interface includes a first component and a vehicle model. The first component includes the vehicle fault, fault resolution suggestions, a first control, a second control, and a third control. Clicking the first control executes the pending action. Clicking the second control causes the reminder interface to display the process for executing the pending action, the cause of the fault, and at least one candidate action. Clicking the third control allows a call for assistance.

[0141] Optional, in Figure 2In the example, the fault is high temperature. The recommended troubleshooting procedure is to decelerate smoothly, stop the car, and turn off the air conditioning. The first control is the button to turn off the air conditioning, the second is the button for artificial intelligence (AI) interpretation, and the third is the button for calling for assistance. The left front tire in the vehicle model is a preset color, indicating a fault.

[0142] The vehicle's air conditioning can be turned off by clicking the "Turn off the air conditioning" button. Clicking the "AI interpretation" button will prompt the reminder interface to display the process for executing the pending operation, the cause of the fault, and at least one candidate operation.

[0143] Optionally, by clicking on an area other than the vehicle model and the first component in the reminder interface, the reminder interface may stop displaying the first component, and the reminder interface then includes the vehicle model.

[0144] Optionally, when the reminder interface includes a model of the vehicle, by clicking on the faulty component in the vehicle model, the reminder interface can redisplay the first component. At this time, the reminder interface includes the vehicle model and the first component.

[0145] See also Figure 3 , Figure 3 A method provided in the embodiment of this application Figure 2 Schematic diagram of the second control being clicked. Figure 3 As shown, after the second control is clicked, the color of the second control is compared to Figure 2 The color of the unclicked component changes. And after the second control is clicked, the content displayed by the first component changes. Figure 2 The fault, suggestion for handling the fault, first control, second control, and third control in the program are transformed into the process of executing the operation to be executed, the cause of the fault, and at least one candidate operation. Figure 3 In the first component, the vehicle fault is displayed, 1. Operations for handling the fault, 1. Candidate operation 1, 2. Candidate operation 2, 3. Candidate operation 3, wherein candidate operation 1, candidate operation 2, and candidate operation 3 all belong to at least one candidate operation.

[0146] Optional, Figure 2 and Figure 3The reminder interface also includes multiple icons above and below. Starting from the upper left side of the reminder interface, the first icon is the user's profile picture, the second icon is the message icon, the third icon indicates the weather and temperature of the vehicle's location (i.e., 18° in the reminder interface), the fourth icon indicates the time (i.e., 8:08 in the reminder interface), the fifth icon indicates that the dashcam is recording, the sixth icon is the Bluetooth icon, the seventh icon is the wireless fidelity (Wi-Fi) icon, and the eighth icon is the cellular network icon.

[0147] Starting from the lower left side of the reminder interface, the first icon is the icon for returning to the main interface, the second icon is the icon for multitasking management, the third icon is the icon for settings, the fourth icon is the icon for navigation, the fifth icon is the icon for music, the sixth icon is the icon for seat adjustment, the seventh icon indicates the set temperature of the vehicle's air conditioning (that is, 24.5° in the reminder interface), the eighth icon is the icon for the 360-degree panoramic imaging system, the ninth icon is the icon for the internal circulation function, the tenth icon is the icon for the windshield defrost function, the eleventh icon is the icon for opening the trunk function, the twelfth icon is the icon for the anti-theft function, and the thirteenth icon is the volume icon.

[0148] It should be understood that in the description of the first scenario, the vehicle fault being high temperature and the pending operation being turning off the air conditioner are merely examples, and should not be interpreted as the vehicle fault being high temperature and the pending operation being turning off the air conditioner in the embodiments of the present application. In actual applications, the vehicle fault may be a fault other than high temperature, and the pending operation may be an operation other than turning off the air conditioner.

[0149] For example, a vehicle fault might be high engine coolant temperature. On the one hand, since the air conditioning compressor increases engine load, turning off cooling reduces the burden on the engine. On the other hand, the heating system utilizes waste heat from the engine coolant to heat the vehicle's interior, indirectly lowering the engine coolant temperature. Therefore, the pending action might be to turn off cooling and turn on heating.

[0150] For another example, the vehicle fault may be low battery power. The operation to be performed may be to turn off at least one of the following electrical devices: lights, audio, air conditioning, seat heating, and ambient lighting.

[0151] For another example, the vehicle's fault may be that the electric rearview mirror cannot be folded. Since the inability to fold the electric rearview mirror may be due to an abnormality in the operation of the program that controls the folding of the electric rearview mirror, the program that controls the electric rearview mirror can be reset. Accordingly, the operation to be executed may be to reset the program that controls the electric rearview mirror.

[0152] The first case has been described so far. Next, the second case will be described, that is, the state includes the energy consumption of the vehicle, and the to-be-performed operation includes an operation to save energy.

[0153] In one possible implementation, the pending operation may be determined based on the state of the vehicle's passenger compartment. For example, the vehicle's passenger compartment may contain a rear passenger seat that is unoccupied and the rear air conditioning is on. Because failure to promptly shut down the rear air conditioning may result in wasted vehicle energy, the pending operation may be determined to include shutting down the rear air conditioning.

[0154] In another possible implementation, the pending operation may be determined based on the vehicle's range. For example, if the vehicle's range is 100 kilometers, a determination may be made based on the vehicle's remaining energy and energy consumption to determine whether the vehicle's remaining energy is sufficient to complete the range. The vehicle's remaining energy includes the vehicle's remaining fuel and remaining battery power. If it is determined that the vehicle's remaining energy is insufficient to complete the range, the pending operation may be determined to include an energy-saving operation (e.g., turning off the air conditioner).

[0155] As an optional embodiment, in the second scenario, the reminder device further controls the display of a fourth control, wherein the fourth control is used to confirm the display of any one or more of the following: the cause of high energy consumption, and suggestions for saving energy. By interacting with the fourth control, the display of any one or more of the following: the cause of high energy consumption, and suggestions for saving energy can be confirmed, and further, any one or more of the following: the cause of high energy consumption, and suggestions for saving energy can be displayed.

[0156] The above describes in detail the method of the embodiment of the present application. The following provides an apparatus of the embodiment of the present application.

[0157] It should be understood that the device provided in the embodiment of the present application, the division of the units therein is only a division of a logical function, which can be fully or partially integrated into a physical entity during actual implementation, or can be physically separated. In addition, the unit in the device can be implemented in the form of a processor calling software. For example, the device includes a processor, the processor is connected to a memory, an instruction is stored in the memory, and the processor calls the instruction stored in the memory to implement any of the above methods or to implement the functions of each unit of the device, wherein the processor is, for example, a general-purpose processor, such as a CPU or MCU or a microprocessor (microprocessor unit, MPU), and the memory is a memory in the device or a memory outside the device.

[0158] Alternatively, the units in the device may be implemented in the form of hardware circuits, and the functions of some or all of the units may be implemented by designing the hardware circuits, and the hardware circuits may be understood as one or more processors. For example, in one implementation, the hardware circuit is an application-specific integrated circuit (ASIC), which implements the functions of some or all of the above units by designing the logical relationships of the components within the circuit. For another example, in another implementation, the hardware circuit may be implemented by a programmable logic device (PLD), taking a field programmable gate array (FPGA) as an example, which may include a large number of logic gate circuits, and the connection relationships between the logic gate circuits may be configured through configuration files, thereby implementing the functions of some or all of the above units.

[0159] In an embodiment of the present application, each unit in the device may be one or more processors (or processing circuits) configured to implement the above method, such as: CPU, MCU, graphics processing unit (GPU), neural network processing unit (NPU), tensor processing unit (TPU), deep learning processing unit (DPU), MPU, digital signal processor (DSP), ASIC, FPGA, or a combination of at least two of these processor forms.

[0160] In addition, the various units in the above devices can be fully or partially integrated together, or can be implemented independently. In one implementation, these units are integrated together and implemented in the form of a system-on-chip (SOC). The SOC may include at least one processor for implementing any of the above methods or implementing the functions of the various units of the device. The types of the at least one processor may be different, for example, including a CPU and an FPGA, or including a CPU and an MCU, or including a CPU and a GPU, etc. Several possible devices are listed below.

[0161] See Figure 4 , Figure 4Schematic diagram of the structure of a reminder device provided in an embodiment of the present application. Optionally, the reminder device 40 can be an independent device, such as a processing device. Alternatively, the reminder device 40 can also be a device in an independent device (such as a vehicle), such as a chip or an integrated circuit. The reminder device 40 is used to implement the aforementioned reminder method, for example Figure 1 The reminder method shown and its possible implementation.

[0162] Exemplarily, the reminder device 40 includes a communication unit 401 and further includes a processing unit 402. The communication unit 401 is used to implement one or more operations such as sending, receiving, and acquiring, and the processing unit 402 is used to implement one or more operations such as processing, determining, generating, calculating, and updating. It should be understood that the unit divisions here are merely illustrative, and in specific implementations, some units may be combined, or a single unit may be split into multiple units.

[0163] In one possible design, the communication unit 401 is used to obtain the vehicle's status and pending operations. The communication unit 401 is also used to output status information and information for confirming the execution of the pending operations.

[0164] In a possible implementation, the communication unit 401 is further configured to control a display state and a first control, wherein the first control is configured to confirm execution of a pending operation.

[0165] In a possible implementation, the communication unit 401 is further configured to control output of a voice, wherein the voice includes status information and information for confirming execution of the operation to be performed.

[0166] In a possible implementation, the state includes a fault, and the operation to be performed includes an operation for handling the fault.

[0167] In one possible implementation, the operation to be performed is based on a safety determination of the vehicle.

[0168] In one possible implementation, the communication unit 401 is further configured to obtain at least one candidate operation, where the candidate operation is an operation for resolving a fault. The processing unit 402 is configured to obtain an operation to be executed based on an operation in a whitelist among the at least one candidate operation, where the operations in the whitelist are determined based on vehicle safety.

[0169] In a possible implementation, at least one candidate operation is obtained based on the network model and input data of the network model, wherein the input data includes one of the following: a fault, and detection information, and the detection information includes information obtained by detecting the vehicle.

[0170] In one possible implementation, the communication unit 401 is further configured to obtain a first text generated by the network model based on the input data, wherein the first text includes descriptive information about an operation for handling the fault. The processing unit 402 is further configured to determine at least one candidate operation based on the first text.

[0171] In a possible implementation, the communication unit 401 is further configured to control the display of a second control, wherein the second control is configured to confirm the display of any one or more of the following: a process for executing the operation to be executed, and a cause of the fault.

[0172] In one possible embodiment, the process of executing the operation to be executed is a second text obtained based on the network model and the input data of the network model, wherein the second text includes descriptive information of the process of executing the operation to be executed, and the input data includes one of the following: fault, detection information, and the detection information includes information obtained by detecting the vehicle.

[0173] In one possible embodiment, the cause of the fault is a third text obtained based on the network model and the input data of the network model, wherein the third text includes descriptive information of the cause of the fault, and the input data includes one of the following: fault, detection information, and the detection information includes information obtained by detecting the vehicle.

[0174] In one possible implementation, the fault includes a high temperature of a tire of the vehicle, and the operation to be performed includes turning off the air conditioner of the vehicle.

[0175] In one possible implementation, the fault includes a faulty component in the vehicle. The communication unit 401 is further configured to control the display of a vehicle model, wherein the faulty component in the model is displayed in a preset manner, which indicates the presence of a fault.

[0176] In one possible implementation, the state of the vehicle includes energy consumption, and the operations to be performed include energy-saving operations, wherein the energy-saving operations include: turning off the vehicle's air conditioning, reducing changes in the vehicle's speed, and closing the vehicle's windows while turning on the vehicle's air conditioning.

[0177] In one possible implementation, the operation to be performed includes an operation determined based on historical vehicle usage data of the vehicle.

[0178] In a possible implementation, the communication unit 401 is further configured to receive an instruction, wherein the instruction is used to confirm the execution of the pending operation. The processing unit 402 is configured to control the execution of the pending operation based on the instruction.

[0179] The detailed description of the above implementation can be found in the introduction of the aforementioned method embodiment.

[0180] See Figure 5, Figure 5 A structural diagram of another reminder device provided in an embodiment of the present application is shown in FIG. Figure 5 The reminder device 50 shown can be an independent device, such as a processing device. Alternatively, the reminder device 50 can also be a device in an independent device (such as a vehicle), such as a chip or an integrated circuit. The reminder device 50 is used to implement the aforementioned reminder method, for example Figure 1 The reminder method shown and its possible implementation.

[0181] The reminder device 50 may include at least one processor 501 and a memory 503. Optionally, it may also include a communication interface 502. Further optionally, it may also include a connection line 504, wherein the processor 501, the communication interface 502, and / or the memory 503 are connected via the connection line 504 and / or communicate with each other via the connection line 504 to transmit control signals and / or data signals.

[0182] Among them: the processor 501 is a module that performs arithmetic operations and / or logical operations, and may specifically include one or more of the following modules: CPU, MCU, application processor (AP), MCU, ECU, GPU, MPU, ASIC, image signal processor (ISP), DSP, FPGA, complex programmable logic device (CPLD), or coprocessor, etc.

[0183] The communication interface 502 can be used to provide information input or output for at least one processor, or to receive signals sent externally and / or send signals to the outside. For example, the communication interface 502 may include an interface circuit. For example, the communication interface 502 may include a wired link interface such as an Ethernet cable, or it may be a wireless link (Wi-Fi, Bluetooth, general wireless transmission, vehicle-mounted short-range communication technology, and other short-range wireless communication technologies, etc.) interface. Optionally, the communication interface 502 may also include a radio frequency transmitter, an antenna, etc. In the case where the communication interface 502 includes an antenna, the number of antennas may be one or more.

[0184] As a possible design, if the reminder device 50 is a standalone device, the communication interface 502 may include a receiver and a transmitter. The receiver and transmitter may be the same component or different components. When the receiver and transmitter are the same component, the component may be referred to as a transceiver.

[0185] As another possible design, if the reminder device 50 is a chip or a circuit, the communication interface 502 may include an input interface and an output interface. The input interface and the output interface may be the same interface, or may be different interfaces.

[0186] Optionally, the functions of the communication interface 502 may be implemented by a transceiver circuit or a dedicated transceiver chip.

[0187] Memory 503 is used to provide storage space for storing data such as an operating system and computer programs. Memory 603 can be one or a combination of random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), or compact disc read-only memory (CD-ROM).

[0188] The functions and actions of the modules or units in the reminder device 50 listed above are merely exemplary.

[0189] Each functional unit in the reminder device 50 can be used to implement the aforementioned reminder method, for example Figure 1 The reminder method shown and its possible implementation.

[0190] Optionally, the processor 501 may be a processor specifically used to execute the aforementioned method (for convenience of distinction, referred to as a dedicated processor), or a processor that executes the aforementioned method by calling a computer program (for convenience of distinction, referred to as a dedicated processor). Optionally, the at least one processor may include both a dedicated processor and a general-purpose processor.

[0191] Optionally, in the case where the reminder device 50 includes at least one memory 503 , if the processor 501 implements the aforementioned reminder method by calling a computer program, the computer program may be stored in the memory 503 .

[0192] The embodiment of the present application further provides a chip, which includes a logic circuit and a communication interface. The communication interface is used to receive a signal or send a signal. The logic circuit is used to receive a signal or send a signal through the communication interface. The chip is used to implement the aforementioned reminder method, for example Figure 1 The reminder method shown and its possible implementation.

[0193] The embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores instructions, and when the instructions are executed on at least one processor (or reminder device), the aforementioned reminder method is implemented, for example Figure 1 The reminder method and possible implementation methods shown in the embodiments are shown in the embodiments.

[0194] The embodiment of the present application further provides a computer program product, which includes computer instructions, and the computer instructions are used to implement the aforementioned reminder method, for example Figure 1 The reminder method shown and its possible implementation.

[0195] An embodiment of the present application further provides a vehicle, which includes a reminder device 40 or a reminder device 50.

[0196] It should be understood that the aforementioned vehicles are vehicles in a broad sense, and may include transportation vehicles (such as commercial vehicles, passenger cars, motorcycles, flying cars, trains, etc.), industrial vehicles (such as forklifts, trailers, tractors, etc.), engineering vehicles (such as excavators, bulldozers, cranes, etc.), agricultural equipment (such as mowers, harvesters, etc.), etc. For example, robots may include intelligent transport robots (automated guided vehicles, AGVs), walking conversational robots, service robots, and other robots.

[0197] It should be noted that in the embodiments of this application, words such as "exemplarily" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design described in this application as "exemplary" or "for example" should not be construed as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplarily" or "for example" is intended to present the relevant concepts in a concrete manner.

[0198] It should be noted that in the embodiments of this application, words such as "exemplarily" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design described in this application as "exemplary" or "for example" should not be construed as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplarily" or "for example" is intended to present the relevant concepts in a concrete manner.

[0199] In the embodiments of the present application, the names of information and devices are exemplarily named to facilitate understanding of the content of the present solution. In specific implementations, the names may have other designs. In addition, the names of the same thing may also have different designs in different scenarios.

Claims

1. A reminder method, characterized in that: The reminder method includes: Acquire a state of the vehicle and an operation to be performed, wherein the operation to be performed includes an operation in response to the state; Output the status information and the information for confirming the execution of the operation to be executed.

2. The reminder method according to claim 1, characterized in that: The output of the status information and the information for confirming the execution of the pending operation includes: The state and a first control are controlled to be displayed, where the first control is used to confirm execution of the operation to be executed.

3. The reminder method according to claim 1, characterized in that: The output of the status information and the information for confirming the execution of the pending operation includes: Controlling output of a voice, the voice including information about the state and information for confirming execution of the to-be-performed operation.

4. The method according to any one of claims 1 to 3, characterized in that The state includes a fault, and the to-be-performed operation includes an operation for handling the fault.

5. The method according to claim 4, characterized in that The operation to be performed is based on a safety determination of the vehicle.

6. The method according to claim 4 or 5, characterized in that The obtaining of the pending operations of the vehicle includes: Obtain at least one candidate operation, where the candidate operation is an operation for processing the fault; The operation to be executed is obtained based on an operation in a white list among the at least one candidate operation, where the operations in the white list are determined based on safety of the vehicle.

7. The method according to claim 6, characterized in that The at least one candidate operation is obtained based on a network model and input data of the network model, where the input data includes one of the following: the fault, and detection information, where the detection information includes information obtained by detecting the vehicle.

8. The method according to claim 7, characterized in that The obtaining of at least one candidate operation includes: Obtaining a first text generated by the network model based on the input data, where the first text includes description information of an operation for handling the fault; Based on the first text, the at least one candidate operation is determined.

9. The method according to any one of claims 4 to 8, characterized in that The reminder method further includes: Control and display a second control, where the second control is used to confirm and display any one or more of the following: a process for executing the operation to be executed, and a cause of the fault.

10. The method according to claim 9, characterized in that The process of executing the operation to be executed is a second text obtained based on a network model and input data of the network model, the second text includes descriptive information of the process of executing the operation to be executed, and the input data includes one of the following: the fault, detection information, and the detection information includes information obtained by detecting the vehicle.

11. The method according to claim 9, characterized in that The cause of the fault is a third text obtained based on the network model and the input data of the network model, and the third text includes descriptive information of the cause of the fault. The input data includes one of the following: the fault, detection information, and the detection information includes information obtained by detecting the vehicle.

12. The method according to any one of claims 4 to 11, characterized in that The fault includes a high temperature of a tire of the vehicle, and the operation to be performed includes turning off an air conditioner of the vehicle.

13. The method according to any one of claims 4 to 12, characterized in that The fault comprises a faulty component in the vehicle, the method further comprising: A model of the vehicle is controlled to be displayed, and the faulty component in the model is displayed in a preset manner, wherein the preset manner indicates that a fault exists.

14. The method according to any one of claims 1 to 3, characterized in that The state includes energy consumption, the to-be-performed operation includes an energy-saving operation, and the energy-saving operation includes: turning off the air conditioner of the vehicle, reducing the change in the speed of the vehicle, and closing the windows of the vehicle when the air conditioner of the vehicle is turned on.

15. The method according to any one of claims 1 to 14, characterized in that The operations to be performed include operations determined based on historical vehicle usage data of the vehicle.

16. The method according to any one of claims 1 to 15, characterized in that The reminder method further includes: receiving an instruction for confirming execution of the pending operation; Based on the instruction, control is performed to execute the operation to be performed.

17. A reminder device, characterized in that: The reminder device includes: a unit for executing the method according to any one of claims 1 to 16.

18. A reminder device, characterized in that: The reminder device includes a processor and a memory, The memory is used to provide a storage space, and the storage space is used to store computer instructions. The processor is configured to call the computer instructions stored in the memory to execute the method according to any one of claims 1 to 16.

19. A vehicle, characterized in that: The vehicle comprises the reminder device according to claim 17 or 18.

20. A computer-readable storage medium, characterized in that The computer-readable storage medium is used to store a computer program. When the computer program is executed, the method according to any one of claims 1 to 16 is performed.

21. A computer program product, characterized in that The computer program product comprises computer language code or computer instructions; When the computer program product is executed by a processor, the method according to any one of claims 1 to 17 is performed.

Images