Key function prompting method and device and vehicle
The method and device address the complexity of vehicle button operations by identifying abnormal triggers and providing prompt information to educate users, improving user experience and reducing errors.
Patent Information
- Application Number
- CN202411347489.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-26
- Publication Date
- 2024-12-06
AI Technical Summary
The increasing complexity of vehicle button functions complicates their operation, leading to frequent abnormal button triggering due to driver unfamiliarity, resulting in a poor user experience.
A method and device that analyze operation information before and after a button trigger to identify abnormal operations, such as long press, repeated press, continuous press, or hesitant press, and provide prompt information to educate the user on the correct button function or location.
Effectively identifies and corrects abnormal button operations, enhancing user understanding and reducing operational errors by providing targeted prompts based on operation type and user familiarity.
Smart Images

Figure CN119078502A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of vehicles, and more specifically, to a key function prompt method, device and vehicle in the field of vehicles. Background Art
[0002] With the application of Internet of Things technology in vehicles, vehicle functions are becoming more and more abundant. However, with the diversification of button functions in vehicles, the operation of the buttons is becoming more and more complicated.
[0003] In the related art, the driver needs to read the manual to master the functions of the buttons in the vehicle. However, as the number of buttons in the vehicle increases, the difficulty for the driver to learn the functions of the buttons in the vehicle increases significantly. When the driver is not familiar with the buttons in the vehicle, the driver often performs the triggering operation on the buttons in the vehicle according to his memory, so it is easy to trigger the buttons in the vehicle by abnormal operation, which brings a bad experience to the driver. Summary of the invention
[0004] The present application provides a button function prompt method, device and vehicle. The method can trigger prompt information corresponding to the abnormal operation after the target object abnormally operates a button in the vehicle, so as to prompt the target object the function of the button.
[0005] In a first aspect, a key function prompt method is provided, the method comprising:
[0006] In response to a trigger operation on a button in the vehicle, obtaining operation information before and after the trigger operation is performed;
[0007] Based on the operation information, determine the operation type of the trigger operation, where the operation type is used to describe the operation behavior mode corresponding to the trigger operation;
[0008] When the operation type is an abnormal operation, the prompt information corresponding to the operation type is triggered. The prompt information is used to prompt the function of the button or the position of the target button. The target button is the button that the target object is looking for, and the target object is the execution object of the trigger operation.
[0009] Through the above scheme, in response to the trigger operation of the button in the vehicle, the operation information before and after the trigger operation is obtained. If the target object does not understand the function of the button in the vehicle, the operation information will be abnormal. Therefore, based on the operation information, the operation type of the trigger operation can be determined. The operation type is used to describe the operation behavior mode corresponding to the trigger operation. In the case where the operation type belongs to an abnormal operation, the target object does not understand the function of the button in the vehicle. In order to enable the target object to master the function of the button in the vehicle, or to help the target object find the target button, the prompt information corresponding to the operation type is triggered. The prompt information is used to prompt the function of the button or the position of the target button. The target button is the button that the target object is looking for, and the target object is the execution object of the trigger operation. That is, even if the target object does not understand the function of the button in the vehicle, after the target object abnormally operates the button in the vehicle, the prompt information corresponding to the abnormal operation is triggered to prompt the target object of the function of the button.
[0010] In combination with the first aspect, in some possible implementations, when the operation information indicates that the duration of the trigger operation after the trigger operation is performed on the key is greater than or equal to the first preset duration, it is determined that the operation type of the trigger operation is a long press operation, and the long press operation is an abnormal operation;
[0011] When the operation information indicates that the number of consecutive triggering of the key after the triggering operation is performed on the key is greater than or equal to the first preset number, determining that the operation type of the triggering operation is a repeated pressing operation, and the repeated pressing operation is an abnormal operation;
[0012] When the operation information indicates that the number of consecutive triggering of other keys after the triggering operation is performed on the key is greater than or equal to the second preset number, determining that the operation type of the triggering operation is a continuous pressing operation, and the continuous pressing operation is an abnormal operation;
[0013] When the operation information indicates that the gesture before the trigger operation is performed on the key is a preset gesture type, it is determined that the operation type of the trigger operation is a hesitant press operation, and the hesitant press operation is an abnormal operation.
[0014] In combination with the first aspect, in some possible implementations, when the operation information indicates that the gesture before the trigger operation is performed on the key is a preset gesture type, determining the length of time that the finger used to complete the gesture stays around the key;
[0015] When the duration of the finger staying around the key is greater than or equal to the second preset duration, it is determined that the operation type of the triggering operation is a hesitant pressing operation.
[0016] In combination with the first aspect, in some possible implementations, multiple operation images of a trigger operation before the operation information indicates that a trigger operation is performed on a key are processed to obtain a trigger area corresponding to the trigger operation performed on the key;
[0017] Recognize multiple operation images within the trigger area to obtain the gesture before the trigger operation is performed on the key;
[0018] Determine whether the gesture is a preset gesture type;
[0019] When the gesture is of a preset gesture type, the duration of the finger's stay around the key is determined based on an image sequence of a plurality of operation images.
[0020] In combination with the first aspect, in some possible implementations, when the gesture is a tap gesture, determining a confidence level corresponding to the tap gesture, the tap gesture being a gesture of a touch without pressing a key;
[0021] When the confidence level corresponding to the tap gesture is greater than the confidence level threshold, the gesture is determined to be a preset gesture type.
[0022] In combination with the first aspect, in some possible implementations, when the operation type is an abnormal operation, obtaining a driving parameter of the vehicle;
[0023] determining an operating state of the vehicle based on a driving parameter of the vehicle;
[0024] Based on the running state of the vehicle, determining whether to trigger prompt information corresponding to the operation type;
[0025] When the vehicle is in the parking state, a prompt message corresponding to the operation type is triggered.
[0026] In combination with the first aspect, in some possible implementations, when the operation type is an abnormal operation, the urgency of the prompt information corresponding to the operation type is determined based on the operation type, and the urgency is used to describe the time required for the target object to find the target key;
[0027] Based on the urgency of the prompt information corresponding to the operation type, the prompt information corresponding to the operation type is triggered, and different prompt information triggering methods correspond to different urgency levels.
[0028] In combination with the first aspect, in some possible implementations, when the operation type is a hesitant press operation and the urgency of the prompt information corresponding to the hesitant press operation is a first degree, a prompt animation corresponding to the key is displayed;
[0029] When the operation type is a continuous pressing operation and the urgency of the prompt information corresponding to the continuous pressing operation is a second degree, the prompt audio corresponding to the key is broadcasted and the prompt text corresponding to the key is displayed, and the second degree of urgency is less than the first degree;
[0030] When the operation type is a repeated pressing operation and the urgency of the prompt information corresponding to the repeated pressing operation is the third degree, the prompt audio corresponding to the key is broadcasted, and the urgency of the third degree is less than the second degree;
[0031] When the operation type is a long press operation and the urgency of the prompt information corresponding to the long press operation is the fourth degree, the prompt text corresponding to the key is displayed, and the fourth degree of urgency is lower than the third degree.
[0032] In combination with the first aspect, in some possible implementations, an object feature of a target object is obtained, where the target object is an execution object of a trigger operation on a button in a vehicle, and the object feature is used to describe basic information of the target object;
[0033] Determining an object type of the target object based on an object feature of the target object, where the object type is used to describe the target object's familiarity with a button in a vehicle to perform a trigger operation;
[0034] Based on the object type of the target object, prompt information corresponding to the operation type is triggered. The prompt information is used to prompt the function of the button or the position of the target button. The target button is the button that the target object is looking for.
[0035] In combination with the first aspect, in some possible implementations, based on the object characteristics of the target object, it is determined whether the target object performs a historical triggering operation on a button in the vehicle;
[0036] In the case where the target object performs a historical trigger operation on a button in the vehicle, determining that the object type of the target object is an old target object;
[0037] In the case where the target object performs a new triggering operation on a button in the vehicle, it is determined that the object type of the target object is a new target object.
[0038] In combination with the first aspect, in some possible implementations, when the object type of the target object is a new target object, prompt information corresponding to the operation type is triggered within a third preset time period;
[0039] In a case where the object type of the target object is an old target object, prompt information corresponding to the operation type is triggered within a fourth preset time period, and the fourth preset time period is greater than the third preset time period.
[0040] In a second aspect, a prompting device for a key function prompting method is provided, the device comprising:
[0041] An acquisition module, for acquiring operation information before and after the trigger operation is performed in response to a trigger operation on a button in the vehicle;
[0042] A determination module, used to determine the operation type of the triggering operation based on the operation information, where the operation type is used to describe the operation behavior mode corresponding to the triggering operation;
[0043] The trigger module is used to trigger the prompt information corresponding to the operation type when the operation type is an abnormal operation. The prompt information is used to prompt the function of the button or the position of the target button. The target button is the button that the target object is looking for, and the target object is the execution object of the trigger operation.
[0044] In a third aspect, a vehicle is provided, comprising a memory and a processor. The memory is used to store executable program code, and the processor is used to call and run the executable program code from the memory, so that the vehicle executes the method executed by the key function prompt method.
[0045] In a fourth aspect, a computer program product is provided, which includes: a computer program code, which, when executed on a computer, enables the computer to execute the method executed by the above-mentioned key function prompt method.
[0046] In a fifth aspect, a computer-readable storage medium is provided, which stores a computer program code. When the computer program code runs on a computer, the computer executes the method executed by the above-mentioned key function prompt method. BRIEF DESCRIPTION OF THE DRAWINGS
[0047] Figure 1 It is a schematic diagram of an implementation environment of a key function prompt method provided in an embodiment of the present application;
[0048] Figure 2 is a schematic flow chart of a key function prompt method provided in an embodiment of the present application;
[0049] Figure 3 is a schematic flow chart of another key function prompt method provided in an embodiment of the present application;
[0050] Figure 4 It is a schematic flow chart of a method for prompting key functions based on a target object portrait provided in an embodiment of the present application;
[0051] Figure 5 It is a structural schematic diagram of a key function prompt method device provided in an embodiment of the present application;
[0052] Figure 6 It is a structural schematic diagram of a key function prompt device based on a target object provided in an embodiment of the present application;
[0053] Figure 7 It is a structural schematic diagram of a vehicle provided in an embodiment of the present application. DETAILED DESCRIPTION
[0054] The technical solution in the present application will be described clearly and in detail below in conjunction with the accompanying drawings. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B: "and / or" in the text is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.
[0055] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as suggesting or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features.
[0056] A vehicle generally includes a plurality of buttons, which are used to control various functions of the vehicle. For example, the air conditioning button is used to control the air conditioning of the vehicle; the speaker button is used to control the music playing and shutting down of the vehicle; and the navigation button is used to control the navigation system of the vehicle to turn on and off. However, with the continuous increase of various functions in the vehicle, the number of buttons has increased sharply, which makes it easy for users to press the wrong buttons or not understand the functions of the buttons in the vehicle.
[0057] Figure 1 It is a schematic diagram of an implementation environment of a key function prompt method provided in an embodiment of the present application.
[0058] For example, Figure 1 As shown, the implementation environment includes a vehicle device 101 and a speaker 102 .
[0059] The vehicle machine device 101 is used to process data during vehicle driving. In some embodiments, the vehicle machine device 101 controls the image sensor to collect images around the buttons in the vehicle. The vehicle machine device 101 processes the collected images around the buttons in the vehicle.
[0060] The speaker 102 is used to play prompt information. In some embodiments, the vehicle device 101 controls the speaker 102 to play prompt information related to the function of the button in the vehicle.
[0061] Figure 2 It is a schematic flowchart of a key function prompt method provided in an embodiment of the present application.
[0062] For example, Figure 2 As shown, taking the execution subject as a vehicle-mounted device as an example, a key function reminder method of the present application is described, and the method 200 includes the following steps.
[0063] Step 201, in response to a trigger operation on a button in a vehicle, obtain operation information before and after the trigger operation is performed.
[0064] Among them, the buttons in the vehicle are used to control various functions of the vehicle. In some embodiments, the buttons in the vehicle include physical buttons and virtual buttons.
[0065] The trigger operation is an operation that triggers the button to control various functions of the vehicle. The operation information includes operation information before the trigger operation is performed and operation information after the trigger operation is performed. For example, after the trigger operation of the button in the vehicle, an electrical signal indicating that the button is pressed is obtained. For another example, before the trigger operation of the button in the vehicle, an image of the cabin before the button in the vehicle is pressed is obtained.
[0066] Step 202: Determine the operation type of the triggering operation based on the operation information. The operation type is used to describe the operation behavior mode corresponding to the triggering operation.
[0067] The trigger operation types include long press operation, repeated press operation, continuous press operation, hesitant press operation and normal operation.
[0068] It should be understood that the target objects have different levels of mastery of the functions of the buttons in the vehicle, so the triggering operations on the buttons in the vehicle are also different, and the operation behavior patterns corresponding to the triggering operations are also different. In order to understand the target object's mastery of the buttons in the vehicle, the operation type of the triggering operation is determined based on the operation information.
[0069] Step 203, when the operation type is an abnormal operation, prompt information corresponding to the operation type is triggered, and the prompt information is used to prompt the function of the button or the position of the target button. The target button is the button that the target object is looking for, and the target object is the execution object of the trigger operation.
[0070] It should be understood that when the target object does not understand the function of a button in the vehicle, the target object usually triggers the operation of the button based on his or her own memory, which often leads to operational errors. Therefore, the operation type of the operational error is determined as an abnormal operation, thereby triggering a prompt message corresponding to the operation type, prompting the target object the function of the button.
[0071] Among them, long press operation, repeated press operation, continuous press operation and hesitant press operation are all abnormal operations.
[0072] It should be understood that when the operation type is an abnormal operation, it is determined that the key is not the key the target object is looking for. In order to obtain the location of the target key, the prompt information corresponding to the operation type is triggered to prompt the target object the location of the target key.
[0073] The embodiment of the present application provides a button function prompt method, which responds to the trigger operation of the button in the vehicle, obtains the operation information before and after the trigger operation is executed, and if the target object does not understand the function of the button in the vehicle, the operation information will be abnormal, so based on the operation information, the operation type of the trigger operation can be determined, and the operation type is used to describe the operation behavior mode corresponding to the trigger operation. In the case where the operation type belongs to an abnormal operation, the target object does not understand the function of the button in the vehicle. In order to enable the target object to master the function of the button in the vehicle, or to help the target object find the target button, the prompt information corresponding to the operation type is triggered. The prompt information is used to prompt the function of the button or the location of the target button. The target button is the button that the target object is looking for, and the target object is the execution object of the trigger operation. That is, even if the target object does not understand the function of the button in the vehicle, after the target object abnormally operates the button in the vehicle, the prompt information corresponding to the abnormal operation is triggered to prompt the target object of the function of the button.
[0074] Figure 3 It is a schematic flow chart of another key function prompt method provided in an embodiment of the present application.
[0075] It should be noted that the above steps 201-203 are a simple description of a key function prompt method provided in an embodiment of the present application. The following will be combined with some examples to provide a more detailed description of a key function prompt method provided in an embodiment of the present application. Figure 3 Taking the execution subject as a vehicle-mounted device as an example, the method includes the following steps.
[0076] Step 301, in response to a trigger operation on a button in a vehicle, obtaining operation information before and after the trigger operation is performed.
[0077] Among them, the buttons in the vehicle include physical buttons and virtual buttons. For example, physical buttons are buttons installed on the vehicle interior panel and used to trigger various functions of the vehicle. For example, physical buttons are used to control multimedia audio call functions. For another example, virtual buttons are buttons displayed on the central control screen.
[0078] It should be understood that in response to the trigger operation on the button in the vehicle, an electrical signal will be generated after the trigger operation is performed on the button in the vehicle. In order to obtain the operation information of the trigger operation, the electrical signal after the trigger operation is performed is obtained.
[0079] In a possible implementation, operation information after the trigger operation is executed is acquired based on the electrical signal.
[0080] In some embodiments, an electrical signal is acquired after a trigger operation is performed.
[0081] It should be understood that for a physical button, in response to a triggering operation on the physical button, the contacts inside the physical button close to form a conductive path, thereby generating an electrical signal, and the vehicle-mounted device receives the electrical signal generated by the physical button.
[0082] It should also be understood that for virtual keys, in response to the triggering operation of the virtual keys, the central control screen detects the touch position and converts the touch position into an electrical signal and sends it to the vehicle device. Therefore, the vehicle device obtains the operation information after the triggering operation based on the electrical signal.
[0083] The operation information includes the operation information before the key is pressed and the operation information after the key is pressed.
[0084] Among them, the operation information before the key is pressed includes the operation image of the target object before the key is pressed; the operation information after the key is pressed includes the first time the key is pressed, the second time the key is released, and the number of triggering operations, etc.
[0085] It should be understood that before the button is pressed, the target object's finger will stay around the button. If the target object is familiar with the function of the button in the vehicle, the target object's finger will stay around the button for a short time. If the target object is not familiar with the function of the button in the vehicle, the target object's finger will stay around the button for a long time. Therefore, in order to determine whether the target object is familiar with the button, it is necessary to obtain the target object's operation image before the button is pressed.
[0086] In some embodiments, operation information before the triggering operation is performed is acquired through an image sensor.
[0087] The image sensor is used to detect the situation inside the cabin, for example, whether the driver's operation behavior complies with traffic regulations, the status of passengers, and object recognition inside the cabin.
[0088] In some embodiments, the vehicle-mounted device obtains an operation image of a button being pressed inside the vehicle cabin from an image sensor.
[0089] The operation image is used to describe the operation image of the target object's hand around the key before the target object performs a trigger operation on the key.
[0090] In this implementation, the operation information after the trigger operation is performed is obtained through the image sensor to determine whether the target object understands the function of the button in the vehicle. That is, when the target object is not familiar with the button in the vehicle, the target object is usually hesitant when performing the trigger operation on the button, that is, the target object's hand will stay around the button in the vehicle and then press the button in the vehicle. Therefore, in order to determine whether the target object is hesitant about the button in the vehicle, it is necessary to obtain the operation image before the button in the vehicle is pressed.
[0091] It should also be understood that after the button is pressed, if the target object is familiar with the function of the button in the vehicle, the button is pressed for a shorter duration and the button is triggered less frequently; if the target object is not familiar with the function of the button in the vehicle, the button is pressed for a longer duration or the button is triggered more frequently. Therefore, the duration of the button being pressed and the number of times the button is triggered are determined based on the operation information after the button is pressed, thereby judging whether the target object is familiar with the function of the button in the vehicle.
[0092] In some embodiments, the duration of a key being pressed is determined based on a first time when the key is pressed and a second time when the key is released.
[0093] The time difference between a first time when the key is pressed and a second time when the key is released is the duration of the key being pressed.
[0094] It should be understood that after a key is pressed, an electrical signal is generated, and the first time when the electrical signal is generated when the key is pressed and the second time when the level changes when the key is released are recorded. If the target object is familiar with the function of the key in the vehicle, the duration of the key being pressed is shorter. If the target object is familiar with the function of the key in the vehicle, the duration of the key being pressed is longer.
[0095] In some embodiments, the triggering times of the triggering operation are determined based on the electrical signal generated after the key is pressed and the level change after the key is released.
[0096] Among them, the time from when the key is pressed to when the key is released is determined as one trigger operation.
[0097] In this implementation, in response to a trigger operation on a button in the vehicle, the accuracy of the operation information after the trigger operation is obtained based on the electrical signal.
[0098] Step 302: Determine the operation type of the triggering operation based on the operation information. The operation type is used to describe the operation behavior mode corresponding to the triggering operation.
[0099] The operation types include abnormal operation and normal operation.
[0100] It should be understood that if the target object is familiar with the function of the button in the vehicle, the triggering operation of the button by the target object is a normal operation. If the target object is not familiar with the function of the button in the vehicle, the target object will perform the triggering operation on the button according to his or her memory, which may result in incorrect button operation. Therefore, if the target object is not familiar with the function of the button in the vehicle, the triggering operation of the button is an abnormal operation.
[0101] The following explains that the operation type of the trigger operation is an abnormal operation.
[0102] Among them, abnormal operations include long press operation, repeated press operation, continuous press operation, and hesitant press operation.
[0103] In a possible implementation, when the operation information indicates that the duration of the trigger operation after the trigger operation is performed on the key is greater than or equal to the first preset duration, the operation type of the trigger operation is determined to be a long press operation, and the long press operation is an abnormal operation.
[0104] The duration of the trigger operation is the duration difference between a first time when the key is pressed and a second time when the key is released.
[0105] For example, if a key is pressed at 21 minutes and 12 seconds and is released at 21 minutes and 15 seconds, the duration of the trigger operation after the trigger operation is performed on the key is 3 seconds.
[0106] The first preset duration is a duration automatically determined by the vehicle equipment, or is set by a technician according to actual conditions, and the present application embodiment does not limit this. For example, the first preset duration may be 2 seconds.
[0107] It should be understood that if the target object is not familiar with the buttons in the vehicle, the target object usually does not understand the functions of each button in the vehicle. If the target object cannot activate the required function, the target object will try to trigger each button in the vehicle, such as long press operation, to trigger the function required by the target object, so the long press operation is an abnormal operation.
[0108] For example, if the target object wants to turn on the air conditioner, the target object will press the air conditioner button in his memory. When the air conditioner button is pressed and the air conditioner is not turned on, the target object will try to long press the button to trigger the air conditioner function.
[0109] It should be understood that in the case of performing a long press operation on a button in the vehicle, it is determined that the target object is not familiar with the button in the vehicle, and thus the long press operation is determined to be an abnormal operation.
[0110] In some embodiments, whether the trigger operation is an abnormal operation is determined based on the duration of the trigger operation.
[0111] For example, when the duration of the trigger operation on a button in the vehicle is 3 seconds, it is determined that the operation type of the trigger operation is a long press operation, and the long press operation is an abnormal operation.
[0112] In this implementation, when the operation information indicates that the duration of the trigger operation after the trigger operation is performed on the button is greater than or equal to the first preset duration, the operation type of the trigger operation is determined to be a long press operation, and the long press operation is an abnormal operation. That is, when the operation type of the trigger operation is a long press operation, the target object does not understand the function of the button in the vehicle, and therefore the long press operation is determined to be an abnormal operation.
[0113] In a possible implementation, when the operation information indicates that the number of consecutive triggering of a key after the triggering operation is performed on the key is greater than or equal to a first preset number, the operation type of the triggering operation is determined to be a repeated pressing operation, and the repeated pressing operation is an abnormal operation.
[0114] The first preset number of times is the number of times automatically determined by the vehicle equipment, or is set by the technician according to the actual situation, and the embodiment of the present application does not limit this. For example, the first preset number of times can be 3 times.
[0115] The number of consecutive triggering times is the number of times the same key is repeatedly triggered within the fifth preset time length.
[0116] The fifth preset time length is a time length automatically determined by the vehicle equipment, or is set by a technician according to actual conditions, and the present application embodiment does not limit this. For example, the fifth preset time length may be 3 seconds.
[0117] It should be understood that when the target object is not familiar with the functions of the buttons in the vehicle, the target object may press the same button multiple times to determine the function of the button. Therefore, the operation type of the trigger operation with a continuous trigger number greater than or equal to the first preset number of times is determined as a repeated press operation.
[0118] In some embodiments, within a fifth preset time period, it is determined that the operation information indicates the number of consecutive triggering operations on the key after the triggering operation is performed on the key.
[0119] The process from when the key is pressed to when the key is released is determined as one trigger.
[0120] It should be understood that since an electrical signal is generated when a key is pressed and the level changes when the key is released, the number of times the key is triggered is determined based on the electrical signal generated when the key is pressed and the level change when the key is released.
[0121] In some embodiments, within a fifth preset time period, if the number of consecutive triggering of a key after the operation instruction performs a triggering operation on the key is greater than or equal to a first preset number, the operation type of the triggering operation is determined to be a repeated pressing operation.
[0122] For example, if the fifth preset time length is 3 seconds, the first preset number of times is 3 times, and the number of consecutive triggering of the key is 4 times, then it is determined that the operation type of the triggering operation is a repeated pressing operation.
[0123] It should be understood that in the case of performing a repeated pressing operation on a button in the vehicle, it is determined that the target object is not familiar with the button in the vehicle, and thus the repeated pressing operation is determined to be an abnormal operation.
[0124] In this implementation, when the operation information indicates that the number of consecutive triggering of the key after the triggering operation is performed on the key is greater than or equal to the first preset number, the operation type of the triggering operation is determined to be a repeated pressing operation, and the repeated pressing operation is an abnormal operation. That is, when the operation type of the triggering operation is a repeated pressing operation, the target object does not understand the function of the key in the vehicle, and therefore the repeated pressing operation is determined to be an abnormal operation.
[0125] In a possible implementation, when the operation information indicates that the number of consecutive triggering of other keys after the triggering operation is performed on a key is greater than or equal to a second preset number, the operation type of the triggering operation is determined to be a continuous pressing operation, and the continuous pressing operation is an abnormal operation.
[0126] It should be understood that if the target object is not familiar with the buttons in the vehicle, the target object will look for the buttons he needs. However, if the target object does not understand the functions of each button, the target object may press the buttons one by one to trigger the functions of each button and find the buttons he needs. Therefore, if the operation type of the triggering operation is a continuous pressing operation, it is determined that the continuous pressing operation is an abnormal operation.
[0127] The second preset number of times is the number of times automatically determined by the vehicle equipment, or is set by the technician according to the actual situation, and the embodiment of the present application does not limit this. For example, the second preset number of times can be 2 times.
[0128] In some embodiments, after a trigger operation is performed on a key, the number of times other keys are triggered is obtained.
[0129] In some embodiments, when the number of times other keys are triggered is greater than or equal to a second preset number, the operation type of the trigger operation is determined to be a continuous pressing operation.
[0130] For example, after a trigger operation is performed on a key, it is determined that the number of trigger times on other keys is 2, and the operation type of the trigger operation is determined to be a continuous pressing operation.
[0131] In some embodiments, after performing a trigger operation on a key, if it is determined that there are multiple trigger operations in the vehicle, the number of other keys for performing the trigger operation is determined.
[0132] For example, after a trigger operation is performed on a button, it is determined that there are multiple trigger operations in the vehicle, and the number of other buttons performing the trigger operation is 2.
[0133] In some embodiments, when the number of keys executing the trigger operation is greater than or equal to the preset number of keys, the operation type of the trigger operation is determined to be a continuous pressing operation.
[0134] For example, when there are two keys performing a trigger operation, the operation type of the trigger operation is determined to be a continuous pressing operation.
[0135] It should be understood that in the case of a continuous pressing operation on a button in a vehicle, it is determined that the target object is not familiar with the button in the vehicle, and thus the continuous pressing operation is determined to be an abnormal operation.
[0136] In this implementation, when the operation information indicates that the number of consecutive triggering of other keys after the triggering operation is performed on the key is greater than or equal to the second preset number, the operation type of the triggering operation is determined to be a continuous pressing operation, and the continuous pressing operation is an abnormal operation. That is, when the operation type of the triggering operation is a continuous pressing operation, the target object does not understand the function of the key in the vehicle, and therefore the continuous pressing operation is determined to be an abnormal operation.
[0137] In a possible implementation, when the operation information indicates that the gesture before the trigger operation is performed on the key is a preset gesture type, it is determined that the operation type of the trigger operation is a hesitant press operation, and the hesitant press operation is an abnormal operation.
[0138] It should be understood that, in the case where the target object is not familiar with the buttons in the vehicle, the target object is hesitant to perform a triggering operation on the button to determine whether the button is the button he is looking for.
[0139] In some embodiments, the operation information is processed to indicate multiple operation images of a trigger operation before a trigger operation is performed on a key, and a trigger area corresponding to the trigger operation performed on the key is obtained; within the range of the trigger area, multiple operation images are identified to obtain a gesture before the key performs the trigger operation.
[0140] The operation information is information generated by performing a trigger operation on a button in the vehicle. The operation image includes a gesture for performing a trigger operation on a button in the vehicle. The gesture is a gesture before performing a trigger operation on a button in the vehicle.
[0141] In some embodiments, multiple operation images are input into a convolutional neural network model, and the multiple operation images are processed by the convolutional neural network model.
[0142] The multiple operation images are continuous images of triggering operations performed on buttons in the vehicle.
[0143] It should be understood that since different operation images have different image parameters, inputting operation images with different image parameters into the convolutional neural network model cannot obtain the correct gesture. Therefore, in order to improve the accuracy of the gesture, each operation image is preprocessed.
[0144] In some embodiments, noise in each operation image is removed based on Gaussian filtering to enhance each operation image, and each pixel in each operation image is weighted averaged to achieve the purpose of noise reduction.
[0145] In some embodiments, feature extraction is performed on the preprocessed operation image to obtain a trigger area corresponding to the trigger operation performed on the key.
[0146] The trigger region is a region of interest (ROI) in the operation image for identifying a trigger operation performed on a key.
[0147] In some embodiments, multiple operation images are automatically detected within the trigger area, and key points of fingers in the multiple operation images are extracted, for example, fingertips.
[0148] In some embodiments, the border of the trigger area is determined according to the position of the key point of the finger. Within the range of the trigger area, the background is subtracted from the multiple operation images based on background subtraction to retain the foreground finger.
[0149] In some embodiments, collective features of fingers and position information of key points of fingers are extracted from the processed multiple operation images, and high-level features of fingers are extracted based on convolutional neural networks to identify the gesture before performing the trigger operation on the key.
[0150] It should be understood that if the target object is not familiar with the buttons in the vehicle, the target object will be hesitant before performing the trigger operation on the button. For example, the gesture is to touch the button lightly and the button is not pressed. If the target object is familiar with the functions of the buttons in the vehicle, the target object's finger is quickly lifted before performing the trigger operation on the button. For example, the target object's finger is quickly lifted and the button is pressed, which means that the target object is relatively familiar with the functions of the buttons in the vehicle.
[0151] In some embodiments, the extracted features are classified by a machine learning model to obtain the gesture category of the gesture. For example, the machine language model is a random forest model, a neural network model, or a support vector machine (SVM) model.
[0152] In some embodiments, it is determined whether the gesture is a preset gesture type. If the gesture is a preset gesture type, the length of time the target object's finger stays around the key is determined based on an image sequence of multiple operation images.
[0153] The preset gesture types include a tap gesture or a hover gesture. A tap gesture is a gesture in which the finger touches a key without pressing the key. A hover gesture is a gesture in which the finger hovers around a key without pressing the key.
[0154] In some embodiments, when the gesture is a tap gesture, a confidence level corresponding to the tap gesture is determined, and when the confidence level corresponding to the tap gesture is greater than a confidence level threshold, the gesture is determined to be a preset gesture type.
[0155] The confidence level is used to determine the accuracy of identifying the gesture. The confidence level threshold is a threshold automatically determined by the vehicle equipment, or is set by a technician according to actual conditions, and the present application embodiment does not limit this. For example, the confidence level threshold may be 0.6.
[0156] For example, when the confidence level corresponding to the light touch gesture is identified as 0.8, the gesture is determined to be a preset gesture type.
[0157] In some embodiments, when the operation information indicates that the gesture before the trigger operation is performed on a key is a preset gesture type, the length of time that the finger used to complete the gesture stays around the key is determined; when the length of time that the finger stays around the key is greater than or equal to a second preset length of time, the operation type of the trigger operation is determined to be a hesitant press operation.
[0158] The second preset time length is a time length automatically determined by the vehicle equipment, or is set by a technician according to actual conditions, and this embodiment of the present application does not limit this. For example, the second preset time length may be 2 seconds.
[0159] In some embodiments, an image sequence of multiple operation images is used to determine changes in gesture features within the trigger area.
[0160] It should be understood that before the trigger operation is performed on the key, the gesture is a tap gesture, and after the trigger operation is performed on the key, the gesture is a press gesture. Therefore, based on the image sequence of the tap gesture and the image sequence of the press gesture, the length of time the finger stays around the key can be determined.
[0161] In some embodiments, when the operation information indicates that the gesture before performing a trigger operation on a key is a tap gesture, the length of time that the finger stays around the key is determined. When the length of time that the finger stays around the key is greater than or equal to a second preset length of time, the operation type of the trigger operation is determined to be a hesitant press operation.
[0162] For example, in the case of a light touch gesture, and the duration of the light touch finger staying around the key is 4 seconds, it is determined that the operation type of the trigger operation is a hesitant press operation.
[0163] In this implementation, when the operation information indicates that the gesture before the trigger operation is performed on the button is a preset gesture type, the operation type of the trigger operation is determined to be a hesitant press operation, and the hesitant press operation is an abnormal operation. That is, when the operation type of the trigger operation is a hesitant press operation, the target object does not understand the function of the button in the vehicle, and therefore the hesitant press operation is determined to be an abnormal operation.
[0164] The following describes the trigger operation type as a normal operation.
[0165] In a possible implementation, when the operation information indicates that the duration of the trigger operation after the trigger operation is performed on the key is less than a first preset duration, and the operation information indicates that the number of consecutive triggering of the key after the trigger operation is performed on the key is less than a first preset number, and the operation information indicates that the number of consecutive triggering of other keys after the trigger operation is performed on the key is less than a second preset number, and the operation information indicates that the gesture before the trigger operation is performed on the key is not a preset gesture type, the operation type of the trigger operation is determined to be a normal operation.
[0166] It should be understood that if the gesture performed by the target object before performing the trigger operation on the key is not a preset gesture type and the key is not continuously triggered or long pressed after the target object performs the trigger operation on the key, the target object is relatively familiar with the function of the key, and therefore the operation type of the trigger operation is determined to be a normal operation.
[0167] In some embodiments, when the operation type of the trigger operation is not a long press operation, a repeated press operation, a continuous press operation, or a hesitant press operation, the operation type of the trigger operation is determined to be a normal operation.
[0168] In some embodiments, when the operation type of the trigger operation is not a long press operation, the length of time that the finger stays around the key is determined. When the length of time that the finger stays around is less than a second preset length of time, the operation type of the trigger operation is determined to be a normal operation.
[0169] In this implementation, when the duration of the trigger operation after the operation information performs the trigger operation on the key is less than the first preset duration, and the operation information indicates that the number of consecutive triggers on the key after the trigger operation is performed on the key is less than the first preset number, and the operation information indicates that the number of consecutive triggers on other keys after the trigger operation is performed on the key is less than the second preset number, and the operation information indicates that the gesture before the trigger operation is performed on the key is not a preset gesture type, the operation type of the trigger operation is determined to be a normal operation. That is, when the operation type of the trigger operation is a normal operation, the target object is familiar with the function of the key in the vehicle.
[0170] Step 303: When the operation type is an abnormal operation, determine whether to trigger prompt information corresponding to the operation type based on the running state of the vehicle.
[0171] It should be understood that when the operation type is an abnormal operation, if the vehicle is in driving state, triggering the prompt information corresponding to the operation type will affect driving safety. Therefore, whether to trigger the prompt information corresponding to the operation type is determined based on the vehicle's operating state.
[0172] In a possible implementation, when the operation type is an abnormal operation, the driving parameters of the vehicle are obtained, and the running state of the vehicle is determined based on the driving parameters of the vehicle. Based on the running state of the vehicle, it is determined whether to trigger the prompt information corresponding to the operation type.
[0173] The prompt information corresponding to the trigger operation type includes a prompt text, a prompt audio, and a prompt animation corresponding to the trigger operation type.
[0174] In some embodiments, when the operation type is an abnormal operation, the vehicle speed is acquired, and the running state of the vehicle is determined based on the vehicle speed.
[0175] In some embodiments, the vehicle speed is acquired through a power system.
[0176] In some embodiments, the vehicle speed is determined based on pulse signals generated by a plurality of wheel speed sensors and a tire radius.
[0177] It is understandable that the vehicle speed may also be obtained through other means, for example, directly obtaining the vehicle speed through a speed sensor or a navigation system. The embodiment of the present application does not limit the specific form of obtaining the vehicle speed.
[0178] In some embodiments, the vehicle speed is used to determine whether the vehicle is in a driving state or a parking state.
[0179] In some embodiments, the gear information of the vehicle is obtained through a gear sensor.
[0180] In some embodiments, when the gear information of the vehicle is a driving gear, the running state of the vehicle is determined to be a driving state. For example, the driving gear includes a forward gear and a reverse gear.
[0181] In some embodiments, when the operating state of the vehicle is the driving state, it is determined not to trigger the prompt information corresponding to the operation type, so as to avoid the prompt information interfering with the driver during the driving of the vehicle.
[0182] In some embodiments, when the running state of the vehicle is the parking state, prompt information corresponding to the trigger operation type is determined to prompt the target object with the function of a button in the vehicle.
[0183] The parking state is when the vehicle is stationary for a period of time.
[0184] In some embodiments, whether the running state of the vehicle is the parking state is determined based on the gear information of the vehicle, the braking state of the vehicle, and the speed of the vehicle.
[0185] In some embodiments, when the gear information of the vehicle is the parking gear, the handbrake of the vehicle is in the braking state, or the brake pedal of the vehicle is pressed and the vehicle speed is 0 kilometers per hour (KPH), the operating state of the vehicle is determined to be the parking state.
[0186] In this implementation, when the operation type is an abnormal operation, the vehicle's driving parameters are obtained, the vehicle's operating state is determined based on the vehicle's driving parameters, and whether to trigger the prompt information corresponding to the operation type is determined based on the vehicle's operating state. That is, the prompt information corresponding to the operation type is prevented from being triggered during the vehicle's driving, thereby avoiding interference of the prompt information on the driver and preventing driving safety from being affected by the prompt information.
[0187] Step 304, when the vehicle is in parking state, prompt information corresponding to the trigger operation type is used to prompt the function of the button or the position of the target button. The target button is the button that the target object is looking for, and the target object is the execution object of the trigger operation.
[0188] It should be understood that in order to avoid the prompt information interfering with the vehicle's driving, when the vehicle's operating state is the parking state, the prompt information corresponding to the operation type is triggered.
[0189] In some embodiments, when the gear information of the vehicle is the parking gear, the handbrake of the vehicle is in the braking state and the vehicle speed is 0KPH, it is determined that the operating state of the vehicle is the parking state.
[0190] In some embodiments, prompt information corresponding to the operation type is displayed on the vehicle's dashboard or on-board screen.
[0191] In some embodiments, the prompt audio is broadcast in the vehicle's onboard audio system.
[0192] For example, when the vehicle is in parking state and the trigger operation is a hesitant press operation, the prompt text or prompt audio may be "This button is an air conditioning button, which is used to control the air conditioning switch or adjust the air conditioning wind speed."
[0193] In some embodiments, the prompt text, prompt audio, and prompt animation corresponding to the trigger operation type are stored in a prompt storage medium. For example, the prompt storage medium includes a USB disk, a mobile hard disk, a magnetic disk, or an optical disk.
[0194] In this implementation, the prompt text, prompt audio and prompt animation corresponding to the trigger operation type are stored in the prompt storage medium, so that the vehicle device can read the prompt text and prompt audio.
[0195] In a possible implementation, when the operation type is an abnormal operation, the urgency of the prompt information corresponding to the operation type is determined based on the operation type, and the urgency is used to describe the time required for the target object to find the target button; based on the urgency of the prompt information corresponding to the operation type, the prompt information corresponding to the operation type is triggered, and different triggering methods of prompt information correspond to different urgency levels.
[0196] In some embodiments, when the operation type of the triggering operation is a hesitant pressing operation, the urgency level of the prompt information corresponding to the hesitant pressing operation is determined to be a first level.
[0197] In some embodiments, when the urgency level of the prompt information corresponding to the hesitant pressing operation is a first level, a prompt animation corresponding to the key is displayed.
[0198] The prompt animation is used to indicate the steps of performing a trigger operation on the key.
[0199] For example, when the trigger operation type is a hesitant press operation, it is determined that the target object has no idea about the function of the button. In order to make the target object understand the function of the button more quickly, a prompt animation corresponding to the button function is displayed on the vehicle device. The prompt animation is "The icon of the air conditioning button is a fan. Please press the air conditioning button on the central control screen to turn on the air conditioning."
[0200] It is understandable that before executing the trigger operation on the key, if it is determined that the trigger operation is a hesitant press operation, the prompt audio corresponding to the trigger operation type is actively triggered to enable the target object to find the location of the target key.
[0201] In some embodiments, when the operation type of the triggering operation is a hesitant pressing operation, a prompt audio corresponding to the triggering operation type is used to determine the key that the target object is looking for.
[0202] In some embodiments, a voice command of a target object is received based on a microphone, wherein the voice command of the target object is used to determine the position of the target key.
[0203] For example, if the target object hesitates to press the air-conditioning button, the prompt audio "How can I help you?" is triggered. If the vehicle equipment receives the target object's instruction "Where is the trunk button?", the vehicle equipment will trigger the prompt information "The button to open the trunk is at the lower left corner of the cockpit door." That is, when the operation type of the triggering operation is a hesitant pressing operation, the target object is actively triggered to ask whether to find the target button, so as to assist the target object in finding the location of the target button.
[0204] In some embodiments, when the operation type of the triggering operation is a continuous pressing operation, the urgency of the prompt information corresponding to the continuous pressing operation is determined to be a second degree, and the urgency of the second degree is less than the first degree.
[0205] The urgency of the continuous pressing operation at the second level is lower than the urgency of the hesitant pressing operation at the first level.
[0206] It should be understood that in the case of performing continuous pressing operations on multiple buttons, it means that the target object is not familiar with the multiple buttons on which the continuous pressing operations are performed in the vehicle. Therefore, the prompt audio corresponding to the multiple buttons is broadcast and the prompt text corresponding to the buttons is displayed to introduce the functions of the multiple buttons to the target object.
[0207] In some embodiments, when the urgency level of the prompt information corresponding to the continuous pressing operation is the second level, the prompt audio corresponding to the key is broadcast and the prompt text corresponding to the key is displayed.
[0208] In some embodiments, based on a speaker, a prompt audio corresponding to a key is actively triggered.
[0209] For example, when the urgency level of the prompt information corresponding to the continuous pressing operation is the second level, it is determined that the target object is unfamiliar with the functions of the multiple buttons. After the prompt text corresponding to the multiple buttons is displayed on the central control screen, the prompt information "How can I help you?" is triggered, thereby determining the button the target object is looking for, so as to announce the location of the target button to the target object.
[0210] In some implementations, when the operation type of the triggering operation is a repeated pressing operation, the urgency of the prompt information corresponding to the repeated pressing operation is determined to be a third degree, and the third degree of urgency is less than the second degree.
[0211] The urgency of the repeated pressing operation at the third level is lower than the urgency of the continuous pressing operation at the second level.
[0212] It should be understood that in the case of repeated pressing operations on a single button, it means that the target object is not familiar with the single button in the vehicle that is repeatedly pressed, so the prompt audio corresponding to the multiple buttons is broadcast to introduce the functions of the multiple buttons to the target object.
[0213] In some embodiments, when the urgency level of the prompt information corresponding to the repeated pressing operation is the third level, the prompt audio corresponding to the key is broadcast.
[0214] For example, when the air conditioner button is repeatedly pressed, it is determined that the target object is not familiar with the function of the air conditioner button, so the prompt audio corresponding to the button is broadcasted, "Air conditioner button, used to turn on or off the air conditioner."
[0215] In some embodiments, when the operation type of the triggering operation is a long press operation, it is determined that the urgency of the prompt information corresponding to the long press operation is a fourth degree, and the fourth degree of urgency is less than the third degree.
[0216] The urgency of the long press operation at the fourth level is lower than the urgency of the repeated press operation at the third level.
[0217] It should be understood that when a long press operation is performed on a button, it means that the target object is not familiar with the button on the vehicle that is being long pressed. Therefore, a prompt text corresponding to the button is displayed on the central control screen to introduce the functions of the multiple buttons to the target object.
[0218] In some embodiments, when the urgency level of the prompt information corresponding to the long press operation is the fourth level, the prompt text corresponding to the key is displayed.
[0219] For example, when the air conditioning button is long pressed, it is determined that the target object is not familiar with the function of the air conditioning button, so the prompt text corresponding to the button is displayed on the central control screen, "Air conditioning button, used to turn on or off the air conditioning."
[0220] It is understandable that the embodiment of the present application provides a key function prompt method, which triggers prompt information corresponding to the operation type when the target user is not familiar with the keys in the vehicle. However, the vehicle also includes other components, such as a lever or handle for adjusting the seat, and the key function prompt method provided by the embodiment of the present application can also be applied to other components in the vehicle.
[0221] The embodiment of the present application provides a button function prompt method, which responds to the trigger operation of the button in the vehicle, obtains the operation information before and after the trigger operation is executed, and determines the operation type of the trigger operation based on the operation information. The operation type is used to describe the operation behavior mode corresponding to the trigger operation. In the case where the operation type belongs to an abnormal operation, it is determined whether to trigger the prompt information corresponding to the operation type based on the running state of the vehicle. In the case where the running state of the vehicle is the parking state and the operation type is an abnormal operation, the target object is unclear about the function of the button, so it is necessary to trigger the prompt information corresponding to the operation type. The prompt information is used to prompt the function of the button or the position of the target button. The target button is the button that the target object is looking for, and the target object is the execution object of the trigger operation. That is, even if the target object does not understand the function of the button in the vehicle, it can still trigger the prompt information describing the function of the button to introduce the function of the button to the target object, providing a better experience for the target object.
[0222] Figure 4 A method for prompting key functions based on a target object portrait is provided in an embodiment of the present application.
[0223] For example, Figure 4 As shown, taking the execution subject as a vehicle-mounted device as an example, a button function based on a target object portrait of the present application is described, and the method 400 includes the following steps.
[0224] Step 401, obtaining object features of a target object, where the target object is an execution object for a trigger operation on a button in a vehicle, and the object features are used to describe basic information of the target object.
[0225] In some embodiments, basic information of the target object is obtained.
[0226] Among them, the basic information is information used to classify the target object, and the object characteristics include the target object's gender, age, and whether the target object is in a driving probationary period.
[0227] For example, the target object is a male, the target object is 21 years old and the target object is in a driving probationary period.
[0228] In some embodiments, basic information of the target object is obtained based on the personal account page of the central control screen.
[0229] For example, based on the personal account page of the central control screen, the target object submits basic information corresponding to the target object on the personal account page.
[0230] In some embodiments, the basic information is analyzed to obtain object features of the target object.
[0231] In this embodiment, the object feature of the target object is acquired so as to determine the category of the target object based on the object feature of the target object.
[0232] Step 402 : determining the object type of the target object based on the object characteristics of the target object, where the object type is used to describe the target object's familiarity with the triggering operation performed by the button in the vehicle.
[0233] It should be understood that the more familiar the target object is with the function of the button in the vehicle, the lower the probability that the target object will operate the button in the vehicle incorrectly, so there is no need to immediately trigger the prompt information describing the button function. In order to provide a better experience for the target object, the target object's familiarity with the trigger operation of the button in the vehicle is determined based on the object characteristics of the target object.
[0234] In a possible implementation, based on the object characteristics of the target object, it is determined whether the target object has performed a historical triggering operation on a button in the vehicle; and based on the historical triggering operation, the object type of the target object is determined.
[0235] In some embodiments, operation information of the target object performing historical trigger operations on buttons in the vehicle is obtained.
[0236] The historical trigger operation refers to an operation in which the target object performs a trigger operation on the key before performing the trigger operation on the key this time.
[0237] In some embodiments, the operation type of the historical trigger operation is determined based on the operation information of the historical trigger operation.
[0238] The operation types of the historical trigger operation include a long press operation, a continuous press operation, a repeated press operation, and a hesitant press operation.
[0239] It can be understood that the specific implementation of determining the operation type of the historical trigger operation based on the operation information of the historical trigger operation can refer to the relevant description in the aforementioned step 302, which will not be repeated here.
[0240] In some embodiments, the operation information of the historical trigger operation is input into a long short-term memory network (LSTM) model to obtain the operation type of the historical trigger operation.
[0241] In some embodiments, the operation information of the historical trigger operation is cleaned to remove invalid or erroneous information; feature extraction is performed on the cleaned operation information to obtain the duration of the historical trigger operation and the sequence of key presses after continuous triggering of the keys; and the operation type of the historical trigger operation is determined based on the duration of the historical trigger operation and the sequence of key presses after continuous triggering of the keys.
[0242] It should be understood that when the target object performs a historical trigger operation on a button in the vehicle, it means that the vehicle equipment has introduced prompt information describing the function of the button to the target object, so the object type of the target object is determined to be an old target object.
[0243] In some embodiments, when the target object performs a historical triggering operation on a button in the vehicle, the object type of the target object is determined to be an old target object.
[0244] It should be understood that when the target object performs a new trigger operation on a button in the vehicle, it means that the vehicle equipment has not introduced prompt information describing the function of the button to the target object, so the object type of the target object is determined to be a new target object.
[0245] In some embodiments, when the target object performs a new triggering operation on a button in the vehicle, the object type of the target object is determined to be a new target object.
[0246] In this implementation, based on the object characteristics of the target object, it is determined whether the target object has performed a historical triggering operation on a button in the vehicle, and based on the historical triggering operation, the object type of the target object is determined. That is, it is convenient to trigger different operations for different object types.
[0247] Step 403, based on the object type of the target object, trigger prompt information corresponding to the operation type, the prompt information is used to prompt the function of the button or the position of the target button, the target button is the button that the target object is looking for.
[0248] It should be understood that when the object type of the target object is a new target object, it is highly likely that the target object is unfamiliar with the button functions in the vehicle, and thus prompt information corresponding to the operation type is quickly triggered.
[0249] In some embodiments, when the object type of the target object is a new target object, prompt information corresponding to the operation type is triggered within a third preset time period.
[0250] The third preset time length is a time length automatically determined by the vehicle equipment, or is set by a technician according to actual conditions, and the present application embodiment does not limit this. For example, the third preset time length may be 1 second.
[0251] It can be understood that the specific implementation of triggering the prompt information corresponding to the operation type within the third preset time period can refer to the relevant description of the aforementioned step 304, which will not be repeated here.
[0252] It should be understood that when the object type of the target object is an old target object, the probability of determining that the target object is unfamiliar with the button functions in the vehicle is small, so the speed of triggering the prompt information corresponding to the operation type is lower than when the object type of the target object is a new target object.
[0253] In some embodiments, when the object type of the target object is an old target object, prompt information corresponding to the operation type is triggered within a fourth preset time length, and the fourth preset time length is greater than the third preset time length.
[0254] The fourth preset time length is a time length automatically determined by the vehicle equipment, or is set by a technician according to actual conditions, and the present application embodiment does not limit this. For example, the fourth preset time length may be 30 seconds.
[0255] It is understandable that the specific implementation of triggering the prompt information corresponding to the operation type within the fourth preset time period can refer to the relevant description of the aforementioned step 304, which will not be repeated here.
[0256] The embodiment of the present application provides a method for prompting button functions based on a target object portrait, which obtains the object characteristics of the target object, the target object is the execution object of the trigger operation on the button in the vehicle, the object characteristics are used to describe the basic information of the target object, based on the object characteristics of the target object, the object type of the target object is determined, the object type is used to describe the familiarity of the target object with the trigger operation performed by the button in the vehicle, based on the object type of the target object, prompt information corresponding to the trigger operation type is generated, the prompt information is used to prompt the function of the button or the location of the target button, and the target button is the button that the target object is looking for. That is, in the case where the target object is not familiar with the function of the button in the vehicle, prompt information describing the button function is triggered in time, and in the case where the target object is familiar with the function of the button in the vehicle, prompt information of the button function is avoided to be triggered in time, so as to prevent interference to the target object and bring a better experience to the target object.
[0257] Figure 5 It is a structural schematic diagram of a key function prompt device provided in an embodiment of the present application.
[0258] For example, Figure 5 As shown, the device 500 includes:
[0259] An acquisition module 501 is used to acquire operation information before and after the trigger operation is performed in response to the trigger operation of a button in the vehicle;
[0260] A determination module 502, configured to determine an operation type of a triggering operation based on the operation information, where the operation type is used to describe an operation behavior mode corresponding to the triggering operation;
[0261] The trigger module 503 is used to trigger the prompt information corresponding to the operation type when the operation type is an abnormal operation. The prompt information is used to prompt the function of the button or the position of the target button. The target button is the button that the target object is looking for, and the target object is the execution object of the trigger operation.
[0262] In a possible implementation manner, the device 500 further includes:
[0263] A determination module 502 is used to determine that the operation type of the trigger operation is a long press operation, and the long press operation is an abnormal operation, when the operation information indicates that the duration of the trigger operation after the trigger operation is performed on the key is greater than or equal to the first preset duration;
[0264] A determination module 502, configured to determine that the operation type of the trigger operation is a repeated pressing operation, and the repeated pressing operation is an abnormal operation, when the operation information indicates that the number of consecutive triggering of the key after the trigger operation is performed on the key is greater than or equal to a first preset number of times;
[0265] The determination module 502 is used to determine that the operation type of the trigger operation is a continuous pressing operation, and the continuous pressing operation is an abnormal operation, when the operation information indicates that the number of consecutive triggering of other keys after the trigger operation is performed on the key is greater than or equal to a second preset number of times;
[0266] The determination module 502 is used to determine that the operation type of the trigger operation is a hesitant press operation when the operation information indicates that the gesture before the trigger operation is performed on the key is a preset gesture type, and the hesitant press operation is an abnormal operation.
[0267] In a possible implementation manner, the device 500 further includes:
[0268] A module for determining a dwell time, used to determine a dwell time of a finger used to complete a gesture around a key when the operation information indicates that the gesture before the trigger operation is performed on the key is a preset gesture type;
[0269] The determination module 502 is configured to determine that the operation type of the triggering operation is a hesitant pressing operation when the duration of the finger staying around the key is greater than or equal to a second preset duration.
[0270] In a possible implementation manner, the device 500 further includes:
[0271] A processing module, used for processing a plurality of operation images of a trigger operation before the operation information indicates that a trigger operation is performed on a key, and obtaining a trigger area corresponding to the trigger operation performed on the key;
[0272] A recognition module, used to recognize multiple operation images within the trigger area to obtain a gesture before performing a trigger operation on the key;
[0273] A gesture type determination module, used to determine whether a gesture is a preset gesture type;
[0274] The module for determining the dwell time is used to determine the dwell time of the finger around the key based on an image sequence of a plurality of operation images when the gesture is of a preset gesture type.
[0275] In a possible implementation manner, the device 500 further includes:
[0276] a confidence determination module, used to determine the confidence corresponding to the tap gesture when the gesture is a tap gesture, the tap gesture being a gesture of a touch without pressing a key;
[0277] The gesture type determination module is used to determine that the gesture is a preset gesture type when the confidence level corresponding to the tap gesture is greater than a confidence level threshold.
[0278] In a possible implementation manner, the device 500 further includes:
[0279] A driving parameter acquisition module is used to acquire the driving parameters of the vehicle when the operation type belongs to an abnormal operation;
[0280] A running state determination module, configured to determine a running state of a vehicle based on a driving parameter of the vehicle;
[0281] A triggering prompt information module is used to determine whether to trigger prompt information corresponding to the operation type based on the running state of the vehicle;
[0282] The trigger module 503 is used to trigger prompt information corresponding to the operation type when the running state of the vehicle is the parking state.
[0283] In a possible implementation manner, the device 500 further includes:
[0284] An urgency determination module is used to determine the urgency of the prompt information corresponding to the operation type based on the operation type when the operation type is an abnormal operation. The urgency is used to describe the time required for the target object to find the target key;
[0285] The trigger module 503 is used to trigger the prompt information corresponding to the operation type based on the urgency of the prompt information corresponding to the operation type. Different triggering modes of the prompt information correspond to different urgency levels.
[0286] In a possible implementation manner, the device 500 further includes:
[0287] A display module, configured to display a prompt animation corresponding to the key when the operation type is a hesitant pressing operation and the urgency level of the prompt information corresponding to the hesitant pressing operation is a first level;
[0288] a broadcasting module, for broadcasting a prompt audio corresponding to the key and displaying a prompt text corresponding to the key when the operation type is a continuous pressing operation and the urgency of the prompt information corresponding to the continuous pressing operation is a second degree, and the second degree of urgency is less than the first degree;
[0289] a broadcasting module, configured to broadcast a prompt audio corresponding to the key when the operation type is a repeated pressing operation and the urgency of the prompt information corresponding to the repeated pressing operation is a third degree, the third degree of urgency being less than the second degree;
[0290] The display module is used to display the prompt text corresponding to the key when the operation type is a long press operation and the urgency of the prompt information corresponding to the long press operation is a fourth degree, and the fourth degree of urgency is less than the third degree.
[0291] Figure 6 It is a structural schematic diagram of a key function prompt device based on a target object provided in an embodiment of the present application.
[0292] For example, Figure 6 As shown, the device 600 includes:
[0293] The object feature acquisition module 601 is used to acquire the object feature of the target object, where the target object is the execution object of the trigger operation of the button in the vehicle, and the object feature is used to describe the basic information of the target object;
[0294] An object type determination module 602 is used to determine the object type of the target object based on the object characteristics of the target object, where the object type is used to describe the target object's familiarity with the trigger operation performed by the button in the vehicle;
[0295] The prompt information triggering module 603 is used to trigger prompt information corresponding to the operation type based on the object type of the target object. The prompt information is used to prompt the function of the button or the position of the target button. The target button is the button that the target object is looking for.
[0296] In a possible implementation manner, the device 600 further includes:
[0297] A historical trigger operation determination module is used to determine whether the target object performs a historical trigger operation on a button in the vehicle based on the object characteristics of the target object;
[0298] An object type determination module 602 is used to determine that the object type of the target object is an old target object when the target object performs a historical trigger operation on a button in the vehicle;
[0299] The object type determination module 602 is used to determine the object type of the target object as a new target object when the target object performs a new trigger operation on a button in the vehicle.
[0300] In a possible implementation manner, the device 600 further includes:
[0301] A prompt information triggering module 603 is used to trigger prompt information corresponding to the operation type within a third preset time period when the object type of the target object is a new target object;
[0302] The prompt information triggering module 603 is used to trigger prompt information corresponding to the operation type within a fourth preset time period when the object type of the target object is an old target object, and the fourth preset time period is greater than the third preset time period.
[0303] Figure 7 It is a structural schematic diagram of a vehicle provided in an embodiment of the present application.
[0304] For example, Figure 7 As shown, the vehicle 700 includes: a memory 701 and a processor 702, wherein the memory 701 stores an executable program code 703, and the processor 702 is used to call and execute the executable program code 703 to perform a key function prompt method.
[0305] In addition, an embodiment of the present application also protects a device, which may include a memory and a processor, wherein the memory stores an executable program code, and the processor is used to call and execute the executable program code to execute a key function prompt method provided by an embodiment of the present application.
[0306] In this embodiment, the functional modules of the device can be divided according to the above method example. For example, each functional module can be corresponded, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware. It should be noted that the division of modules in this embodiment is schematic and is only a logical function division. There may be other division methods in actual implementation.
[0307] In the case of dividing each functional module according to each function, the device may also include a display module, a broadcast module, a driving parameter acquisition module, etc. It should be noted that all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module, which will not be repeated here.
[0308] It should be understood that the device provided in this embodiment is used to execute the above-mentioned key function prompt method, and thus can achieve the same effect as the above-mentioned implementation method.
[0309] In the case of an integrated unit, the device may include a processing module and a storage module. When the device is applied to a vehicle, the processing module may be used to control and manage the actions of the vehicle. The storage module may be used to support the vehicle in executing related program codes, etc.
[0310] The processing module may be a processor or a controller, which may implement or execute various exemplary logic blocks, modules and circuits shown in conjunction with the disclosure of the present application. The processor may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of digital signal processing (DSP) and a microprocessor, etc. The storage module may be a memory.
[0311] In addition, the device provided in the embodiments of the present application may specifically be a chip, component or module, and the chip may include a connected processor and memory; wherein the memory is used to store instructions, and when the processor calls and executes the instructions, the chip can execute a key function prompt method provided in the above embodiment.
[0312] This embodiment also provides a computer-readable storage medium, in which a computer program code is stored. When the computer program code is executed on a computer, the computer executes the above-mentioned related method steps to implement a key function prompt method provided in the above embodiment.
[0313] This embodiment further provides a computer program product. When the computer program product is run on a computer, the computer is caused to execute the above-mentioned related steps to implement a key function prompt method provided in the above-mentioned embodiment.
[0314] Among them, the device, computer-readable storage medium, computer program product or chip provided in this embodiment is used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above, and will not be repeated here.
[0315] Through the description of the above implementation methods, technical personnel in the relevant field can understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.
[0316] In the embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0317] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims
1. A key function prompt method, It is characterized in that The method comprises: In response to a trigger operation on a button in the vehicle, obtaining operation information before and after the trigger operation is performed; Based on the operation information, determining an operation type of the trigger operation, where the operation type is used to describe an operation behavior mode corresponding to the trigger operation; When the operation type is an abnormal operation, prompt information corresponding to the operation type is triggered, and the prompt information is used to prompt the function of the button or the position of the target button. The target button is the button that the target object is looking for, and the target object is the execution object of the trigger operation.
2. The method according to claim 1, It is characterized in that The determining, based on the operation information, the operation type of the triggering operation includes at least one of the following: When the operation information indicates that the duration of the trigger operation after the trigger operation is performed on the key is greater than or equal to a first preset duration, determining that the operation type of the trigger operation is a long press operation, and the long press operation is an abnormal operation; When the operation information indicates that the number of consecutive triggering of the key after the triggering operation is performed on the key is greater than or equal to a first preset number, determining that the operation type of the triggering operation is a repeated pressing operation, and the repeated pressing operation is an abnormal operation; When the operation information indicates that the number of consecutive triggering of other keys after the triggering operation is performed on the key is greater than or equal to a second preset number, determining that the operation type of the triggering operation is a continuous pressing operation, and the continuous pressing operation is an abnormal operation; When the operation information indicates that the gesture before performing the trigger operation on the key is a preset gesture type, it is determined that the operation type of the trigger operation is a hesitant press operation, and the hesitant press operation is an abnormal operation.
3. The method according to claim 2, It is characterized in that When the operation information indicates that the gesture before the trigger operation is performed on the key is a preset gesture type, determining that the operation type of the trigger operation is a hesitant press operation includes: When the operation information indicates that the gesture before the trigger operation is performed on the key is a preset gesture type, determining the length of time that a finger used to complete the gesture stays around the key; When the duration of the finger staying around the key is greater than or equal to a second preset duration, it is determined that the operation type of the trigger operation is a hesitant pressing operation.
4. The method according to claim 3, It is characterized in that When the operation information indicates that the gesture before the trigger operation is performed on the key is a preset gesture type, determining the length of time that a finger corresponding to the gesture stays around the key includes: Processing the operation information indicating a plurality of operation images of the trigger operation before the trigger operation is performed on the key, to obtain a trigger area corresponding to the trigger operation performed on the key; Recognize the plurality of operation images within the trigger area to obtain a gesture before performing the trigger operation on the key; Determining whether the gesture is a preset gesture type; In the case that the gesture is of a preset gesture type, the length of time that the finger stays around the key is determined based on an image sequence of the plurality of operation images.
5. The method according to claim 4, It is characterized in that The determining whether the gesture is a preset gesture type includes: In the case where the gesture is a tap gesture, determining a confidence level corresponding to the tap gesture, the tap gesture being a gesture in which the gesture touches the key without pressing the key; When the confidence level corresponding to the tap gesture is greater than a confidence level threshold, the gesture is determined to be a preset gesture type.
6. The method according to claim 1, It is characterized in that When the operation type is an abnormal operation, triggering prompt information corresponding to the operation type includes: When the operation type is an abnormal operation, obtaining driving parameters of the vehicle; determining an operating state of the vehicle based on a driving parameter of the vehicle; When the running state of the vehicle is a parking state, prompt information corresponding to the operation type is triggered.
7. The method according to claim 1, It is characterized in that When the operation type is an abnormal operation, triggering prompt information corresponding to the operation type includes: In the case where the operation type belongs to an abnormal operation, determining the urgency of the prompt information corresponding to the operation type based on the operation type, the urgency being used to describe the time required for the target object to find the target key; Based on the urgency of the prompt information corresponding to the operation type, the prompt information corresponding to the operation type is triggered, and different triggering modes of the prompt information correspond to different urgency levels.
8. The method according to claim 7, It is characterized in that The triggering of the prompt information corresponding to the operation type based on the urgency of the prompt information corresponding to the operation type includes: In a case where the operation type is a hesitant pressing operation and the urgency level of the prompt information corresponding to the hesitant pressing operation is a first level, displaying a prompt animation corresponding to the button; When the operation type is a continuous pressing operation and the urgency of the prompt information corresponding to the continuous pressing operation is a second degree, the prompt audio corresponding to the key is broadcasted and the prompt text corresponding to the key is displayed, and the second degree of urgency is less than the first degree; When the operation type is a repeated pressing operation and the urgency of the prompt information corresponding to the repeated pressing operation is a third degree, broadcasting a prompt audio corresponding to the key, the third degree of urgency being less than the second degree; When the operation type is a long press operation and the urgency of the prompt information corresponding to the long press operation is a fourth degree, a prompt text corresponding to the button is displayed, and the fourth degree of urgency is lower than the third degree.
9. A key function prompt device, It is characterized in that The device comprises: An acquisition module, configured to acquire operation information before and after the trigger operation is performed in response to a trigger operation on a button in the vehicle; A determination module, configured to determine an operation type of the trigger operation based on the operation information, wherein the operation type is used to describe an operation behavior mode corresponding to the trigger operation; A trigger module is used to trigger prompt information corresponding to the operation type when the operation type is an abnormal operation. The prompt information is used to prompt the function of the button or the position of the target button. The target button is the button that the target object is looking for, and the target object is the execution object of the trigger operation.
10. A vehicle, It is characterized in that The vehicle comprises: A memory for storing executable program codes; A processor, configured to call and run the executable program code from the memory, so that the vehicle executes the method according to any one of claims 1 to 8.
Citation Information
Cited By
Steering wheel assembly assembling monitoring method and system
CN119689243A
