Interaction method, device and equipment of human-computer interaction interface, vehicle and chip

Abstract

The invention provides an interaction method, device and equipment of a human-computer interaction interface, a vehicle and a chip, which can be applied to an intelligent cockpit, the human-computer interaction interface comprises a background layer and a functional layer, the functional layer is preset with at least one target button, and the target button is arranged in an operation object area of the target button on the background layer. The method comprises the following steps: in response to a triggering operation on a target button, outputting prompt information outside a triggering area of the target button; wherein the target button can trigger a plurality of function states, and the prompt information is used for indicating the currently triggered and executed target function state. Therefore, through the reasonable interface layout and the clear operation object area of the button, the user can more smoothly complete the interaction operation, and the interaction experience is improved; through the visual display mode, the function state of the button which is currently triggered and executed is prompted outside the triggering area of the button, the shielding condition can be avoided, a user can visually know the real-time function state of the button, and the operation efficiency is improved.

Description

Technical Field

[0001] The present application relates to the technical field of human-computer interaction, and particularly to an interaction method, device, equipment, vehicle and chip for a human-computer interaction interface. Background Art

[0002] When a user operates a human-machine interaction (HMI) interface of an electronic device (such as a vehicle), the problem that the finger blocks a button (or icon) in the HMI interface often occurs. This kind of blockage makes it difficult for the user to clearly identify the current function state of the button, reducing the operation efficiency of the user on the button. At the same time, the HMI interface usually contains a large number of buttons with multiple function states, which further increases the complexity of the interaction structure, thus increasing the learning and operation difficulty of the user. Summary of the Invention

[0003] The present application aims to solve at least one of the technical problems in the related art to some extent.

[0004] To this end, the present application provides an interaction method, device, equipment, vehicle and chip for a human-computer interaction interface, so as to enable the user to complete the interaction operation more smoothly by means of reasonable interface layout and clear operation object area of the button, and improve the interaction body; through a visual display method with timely feedback, the current triggered function state of the button is prompted outside the triggerable area of the button, which can not only avoid the occlusion situation, but also enable the user to intuitively understand the real-time function state of the button, improving the operation efficiency.

[0005] In one aspect of the embodiments of the present application, an interaction method for a human-computer interaction interface is provided. The human-computer interaction interface includes a background layer and a function layer. The function layer is preset with at least one target button, and the target button is set in the operation object area of the target button on the background layer. The method includes:

[0006] Responding to a trigger operation on the target button, and outputting a prompt message outside the triggerable area of the target button;

[0007] Wherein, the target button can trigger multiple function states, and the prompt message is used to indicate the currently triggered target function state.

[0008] In another aspect of the embodiments of the present application, an interaction device for a human-computer interaction interface is provided. The human-computer interaction interface includes a background layer and a function layer. The function layer is preset with at least one target button, and the target button is set in the operation object area of the target button on the background layer. The device includes:

[0009] A processing module, configured to output a prompt message outside the triggerable area of the target button in response to a trigger operation on the target button;

[0010] Wherein, the target button can trigger multiple functional states, and the prompt message is used to indicate the target functional state currently triggered and executed.

[0011] Another embodiment of this application provides an electronic device, including: a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the program, the interactive method of the human-computer interaction interface described in the foregoing aspect is implemented.

[0012] Another embodiment of this application provides a vehicle, including: a processor; a memory for storing processor-executable instructions; wherein, the processor is configured to: implement the interactive method of the human-computer interaction interface described in the foregoing aspect.

[0013] Another embodiment of this application provides a chip, which includes an interface circuit and a processing circuit coupled to each other. The interface circuit is used for inputting or outputting signals, and the processing circuit is configured to execute the interactive method of the human-computer interaction interface described in the foregoing aspect.

[0014] Another embodiment of this application provides a non-transitory computer-readable storage medium, on which computer program instructions are stored. When the computer program instructions are executed by a processor, the interactive method of the human-computer interaction interface described in the foregoing aspect is implemented.

[0015] Another embodiment of this application provides a computer program product, on which a computer program is stored. When the program is executed by a processor, the interactive method of the human-computer interaction interface described in the foregoing aspect is implemented.

[0016] The interaction method, device, equipment, vehicle, and chip of the human-machine interaction interface proposed in this application can make the structure of the HMI interface clearer (i.e., hierarchical) by dividing the HMI interface into a background layer and a function layer, which helps users quickly understand the layout and function distribution of the interface. Moreover, through reasonable interface layout and clear operation object areas of target buttons, users can complete interaction operations more smoothly, improving the overall interaction experience. When a trigger operation of a user on a target button in the HMI interface is detected, through a visual display method with timely feedback, the current function state triggered by the target button is prompted outside the triggerable area of the target button, which can not only avoid occlusion but also enable users to intuitively understand the real-time function state of the target button, improving the operation efficiency of users on the target button. In addition, this interaction method does not require text information to be always displayed in the surrounding area of the target button to prompt the current function state triggered by the target button, which can improve the aesthetics of the HMI interface. Without increasing the information load of the HMI interface, by dynamically following the user's operation, the current function state triggered by the target button is dynamically prompted, enhancing the interaction experience.

[0017] Additional aspects and advantages of this application will be given in part in the following description, become apparent in part from the following description, or be learned through the practice of this application. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The above-mentioned and / or additional aspects and advantages of this application will become apparent and easy to understand from the following description of embodiments in conjunction with the drawings, where:

[0019] Figure 1 Schematic diagram of the button display method in the HMI interface in the related art Figure 1 ;

[0020] Figure 2 Schematic diagram of the button display method in the HMI interface in the related art Figure 2 ;

[0021] Figure 3 Schematic flow chart of the first interaction method of the human-machine interaction interface provided in the embodiment of this application;

[0022] Figure 4 Schematic flow chart of the second interaction method of the human-machine interaction interface provided in the embodiment of this application;

[0023] Figure 5a Schematic diagram of the button display method in the closed state provided in the embodiment of this application;

[0024] Figure 5b Schematic diagram of the four gears corresponding to the ventilation button provided in the embodiment of this application;

[0025] Figure 6 Schematic diagram of the button display mode in the non - closed state provided by the embodiment of the present application;

[0026] Figure 7 Schematic flow chart of the third human - machine interaction interface interaction method provided by the embodiment of the present application;

[0027] Figure 8 Schematic flow chart of the fourth human - machine interaction interface interaction method provided by the embodiment of the present application;

[0028] Figure 9 Schematic flow chart of the fifth human - machine interaction interface interaction method provided by the embodiment of the present application;

[0029] Figure 10 Schematic structural diagram of an interaction device for a human - machine interaction interface provided by the embodiment of the present application;

[0030] Figure 11 Schematic structural diagram of an electronic device provided by the embodiment of the present application;

[0031] Figure 12 Block diagram of a vehicle shown according to an exemplary embodiment;

[0032] Figure 13 Schematic structural diagram of a chip proposed by the embodiment of the present application. Detailed implementation manners

[0033] The embodiments of the present application will be described in detail below. The examples of the embodiments are shown in the drawings, where the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions from beginning to end. The embodiments described below by referring to the drawings are exemplary and are intended to explain the present application, but should not be construed as limiting the present application.

[0034] In the related art, the button display modes in the HMI interface of a vehicle may include Figure 1 the display mode 1 shown in Figure 2 and the display mode 2 shown in

[0035] Among them, for Figure 1 the display mode 1, the text is always displayed below the button (or icon) in the HMI interface. However, during the process of the user clicking the button, the user cannot obtain the gear information of the current button, and the text - form prompt information is not dynamically displayed.

[0036] Among them, for Figure 2In Display Mode 2, only buttons (or icons) are shown in the HMI interface, lacking any explanations or information prompts. For example, the ventilation and heating function belongs to a composite button with four gears: off, first gear, second gear, and third gear. When the user clicks the button, their hand may block the button, so the user can only judge the current gear of the button by remembering the number of clicks.

[0037] It should be noted that Figure 2 The button shown in Area 21 refers to the steering wheel heating button, the button shown in Area 22 refers to the seat heating button, and the button shown in Area 23 refers to the ventilation button.

[0038] In summary, the above display mode has at least the following disadvantages:

[0039] 1. It is not aesthetically pleasing. If the vehicle chooses to make the buttons of the composite function into multiple buttons, it will cause the HMI interface to be visually crowded and not aesthetically pleasing. Or, if the text is always displayed below the button, the layout of the HMI interface will be rather fragmented.

[0040] 2. The operation efficiency is relatively low. The user's click behavior is a dynamic behavior, and the finger will block the information of the button currently being clicked, resulting in the user not being able to see which gear or function state of the button is currently being clicked, thus reducing the user's operation efficiency.

[0041] Therefore, in view of at least one of the problems existing in the above related technologies, the present application proposes an interaction method, device, equipment, vehicle, and chip for a human-machine interaction interface.

[0042] Next, the interaction method, device, equipment, vehicle, and chip for the human-machine interaction interface according to the embodiments of the present application will be described with reference to the accompanying drawings.

[0043] Figure 3 It is a schematic flowchart of the first interaction method for the human-machine interaction interface provided by the embodiments of the present application.

[0044] Among them, the human-machine interaction (HMI) interface includes a background layer and a function layer. Among them, the function layer is preset with at least one target button, and each target button is set in the operation object area of the background layer corresponding to the target button.

[0045] Among them, the "layer" is not limited to the hierarchical structure in the view, but also includes elements with an overlapping relationship in the interface.

[0046] Among them, the background layer is the basic layer of the HMI interface, which provides the overall background and visual style of the HMI interface, including elements such as the background color, pattern, texture, or image of the HMI interface, providing visual unity and beauty for the HMI interface. That is, the background layer provides a basic visual framework for the HMI interface, enabling users to quickly identify the overall style and theme of the interface.

[0047] Among them, the functional layer can be a layer superimposed on the background layer, which contains all the interactive elements and functional components in the HMI interface, such as buttons, sliders, text boxes, etc., and is the main way for users to interact with the HMI interface. That is, the functional layer realizes the interactive function of the HMI interface, enabling users to complete various operations and tasks.

[0048] Among them, each target button on the functional layer is set in the operation object area of the target button on the background layer. Taking the HMI interface displayed in a vehicle as an example, the target button includes a seat heating button. In the background layer of the HMI interface, each seat in the cockpit is shown, and a seat heating button can be shown on each seat. Among them, the operation object area of each seat heating button includes the seat area shown under the seat heating button.

[0049] Thus, dividing the HMI interface into a background layer and a functional layer makes the structure of the HMI interface clearer (i.e., hierarchical), which helps users quickly understand the layout and function distribution of the interface. Among them, setting the target button in the operation object area of the target button on the background layer can enable users to intuitively find the button to be operated, reducing the possibility of misoperation. That is, through a reasonable interface layout and a clear operation object area, users can complete the interactive operation more smoothly, improving the overall interactive experience.

[0050] In addition, the layered design allows designers to design the HMI interface more flexibly. They can adjust the content and layout of the background layer and the functional layer according to actual needs. When new functions need to be added or existing functions need to be modified, only corresponding adjustments need to be made to the functional layer, without the need to make large-scale changes to the entire HMI interface, which can reduce the development and maintenance costs of the interface. And through a reasonable layered design, the visual effect of the HMI interface can be better controlled, improving the aesthetics and attractiveness of the HMI interface.

[0051] It should be noted that the interactive method of the human-computer interaction interface in the embodiments of the present application can be applied to an interactive device of the human-computer interaction interface. In some possible embodiments, the interactive device can be configured in an electronic device or a chip so that the electronic device or the chip can execute the interactive function of the human-computer interaction interface. Additionally, in some possible embodiments, the interactive device can also be software in an electronic device, etc.

[0052] In any embodiment of the present application, the chip can be integrated into an electronic device. The chip includes, but is not limited to, a Central Processing Unit (CPU), an Image Signal Processing (ISP), an Application-Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Field-Programmable Gate Array (FPGA), a System On A Chip (SOC), a Reduced Instruction Set Computer (RISC), etc., which are not listed one by one here.

[0053] Among them, the electronic device includes, but is not limited to: vehicles, terminals, smart home devices, etc.

[0054] Among them, the vehicle includes, but is not limited to: hybrid vehicles, non-hybrid vehicles, electric vehicles, fuel cell vehicles or other types of vehicles. Among them, the vehicle can be an autonomous vehicle, a semi-autonomous vehicle or a non-autonomous vehicle, and the embodiments of the present application do not limit this.

[0055] Among them, a terminal is an entity on the user side for receiving or transmitting signals, such as a mobile phone. A terminal can also be referred to as a terminal device (terminal), user equipment (UE for short), mobile station (MS for short), mobile terminal (MT for short), etc. A terminal can be a mobile phone with communication functions, a wearable device, a tablet computer (Pad), a computer with wireless transceiver functions, a virtual reality (VR for short) terminal, an augmented reality (AR for short) terminal, a wireless terminal in industrial control, a wireless terminal in self-driving, a wireless terminal in remote medical surgery, a wireless terminal in a smart grid, a wireless terminal in transportation safety, a wireless terminal in a smart city, a wireless terminal in a smart home, and so on. Embodiments of this application do not limit the specific technologies and specific device forms adopted by the terminal.

[0056] As Figure 3 shown, the interaction method of this human-computer interaction interface may include the following step S301:

[0057] Step S301, in response to a trigger operation on a target button, output a prompt message outside the triggerable area of the target button; among them, the target button can trigger multiple function states, and the prompt message is used to indicate the target function state currently triggered and executed.

[0058] Among them, the target button can trigger multiple function states. Exemplarily, the target button includes but is not limited to: a multi-state button, a multi-gear button, a composite function button.

[0059] Among them, the trigger operation includes but is not limited to: a click operation, a slide operation, etc.

[0060] In any embodiment of this application, the function state can be used to control the target button to switch between multiple functions to meet the operation requirements of users in different scenarios.

[0061] Taking an electronic device including a vehicle as an example and the target button including a ventilation button, the multiple functions of the ventilation button include but are not limited to: a closing function and a wind speed adjustment function. Among them, the wind speed adjustment function includes but is not limited to: a minimum wind speed adjustment function (such as the first gear, applicable to situations where slight ventilation is required or strong airflows are to be avoided from directly blowing on passengers), a moderate wind speed adjustment function (such as the second gear, applicable to ventilation requirements under general driving conditions), and a maximum wind speed adjustment function (such as the third gear, applicable to situations where rapid cooling is needed or humid air inside the vehicle is to be removed).

[0062] In any one of the embodiments of the present application, the functional state can be used to control the target button to switch between multiple gears to meet the operation requirements of users in different scenarios.

[0063] Among them, the gears include but are not limited to: off, third gear, second gear, first gear, etc.

[0064] In any one of the embodiments of the present application, the functional state can be used to control the target button to switch between multiple function combinations to meet the operation requirements of users in different scenarios.

[0065] Exemplarily, the target button may include a composite function button. When the user touches the target button, the electronic device can be controlled to execute multiple functions (i.e., composite functions).

[0066] In summary, providing multiple functional states with different functions to control the button to switch between multiple functions, gears or function combinations can achieve flexible switching according to different driving scenarios and user requirements. For example, the ventilation button can be switched between off, low gear, medium gear and high gear to adapt to different temperatures and ventilation requirements. This design makes the HMI interface more adaptable to diverse driving environments, improving the applicability of the vehicle and user satisfaction. Moreover, the multiple functional states can provide users with more choices and control rights, enabling users to adjust device settings according to their preferences and needs, enhancing the user experience.

[0067] In the first possible implementation manner of the embodiment of the present application, when a trigger operation of the user on the target button in the function layer of the HMI interface is detected, in response to the trigger operation, a prompt message can be output outside the triggerable area of the target button; wherein, the prompt message is used for the target functional state currently triggered and executed by the target button. For example, the target functional state can be the functional state currently occupied by the target button.

[0068] Therefore, when a trigger operation of a target button in the HMI interface is detected, the functional state currently triggered and executed by the target button is prompted outside the triggerable area of the target button in a visual display manner. This can not only avoid occlusion but also enable the user to intuitively know the real-time functional state of the target button, improving the operation efficiency of the user on the target button. Moreover, there is no need to constantly display text information in the surrounding area of the target button to prompt the functional state of the target button currently, which can enhance the aesthetics of the HMI interface. On the premise of not increasing the information load of the HMI interface, by dynamically following the user's operation, the functional state currently triggered and executed by the target button is dynamically prompted, which can enhance the interaction experience.

[0069] In the second possible implementation manner of the embodiment of the present application, when a trigger operation of a target button in the function layer of the HMI interface is detected, a prompt message may also be broadcast in response to the trigger operation, where the prompt message is used to indicate the target functional state currently triggered and executed by the target button among multiple functional states. For example, the target functional state may be the functional state of the target button currently.

[0070] Therefore, when a trigger operation of a target button in the HMI interface is detected, the functional state currently triggered and executed by the target button is prompted by voice broadcast, allowing the user to quickly understand the current functional state of the target button without being distracted to view the screen or the button, improving the operation efficiency of the user. Taking an electronic device including a vehicle as an example, the voice broadcast method can reduce the distraction of the driver during driving, thereby improving driving safety. That is, the driver can quickly confirm the current functional state of the target button through auditory feedback without interrupting visual attention or manual operation to view, and this instant feedback enhances the user's trust and satisfaction with the HMI interface.

[0071] In the third possible implementation manner of the embodiment of the present application, when a trigger operation of a target button in the HMI interface is detected, a prompt message may be output outside the triggerable area of the target button in response to the trigger operation, and the prompt message is also broadcast by voice.

[0072] Therefore, by processing the prompt message in different ways, the flexibility and applicability of this method can be improved.

[0073] The interaction method of the human-machine interaction interface according to the embodiments of the present application divides the HMI interface into a background layer and a function layer, which can make the structure of the HMI interface clearer (i.e., hierarchical), and helps users quickly understand the layout and function distribution of the interface. Moreover, through reasonable interface layout and clear operation object areas of target buttons, users can complete interaction operations more smoothly, improving the overall interaction experience. When it is detected that the user triggers an operation on a target button in the HMI interface, through a visual display method with timely feedback, the current function state triggered and executed by the target button is prompted outside the triggerable area of the target button, which can not only avoid occlusion, but also enable users to intuitively understand the real-time function state of the target button, improving the operation efficiency of users on the target button. In addition, this interaction method does not require text information to be constantly displayed in the surrounding area of the target button to prompt the current function state triggered and executed by the target button, which can improve the aesthetics of the HMI interface. Without increasing the information load of the HMI interface, by dynamically following the user's operation, the current function state triggered and executed by the target button is dynamically prompted, which can enhance the interaction experience.

[0074] The embodiments of the present application provide another interaction method. Figure 4 It is a schematic flowchart of the interaction method of the second human-machine interaction interface provided by the embodiments of the present application.

[0075] Among them, the human-machine interaction interface includes a background layer and a function layer. The function layer is preset with at least one target button, and each target button is set in the operation object area of the target button on the background layer.

[0076] It should be noted that the interaction method of the human-machine interaction interface can be executed alone, or can be executed in combination with any one of the embodiments in the present application or possible implementation manners in the embodiments, or can also be executed in combination with any one of the technical solutions in the related art. The embodiments of the present application do not limit this.

[0077] As Figure 4 shown, the interaction method of the human-machine interaction interface may include the following steps S401 to S402:

[0078] Step S401, in response to detecting multiple trigger operations on the target button, output prompt information corresponding to the multiple trigger operations outside the triggerable area of the target button in sequence.

[0079] Among them, the target button can trigger multiple function states, and the prompt information is used to prompt the target function state corresponding to each trigger operation.

[0080] It should be noted that the explanations of the trigger operation, the target button, and the function state in the above embodiments also apply to this embodiment, and will not be repeated here.

[0081] In an embodiment of the present application, in the case where multiple triggering operations on a target button in the function layer of the HMI interface are detected, prompt information corresponding to the multiple triggering operations can be output outside the triggerable area of the target button in sequence.

[0082] For example, taking the triggering operation including a click operation, the electronic device including a vehicle, the target button including the ventilation button in the HMI interface of the vehicle, and the ventilation button including 4 gears, namely off, third gear, second gear, and first gear as an example, in the case where the user does not click the ventilation button in the HMI interface of the vehicle (such as the ventilation button on the driver's seat area), the ventilation button in the HMI interface can be as Figure 5a shown in area 52, in the off state. Among them, the display form of the ventilation button in the off state is the first preset state, such as the color being gray.

[0083] Among them, Figure 5a the button shown in area 51 is the automatic transmission button on the driver's seat area, the button shown in area 52 is the ventilation button on the driver's seat area, and the button shown in area 53 is the seat heating button on the driver's seat area.

[0084] Among them, the four gears corresponding to the ventilation button can be as Figure 5b shown, where Figure 5b the gear corresponding to area 54 is off, the gear corresponding to area 55 is third gear, the gear corresponding to area 56 is second gear, and the gear corresponding to area 57 is first gear.

[0085] In the case where the user clicks the ventilation button (such as Figure 5a the ventilation button shown in area 52), prompt information can appear in the surrounding area outside the triggerable area of the ventilation button, such as the upper area, to prompt the current gear of the ventilation button. Among them, the prompt information can be changed according to the number of clicks or the click speed of the user. For example, when the user clicks the ventilation button once, the prompt information is used to indicate that the ventilation button is in first gear; when the user clicks the ventilation button twice, the prompt information is used to indicate that the ventilation button is in second gear; when the user clicks the ventilation button three times, the prompt information is used to indicate that the ventilation button is in third gear. At this time, the HMI interface can be as Figure 6 shown; when the user clicks the ventilation button 4 times, the prompt information is used to indicate that the ventilation button is in the off state. The user can cycle through the four gears of the ventilation button by clicking multiple times. Among them, the display form of the ventilation button in a non-off state is the second preset state, such as the color being blue.

[0086] It should be noted that if the user triggers the target button at a relatively fast speed and the prompt information corresponding to each trigger operation is quickly displayed, at least the following problems will occur: On the one hand, it will cause visual interference to the user. In the case where the electronic device includes a vehicle, if the prompt information flashes or switches on the screen at a relatively fast speed, it will make it difficult for the driver to concentrate and may even cause visual fatigue, thus affecting driving safety. On the other hand, in the case where the prompt information quickly switches, the user may have difficulty capturing the key or important prompt information, which may cause the user to miss important operation guides or status feedback, thus affecting the user's correct understanding and use of the device functions.

[0087] Similarly, if the user triggers the target button at a relatively fast speed and the prompt information corresponding to each trigger operation is quickly announced, at least the following problems will occur: On the one hand, it will cause auditory interference to the user. In the case where the electronic device includes a vehicle, it may make it difficult for the user to focus on the road conditions and driving operations, increasing the driving risk. On the other hand, when multiple prompt information is continuously announced within a short period of time, the user may have difficulty distinguishing and understanding the specific content of each prompt information. In the case where the electronic device includes a vehicle, it may cause the user to misunderstand the vehicle status or operation guide, thus affecting their driving decisions. In addition, the rapid voice announcement will distract the user's attention and make it difficult for them to focus on the driving task. This distraction is particularly dangerous in emergency or complex driving environments.

[0088] In view of the above problems, in any embodiment of the present application, when it is detected that the user performs multiple trigger operations on the target button in the HMI interface, it can be further determined whether the time interval between two adjacent triggers in the multiple trigger operations is greater than or equal to a duration threshold. When the time interval between two adjacent triggers in the multiple trigger operations is greater than or equal to the duration threshold, the prompt information corresponding to the multiple trigger operations can be output outside the triggerable area of the target button in sequence, and / or the prompt information corresponding to the multiple trigger operations can be announced by voice in sequence.

[0089] Among them, the duration threshold is a pre-set time threshold. It should be understood that the duration threshold is a relatively small threshold, and its time unit is, for example, milliseconds (ms).

[0090] Thus, when the user triggers the target button at a relatively slow speed, the prompt information corresponding to the multiple trigger operations is displayed and / or announced in sequence, which can avoid causing interference to the user's hearing and vision, enabling the user to capture the key status feedback and enhancing the user's interaction experience.

[0091] Step S402: In response to detecting multiple triggering operations on the target button, output the prompt message corresponding to the last detected triggering operation outside the triggerable area of the target button.

[0092] In the embodiments of the present application, when detecting multiple triggering operations by the user on the target button in the function layer of the HMI interface, the prompt message corresponding to the last detected triggering operation can be output only outside the triggerable area of the target button. Thus, by shielding the prompt messages corresponding to some of the triggering operations, the visual and auditory interferences to the user can be reduced, ensuring that the user can quickly obtain the status information they care about, improving the effectiveness of information acquisition, and thereby enhancing the overall satisfaction of the user with the HMI interface.

[0093] In any embodiment of the present application, when detecting multiple triggering operations by the user on the target button in the function layer of the HMI interface, it can be determined whether the time interval between two adjacent triggerings among the multiple triggering operations is less than a duration threshold. When the time interval between two adjacent triggerings among the multiple triggering operations is less than the duration threshold, output the prompt message corresponding to the last detected triggering operation outside the triggerable area of the target button, and / or, voice broadcast the prompt message corresponding to the last detected triggering operation.

[0094] Thus, when the user's triggering speed on the target button is relatively fast, only the prompt message corresponding to the last detected triggering operation is sequentially displayed and / or broadcasted, which can avoid interfering with the user's hearing and vision, enabling the user to capture the key prompt information or status feedback, and enhancing the user's usage experience.

[0095] It should be noted that step S401 and step S402 are two parallel implementation methods and can be executed alternatively.

[0096] The interaction method of the human-machine interaction interface in the embodiments of the present application can adopt different ways to process the prompt messages corresponding to multiple triggering operations, which can improve the flexibility and applicability of the method.

[0097] The embodiments of the present application provide another interaction method for the human-machine interaction interface. Figure 7 It is a schematic flowchart of the third interaction method for the human-machine interaction interface provided by the embodiments of the present application.

[0098] Among them, the human-machine interaction interface includes a background layer and a function layer. The function layer is preset with at least one target button, and the target button is set in the operation object area of the target button on the background layer.

[0099] It should be noted that the interaction method of the human-computer interaction interface can be executed independently, or can be executed in combination with any one of the embodiments or possible implementation manners in this application, or can also be executed in combination with any one of the technical solutions in the related art. The embodiments of this application do not limit this.

[0100] As Figure 7 shown, the interaction method of the human-computer interaction interface may include the following steps S701 to S702:

[0101] Step S701, in response to detecting multiple triggering operations on a target button, and the time interval between two adjacent triggering operations among the multiple triggering operations is less than a duration threshold, determine the target function state corresponding to the last detected triggering operation from multiple function states according to the number of triggered times of the multiple triggering operations.

[0102] Among them, the target button can trigger multiple function states.

[0103] It should be noted that the explanations of the target button, triggering operation, function state, and duration threshold in the foregoing embodiments also apply to this embodiment, and will not be repeated here.

[0104] In the embodiments of this application, when detecting multiple triggering operations of a user on a target button in the function layer of the HMI interface, it can be determined whether the time interval between two adjacent triggering operations among the multiple triggering operations is less than a duration threshold. If not, prompt information corresponding to the multiple triggering operations is output outside the triggerable area of the target button in sequence. If so, only the prompt information corresponding to the last detected triggering operation is output outside the triggerable area of the target button.

[0105] Among them, the generation method of the prompt information corresponding to the last detected triggering operation may include: determining the target function state corresponding to the last detected triggering operation from multiple function states triggerable by the target button according to the number of triggered times of the multiple triggering operations, so as to generate the prompt information corresponding to the last detected triggering operation according to the target function state.

[0106] For example, taking the trigger operation including a click operation as an example, the function state corresponding to the target button when the user clicks the target button for the last time can be determined according to the number of times the target button has been clicked. In this application, it is denoted as the target function state. Assume that the target button is a ventilation button, and the ventilation button has 4 gears, namely off, third gear, second gear, and first gear. When the number of clicks is 1, the target function state can be the first gear; when the number of clicks is 2, the target function state can be the second gear; when the number of clicks is 3, the target function state can be the third gear; when the number of clicks is 4, the target function state can be off; when the number of triggers is 5, the target function state can be the first gear; when the number of triggers is 6, the target function state can be the second gear, and so on. For the sake of brevity, they are not all listed here.

[0107] Step S702: Output a prompt message outside the triggerable area of the target button according to the target function state.

[0108] In the embodiment of this application, a prompt message can be generated according to the target function state corresponding to the last monitored trigger operation, and the prompt message is output outside the triggerable area of the target button. Among them, the prompt message is used to indicate the target function state corresponding to the last monitored trigger operation.

[0109] The interaction method of the human-computer interaction interface in the embodiment of this application can determine the target function state corresponding to the last monitored trigger operation according to the number of times of multiple trigger operations, which can improve the accuracy and reliability of the determination result.

[0110] The embodiment of this application provides another interaction method for a human-computer interaction interface. Figure 8 It is a schematic flowchart of the fourth interaction method for the human-computer interaction interface provided by the embodiment of this application.

[0111] Among them, the human-computer interaction interface includes a background layer and a function layer. The function layer is preset with at least one target button, and the target button is set in the operation object area of the background layer corresponding to the target button.

[0112] It should be noted that the interaction method of this human-computer interaction interface can be executed alone, or it can also be executed in combination with any one of the embodiments in this application or the possible implementation manners in the embodiments, or it can also be executed in combination with any one of the technical solutions in the related art. The embodiments of this application do not limit this.

[0113] As Figure 8 shown, the interaction method of this human-computer interaction interface can include the following steps S801 to S802:

[0114] Step S801: In response to detecting multiple triggering operations on a target button, where the time interval between two adjacent triggering operations among the multiple triggering operations is less than a duration threshold, query the mapping relationship associated with the target button based on the number of triggered times of the multiple triggering operations and the historical function status, so as to determine the target function status corresponding to the last detected triggering operation.

[0115] Among them, the target button can trigger multiple function statuses.

[0116] It should be noted that the explanations of the target button, triggering operation, function status, and duration threshold in the foregoing embodiments also apply to this embodiment, and will not be elaborated here.

[0117] In the embodiment of the present application, when detecting multiple triggering operations on the target button in the function layer of the HMI interface by the user, it can be determined whether the time interval between two adjacent triggering operations among the multiple triggering operations is less than the duration threshold. If not, prompt information corresponding to the multiple triggering operations is output outside the triggerable area of the target button in sequence. If so, only the prompt information corresponding to the last detected triggering operation is output outside the triggerable area of the target button.

[0118] Among them, the generation method of the prompt information corresponding to the last detected triggering operation may include: querying the mapping relationship associated with the target button according to the number of triggered times of the multiple triggering operations and the historical function status of the target button, so as to determine the target function status corresponding to the last detected triggering operation. Therefore, in the present application, the prompt information corresponding to the last detected triggering operation can be generated according to this target function status.

[0119] Among them, the historical function status is the function status triggered and executed by the target button before detecting the multiple triggering operations; the mapping relationship is used to indicate the corresponding relationship between the number of trigger times and the function status associated with the target button.

[0120] For example, taking the target button as the ventilation button, and the ventilation button has 4 gears, namely off, third gear, second gear, and first gear, and the mapping relationship indicates that the function status corresponding to the trigger times of 1 is the first gear, the function status corresponding to the trigger times of 2 is the second gear, the function status corresponding to the trigger times of 3 is the third gear, and the function status corresponding to the trigger times of 4 is off as an example. Assuming that the historical function status is the first gear, when the number of triggered times is 2, the target function status can be the third gear; when the number of triggered times is 3, the target function status can be off; when the number of triggered times is 4, the target function status can be the first gear; when the number of triggered times is 5, the target function status can be the second gear, and so on, which will not be listed one by one here.

[0121] In any embodiment of the present application, the number of times of triggered operations can be counted by a counter associated with a target button.

[0122] As an example, in response to multiple trigger operations, a multi-round iteration process can be executed; wherein, the iteration process is used to update the count value of the counter associated with the target button. Thus, in the present application, the count value of the counter updated in the last round of the iteration process can be used as the number of times of triggered operations for the multiple trigger operations.

[0123] Exemplarily, the first round of the multi-round iteration process may include: when the first trigger operation of the user on the target button is detected, adding 1 to the count value of the counter associated with the target button.

[0124] Exemplarily, a non-first-round iteration process in the multi-round iteration process, such as the i-th (where i is a positive integer greater than 1) round of the iteration process, may include: determining whether the i-th trigger operation of the user on the target button is detected within a set time period after the (i - 1)-th trigger operation. If so, adding 1 to the count value of the counter associated with the target button; if not, ending the iteration process.

[0125] Wherein, the duration of the set time period matches or is consistent with the above-mentioned duration threshold.

[0126] In summary, when multiple trigger operations are detected, by means of multi-round iteration, the count value of the counter associated with the target button is iteratively updated, which can improve the accuracy and reliability of the statistics of the number of times of triggered operations for the multiple trigger operations.

[0127] In any embodiment of the present application, after determining the target function state corresponding to the last detected trigger operation based on the number of times of triggered operations for the multiple trigger operations, the count value of the counter associated with the target button can also be cleared, thereby improving the accuracy and reliability of the function state prompt of the target button when the user subsequently triggers the target button.

[0128] Step S802, output a prompt message outside the triggerable area of the target button according to the target function state.

[0129] It should be noted that the explanation of step S802 can be referred to the relevant description in any embodiment of the present application and will not be elaborated here.

[0130] The interaction method of the human-computer interaction interface in the embodiment of the present application comprehensively considers the historical function state of the target button and the number of times of triggered operations for the multiple trigger operations to determine the target function state corresponding to the last detected trigger operation, which can improve the rationality and reliability of the determination result.

[0131] An embodiment of the present application provides another interaction method for a human - machine interaction interface. Figure 9 It is a schematic flowchart of the fifth interaction method for a human - machine interaction interface provided by an embodiment of the present application.

[0132] Among them, the human - machine interaction (HMI) interface includes a background layer and a function layer. The function layer is preset with at least one target button, and the target button is set in the operation object area of the background layer corresponding to the target button.

[0133] It should be noted that the interaction method of this human - machine interaction interface can be executed alone, or it can also be executed in combination with any one of the embodiments in the present application or the possible implementation manners in the embodiments, or it can also be executed in combination with any one of the technical solutions in the related art. The embodiments of the present application do not limit this.

[0134] As Figure 9 shown, the interaction method of this human - machine interaction interface may include the following steps S901 to S902:

[0135] Step S901, in response to a triggering operation on the target button in the HMI interface of the electronic device, output a prompt message outside the triggerable area of the target button.

[0136] Among them, the target button can trigger multiple functional states, and the prompt message is used to indicate the target functional state currently triggered and executed by the target button.

[0137] It should be noted that the explanation of step S901 can refer to the relevant descriptions in any embodiment of the present application, and will not be elaborated here.

[0138] In any one of the embodiments of the present application, the prompt message can be displayed in a set area outside the triggerable area of the target button; among them, the distance between the set area and the triggerable area of the target button is less than a distance threshold.

[0139] Among them, the distance threshold is related to the size of the HMI interface. The distance threshold corresponding to a larger - sized HMI interface can be greater than the distance threshold corresponding to a smaller - sized HMI interface.

[0140] Exemplarily, the set area can be a blank area outside the triggerable area of the target button. This set area can be located above the target button, or it can be located below, to the left, or to the right of the target button. The embodiments of the present application do not limit this.

[0141] Exemplarily, the set area can be located above the triggerable area, and the size of the set area is the same as that of the triggerable area of the target button. Thus, the occlusion situation can be avoided, enabling the user to intuitively know the functional state currently triggered and executed by the target button, and improving the user experience.

[0142] In summary, displaying a prompt message in the surrounding area outside the triggerable area of the target button can help the user focus their attention on the operation area around the target button. This design not only helps the user quickly understand the functional state currently triggered by the target button, but also helps the user more accurately find and click the required button, improving the user's operation efficiency.

[0143] In any embodiment of the present application, the prompt message can fade out after being displayed for a set duration.

[0144] Exemplarily, when the display duration of the prompt message in the set area reaches the set duration, the prompt message is displayed in a fade-out form.

[0145] Thus, without increasing the information load of the HMI interface, by dynamically following the user's operation, the functional state currently triggered by the target button can be dynamically prompted, enhancing the interaction experience.

[0146] In any embodiment of the present application, when the target functional state includes a closed state, the display form of the target button within the triggerable area of the target button can be updated to a first preset state.

[0147] Among them, the first preset state is used to indicate the display form of the target button in the closed state, including but not limited to the color, shape, size, etc. of the target button in the closed state.

[0148] Exemplarily, the first preset state can be used to indicate that the shape and size of the target button remain unchanged, and the color is gray.

[0149] In any embodiment of the present application, when the target functional state includes a non-closed state, the display form of the target button within the triggerable area of the target button can be updated to a second preset state.

[0150] Among them, the second preset state is different from the first preset state. The second preset state is used to indicate the display form of the target button in the non-closed state, including but not limited to the color, shape, size, etc. of the target button in the non-closed state.

[0151] Exemplarily, the second preset state can be used to indicate that the shape and size of the target button remain unchanged, and the color is blue.

[0152] Thus, the user can intuitively know the on / off state of the target button, further enhancing the user's interaction experience.

[0153] In any embodiment of the present application, the target button can include a control that is in a transparent state and allows gesture operations, taking into account the aesthetics and interaction efficiency of the HMI interface.

[0154] Among them, gesture operation is a non-contact or contact-based interaction method between the user and the electronic device.

[0155] In any embodiment of the present application, the target button may include: a control in a transparent state that allows touch operations (such as click operations), so as to balance the aesthetics of the HMI interface and the convenience of interaction.

[0156] In any embodiment of the present application, the target button may include: a control in a transparent state that allows gesture operations and touch operations (such as click operations), so as to balance the aesthetics of the HMI interface and the interaction experience.

[0157] Step S902, in response to the execution timing of reaching the target function state, control the components associated with the target button in the electronic device according to the target function state.

[0158] Among them, the execution timing of the target function state includes: a contact point is detected in the triggerable area of the target button, and the contact point disappears in the triggerable area.

[0159] In an embodiment of the present application, when a contact point is detected in the triggerable area of the target button and the contact point disappears in the triggerable area, the components associated with the target button in the electronic device may also be controlled according to the target function state currently triggered and executed by the target button.

[0160] As an example, taking an electronic device including a vehicle as an example, the in-vehicle components associated with the target button in the vehicle may be controlled according to the target function state currently triggered and executed by the target button. Assuming that the target button includes an air-conditioning button, the air conditioner in the vehicle may be controlled according to the target function state currently triggered and executed by the air-conditioning button. For another example, assuming that the target button includes a seat heating button as shown in area 53 in Figure 5a the heating element under the driver's seat in the vehicle may be controlled to heat the driver's seat.

[0161] In any embodiment of the present application, when the electronic device includes a vehicle, the target button includes but is not limited to: a ventilation button; a heating button; an air-conditioning button; a massage button; a seat adjustment button, etc.

[0162] It can be understood that for users who are not familiar with the HMI interface of the vehicle, displaying prompt information around different types of buttons, and / or, voice-broadcasting prompt information, can enhance the understanding of functions and improve the operation efficiency of users.

[0163] The interaction method of the human-computer interaction interface according to the embodiments of the present application controls the components associated with the target button in the electronic device according to the target function state of the target button, which can meet the user's personalized device control requirements.

[0164] In any one of the embodiments of the present application, taking the trigger operation including a click operation as an example for illustration, when the user clicks a button on the HMI interface, a prompt message can be dynamically generated, and the prompt message can be dynamically displayed outside the triggerable area of the button to prompt the user of the function state currently triggered by the button. Among them, the prompt message changes according to the user's click speed. Thereby, the operation efficiency of the user can be significantly improved, the problem that the user's finger blocks the button is effectively solved, and the user can clearly see the function state of the button at the current moment. Moreover, this design form is light and beautiful, and without increasing the information load of the interface, the user's interaction experience is enhanced by the dynamic following method.

[0165] As an example, taking the ventilation button in the HMI interface of a vehicle as the target button for example, when the user does not click the ventilation button, the ventilation button can be in the closed state as shown in Figure 5a ; when the user clicks the ventilation button, a prompt message as shown in Figure 6 can appear on the HMI interface, where the prompt message is used to indicate the gear information (such as the third gear) currently occupied by the ventilation button. Among them, the prompt message can appear according to the user's click speed. If the user's click speed is too fast, some of the signals will be blocked, and finally the prompt message stays at the final function state or gear when the user raises the hand.

[0166] Among them, Figure 5a and Figure 6 the ventilation button and the seat heating button (shown in area 53 in Figure 5) include four gears, namely off, third gear, second gear, and first gear. During the process of the user clicking the button, the user can cycle among these four gears. That is, when the user clicks the button four times, the user can respectively poll to a certain gear that the user wants, and the corresponding gear information can appear in the upper area of the button in sequence according to the user's click speed.

[0167] In summary, the solution provided by the present application has at least the following advantages:

[0168] 1. During the process of the user operating the button, since the finger blocks the button, it is not easy to see the function state currently occupied by the button. When the user's click speed is relatively fast, the user will get lost among the multiple function states of the button. To solve this problem, in the present application, in the form of text, the function state currently occupied by the button is prompted next to the user's click position, which can not only prompt the icon meaning of the button, but also explain the function state currently occupied by the button, improving the operation efficiency of the user.

[0169] 2. This interactive expression form can appear in many HMI interfaces, enhancing users' understanding of the functions of the buttons in the HMI interface.

[0170] 3. The prompt message can appear in the blank areas of different buttons, in all four directions of up, down, left, and right, which can improve the applicability of this method.

[0171] 4. For all buttons (or icons) in the HMI interface that are not easily understood, text prompts can appear. This intuitive information display method helps to improve users' satisfaction and trust.

[0172] 5. In the case where the user clicks at a relatively fast speed, the overly fast signals are blocked, and the final prompt message stays at the final functional state or gear at the moment when the user raises the hand, which can reduce the visual interference to the user.

[0173] 6. This interactive form can appear in all HMI interfaces, including the multi-terminal screens, rear screens, and rear PADs of vehicles, improving the flexibility and applicability of this method.

[0174] To implement the above embodiments, an interactive device for a human-machine interface is further proposed in the embodiments of the present application.

[0175] Figure 10 It is a schematic structural diagram of an interactive device for a human-machine interface provided by the embodiments of the present application.

[0176] Among them, the human-machine interface includes a background layer and a function layer. The function layer is preset with at least one target button, and the target button is set in the operation object area of the background layer corresponding to the target button.

[0177] As Figure 10 shown, the interactive device 1000 for the human-machine interface may include: a processing module 1010.

[0178] Among them, the processing module 1010 is configured to output a prompt message outside the triggerable area of the target button in response to a trigger operation on the target button; wherein, the target button can trigger multiple functional states, and the prompt message is used to indicate the currently triggered target functional state.

[0179] Further, in one implementation manner of the embodiments of the present application, the functional state is used to control the target button to switch between multiple functions; or, the functional state is used to control the target button to switch between multiple gears; or, the functional state is used to control the target button to switch between multiple function combinations.

[0180] In one implementation manner of the embodiment of the present application, the processing module 1010 is configured to: in response to detecting multiple trigger operations on the target button, sequentially output prompt information corresponding to the multiple trigger operations outside the triggerable area of the target button; or, in response to detecting multiple trigger operations on the target button, output prompt information corresponding to the last detected trigger operation outside the triggerable area of the target button.

[0181] In one implementation manner of the embodiment of the present application, the processing module 1010 is configured to: in response to detecting multiple trigger operations on the target button, and the time interval between two adjacent triggers in the multiple trigger operations is greater than or equal to the duration threshold, sequentially output prompt information corresponding to the multiple trigger operations outside the triggerable area of the target button.

[0182] In one implementation manner of the embodiment of the present application, the processing module 1010 is configured to: in response to detecting multiple trigger operations on the target button, and the time interval between two adjacent triggers in the multiple trigger operations is less than the duration threshold, output prompt information corresponding to the last detected trigger operation outside the triggerable area of the target button.

[0183] In one implementation manner of the embodiment of the present application, the processing module 1010 is configured to: determine the target function state corresponding to the last detected trigger operation from multiple function states according to the number of times the multiple trigger operations have been triggered; and output prompt information outside the triggerable area of the target button according to the target function state.

[0184] In one implementation manner of the embodiment of the present application, the processing module 1010 is configured to: query the mapping relationship associated with the target button according to the number of times triggered and the historical function state to determine the target function state corresponding to the last detected trigger operation; wherein, the historical function state is the function state executed by the target button trigger before detecting multiple trigger operations; and the mapping relationship is used to indicate the corresponding relationship between the number of triggers and the function state.

[0185] In one implementation manner of the embodiment of the present application, the processing module 1010 is further configured to: in response to multiple trigger operations, execute multiple rounds of iterative processes; wherein, the iterative process is used to update the count value of the counter associated with the target button; and use the count value of the counter updated in the last round of the iterative process as the number of times the multiple trigger operations have been triggered.

[0186] In one implementation manner of the embodiment of the present application, when the processing module 1010 executes the first round of the iterative process in the multiple rounds of iterative processes, specifically: in the case of detecting the first trigger operation on the target button, increment the count value of the counter by 1;

[0187] The processing module 1010 executes the i-th iteration process in multiple rounds of iteration processes, specifically: determining whether the i-th trigger operation on the target button is detected within a set time period after the (i - 1)-th trigger operation; where i is a positive integer greater than 1, and the duration of the set time period matches the duration threshold; if not, ending the iteration process; if so, incrementing the count value of the counter by 1.

[0188] In an implementation manner of the embodiment of the present application, the interaction device 1000 of the human-computer interaction interface may further include:

[0189] A clearing module, configured to clear the count value of the counter.

[0190] In an implementation manner of the embodiment of the present application, the processing module 1010 is configured to: display the prompt information within a set area outside the triggerable area of the target button; where the distance between the set area and the triggerable area is less than the distance threshold.

[0191] In an implementation manner of the embodiment of the present application, the set area is located above the triggerable area, and the set area has the same size as the triggerable area.

[0192] In an implementation manner of the embodiment of the present application, the interaction device 1000 of the human-computer interaction interface may further include:

[0193] A display module, configured to fade out and display the prompt information in response to the display duration of the prompt information within the set area reaching the set duration.

[0194] In an implementation manner of the embodiment of the present application, the interaction device 1000 of the human-computer interaction interface may further include:

[0195] An update module, configured to update the display form of the target button within the triggerable area to a first preset state in response to the target function state including the off state; or update the display form of the target button within the triggerable area to a second preset state in response to the target function state including a non-off state.

[0196] In an implementation manner of the embodiment of the present application, the human-computer interaction interface is displayed on an electronic device, and the interaction device 1000 of the human-computer interaction interface may further include:

[0197] A control module, configured to control the components associated with the target button in the electronic device according to the target function state in response to the execution timing of reaching the target function state; where the execution timing includes: a contact point is detected in the triggerable area of the target button, and the contact point disappears in the triggerable area.

[0198] In an implementation manner of the embodiment of the present application, the target button includes: a control in a transparent state that allows gesture operations and / or touch operations.

[0199] In an implementation manner of the embodiment of the present application, the interaction device 1000 of the human-machine interaction interface may further include:

[0200] A broadcast module, configured to broadcast prompt information by voice.

[0201] In an implementation manner of the embodiment of the present application, the human-machine interaction interface is displayed on a vehicle, and the target button includes any one of the following: a ventilation button; a heating button; an air-conditioning button; a massage button; a seat adjustment button.

[0202] It should be noted that the foregoing explanation of any method embodiment is also applicable to the interaction device of the human-machine interaction interface of this embodiment, and will not be repeated here.

[0203] In the interaction device of the human-machine interaction interface of the embodiment of the present application, by dividing the HMI interface into a background layer and a function layer, the structure of the HMI interface can be made clearer (that is, hierarchical), which helps users quickly understand the layout and function distribution of the interface. Moreover, through reasonable interface layout and clear operation object areas of the target buttons, users can complete interaction operations more smoothly, improving the overall interaction experience. When it is detected that the user triggers an operation on the target button in the HMI interface, through a visual display method with timely feedback, the current function state triggered and executed by the target button is prompted outside the triggerable area of the target button, which can not only avoid occlusion, but also enable users to intuitively understand the real-time function state of the target button, improving the operation efficiency of users on the target button. In addition, this interaction method does not require text information to be always displayed in the surrounding area of the target button to prompt the current function state triggered and executed by the target button, which can improve the aesthetics of the HMI interface. Without increasing the information load of the HMI interface, by dynamically following the user's operation, the current function state triggered and executed by the target button is dynamically prompted, which can enhance the interaction experience.

[0204] To implement the above embodiment, the present application also proposes an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the program, the interaction method described in any of the foregoing embodiments is implemented.

[0205] Figure 11 It is a schematic structural diagram of an electronic device provided by an embodiment of the present application. For example, the electronic device 1100 may be a mobile phone, a computer, a digital broadcast terminal, a message receiving and sending device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0206] Referring to Figure 11, the electronic device 1100 may include one or more of the following components: a processing component 1102, a memory 1104, a power component 1106, a multimedia component 1108, an audio component 1110, an input / output (I / O) interface 1112, a sensor component 1114, and a communication component 1116.

[0207] The processing component 1102 generally controls the overall operation of the electronic device 1100, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 1102 may include one or more processors 1120 to execute instructions to complete all or part of the steps of the above methods. In addition, the processing component 1102 may include one or more modules to facilitate the interaction between the processing component 1102 and other components. For example, the processing component 1102 may include a multimedia module to facilitate the interaction between the multimedia component 1108 and the processing component 1102.

[0208] The memory 1104 is configured to store various types of data to support the operation of the electronic device 1100. Examples of such data include instructions for any application or method operating on the electronic device 1100, contact data, phone book data, messages, pictures, videos, etc. The memory 1104 may be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, a magnetic disk, or an optical disk.

[0209] The power component 1106 provides power to various components of the electronic device 1100. The power component 1106 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the electronic device 1100.

[0210] The multimedia component 1108 includes a screen that provides an output interface between the electronic device 1100 and the user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors can sense not only the boundaries of the touch or swipe actions but also detect the duration and pressure associated with the touch or swipe operations. In some embodiments, the multimedia component 1108 includes a front camera and / or a rear camera. When the electronic device 1100 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each of the front camera and the rear camera can be a fixed optical lens system or have a focal length and optical zoom capabilities.

[0211] The audio component 1110 is configured to output and / or input audio signals. For example, the audio component 1110 includes a microphone (MIC) that is configured to receive external audio signals when the electronic device 1100 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals can be further stored in the memory 1104 or transmitted via the communication component 1116. In some embodiments, the audio component 1110 further includes a speaker for outputting audio signals.

[0212] The I / O interface 1112 provides an interface between the processing component 1102 and a peripheral interface module, which can be a keyboard, a click wheel, buttons, etc. These buttons can include, but are not limited to: a home button, a volume button, a power button, and a lock button.

[0213] The sensor assembly 1114 includes one or more sensors for providing status assessment of various aspects for the electronic device 1100. For example, the sensor assembly 1114 can detect the on / off state of the electronic device 1100, the relative positioning of components, such as the display and keypad of the electronic device 1100. The sensor assembly 1114 can also detect a change in the position of the electronic device 1100 or a component of the electronic device 1100, the presence or absence of user contact with the electronic device 1100, the orientation or acceleration / deceleration of the electronic device 1100, and a change in the temperature of the electronic device 1100. The sensor assembly 1114 can include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 1114 can also include a light sensor, such as a Complementary Metal-Oxide-Semiconductor (CMOS) or Charge-Coupled Device (CCD) image sensor, for use in imaging applications. In some embodiments, the sensor assembly 1114 can also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0214] The communication component 1116 is configured to facilitate communication between the electronic device 1100 and other devices in a wired or wireless manner. The electronic device 1100 can access a wireless network based on communication standards, such as WiFi, 4G, or 5G, or a combination thereof. In an exemplary embodiment, the communication component 1116 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 1116 further includes a Near Field Communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on Radio Frequency Identification (RFID) technology, Infrared Data Association (IrDA) technology, Ultra-Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0215] In an exemplary embodiment, the electronic device 1100 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components, and is used to execute the foregoing method.

[0216] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is further provided, such as a memory 1104 including instructions. The foregoing instructions may be executed by a processor 1120 of the electronic device 1100 to complete the foregoing method. For example, the non-transitory computer-readable storage medium may be a read-only memory (ROM), a random access memory (RAM), a compact disc read-only memory (CD-ROM), a magnetic tape, a floppy disk, an optical data storage device, or the like.

[0217] To implement the foregoing embodiment, the present application further provides a vehicle, including: a processor; a memory for storing executable instructions of the processor; wherein, the processor is configured to: implement the interaction method as described in any of the foregoing embodiments.

[0218] Figure 12 FIG. 10 is a block diagram of a vehicle 1200 shown according to an exemplary embodiment. For example, the vehicle 1200 may be a hybrid vehicle, or may be a non-hybrid vehicle, an electric vehicle, a fuel cell vehicle, or other types of vehicles. The vehicle 1200 may be an autonomous vehicle, a semi-autonomous vehicle, or a non-autonomous vehicle.

[0219] Referring to Figure 12 , the vehicle 1200 may include various subsystems. For example, an infotainment system 1210, a perception system 1220, a decision control system 1230, a drive system 1240, and a computing platform 1250. Among them, the vehicle 1200 may further include more or fewer subsystems, and each subsystem may include multiple components. In addition, each subsystem and each component of the vehicle 1200 may be interconnected in a wired or wireless manner.

[0220] In some embodiments, the infotainment system 1210 may include a communication system, an entertainment system, a navigation system, and the like.

[0221] The perception system 1220 may include several types of sensors for sensing information about the environment around the vehicle 1200. For example, the perception system 1220 may include a global positioning system (the global positioning system may be a GPS system, a Beidou system, or other positioning systems), an inertial measurement unit (IMU), lidar, millimeter-wave radar, ultrasonic radar, and a camera device.

[0222] The decision and control system 1230 may include a computing system, a vehicle controller, a steering system, an accelerator, and a braking system.

[0223] The drive system 1240 may include components that provide motive power for the vehicle 1200. In one embodiment, the drive system 1240 may include an engine, an energy source, a powertrain, and wheels. The engine may be one or a combination of an internal combustion engine, an electric motor, and an air compression engine. The engine is capable of converting the energy provided by the energy source into mechanical energy.

[0224] Some or all of the functions of the vehicle 1200 are controlled by the computing platform 1250. The computing platform 1250 may include at least one processor 1251 and a memory 1252. The processor 1251 may execute instructions 1253 stored in the memory 1252.

[0225] The processor 1251 may be any conventional processor, such as a commercially available CPU. The processor may also include, for example, a Graphics Processing Unit (GPU), a Field Programmable Gate Array (FPGA), a System on Chip (SOC), an Application Specific Integrated Circuit (ASIC), or a combination thereof.

[0226] The memory 1252 may be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, a magnetic disk, or an optical disk.

[0227] In addition to instruction 1253, the memory 1252 can also store data, such as road maps, route information, data on the position, direction, speed, etc. of the vehicle. The data stored in the memory 1252 can be used by the computing platform 1250.

[0228] In an embodiment of the present application, the processor 1251 can execute the instruction 1253 to complete all or part of the steps of any of the above method embodiments 5 to Figure 8 any one of the method embodiments.

[0229] To implement the above embodiments, the present application also proposes a chip. The chip includes an interface circuit and a processing circuit that are coupled to each other. The interface circuit is used for inputting or outputting signals, and the processing circuit is configured to execute the interaction method provided in any of the foregoing embodiments.

[0230] Figure 13 is a schematic structural diagram of another chip proposed in an embodiment of the present application. Reference can be made to Figure 13 the schematic structural diagram of the chip 1300 shown, but not limited thereto.

[0231] The chip 1300 includes a processing circuit 1301, and the processing circuit 1301 is configured to execute any of the above interaction methods.

[0232] In some embodiments, the chip 1300 further includes one or more interface circuits 1302. Optionally, the interface circuit 1302 is connected to the memory 1303. The interface circuit 1302 can be used to receive signals from the memory 1303 or other devices, and the interface circuit 1302 can be used to send signals to the memory 1303 or other devices. For example, the interface circuit 1302 can read the instructions stored in the memory 1303 and send the instructions to the processing circuit 1301.

[0233] In some embodiments, the interface circuit 1302 executes at least one of the communication steps such as sending and / or receiving in the above method, and the processing circuit 1301 executes other steps.

[0234] In some embodiments, terms such as interface circuit, interface, transceiver pin, transceiver, etc. can be used interchangeably.

[0235] In some embodiments, the chip 1300 further includes one or more memories 1303 for storing instructions. Optionally, all or part of the memories 1303 can be outside the chip 1300.

[0236] To implement the above embodiments, the present application also proposes a non-transitory computer-readable storage medium, on which a computer program is stored. When the program is executed by a processor, it implements the interaction method described in any of the foregoing method embodiments.

[0237] To implement the above embodiments, the present application further provides a computer program product, on which a computer program is stored. When the computer program is executed by a processor, the interactive method described in any of the foregoing method embodiments is implemented.

[0238] In the description of this specification, the descriptions with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples", etc. mean that the specific features, structures, materials, or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, without conflict, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of different embodiments or examples.

[0239] In addition, the terms "first" and "second" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly specifying the quantity of the indicated technical features. Thus, the features defined with "first" and "second" may explicitly or implicitly include at least one of these features. In the description of the present application, the meaning of "a plurality" is at least two, such as two, three, etc., unless otherwise specifically defined.

[0240] Any process or method description shown in a flowchart or described in other ways herein may be understood to represent a module, segment, or portion of code including one or more executable instructions for implementing a customized logic function or process. The scope of the preferred embodiments of the present application includes additional implementations, where the functions may be executed in a substantially simultaneous manner or in a reverse order according to the involved functions, rather than in the order shown or discussed, which should be understood by those skilled in the art to which the embodiments of the present application pertain.

[0241] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a definable sequence list of executable instructions for implementing logical functions, and can be specifically implemented in any computer-readable medium for use by an instruction execution system, apparatus, or device (such as a computer-based system, a system including a processor, or other systems that can fetch and execute instructions from the instruction execution system, apparatus, or device), or used in combination with these instruction execution systems, apparatuses, or devices. For the purposes of this specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate, or transmit a program for use by or in combination with an instruction execution system, apparatus, or device. More specific examples (non-exhaustive list) of computer-readable media include the following: an electrical connection portion with one or more wirings (electronic device), a portable computer disk cartridge (magnetic device), a random access memory (Random Access Memory, abbreviated as RAM), a read-only memory (Read-Only Memory, abbreviated as ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (Compact Disc Read-Only Memory, abbreviated as CDROM). Additionally, a computer-readable medium can even be paper or other suitable media on which the program can be printed, because the program can be obtained electronically, for example, by optically scanning the paper or other media, followed by editing, interpretation, or other suitable processing as necessary, and then stored in a computer memory.

[0242] It should be understood that various parts of the present application can be implemented by hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or a combination of the following techniques well known in the art can be used: discrete logic circuits with logic gate circuits for implementing logical functions on data signals, application-specific integrated circuits with suitable combinational logic gate circuits, programmable gate arrays (Programmable Gate Array, abbreviated as PGA), field-programmable gate arrays (Field-Programmable Gate Array, abbreviated as FPGA), etc.

[0243] Those of ordinary skill in the art of this technology can understand that all or part of the steps carried by the method of the above embodiments can be completed by instructing relevant hardware through a program, and the program can be stored in a computer-readable storage medium. When the program is executed, it includes one or a combination of the steps of the method embodiments.

[0244] In addition, each functional unit in various embodiments of the present application may be integrated into a processing module, or each unit may exist physically alone, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. When the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

[0245] The above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disc, etc. Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limiting the present application. Those of ordinary skill in the art can make changes, modifications, substitutions and variations to the above embodiments within the scope of the present application.

Claims

1. An interaction method for a human-computer interaction interface, characterized in that, The human-machine interaction interface includes a background layer and a function layer. The function layer is preset with at least one target button, and the target button is set in the operation object area of the background layer. The method includes: In response to a trigger operation on the target button, a prompt message is output outside the triggerable area of the target button; Wherein, the target button can trigger multiple function states, and the prompt message is used to indicate the target function state currently triggered and executed.

2. The method according to claim 1, wherein The function state is used to control the target button to switch between multiple functions; or, The function state is used to control the target button to switch between multiple gears; or, The function state is used to control the target button to switch between multiple function combinations.

3. The method according to claim 1, characterized in that, The step of outputting a prompt message outside the triggerable area of the target button in response to a trigger operation on the target button includes: In response to detecting multiple trigger operations on the target button, the prompt messages corresponding to the multiple trigger operations are sequentially output outside the triggerable area of the target button; or, In response to detecting multiple trigger operations on the target button, the prompt message corresponding to the last detected trigger operation is output outside the triggerable area of the target button.

4. The method according to claim 3, characterized in that The step of outputting the prompt messages corresponding to the multiple trigger operations sequentially outside the triggerable area of the target button in response to detecting multiple trigger operations on the target button includes: In response to detecting multiple trigger operations on the target button, and the time interval between two adjacent trigger operations in the multiple trigger operations is greater than or equal to a duration threshold, the prompt messages corresponding to the multiple trigger operations are sequentially output outside the triggerable area of the target button.

5. The method according to claim 3, characterized in that, The step of outputting the prompt message corresponding to the last detected trigger operation outside the triggerable area of the target button in response to detecting multiple trigger operations on the target button includes: In response to detecting multiple trigger operations on the target button, and the time interval between two adjacent trigger operations in the multiple trigger operations is less than the duration threshold, the prompt message corresponding to the last detected trigger operation is output outside the triggerable area of the target button.

6. The method according to claim 5, characterized in that, The step of outputting the prompt message corresponding to the last detected trigger operation outside the triggerable area of the target button includes: According to the number of times the multiple trigger operations have been triggered, the target function state corresponding to the last detected trigger operation is determined from the multiple function states; According to the target function state, the prompt message is output outside the triggerable area of the target button.

7. The method according to claim 6, characterized in that, The step of determining the target function state corresponding to the last detected trigger operation from the multiple function states according to the number of times the multiple trigger operations have been triggered includes: According to the number of times triggered and the historical function state, a mapping relationship associated with the target button is queried to determine the target function state corresponding to the last detected trigger operation; The historical function status is the function status triggered and executed by the target button before the multiple trigger operations are monitored; and the mapping relationship is used to indicate the corresponding relationship between the number of trigger times and the function status.

8. The method according to claim 6, wherein The number of times the multiple trigger operations have been triggered is determined by the following steps: In response to the multiple triggering operations, executing multiple rounds of iterative processes; wherein the iterative process is used to update the count value of the counter associated with the target button; The count value of the counter updated in the last round of the iterative process is used as the number of times the triggering operations have been triggered.

9. The method according to claim 8, wherein The first round of iteration in the multiple rounds of iterations includes: When the first trigger operation on the target button is detected, the count value of the counter is increased by 1; The i-th round of iteration process in the multiple rounds of iteration process includes: Determine whether an i-th trigger operation on the target button is detected within a set time period after the i-1-th trigger operation; wherein i is a positive integer greater than 1, and the duration of the set time period matches the duration threshold; If not, then end the iterative process; If so, the count value of the counter is increased by 1.

10. The method according to claim 9, characterized in that, After determining the target functional state corresponding to the trigger operation monitored last time from the multiple functional states according to the number of times the trigger operations have been triggered, the method further includes: The count value of the counter is cleared to zero.

11. The method according to any one of claims 1-10, characterized in that, Outputting the prompt information outside the triggerable area of ​​the target button includes: The prompt information is displayed in a set area outside the triggerable area of ​​the target button; wherein the distance between the set area and the triggerable area is less than a distance threshold.

12. The method according to claim 11, wherein The setting area is located above the triggerable area, and the setting area has the same size as the triggerable area.

13. The method according to claim 11, wherein The method further comprises: In response to the display time of the prompt information in the set area reaching the set time, the prompt information is displayed in a fade-out form.

14. The method according to any one of claims 1-10, characterized in that, The method further comprises any of the following: In response to the target function state including an off state, updating the display form of the target button in the triggerable area to a first preset state; In response to the target function state including a non-closed state, the display form of the target button in the triggerable area is updated to a second preset state.

15. The method according to any one of claims 1-10, characterized in that, The human-computer interaction interface is displayed on the electronic device, and the method further includes: In response to reaching the execution timing of the target functional state, controlling the component associated with the target button in the electronic device according to the target functional state; The execution timing includes: a touch point is detected in a triggerable area of ​​the target button, and the touch point disappears in the triggerable area.

16. The method according to any one of claims 1 to 10, characterized in that, The target button includes: a control that is in a transparent state and allows gesture operation and / or touch operation.

17. The method according to any one of claims 1 to 10, characterized in that, The method further comprises: The prompt information is announced by voice.

18. The method according to any one of claims 1 to 10, characterized in that The human-computer interaction interface is displayed on the vehicle, and the target button includes any one of the following: Ventilation button; Heating button; Air conditioning buttons; Massage button; Seat adjustment buttons.

19. An interaction device for a human-computer interaction interface, characterized in that, The human-computer interaction interface includes a background layer and a function layer. At least one target button is preset in the function layer, and the target button is disposed in the operation object area of the target button on the background layer. The device includes: A processing module, configured to output a prompt message outside the triggerable area of the target button in response to a trigger operation on the target button; Wherein, the target button can trigger multiple functional states, and the prompt message is used to indicate the currently triggered target functional state.

20. An electronic device, characterized in that, It includes a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the program, the steps of the method according to any one of claims 1 to 18 are implemented.

21. A vehicle, characterized in that, It includes: A processor; A memory for storing instructions executable by the processor; Wherein, the processor is configured to: Implement the steps of the method according to any one of claims 1 to 18.

22. A non-transitory computer-readable storage medium having computer program instructions stored thereon, characterized in that, When the program instruction is executed by the processor, the steps of the method according to any one of claims 1 to 18 are implemented.

23. A chip, characterized in that, The chip includes an interface circuit and a processing circuit which are coupled to each other. The interface circuit is used to input or output signals, and the processing circuit is used to implement the method according to any one of claims 1 to 18.

24. A computer program product, characterized in that, It includes a computer program which, when executed by a processor, implements the steps of the method according to any one of claims 1 to 18.

Images