Self-adaptive human-computer interaction method, electronic equipment, vehicle, storage medium and program product
By obtaining the data set and functional database of interactive objects and dynamically switching the human-computer interaction control function, the problem of the inability to adapt to scene changes in the existing technology is solved, and the interaction efficiency and user experience are improved.
Patent Information
- Application Number
- CN202411271500.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-11
- Publication Date
- 2024-11-12
AI Technical Summary
The existing human-computer interaction control functions cannot be adaptively switched according to scene changes, resulting in low interaction efficiency and high user learning costs.
By obtaining the data set of interactive objects (such as geographical location, weather, ambient temperature, etc.), determining the current scene, and selecting the control function corresponding to the scene from the pre-established functional database, using the preset algorithm to calculate the recommended degree value, dynamically Switch control function.
It realizes adaptive switching between control functions and scenes, improving the adaptive ability and user experience of human-computer interaction.
Smart Images

Figure CN118928450A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of intelligent control technology, and in particular to an adaptive human-computer interaction method, electronic equipment, vehicle, storage medium and program product. Background Art
[0002] At present, the relationship between the control function and the application scenario of human-computer interaction is usually fixed, and the control function cannot be switched adaptively according to the changes in the scene, which makes the interaction efficiency low and the user learning cost high. For example, the published patent CN117962742A "Control method, device and vehicle of vehicle components" realizes related functions by detecting user gestures and the execution area of gesture actions. This method can realize many functions, but it has high requirements on the detection accuracy of hardware equipment, and users need to learn the corresponding meaning of each area in the car, which has a high learning cost. In addition, the control function corresponding to the gesture action in the same area of the car cannot be switched adaptively with the change of the scene. Summary of the invention
[0003] In view of this, the purpose of the embodiments of the present application is to provide an adaptive human-computer interaction method, electronic device, vehicle, storage medium and program product, which can improve the problem that the control function in human-computer interaction cannot be adaptively switched according to changes in the scene.
[0004] In order to achieve the above technical objectives, the technical solutions adopted in this application are as follows:
[0005] In a first aspect, an embodiment of the present application provides an adaptive human-computer interaction method, the method comprising:
[0006] Acquire a data set corresponding to the interactive object, the data set including at least one of the geographical location, weather, ambient temperature, ambient humidity, time, and light intensity of the interactive object;
[0007] Determine, according to the data set, the scene in which the interactive object is currently located as a target scene;
[0008] A control function corresponding to the target scene is selected and enabled from a pre-established function database as a current human-computer interaction function, wherein the function database includes at least two control functions.
[0009] In combination with the first aspect, in some optional implementations, before obtaining the data set corresponding to the interactive object, the method further includes:
[0010] creating a function database having at least two control functions based on the function configuration data;
[0011] Through the preset algorithm, the recommended degree values of different control functions in the corresponding scenarios are determined.
[0012] In combination with the first aspect, in some optional implementations, the recommended degree values of different control functions in corresponding scenarios are determined by a preset algorithm, including:
[0013] Obtaining a first frequency value of the current user selecting the same control function in a corresponding scenario, a second frequency value of all users selecting the same control function in the corresponding scenario, and a logic value of selecting the same control function in the corresponding scenario;
[0014] Based on the first frequency value, the second frequency and the logic value corresponding to any control function in the corresponding scenario, a recommended degree value of any control function in the corresponding scenario is determined by a preset formula to obtain recommended degree values of different control functions in the corresponding scenario, and the preset formula is:
[0015] Y=X1+K2*X2
[0016] In the formula, Y refers to the recommended degree value, X1 refers to the first frequency, X2 refers to the second frequency, and K2 refers to the logic value.
[0017] In combination with the first aspect, in some optional implementations, the first frequency X1 is determined as follows:
[0018]
[0019] Where, X ∝1 Refers to the total number of times the current user selects the same control function in the corresponding scenario, and SUM refers to the total number of times the current user selects all control functions in the corresponding scenario;
[0020] The second frequency X2 is determined as follows:
[0021]
[0022] In the formula, Z n Refers to the frequency value of the nth user selecting the same control function in the corresponding scenario, N refers to the total number of users, and n is an integer between 1 and N;
[0023] The logic value K2 is obtained based on the average extracted variance value AVE of the current user's operation proportion, and the logic value is used to indicate the concentration degree of selecting the same control function in the corresponding scenario, wherein, Num1 refers to the number of users who select the same control function in the corresponding scenario.
[0024] In combination with the first aspect, in some optional implementations, after selecting and enabling a control function corresponding to the target scene from a pre-established function database, the method further includes:
[0025] When the first control instruction for updating the recommendation value is received, based on the latest historical operation record, the recommendation value of different control functions in the corresponding scenario is determined by a preset algorithm, and the recommendation value of the historical record is updated.
[0026] In combination with the first aspect, in some optional implementations, determining the scene in which the interactive object is currently located as the target scene according to the data set includes:
[0027] Based on the pre-established correspondence between the data and the scenes in the preset scene library, a scene corresponding to the data in the data set is selected from the preset scene library as the target scene.
[0028] In combination with the first aspect, in some optional implementations, a control function corresponding to the target scene is selected and enabled from a pre-established function database as the current human-computer interaction function, including:
[0029] From the function database, a control function with the largest recommendation value in the target scenario is selected and enabled as the current human-computer interaction function, wherein the control functions stored in the function database carry the recommendation value corresponding to the target scenario.
[0030] In combination with the first aspect, in some optional implementations, the method further includes:
[0031] Receive an interactive instruction input by the current user, wherein the interactive instruction includes at least one of an instruction generated based on a physical key, an instruction generated based on a touch screen, an instruction generated based on a gesture action image of the current user, and an instruction generated based on a voice of the current user;
[0032] Based on the interaction instruction, a sub-function corresponding to the current human-computer interaction function is executed.
[0033] In combination with the first aspect, in some optional implementations, the method further includes:
[0034] During the execution of the sub-function, if a second control instruction for interrupting the execution operation is received, the execution component executing the sub-function is controlled to pause the action, and the execution component is controlled to roll back to the state before executing the sub-function.
[0035] In combination with the first aspect, in some optional implementations, between the step of receiving the interaction instruction currently input by the user and the step of executing the sub-function corresponding to the current human-computer interaction function based on the interaction instruction, the method further includes:
[0036] If the risk level corresponding to the current human-computer interaction function is higher than the preset level, a prompt message is issued indicating that the current user needs to confirm whether to continue the execution;
[0037] Within a first preset time period of sending the prompt information, if a first confirmation instruction indicating confirmation to continue execution is received, the execution step executes a sub-function corresponding to the current human-computer interaction function based on the interaction instruction.
[0038] In combination with the first aspect, in some optional implementations, the method further includes:
[0039] Control the display screen of the interactive object to display the identification information corresponding to the current human-computer interaction function, and / or display the running status of the corresponding sub-function under the current human-computer interaction function, wherein the identification information includes at least one of a function icon and text.
[0040] In combination with the first aspect, in some optional implementations, the method further includes:
[0041] When receiving a fourth control instruction for switching a control function, based on the switching direction carried by the fourth control instruction, selecting a control function adjacent to the current human-computer interaction function and having the same switching direction from the function database as a candidate control function, wherein the control functions in the function database are arranged in order of magnitude of the recommendation degree values;
[0042] When a second confirmation instruction indicating selection of the candidate control function is received, or when no new fourth control instruction is received within a second preset time after receiving the fourth control instruction, the candidate control function is used as the current human-computer interaction function.
[0043] In combination with the first aspect, in some optional embodiments, the interactive object includes a vehicle, and the control functions in the function database include at least one of a sunroof switch function, a window lifting function, a driving mode switching function, an energy feedback adjustment function, a music switching function, a volume adjustment function, an air conditioning volume adjustment function, an air conditioning temperature adjustment function, a phone answering function, and a front windshield defog function.
[0044] In a second aspect, an embodiment of the present application further provides an electronic device, comprising a processor and a memory coupled to each other, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the electronic device executes the above method.
[0045] In a third aspect, an embodiment of the present application further provides a vehicle, comprising a vehicle body and the above-mentioned electronic device.
[0046] In a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium, wherein a computer program is stored in the computer-readable storage medium. When the computer program is executed on a computer, the computer executes the above method.
[0047] In a fifth aspect, an embodiment of the present application further provides a computer program product, including a computer program, which implements the above method when executed by a processor.
[0048] The invention adopting the above technical solution has the following advantages:
[0049] In the technical solution provided in the present application, a data set including at least one of the geographical location, weather, ambient temperature, ambient humidity, time, and light intensity of the interactive object is used to determine the scene in which the interactive object is currently located as the target scene; then, from a function database including at least two control functions, a control function corresponding to the target scene is selected and enabled as the current human-computer interaction function. In this way, the relationship between the control function and the scene in which the interactive object is located is no longer strongly coupled, which is conducive to the adaptive switching of the control function of human-computer interaction as the scene in which the interactive object is located changes, and further helps to improve the adaptive ability of human-computer interaction and user experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0050] The present application may be further described by the non-limiting embodiments given in the accompanying drawings. It should be understood that the following drawings only illustrate certain embodiments of the present application and therefore should not be regarded as limiting the scope. For those of ordinary skill in the art, other relevant drawings may be obtained based on these drawings without creative effort.
[0051] Figure 1 One of the flowcharts of the adaptive human-computer interaction method provided in the embodiment of the present application.
[0052] Figure 2 The second flowchart of the adaptive human-computer interaction method provided in the embodiment of the present application.
[0053] Figure 3 for Figure 2 Schematic diagram of the flow chart of the sub-steps of step 020.
[0054] Figure 4 A schematic diagram of a flow chart for calculating a logic value K2 provided in an embodiment of the present application.
[0055] Figure 5 The third flowchart of the adaptive human-computer interaction method provided in the embodiment of the present application.
[0056] Figure 6 A schematic diagram of the circuit structure of an electronic device provided in an embodiment of the present application.
[0057] Icon: 200 - electronic device; 210 - vehicle controller; 220 - image acquisition module; 230 - display module; 240 - sensor component; 250 - communication module. DETAILED DESCRIPTION
[0058] The present application will be described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be noted that in the drawings or descriptions, similar or identical parts use the same figure numbers, and the implementation methods not shown or described in the drawings are forms known to ordinary technicians in the relevant technical field. In the description of this application, the terms "first", "second", etc. are only used to distinguish the description and cannot be understood as indicating or implying relative importance.
[0059] First embodiment
[0060] Please refer to Figure 1 The embodiment of the present application provides an adaptive human-computer interaction method, which can be applied to electronic devices. The electronic device can be a terminal device, a vehicle-mounted intelligent system, a ship intelligent system, etc., which can be used as an interactive object of the user. The adaptive human-computer interaction method can include the following steps:
[0061] Step 110, obtaining a data set corresponding to the interactive object, wherein the data set includes at least one of the geographical location, weather, ambient temperature, ambient humidity, time, and light intensity of the interactive object;
[0062] Step 120, determining the scene in which the interactive object is currently located according to the data set as a target scene;
[0063] Step 130 , selecting and enabling a control function corresponding to the target scene from a pre-established function database as the current human-computer interaction function, wherein the function database includes at least two control functions.
[0064] The following will describe the steps of the adaptive human-computer interaction method in detail as follows:
[0065] Please refer to Figure 2 Before step 110, the method may further include the step of creating a function database. For example, before step 110, the method may further include:
[0066] Step 010, creating a function database having at least two control functions based on the function configuration data;
[0067] Step 020, determining the recommended degree values of different control functions in corresponding scenarios through a preset algorithm.
[0068] In this embodiment, the function configuration data is data prepared by engineers based on different control functions. The control functions recorded and stored in the function database may be as shown in Table 1 below.
[0069] Table 1:
[0070] Sunroof switch function Window lift function Driving mode switching function Energy feedback regulation function Music switching function Volume adjustment function Air conditioning air volume adjustment function Air conditioning temperature adjustment function Phone connection function Front windshield defog function
[0071] Understandably, the control functions in the function database may include, but are not limited to, at least one of the sunroof switch function, window lift function, driving mode switch function, energy feedback adjustment function, music switch function, volume adjustment function, air conditioning volume adjustment function, air conditioning temperature adjustment function, phone connection function, and front windshield defog function recorded in Table 1. Engineers may delete the control functions in the function database and add new control functions as needed.
[0072] In step 020, the preset algorithm can be flexibly selected according to actual conditions and can be used to calculate the recommended degree value of each control function in different scenarios.
[0073] Please refer to Figure 3 For example, step 020, determining the recommended degree values of different control functions in corresponding scenarios by a preset algorithm, may include:
[0074] Step 021, obtaining a first frequency value of the current user selecting the same control function in a corresponding scenario, a second frequency value of all users selecting the same control function in the corresponding scenario, and a logic value of selecting the same control function in the corresponding scenario;
[0075] Step 022, based on the first frequency value X1, the second frequency X2 and the logic value K2 corresponding to any control function in the corresponding scenario, determine the recommended degree value Y of any control function in the corresponding scenario through a preset formula to obtain the recommended degree values of different control functions in the corresponding scenario. The preset formula for calculating the recommended degree value Y is:
[0076] Y=X1+K2*X2 (1)
[0077] In the formula, Y refers to the recommended degree value, X1 refers to the first frequency, X2 refers to the second frequency, and K2 refers to the logic value.
[0078] In this embodiment, the recommendation value may be determined by three factors: user, scenario, and control function, that is, the recommendation values of the same control function may be different for different users and different scenarios. In the process of the user using the control function, the interactive object may count the historical operation records of the user to count the frequency of the user selecting each control function in each scenario, and generate a user's personal frequency value for each control function in each scenario, which is the first frequency X1.
[0079] In step 021, the first frequency X1 may be determined in the following manner:
[0080]
[0081] In the formula, X ∝1 Refers to the total number of times the current user selects the same control function in the corresponding scenario, and SUM refers to the total number of times the current user selects all control functions in the corresponding scenario.
[0082] When the user triggers the control function for the first time, the initial value of X1 may be 0 or other default values. In addition, each time the user triggers the control function, the electronic device may iteratively update the first frequency X1 corresponding to the current user.
[0083] In this embodiment, the method can be implemented by a program (such as an application program, a system program, etc.) deployed in the interactive object. The server can use the Internet big data to obtain the operation records of all users who use the same program to select the corresponding control function in different scenarios, and store the records. The interactive object can obtain the second frequency X2 from the server. Based on big data, the interactive object can count the frequency of all users of this brand selecting each control function in each scenario, and calculate the average frequency value of all users selecting each control function in the scenario, which is the second frequency X2.
[0084] The second frequency X2 may be determined in the following manner:
[0085]
[0086] In the formula, Z n It refers to the frequency value of the nth user selecting the same control function in the corresponding scenario, N refers to the total number of users, and n is an integer between 1 and N.
[0087] The logic value K2 is obtained based on the average extracted variance value AVE of the current user's operation proportion, and the logic value is used to indicate the concentration degree of selecting the same control function in the corresponding scenario, where: Num1 refers to the number of users who select the same control function in the corresponding scenario, and N refers to the total number of users.
[0088] In this embodiment, the first frequency X1 reflects the personal operating habits of local users, the logic between control functions and scenes. The second frequency X2 is derived based on the operating data of all users, and focuses more on reflecting the logic between control functions and scenes. The logic value K2 is used to determine whether the user's choice in each scene is a common operation for all users or a personalized operation for the user. The logic value K2 is positively correlated with the degree of concentration of all user choices in a certain scene. The higher the degree of concentration, the stronger the logic behind this choice, and the larger the K2 value; on the contrary, the lower the degree of concentration, the higher the degree of personalized choice of the user behind this choice, and the smaller the K2 value. Using the logic value K2, the second frequency X2 of the control function with strong commonality is superimposed on the first frequency X1 to speed up the algorithm iteration speed. For the control function with weak commonality, the average frequency value X2 is not superimposed on the user's personal frequency value X1 to respect the user's personalized choice.
[0089] Please refer to Figure 4 In this embodiment, the logic value K2 can be obtained by the average extracted variance value AVE of the user's operation proportion. As an example, the calculation method of the logic value K2 can be:
[0090] S31, calculating the AVE value of each control function;
[0091] S32, when 20%>AVE≥0, K2=0;
[0092] S33, when 80%>AVE≥20%, K2=AVE;
[0093] S34, when 100% ≥ AVE ≥ 80%, K2 = 1;
[0094] S35, output logic value K2.
[0095] For example, 75% of users will select the sunroof switch function as the current human-computer interaction function when the weather changes from sunny to rainy. In the same scenario (e.g., the weather changes from sunny to rainy, or the weather forecast indicates that it will rain within half an hour), users select the sunroof switch function as a common operation, and the K2 value is 0.75; 10% of users will select the volume adjustment function as the control function of the gesture interaction method when the weather changes from sunny to rainy. In this scenario, users select the gesture interaction control function as the volume adjustment function as a personalized operation, and the K2 value is equal to 0.
[0096] The calculation of the logical value K2 is described below by example:
[0097] In the first step, the interactive object / server can retrieve big data according to the current scene and calculate the AVE value of each control function. For example, if the current scene is that the weather changes from sunny to rainy and the car windows are open, the AVE value of each control function can be calculated.
[0098] The second step is to obtain K2 based on the AVE value. For example, the AVE value of the window lift function is 75%, which means that the window lift function is a common operation in this scenario, and K2 is 0.75; the AVE value of the volume adjustment function is 10%, which means that the volume adjustment function is a personalized operation in this scenario, and K2 is 0.
[0099] In step 110, the interactive object can use its own or external electronic devices to obtain a data set. For example, when the interactive object is a vehicle, the electronic device may include, but is not limited to, a temperature sensor, a humidity sensor, a HUD (Head-up Display), a dashboard, a display screen, an image acquisition module, a communication module, and a positioning module. The acquired data set may include, but is not limited to, geographic location, weather, ambient temperature, ambient humidity, time, light intensity, sunroof switch status, window switch status, vehicle speed, etc. The data set is acquired in a conventional manner and will not be described in detail here.
[0100] Step 120, determining the scene in which the interactive object is currently located according to the data set as a target scene, may include:
[0101] Based on the pre-established correspondence between the data and the scenes in the preset scene library, a scene corresponding to the data in the data set is selected from the preset scene library as the target scene.
[0102] In this embodiment, engineers can list several scenarios based on different data in the data set as a preset scenario library, and create a correspondence between different data and scenarios. The correspondence can be a relationship table, which records different data and corresponding scenarios. The interactive object can find the scene corresponding to the current data set from the relationship table as the target scene.
[0103] In this embodiment, different control functions can be set with different risk levels to reflect the risk situation of triggering the control function. The risk levels of different control functions can be flexibly set according to actual conditions. The higher the risk level, the lower the safety of driving. To ensure driving safety, the triggering of a control function with a high risk level can be configured to require reconfirmation or multiple confirmations before execution. The triggering of a control function with a low risk level can be configured to be executed once triggered.
[0104] For example, as an optional implementation, between step 120 and step 130, the method may further include:
[0105] If the risk level corresponding to the current human-computer interaction function is higher than the preset level, a prompt message is issued indicating that the current user needs to confirm whether to continue the execution;
[0106] Within a first preset time period of sending the prompt information, if a first confirmation instruction indicating confirmation to continue execution is received, the execution step executes a sub-function corresponding to the current human-computer interaction function based on the interaction instruction.
[0107] In this embodiment, the content of the prompt information can be flexibly set according to actual conditions. The first preset duration and the second preset duration described below can be flexibly set according to actual conditions. The first confirmation instruction can be an instruction generated by the current user through a corresponding physical button, an instruction generated based on a virtual function button in a touch display screen, an instruction generated based on collecting a corresponding gesture action image of the current user, or an instruction generated based on collecting a corresponding voice of the current user. The generation method of the first confirmation instruction is not specifically limited here.
[0108] In this embodiment, for control functions related to driving safety, such as driving mode switching function and energy recovery adjustment function, such functions need to be confirmed by the user again before they are executed. Control functions that do not involve driving safety, such as air volume adjustment function, window lifting function, music switching function, etc., can be executed after a single trigger without the need for user confirmation.
[0109] As an example, the controller detects that the currently enabled control function involves driving safety, for example, the driving mode switching function. If it is a gesture interaction, during the activation of the driving mode switching function, in a detection process, the controller detects the user's first waving movement, for example, the user waves forward at this time. At this time, the display screen can prompt the user that the current function involves driving safety and needs to be confirmed by gesture movement again. The prompt content can be "Please repeat the last gesture movement to confirm the execution." Within 3 seconds of the prompt message being issued, if the user repeats the last gesture movement and the image acquisition module captures the forward waving movement image indicating confirmation of execution, a first confirmation instruction will be generated at this time. After obtaining the first confirmation instruction, continue to execute step 130, such as switching the driving mode; if the first confirmation instruction is not received within 3 seconds of the prompt message being issued, the process ends, and a prompt message indicating a confirmation timeout can also be issued.
[0110] Step 130, selecting and enabling a control function corresponding to the target scene from a pre-established function database as the current human-computer interaction function, may include:
[0111] From the function database, a control function with the largest recommendation value in the target scenario is selected and enabled as the current human-computer interaction function, wherein the control functions stored in the function database carry the recommendation value corresponding to the target scenario.
[0112] In this embodiment, the function database may store and record the recommendation value of each control function of each user in different scenarios. The interactive object may index the recommendation value of each control function corresponding to the current user (such as user account) and the target scenario from the function database, and then select the control function with the largest recommendation value as the current human-computer interaction function and enable the function. After the function is enabled, the following steps 140 and 150 may be performed to perform the corresponding human-computer interaction process.
[0113] Please refer to Figure 5 As an optional implementation, after step 130, the method may further include:
[0114] Step 140, receiving an interaction instruction input by the current user, wherein the interaction instruction includes at least one of an instruction generated based on a physical key, an instruction generated based on a touch screen, an instruction generated based on a gesture action image of the current user, and an instruction generated based on a voice of the current user;
[0115] Step 150: Execute a sub-function corresponding to the current human-computer interaction function based on the interaction instruction.
[0116] In this embodiment, the interaction instruction is used to trigger the execution of the sub-function corresponding to the human-computer interaction function, and can be flexibly generated according to actual conditions. For example, if the interaction instruction is an instruction generated based on a gesture action image, the sub-functions triggered by different gesture actions can be as shown in Table 2 below.
[0117] Table 2:
[0118]
[0119]
[0120] As an example, when the interaction object is a vehicle, the implementation process of step 110 to step 150 may be as follows:
[0121] In the first step, the controller on the vehicle retrieves the Internet of Vehicles information and data collected by sensors to obtain information such as the current temperature, humidity, weather, vehicle speed, time, location, window status, sunroof status, etc.
[0122] In the second step, the controller determines the current scene of the vehicle based on the retrieved data set. If the user is currently entering a scenic area from the urban area, the weather is clear, the vehicle speed is 35, the temperature is 26°C, the humidity is 50%, and the windows are closed, the corresponding scene is scene 1.
[0123] In the third step, the controller matches the recommended degree value Y of each control function according to the current scene 1, and sorts the control functions from high to low according to the size of the recommended degree value Y, such as: sunroof switch function-window lifting function-driving mode switching function-volume adjustment function-energy feedback adjustment function-music switching function-air conditioning volume adjustment function-air conditioning temperature adjustment function-telephone connection function-front windshield defog function; then, select the "sunroof switch function" with the largest recommended degree value Y as the current human-computer interaction function, and enable the function. In addition, the controller controls the display screen to display the function icon of the current control function.
[0124] In the fourth step, the image acquisition module sends the captured user's gesture image to the controller to determine the user's gesture. Assuming that the user waves forward at this time, the controller detects the user's waving forward through the image acquisition module.
[0125] In the fifth step, the controller controls the sunroof to open and controls the display screen to flash the function icon of the sunroof switch.
[0126] The sixth step is to record the user's operation records to iteratively update the recommended degree value of the control function.
[0127] After step 130, the method may further include:
[0128] When a first control instruction for updating the recommendation value is received, based on the latest historical operation record, the recommendation values of different control functions in the corresponding scenario are determined by a preset algorithm, and the recommendation values of the historical records are updated.
[0129] The first control instruction may be an instruction automatically generated based on a set cycle, or an instruction generated by a user through a function button on a touch screen. The latest historical operation record is the historical operation record of all users recorded by the server before receiving the first control instruction. The historical operation record can be used to calculate the latest first frequency value, second frequency value and logic value, and then the latest recommendation value is calculated using formula (1) to update the historical recommendation value. This is conducive to making the recommendation value more accurately adapt to subsequent human-computer interaction to improve the accuracy of the recommended control function.
[0130] As an optional implementation, the method may further include:
[0131] During the execution of the sub-function, if a second control instruction for interrupting the execution operation is received, the execution component that controls the execution of the sub-function is suspended, and the execution component is controlled to roll back to the state before the execution of the sub-function. The generation method of the second control instruction is similar to the generation method of the interaction instruction, and will not be repeated here.
[0132] In this embodiment, when the user finds that the control function is triggered by mistake, the user can interrupt the action of the current vehicle target execution component by making a fist gesture and return to the state before the action. After the controller detects the user's fist gesture through the image acquisition module, it can first interrupt the ongoing action of the mistakenly triggered execution component (i.e., the target execution component) and then return to the state before the action.
[0133] As an example, the process of interrupting the false triggering of the control function may be as follows:
[0134] When the user finds that the gesture recognition is falsely triggered, if the executing component is a defogger component on the vehicle and the front windshield defogger function is executed. During the defogger period, if the controller detects the user's fist gesture through the image acquisition module, the controller will control the defogger component to turn off the front windshield defogger function.
[0135] With the iteration of the algorithm and the accumulation of user operation data, the intelligence level of the method provided in this embodiment will be higher and higher, but in the iteration process, it is still inevitable that the recommended function does not match the user's needs. At this time, the user can switch the control function.
[0136] For example, as an optional implementation, the method may further include:
[0137] When receiving a fourth control instruction for switching a control function, based on the switching direction carried by the fourth control instruction, selecting a control function adjacent to the current human-computer interaction function and having the same switching direction from the function database as a candidate control function, wherein the control functions in the function database are arranged in order of magnitude of the recommendation degree values;
[0138] When a second confirmation instruction indicating selection of the candidate control function is received, or when no new fourth control instruction is received within a second preset time after receiving the fourth control instruction, the candidate control function is used as the current human-computer interaction function.
[0139] In this embodiment, the user can switch to the previous control function by waving left, or switch to the next control function by waving right. After the controller recognizes the user's gesture movement through the image acquisition module, the switched control function icon is displayed on the display screen.
[0140] As an example, the switching process of the control function may be as follows:
[0141] In the first step, assuming that the current human-computer interaction function is the window lifting function, the order of the control functions based on the recommended degree value from large to small is: sunroof switch function-window lifting function-driving mode switching function-volume adjustment function-energy feedback adjustment function-music switching function-air volume adjustment function-temperature adjustment function-backrest angle adjustment function-phone connection function-front windshield defog function. If the controller recognizes the user's waving action to the right through the image acquisition module.
[0142] In the second step, the controller adjusts the current control function to the next control function, that is, switches the "window lifting function" to the "driving mode switching function".
[0143] In the third step, the controller controls the display screen to display the icon of the driving mode switching function.
[0144] The user can wave left or right multiple times until switching to the control function he needs. Since the control functions are sorted according to the recommended values (the sorting method can be from the order of recommended values from large to small, or from small to large), it is helpful for users to quickly switch to the control functions they need and use frequently.
[0145] As an optional implementation, the method may further include:
[0146] Control the display screen of the interactive object to display the identification information corresponding to the current human-computer interaction function, and / or display the running status of the corresponding sub-function under the current human-computer interaction function, wherein the identification information includes at least one of a function icon and text.
[0147] In this embodiment, when switching or enabling a control function, the display screen can be controlled to display the function icon of the currently selected / enabled control function. When executing a sub-function of the control function, the function icon corresponding to the sub-function can be flashed so that the user can intuitively understand the currently enabled control function and the operating status of the sub-function.
[0148] Second embodiment
[0149] The embodiment of the present application provides an electronic device, which may include a processor and a memory. The memory stores a computer program, and when the computer program is executed by the processor, the electronic device can perform the corresponding steps in the following adaptive human-computer interaction method.
[0150] Please refer to Figure 6 For example, when the electronic device 200 is used as an intelligent system on a vehicle, the processor and the memory can be integrated as a vehicle controller 210. In other embodiments, the processor and the memory can be independent electronic devices.
[0151] The electronic device 200 may also include, but not limited to, electronic devices such as an image acquisition module 220, a display module 230, a sensor assembly 240, and a communication module 250, and each electronic device may be connected to each other through a bus communication. The sensor assembly 240 may include, but not limited to, a temperature sensor and a humidity sensor. The display module 230 may include, but not limited to, a HUD (Head-up Display), an instrument panel, a central control display screen, etc. The image acquisition module 220 may be, but not limited to, an in-vehicle camera. The communication module 250 may be used to establish a communication connection between the vehicle and devices such as a smart phone and a server.
[0152] The electronic device 200 may also include other modules, such as a positioning module. The vehicle controller 210 may obtain corresponding data sets (such as temperature, humidity, geographic location, vehicle speed, etc.) from the electronic device.
[0153] It should be noted that those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the electronic device 200 described above can refer to the corresponding process of each step in the aforementioned method, and will not be elaborated herein.
[0154] Third embodiment
[0155] The embodiment of the present application also provides a vehicle, which has a vehicle body and the electronic device in the above embodiment. When the vehicle uses the adaptive human-computer interaction method in the above embodiment to interact with the user, the control function of the human-computer interaction is adaptively switched as the scene in which the interactive object is located changes, thereby facilitating the improvement of the adaptive ability of the human-computer interaction and the user experience.
[0156] Fourth embodiment
[0157] The embodiment of the present application further provides a computer-readable storage medium. The computer-readable storage medium stores a computer program, and when the computer program is executed on a computer, the computer executes the adaptive human-computer interaction method described in the above embodiment.
[0158] Fifth embodiment
[0159] The embodiment of the present application further provides a computer program product, including a computer program. When the computer program is executed by a processor, the adaptive human-computer interaction method described in the above embodiment can be implemented.
[0160] Through the description of the above implementation methods, technical personnel in this field can clearly understand that the present application can be implemented by hardware, and can also be implemented by means of software plus a necessary general hardware platform. Based on such an understanding, the technical solution of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.), including a number of instructions for enabling a computer device (which can be a personal computer, an electronic device, or a network device, etc.) to execute the methods described in each implementation scenario of the present application.
[0161] In the embodiments provided in the present application, it should be understood that the disclosed equipment and methods can also be implemented in other ways. The equipment and method embodiments described above are merely schematic, for example, the flowcharts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the systems, methods and computer program products according to the multiple embodiments of the present application. In this regard, each box in the flowchart or block diagram can represent a part of a module, a program segment or a code, and a part of the module, program segment or code includes one or more executable instructions for implementing the specified logical functions. It should also be noted that each box in the block diagram and / or the flowchart, and the combination of the boxes in the block diagram and / or the flowchart can be implemented by a dedicated hardware-based system that performs the specified function or action, or can be implemented by a combination of dedicated hardware and computer instructions. In addition, each functional module in each embodiment of the present application can be integrated together to form an independent part, or each module can exist separately, or two or more modules can be integrated to form an independent part.
[0162] The above description is only an embodiment of the present application and is not intended to limit the protection scope of the present application. For those skilled in the art, the present application may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims
1. An adaptive human-computer interaction method, characterized in that: The method comprises: Acquire a data set corresponding to the interactive object, the data set including at least one of the geographical location, weather, ambient temperature, ambient humidity, time, and light intensity of the interactive object; Determine, according to the data set, the scene in which the interactive object is currently located as a target scene; A control function corresponding to the target scene is selected and enabled from a pre-established function database as a current human-computer interaction function, wherein the function database includes at least two control functions.
2. The method according to claim 1, characterized in that Before acquiring the data set corresponding to the interactive object, the method further includes: creating a function database having at least two control functions based on the function configuration data; Through the preset algorithm, the recommended degree values of different control functions in the corresponding scenarios are determined.
3. The method according to claim 2, characterized in that Through the preset algorithm, the recommended degree values of different control functions in the corresponding scenarios are determined, including: Obtaining a first frequency value of the current user selecting the same control function in a corresponding scenario, a second frequency value of all users selecting the same control function in the corresponding scenario, and a logic value of selecting the same control function in the corresponding scenario; Based on the first frequency value, the second frequency and the logic value corresponding to any control function in the corresponding scenario, a recommended degree value of any control function in the corresponding scenario is determined by a preset formula to obtain recommended degree values of different control functions in the corresponding scenario, and the preset formula is: Y=X1+K2*X2 In the formula, Y refers to the recommended degree value, X1 refers to the first frequency, X2 refers to the second frequency, and K2 refers to the logic value.
4. The method according to claim 3, characterized in that: The first frequency X1 is determined as follows: In the formula, X ∝1 Refers to the total number of times the current user selects the same control function in the corresponding scenario, and SUM refers to the total number of times the current user selects all control functions in the corresponding scenario; The second frequency X2 is determined as follows: In the formula, Z n Refers to the frequency value of the nth user selecting the same control function in the corresponding scenario, N refers to the total number of users, and n is an integer between 1 and N; The logic value K2 is obtained based on the average extracted variance value AVE of the current user's operation proportion, and the logic value is used to indicate the concentration degree of selecting the same control function in the corresponding scenario, wherein, Num1 refers to the number of users who select the same control function in the corresponding scenario.
5. The method according to claim 2, characterized in that: After selecting and enabling a control function corresponding to the target scenario from a pre-established function database, the method further includes: When the first control instruction for updating the recommendation value is received, based on the latest historical operation record, the recommendation value of different control functions in the corresponding scenario is determined by a preset algorithm, and the recommendation value of the historical record is updated.
6. The method according to claim 1, characterized in that Determining, according to the data set, a scene in which the interactive object is currently located as a target scene, including: Based on the pre-established correspondence between the data and the scenes in the preset scene library, a scene corresponding to the data in the data set is selected from the preset scene library as the target scene.
7. The method according to claim 1, characterized in that From a pre-established function database, a control function corresponding to the target scenario is selected and enabled as the current human-computer interaction function, including: From the function database, a control function with the largest recommendation value in the target scenario is selected and enabled as the current human-computer interaction function, wherein the control functions stored in the function database carry the recommendation value corresponding to the target scenario.
8. The method according to claim 1, characterized in that The method further comprises: Receive an interactive instruction input by the current user, wherein the interactive instruction includes at least one of an instruction generated based on a physical key, an instruction generated based on a touch screen, an instruction generated based on a gesture action image of the current user, and an instruction generated based on a voice of the current user; Based on the interaction instruction, a sub-function corresponding to the current human-computer interaction function is executed.
9. The method according to claim 8, characterized in that The method further comprises: During the execution of the sub-function, if a second control instruction for interrupting the execution operation is received, the execution component executing the sub-function is controlled to pause the action, and the execution component is controlled to roll back to the state before executing the sub-function.
10. The method according to claim 8, characterized in that Between the step of receiving the interaction instruction currently input by the user and the step of executing the sub-function corresponding to the current human-computer interaction function based on the interaction instruction, the method further includes: If the risk level corresponding to the current human-computer interaction function is higher than the preset level, a prompt message is issued indicating that the current user needs to confirm whether to continue the execution; Within a first preset time period of sending the prompt information, if a first confirmation instruction indicating confirmation to continue execution is received, the execution step executes a sub-function corresponding to the current human-computer interaction function based on the interaction instruction.
11. The method according to claim 8, characterized in that The method further comprises: Control the display screen of the interactive object to display the identification information corresponding to the current human-computer interaction function, and / or display the running status of the corresponding sub-function under the current human-computer interaction function, wherein the identification information includes at least one of a function icon and text.
12. The method according to claim 1, characterized in that The method further comprises: When receiving a fourth control instruction for switching a control function, based on the switching direction carried by the fourth control instruction, selecting a control function adjacent to the current human-computer interaction function and having the same switching direction from the function database as a candidate control function, wherein the control functions in the function database are arranged in order of magnitude of the recommendation degree values; When a second confirmation instruction indicating selection of the candidate control function is received, or when no new fourth control instruction is received within a second preset time after receiving the fourth control instruction, the candidate control function is used as the current human-computer interaction function.
13. The method according to any one of claims 1 to 12, characterized in that The interactive object includes a vehicle, and the control functions in the function database include at least one of a sunroof switch function, a window lifting function, a driving mode switching function, an energy feedback adjustment function, a music switching function, a volume adjustment function, an air conditioning volume adjustment function, an air conditioning temperature adjustment function, a phone connection function, and a front windshield defog function.
14. An electronic device, characterized in that: The electronic device comprises a processor and a memory coupled to each other, wherein the memory stores a computer program. When the computer program is executed by the processor, the electronic device executes the method according to any one of claims 1 to 13.
15. A vehicle, characterized in that: The vehicle comprises a vehicle body and the electronic device as claimed in claim 14.
16. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed on a computer, the computer is enabled to execute the method according to any one of claims 1 to 13.
17. A computer program product, characterized in that It comprises a computer program which, when executed by a processor, implements the method according to any one of claims 1 to 13.
Citation Information
Patent Citations
Vehicle component control method and device and vehicle
CN117962742A
