Interface response method and device for control terminal, electronic equipment and storage medium

By identifying the pre-trigger function points on the display interface of the control terminal and determining the target function points, the problem that visually impaired users find it difficult to accurately when clicking on the function area is solved, and more accurate user operations and better user experience are achieved.

CN119717623APending Publication Date: 2025-03-28GREE ELECTRIC APPLIANCE INC OF ZHUHAI +1
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
CN202411875273.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-12-19
Publication Date
2025-03-28

AI Technical Summary

Technical Problem

When using the control terminal, visually impaired people find it difficult to accurately click on the functional area due to hand shaking or unable to see clearly, resulting in the inability to accurately control smart home devices, affecting the user experience.

Method used

By realizing the identification of pre-trigger function points and determining the target function points on the display interface of the control terminal, double screening is performed using the trigger operation and the trigger area, error area and distance threshold of the function points to ensure accurate response to the user's trigger operation.

Benefits of technology

It realizes that when the user triggers the function point, the target function point corresponding to the trigger operation is accurately determined, thereby improving the accuracy and experience of the user's operation.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119717623A_ABST
    Figure CN119717623A_ABST
Patent Text Reader

Abstract

The invention relates to an interface response method and device for a control terminal, electronic equipment and a storage medium, the method and device are applied to the control terminal, the control terminal comprises a preset display interface, the display interface comprises at least one function point, and the method comprises the steps that when a trigger operation for the display interface is received, the function point of the display interface is displayed; determining at least one pre-triggering function point correspondingly triggered by the triggering operation under the condition that the triggering operation does not trigger any function point; determining a target function point from the at least one pre-triggering function point; and responding to the target function point. Therefore, the target function point corresponding to the trigger operation can be accurately determined under the condition that the trigger operation of the user does not trigger the function point in the display interface, so that the trigger operation is responded more accurately, and the user experience is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of intelligent terminals, and in particular to a method, device, electronic device and storage medium for controlling the interface response of a terminal. Background Art

[0002] At present, with the continuous development of smart home systems, in order to facilitate the control of smart home devices, multiple smart home devices can generally be controlled through a unified smart terminal, realizing one control terminal to control multiple smart home devices, so that users can enjoy the experience brought by technology.

[0003] However, there are some visually impaired people in society who cannot better use and experience the convenience brought to us by technology due to physiological reasons. For example, most visually impaired users will encounter operational difficulties when using control terminals. For example, when they want to use a certain function, they need to implement this function by clicking on the APP (Application, mobile software). However, due to hand shaking or unclear vision, they cannot accurately click on the desired functional area, which makes it impossible to accurately control the desired smart home devices, affecting the user experience. Summary of the invention

[0004] The present application provides an interface response method, device, electronic device and storage medium of a control terminal to solve the technical problem in the prior art that some visually impaired people are unable to accurately click on the functional area they want to click in the control terminal due to hand tremors or unclear vision, thereby failing to accurately control the smart home devices they want to control, affecting the user experience.

[0005] In a first aspect, the present application provides an interface response method of a control terminal, which is applied to a control terminal, wherein the control terminal includes a preset display interface, and the display interface includes at least one function point. The method includes:

[0006] Upon receiving a trigger operation for a display interface and determining that the trigger operation does not trigger any function point, determining at least one pre-trigger function point triggered by the trigger operation;

[0007] Determining a target function point from at least one of the pre-trigger function points;

[0008] Respond to the target function point.

[0009] As an optional implementation manner, each of the function points corresponds to a trigger area, and determining that the trigger operation does not trigger any function point includes:

[0010] Acquire a trigger point in the display interface corresponding to the trigger operation;

[0011] In the case where it is determined that the trigger point does not belong to any of the trigger areas, determining that the trigger operation does not trigger any function point;

[0012] The determining of at least one pre-trigger function point triggered by the trigger operation includes:

[0013] At least one pre-trigger function point triggered by the trigger operation is determined according to the trigger point and the trigger area of ​​each of the function points.

[0014] As an optional implementation, each of the function points corresponds to an error area, the error area is larger than the trigger area corresponding to the function point and includes the trigger area;

[0015] The determining, according to the trigger point and the trigger area of ​​each of the function points, at least one pre-trigger function point triggered by the trigger point includes:

[0016] determining whether the trigger point belongs to at least one of the error regions;

[0017] In the case where it is determined that the trigger point belongs to at least one of the error regions, a function point corresponding to the error region to which the trigger point belongs is determined as a pre-trigger function point.

[0018] As an optional implementation, the method further includes:

[0019] In the case where it is determined that the trigger point does not belong to any of the error regions, determining the shortest distance between the trigger point and a boundary of each of the plurality of adjacent trigger regions;

[0020] Determining whether each of the shortest distances is less than a preset distance threshold;

[0021] When it is determined that the shortest distance is less than the distance threshold, the function point corresponding to the shortest distance is determined as the pre-trigger function point.

[0022] As an optional implementation, the determining, according to the trigger point and the trigger area of ​​each of the function points, at least one pre-trigger function point triggered by the trigger operation includes:

[0023] Determine the shortest distance between the trigger point and a boundary of each of the trigger areas in a plurality of adjacent trigger areas;

[0024] Determining whether each of the shortest distances is less than a preset distance threshold;

[0025] When it is determined that the shortest distance is less than the distance threshold, the function point corresponding to the shortest distance is determined as the pre-trigger function point.

[0026] As an optional implementation manner, determining a target function point from at least one of the pre-trigger function points includes:

[0027] Determining at least one initial function point from at least one of the pre-trigger function points;

[0028] Acquiring function information of at least one of the initial function points;

[0029] Feedback the functional information of at least one of the initial functional points;

[0030] In case of receiving a confirmation operation for any of the function information, the initial function point corresponding to the function information is determined as a target function point.

[0031] As an optional implementation manner, determining at least one initial function point from at least one of the pre-trigger function points includes:

[0032] In the case where it is determined that there is one pre-trigger function point, determining the pre-trigger function point as an initial function point;

[0033] In the case where it is determined that there are multiple pre-trigger function points, at least one initial function point is determined from the multiple pre-trigger function points.

[0034] As an optional implementation, each of the function points is used to control a preset smart home device, and determining at least one initial function point from the plurality of pre-trigger function points includes:

[0035] Determine the operating status of the smart home device corresponding to each of the pre-trigger function points;

[0036] For each of the pre-trigger function points, determining whether the operation state of the smart home device corresponding to the pre-trigger function point is in operation;

[0037] When it is determined that the operating state of the smart home device corresponding to the pre-trigger function point is in operation, the pre-trigger function point is determined as the initial function point.

[0038] As an optional implementation manner, determining at least one initial function point from the plurality of pre-trigger function points includes:

[0039] For each of the pre-trigger function points, obtaining the historical time point at which the pre-trigger function point was most recently triggered;

[0040] In the case where it is determined that the historical time point is within a preset historical time period, the pre-trigger function point is determined as an initial function point.

[0041] As an optional implementation manner, the feeding back the function information of at least one of the initial function points includes:

[0042] Obtain text description information of the function information corresponding to each of the initial function points;

[0043] A function information layer is outputted at the top layer of the display interface, wherein the function information layer includes the text description information of the initial function point and a selection button for the text description information; wherein the font size of the text description information is larger than the font size in the display interface.

[0044] As an optional implementation, the selection button includes a first selection button and a second selection button, and when a confirmation operation for any of the function information is received, determining the initial function point corresponding to the function information as the target function point includes:

[0045] In case of receiving a first trigger operation for the first selection button, determining the initial function point as a target function point;

[0046] The method further comprises:

[0047] When a second trigger operation for the second selection button is received, the function information layer is closed; when it is determined that there is a next initial function point, a next function information layer corresponding to the next initial function point is output at the top layer of the display interface.

[0048] As an optional implementation manner, the feeding back the function information of at least one of the initial function points includes:

[0049] In the case where there is only one initial function point, playing the first voice information indicating whether the initial function point is selected and the second voice information corresponding to the function information of the initial function point according to the preset voice playing mode;

[0050] In the case that there are multiple initial function points, the first voice information and the second voice information corresponding to each initial function point are played in turn according to a preset voice playing mode.

[0051] As an optional implementation manner, when a confirmation operation for any of the function information is received, determining the initial function point corresponding to the function information as the target function point includes:

[0052] For the first voice information corresponding to any of the initial function points, determining whether a response voice signal corresponding to the first voice information is received;

[0053] When receiving the response voice signal, recognizing the response voice signal to obtain a recognition result;

[0054] In the case where the recognition result indicates the selection of the initial function point, the initial function point corresponding to the recognition result is determined as the target function point.

[0055] As an optional implementation, the method further includes:

[0056] When the control terminal outputs the display interface and does not receive any trigger operation within a preset time period, obtaining historical trigger operations for the display interface within a preset historical time period;

[0057] Determine a plurality of selection function points according to the historical trigger operation, and obtain selection function information corresponding to each of the selection function points;

[0058] Polling and playing the voice function information corresponding to each of the selected function points, the voice function information including third voice information used to indicate whether the selected function point is selected, and fourth voice information corresponding to the selected function information;

[0059] When receiving the response voice information for any of the selected function points, recognizing the response voice information to obtain a response recognition result;

[0060] In the case where the response recognition result indicates that the selection function point is selected, the selection function point is responded to.

[0061] In a second aspect, the present application provides an interface response device for a control terminal, which is applied to a control terminal, wherein the control terminal includes a preset display interface, the display interface includes at least one function point, and the device includes:

[0062] A first determining module is used to determine at least one pre-trigger function point triggered by the trigger operation when receiving a trigger operation on the display interface and determining that the trigger operation does not trigger any function point;

[0063] A second determination module, configured to determine a target function point from at least one of the pre-trigger function points;

[0064] The response module is used to respond to the target function point.

[0065] In a third aspect, the present application provides an electronic device comprising: a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other through the communication bus; the memory is used to store a computer program; and the processor is used to implement the interface response method of the control terminal described in any one of the first aspects when executing the computer program.

[0066] In a fourth aspect, the present application provides a storage medium having a computer program stored thereon, which, when executed by a processor, implements the interface response method of the control terminal described in any one of the first aspects.

[0067] The above-mentioned technical scheme provided by the embodiment of the present application has the following advantages over the prior art: the method provided by the embodiment of the present application, by predicting the pre-trigger function point that the user wants to trigger according to the trigger operation when it is determined that the trigger operation on the display interface has not triggered any function point, and determining a target function point from the pre-trigger function points, can accurately determine the target function point corresponding to the trigger operation through double screening in different dimensions, so as to respond to the target function point, and realizes that when the user's trigger operation does not trigger the function point in the display interface, the target function point corresponding to the trigger operation can be accurately determined, thereby achieving a more accurate response to the trigger operation and improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0068] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

[0069] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0070] One or more embodiments are exemplarily described by pictures in the corresponding drawings, and these exemplified descriptions do not constitute limitations on the embodiments. Elements with the same reference numerals in the drawings represent similar elements, and unless otherwise stated, the figures in the drawings do not constitute proportional limitations.

[0071] Figure 1 A flowchart of an embodiment of a method for controlling an interface response of a terminal provided in an embodiment of the present application;

[0072] Figure 2 A flowchart of another embodiment of a method for controlling an interface response of a terminal provided in an embodiment of the present application;

[0073] Figure 3A schematic diagram of an error region provided in an embodiment of the present application;

[0074] Figure 4 A flowchart of another embodiment of a method for controlling an interface response of a terminal provided in an embodiment of the present application;

[0075] Figure 5 A flowchart of another embodiment of a method for controlling an interface response of a terminal provided in an embodiment of the present application;

[0076] Figure 6 A flowchart of an embodiment of a method for controlling an interface response of a terminal provided in an embodiment of the present application;

[0077] Figure 7 A flowchart of an embodiment of a method for controlling an interface response of a terminal provided in an embodiment of the present application;

[0078] Figure 8 A flowchart of an embodiment of an interface response device for a control terminal provided in an embodiment of the present application;

[0079] Fig. 9 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0080] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0081] The disclosure below provides many different embodiments or examples to implement different structures of the present invention. In order to simplify the disclosure of the present invention, the parts and settings of specific examples are described below. Of course, they are only examples, and the purpose is not to limit the present invention. In addition, the present invention can repeat reference numbers and / or letters in different examples. This repetition is for the purpose of simplification and clarity, and does not itself indicate the relationship between the various embodiments and / or settings discussed.

[0082] In order to solve the technical problem in the prior art that some visually impaired people are unable to accurately click on the functional area they want to click in the control terminal due to hand tremors or unclear vision, thereby being unable to accurately control the smart home devices they want to control, affecting the user experience, the present application provides an interface response method, device, electronic device and storage medium for a control terminal, which can predict the pre-trigger function point that the user wants to trigger according to the trigger operation when it is determined that the trigger operation on the display interface has not triggered any function point, and determine a target function point from the pre-trigger function points. Through dual screening in different dimensions, it can accurately determine the target function point corresponding to the trigger operation, thereby responding to the target function point, and achieving accurate determination of the target function point corresponding to the trigger operation when the user's trigger operation does not trigger the function point in the display interface, thereby achieving more accurate response to the trigger operation and improving the user experience.

[0083] The interface response method of the control terminal provided in the present application is further explained below with reference to specific embodiments in conjunction with the accompanying drawings. The embodiments do not constitute a limitation on the embodiments of the present application.

[0084] See also Figure 1 , is a flow chart of an embodiment of a method for controlling the interface response of a terminal provided in an embodiment of the present application. As an embodiment, Figure 1 The process shown can be applied to a control terminal, which may include a preset display interface, wherein the display interface includes at least one function point. Figure 1 As shown, the process may include the following steps:

[0085] Step 101: When a trigger operation for a display interface is received and it is determined that the trigger operation does not trigger any function point, determine at least one pre-trigger function point triggered by the trigger operation.

[0086] The above-mentioned display interface refers to the interface currently displayed by the control terminal, and the display interface may include multiple function points.

[0087] The above-mentioned control terminal refers to a terminal used to control smart home devices, and can also be a smart terminal for daily use. It can be a hardware device that supports network connection and thus provides various network services. It can support various electronic devices with display screens, including but not limited to smart phones, tablet computers, laptop computers, desktop computers, etc. It can also be an application installed in the above-mentioned electronic devices. The embodiments of the present application do not impose any restrictions on this.

[0088] The above-mentioned smart home devices refer to smart devices used in daily home environments, which may include but are not limited to: smart air conditioners, smart TVs, smart refrigerators, smart curtains, smart speakers, etc.

[0089] The above-mentioned function points refer to buttons or trigger points on the display interface of the control terminal, each of which can realize a function after being triggered, so the above-mentioned buttons or trigger points can be called function points. For example, the volume up button can increase the volume of the smart home device to be controlled (such as a TV) after being triggered; another example is the next page button, which can jump the current display interface to the next display interface after being triggered.

[0090] The above-mentioned pre-trigger function point refers to a function point that is predicted to be triggered by the trigger operation when the trigger operation does not trigger any function point.

[0091] In an embodiment of the present application, a user can control the smart home device through a control terminal, and the above-mentioned control terminal generally may include a display interface, which may include at least one function point. The user can perform corresponding control operations on the smart home device by triggering the function point in the display interface.

[0092] In actual applications, the user may be unable to accurately trigger the desired function point when triggering the function point in the display interface of the control terminal due to physical reasons (such as hand shaking or visual impairment, etc.).

[0093] Based on this, when the control terminal receives a trigger operation for the display interface and determines that the trigger operation does not trigger any function point, it can first predict at least one pre-trigger function point that the trigger operation may trigger.

[0094] As for how to determine that the trigger operation does not trigger any function point, and how to determine at least one pre-trigger function point corresponding to the trigger operation, it can be seen below. Figure 2 The process shown is explained and will not be described in detail here.

[0095] Step 102: Determine a target function point from at least one pre-trigger function point.

[0096] Step 103: respond to the above target function point.

[0097] The following is a unified description of step 102 and step 103:

[0098] The above-mentioned target function point refers to a function point triggered by a trigger operation determined from at least one pre-trigger function point.

[0099] In the embodiment of the present application, in order to more accurately determine the function point that the user wants to trigger, after predicting at least one pre-trigger function point corresponding to the trigger operation, the control terminal can determine the target function point that the user wants to trigger from the pre-trigger function point, and then respond to the target function point.

[0100] As an optional implementation, since the above trigger operation is a manual operation, in order to more accurately determine the target function point corresponding to the trigger operation, the control terminal can determine the target function point from at least one pre-trigger function point according to the user's selection. As for how to determine the target function point from at least one pre-trigger function point, it can be explained below and will not be described in detail here.

[0101] The technical solution provided by the embodiment of the present application can determine at least one pre-trigger function point corresponding to the trigger operation when receiving a trigger operation on the display interface and determining that the trigger operation has not triggered any function point, determine the target function point from the at least one pre-trigger function point, and respond to the above target function point. This technical solution predicts the pre-trigger function point that the user wants to trigger based on the trigger operation when it is determined that the trigger operation on the display interface has not triggered any function point, and determines a target function point from the pre-trigger function points. Through double screening in different dimensions, it can accurately determine the target function point corresponding to the trigger operation, thereby responding to the target function point, and accurately determining the target function point corresponding to the trigger operation when the user's trigger operation does not trigger the function point in the display interface, thereby achieving a more accurate response to the trigger operation and improving the user experience.

[0102] See also Figure 2 , which is a flow chart of an embodiment of another method for controlling the interface response of a terminal provided in an embodiment of the present application. Figure 2 The process shown in Figure 1 Based on the process shown in FIG. 1 , it is described how to determine that the trigger operation does not trigger any function point, and how to determine at least one pre-trigger function point corresponding to the trigger operation, when each function point corresponds to a trigger area. Figure 2 As shown, the process may include the following steps:

[0103] Step 201, obtaining a trigger point in a display interface corresponding to a trigger operation;

[0104] Step 202: When it is determined that the trigger point does not belong to any trigger area, it is determined that the trigger operation does not trigger any function point, wherein each function point corresponds to a trigger area.

[0105] The following is a unified description of step 201 and step 202:

[0106] The trigger point mentioned above refers to the point where the trigger operation is triggered in the display interface, which can also be a smaller trigger area, collectively referred to as the trigger point here.

[0107] In an embodiment of the present application, in the display interface of the control terminal, each function point may correspond to a trigger area. Based on this, when determining whether a trigger operation triggers a function point, the trigger point on the display interface corresponding to the trigger operation may be obtained, and it may be determined whether the trigger point belongs to any trigger area.

[0108] As an optional implementation, when determining whether the trigger point belongs to any trigger area, since the trigger point may be an area, it can be determined whether the overlapping area of ​​the trigger point and any trigger area accounts for a greater than a preset value in the total area of ​​the trigger point. If the overlapping area accounts for a greater than the preset value in the total area of ​​the trigger point, it is determined that the trigger point belongs to the corresponding trigger area; if the overlapping area accounts for a less than or equal to the preset value in the total area of ​​the trigger point, it is determined that the trigger point does not belong to the corresponding trigger area.

[0109] Optionally, when it is determined that the trigger point belongs to any trigger area, it means that the trigger point triggers the function point corresponding to the above trigger area, so the trigger operation can be determined to trigger the function point.

[0110] Optionally, when it is determined that the trigger point does not belong to any trigger area, it is indicated that the trigger point does not trigger any function point, and therefore it can be determined that the trigger operation does not trigger any function point.

[0111] Step 203: Determine at least one pre-trigger function point triggered by the trigger operation according to the trigger point and the trigger area of ​​each function point.

[0112] In an embodiment of the present application, when the control terminal determines that the trigger point corresponding to the trigger operation has not triggered any function point, it can determine at least one pre-trigger function point triggered by the trigger operation based on the above trigger point and the trigger area of ​​each function point.

[0113] As an optional implementation, in the display interface of the control terminal, each function point may correspond to an error area, which represents the area range where false triggering is allowed when the function point is triggered, and the error area may be larger than the triggering area of ​​the corresponding function point. Figure 3 , is a schematic diagram of an error region provided in an embodiment of the present application. Figure 3 As shown, the display interface 30 may include a function point A, and the trigger area corresponding to the function point A is a solid line area 31, and there is also an error area, that is, a dotted line area 32, which may be larger than the trigger area and include the trigger area.

[0114] Based on this, when determining at least one pre-trigger function point triggered by the trigger point according to the trigger point and the trigger area of ​​each function point, it can be determined whether the trigger point belongs to at least one error area.

[0115] Optionally, when it is determined that the trigger point belongs to at least one error region, a function point corresponding to the error region to which the trigger point belongs is determined as a pre-trigger function point.

[0116] Optionally, when it is determined that the trigger point does not belong to any error area, multiple trigger areas adjacent to the trigger point may be determined, and the shortest distance between the trigger point and the boundary of each trigger area among the multiple adjacent trigger areas may be determined. The adjacent trigger area means that there is no other trigger area between the trigger area and the trigger point.

[0117] As an exemplary embodiment, when determining the shortest distance between a trigger point and the boundary of a trigger area, the intersection of a line connecting the trigger point and the midpoint of the trigger area and the boundary of the trigger area can be determined, and the distance between the intersection and the trigger point can be determined, and then the distance is determined as the shortest distance between the trigger point and the boundary of the trigger area.

[0118] Afterwards, it can be determined whether each shortest distance is less than a preset distance threshold. The above distance threshold is a preset distance threshold that may trigger a function point.

[0119] Optionally, when it is determined that the shortest distance is less than a distance threshold, the function point corresponding to the shortest distance may be determined as a pre-trigger function point.

[0120] As another optional implementation, multiple trigger areas adjacent to the trigger point may be directly determined, and the shortest distance between the trigger point and the boundary of each trigger area among the multiple adjacent trigger areas may be determined. The adjacent trigger area refers to a trigger area without other trigger areas between the trigger area and the trigger point.

[0121] As an exemplary embodiment, when determining the shortest distance between a trigger point and the boundary of a trigger area, the intersection of a line connecting the trigger point and the midpoint of the trigger area and the boundary of the trigger area can be determined, and the distance between the intersection and the trigger point can be determined, and then the distance is determined as the shortest distance between the trigger point and the boundary of the trigger area.

[0122] Afterwards, it can be determined whether each shortest distance is less than a preset distance threshold. The above distance threshold is a preset distance threshold that may trigger a function point.

[0123] Optionally, when it is determined that the shortest distance is less than a distance threshold, the function point corresponding to the shortest distance may be determined as a pre-trigger function point.

[0124] The technical solution provided by the embodiment of the present application determines that the trigger operation has not triggered any function point by obtaining the trigger point in the display interface corresponding to the trigger operation, and when it is determined that the trigger point does not belong to any trigger area, the trigger operation determines that the trigger operation has not triggered any function point, wherein each function point corresponds to a trigger area, and at least one pre-trigger function point corresponding to the trigger operation is determined based on the trigger point and the trigger area of ​​each function point. This technical solution determines the trigger area of ​​each function point, and determines at least one pre-trigger function point corresponding to the trigger operation based on the trigger point corresponding to the trigger operation and the trigger area of ​​each function point. Through the setting of the trigger area, it can simply and quickly determine whether the trigger operation triggers the function point, and when the trigger operation does not trigger the function point, quickly determine at least one pre-trigger function point corresponding to the trigger operation.

[0125] See also Figure 4 , which is a flow chart of an embodiment of another method for controlling the interface response of a terminal provided in an embodiment of the present application. Figure 4 The process shown in Figure 1 Based on the process shown in FIG. 1 , it is described how to determine the target function point from at least one pre-trigger function point. Figure 4 As shown, the process may include the following steps:

[0126] Step 401: Determine at least one initial function point from at least one pre-trigger function point.

[0127] The above-mentioned initial function point refers to a function point that may be triggered by a trigger operation determined by the control terminal after re-screening at least one pre-trigger function point.

[0128] In the embodiment of the present application, in order to further improve the accuracy of determining the function point corresponding to the trigger operation, the control terminal can further screen the pre-trigger function points to determine at least one initial function point. The initial function point can be all the function points of the pre-trigger function points or some of the function points of the pre-trigger function points, and the embodiment of the present application does not limit this.

[0129] As an optional implementation manner, when it is determined that there is only one pre-trigger function point, the pre-trigger function point may be directly determined as the initial function point.

[0130] As another optional implementation manner, when it is determined that there are multiple pre-trigger function points, at least one initial function point may be determined from the multiple pre-trigger function points.

[0131] As an exemplary implementation, each of the above-mentioned function points can be used to control a preset smart home device, that is, different function points can control different smart home devices. For example, the control terminal is currently used to control the power-on status of multiple smart home devices. At this time, each function point in the display interface can respectively control the smart air conditioner, smart TV, and smart curtains, etc.

[0132] Based on this, when determining the initial function point from the pre-trigger function points, the operating state of the smart home device corresponding to each pre-trigger function point can be determined. The operating state may include the operating state and the closed state of the corresponding smart home device.

[0133] In this regard, for each pre-trigger function point, it can be determined whether the operating state of the smart home device corresponding to the pre-trigger function point is in operation.

[0134] Optionally, when it is determined that the operating state of the smart home device corresponding to the pre-trigger function point is running, it means that the smart home device is in a state to be controlled, and therefore the pre-trigger function point corresponding to the smart home device can be determined as the initial function point.

[0135] As another exemplary implementation, when determining at least one initial function point from a plurality of pre-trigger function points, a historical time point at which the pre-trigger function point was most recently triggered may be obtained for each pre-trigger function point.

[0136] Optionally, when it is determined that the historical time point is within a preset historical time period, it means that the user has triggered the corresponding pre-trigger function point within the historical time period, and there is a possibility of re-triggering, so the pre-trigger function point corresponding to the historical time point can be determined as the initial function point. The above historical time period can be a recent period of time that is preset, such as the latest 10 minutes, 30 minutes, or 1 hour.

[0137] Step 402: Acquire function information of at least one initial function point.

[0138] Step 403: Feedback function information of at least one initial function point.

[0139] Step 404: When a confirmation operation for any of the above functional information is received, an initial functional point corresponding to the functional information is determined as a target functional point.

[0140] The following is a unified description of steps 402 to 404:

[0141] The above-mentioned functional information refers to the relevant information of the initial functional point, which may include but is not limited to: the functional description information of the initial functional point in the display interface, and the role description information of the initial functional point. For example, the function description information of the button used to increase the air-conditioning temperature in the display interface is "temperature +", and its corresponding role description information is "used to increase the temperature".

[0142] In the embodiment of the present application, after determining at least one initial function point, the control terminal may obtain function information of each initial function point and feed back the function information of the at least one initial function point.

[0143] As an optional implementation method, when there are multiple pieces of the above functional information, the above functional information can be fed back one by one.

[0144] As another optional implementation, when there are multiple pieces of the above functional information, the above functional information may be fed back simultaneously.

[0145] As for the specific feedback method of the functional information of at least one initial functional point, it can be respectively provided as follows: Figure 5 and Figure 6 The process shown is explained and will not be described in detail here.

[0146] Based on this, the user can determine whether the function information to be triggered by the trigger operation is the function information fed back. If so, a confirmation operation can be performed. If not, no confirmation operation can be performed, or a negative operation can be performed.

[0147] In this regard, when receiving a confirmation operation for any functional information, the control terminal may determine the initial functional point corresponding to the functional information as the target functional point.

[0148] The technical solution provided by the embodiment of the present application determines at least one initial function point from at least one pre-trigger function point, obtains function information of at least one initial function point, and feeds back the function information of at least one initial function point. When a confirmation operation for any of the above function information is received, the initial function point corresponding to the function information is determined as the target function point. This technical solution further selects at least one initial function point from the pre-trigger function points, and feeds back the function information of the initial function point, so that the user performs a confirmation operation on the initial function point, thereby determining the target function point according to the user's confirmation operation, thereby achieving more accurate determination of the target function point corresponding to the trigger operation.

[0149] See also Figure 5 , which is a flow chart of an embodiment of another interface response method of a control terminal provided in an embodiment of the present application. Figure 5 The process shown in Figure 4Based on the process shown in the figure, it describes how to feedback the functional information of the initial function point. Figure 5 As shown, the process may include the following steps:

[0150] Step 501: Obtain text description information of the function information corresponding to each initial function point.

[0151] Step 502: output a function information layer at the top layer of the display interface, wherein the function information layer includes text description information of an initial function point and selection buttons for the text description information; wherein the font size of the text description information is larger than the font size in the display interface, and the selection buttons include a first selection button and a second selection button.

[0152] The following is a unified description of step 501 and step 502:

[0153] The above-mentioned functional information refers to the relevant information of the initial functional point, which may include but is not limited to: functional description information of the initial functional point in the display interface, and role description information of the initial functional point.

[0154] The above text description information refers to the functional information described in text.

[0155] The above-mentioned function information layer refers to a layer containing the above-mentioned function information. In order to allow the user to select the initial function point immediately, the function information layer may be located at the topmost layer in the display interface of the control terminal.

[0156] In an embodiment of the present application, in order to enable the user to determine the target function point corresponding to the current trigger operation, the control terminal can obtain text description information of the function information corresponding to the initial function point after determining the initial function point and obtaining the function information corresponding to the initial function point.

[0157] Afterwards, in order to facilitate the user to determine whether the initial function point is currently triggered, the control terminal can write the above text description information into a function information layer and output the function information layer at the top of the display interface. Further, in order to facilitate the user to understand the function information, the font size of the above text description information can be larger than the font size in the current display interface.

[0158] Among them, in order to facilitate user selection, the above-mentioned function information layer may also include a selection button for the above-mentioned text information. Optionally, the above-mentioned selection button may include a first selection button and a second selection button, the above-mentioned first selection button is used to indicate confirmation of the current initial function point, and the above-mentioned second selection button is used to indicate denial of the current initial function point. For example, the above-mentioned initial function point is to increase the temperature, then the corresponding function information layer may include text description information "whether to click the temperature increase button, the temperature increase button is used to increase the temperature of the air conditioner", as well as a first selection button marked "yes" and a second selection button marked "no".

[0159] Step 503: When a first trigger operation for a first selection button is received, the initial function point is determined as a target function point.

[0160] Step 504: When receiving a second trigger operation of a second selection button, close the function information layer.

[0161] Step 505: When it is determined that there is a next initial function point, output a next function information layer corresponding to the next initial function point at the top layer of the display interface.

[0162] The following is a unified description of steps 503 to 505:

[0163] In the embodiment of the present application, when the selection button includes a first selection button and a second selection button, the user can select whether to trigger the target function point corresponding to the operation to be the initial function point according to the function information layer.

[0164] Optionally, when receiving a trigger operation for a first selection button (hereinafter referred to as a first trigger operation for ease of distinction), the control terminal may determine an initial function point corresponding to the first trigger operation as a target function point.

[0165] Optionally, when the control terminal receives a trigger operation for the second selection button (hereinafter referred to as the second trigger operation for ease of distinction), it indicates that the user has not triggered the initial function point corresponding to the function information layer, and therefore the above function information layer can be closed.

[0166] Furthermore, the function information layer may correspond to an initial function point corresponding to the initial function point of the function information. Therefore, after closing the function information layer, it may be determined whether there is a next initial function point that has not been displayed.

[0167] Optionally, when it is determined that there is a next initial function point, the next function information layer corresponding to the next initial function point can be output at the top layer of the above display interface, so that the user can continue to determine whether to select the current initial function point based on the next function information layer.

[0168] The technical solution provided by the embodiment of the present application is to obtain the text description information of the function information corresponding to each initial function point, and output the function information layer at the top layer of the display interface, wherein the function information layer includes the text description information of an initial function point and the selection button for the text description information; wherein the font size of the text description information is larger than the font size in the display interface, and the selection button includes a first selection button and a second selection button, and when a first trigger operation for the first selection button is received, the initial function point is determined as the target function point, and when a second trigger operation for the second selection button is received, the function information layer is closed, and when it is determined that there is a next initial function point, the next function information layer corresponding to the next initial function point is output at the top layer of the display interface. This technical solution, by feeding back the function information of the initial function point in the form of text description information with a larger font size, and selecting the text description information with a larger font size, because the font size of the text description information is larger and located at the top layer, it can prevent the user from being unable to accurately determine the function point due to hand shaking or visual impairment, and realizes the user confirming the target function point corresponding to the trigger operation, thereby realizing more accurate determination of the target function point corresponding to the trigger operation.

[0169] See also Figure 6 , is a flow chart of an embodiment of an interface response method of a control terminal provided in an embodiment of the present application. Figure 6 The process shown in Figure 4 Based on the process shown in the figure, it describes how to feedback the functional information of the initial function point. Figure 6 As shown, the process may include the following steps:

[0170] Step 601, determine whether the initial function point is one, if so, execute step 602; if not, execute step 603;

[0171] Step 602: Play the first voice information indicating whether the initial function point is selected and the second voice information of the function information corresponding to the initial function point according to the preset voice playing mode.

[0172] Step 603: When there are multiple initial function points, the first voice information and the second voice information corresponding to each initial function point are played in round-robin fashion according to a preset voice playing mode.

[0173] The following is a unified description of steps 601 to 603:

[0174] The above-mentioned voice playing mode refers to a pre-set playing mode of playing information through voice, which may include but is not limited to: the sound, tone, and speaking speed of the voice playing.

[0175] The first voice information is a voice signal for indicating whether to select a corresponding initial function point, for example, “whether to select to turn on the air conditioning function”.

[0176] The above-mentioned second voice information is used to describe the functional information of the corresponding initial function point. The functional information may include relevant information of the initial function point, which may include but is not limited to: the functional description information of the initial function point in the display interface, and the function description information of the initial function point. For example, when the first voice information is "Do you choose to turn on the air conditioning function", the corresponding second voice information may be "This function is to turn on the air conditioning function, which is used to control the control inside the house to start and run."

[0177] In an embodiment of the present application, in order to prevent the user from being unable to accurately determine the initial function point to be clicked due to visual impairment or other reasons, the control terminal can, after determining at least one initial function point, play the first voice information and the second voice information corresponding to the initial function point through a preset voice playback mode, so that the user can determine whether the initial function point is the target function point corresponding to the trigger operation through the first voice information and the second voice information.

[0178] As an optional implementation method, it can be determined first whether the initial function point is one, and if so, the first voice information and the second voice information corresponding to the initial function point can be played directly according to the above-mentioned voice playback mode.

[0179] Optionally, when it is determined that there are multiple initial function points, the first voice information and the second voice information corresponding to each initial function point may be played in turn according to the above-mentioned preset voice playback mode.

[0180] As an exemplary implementation, the first voice information and the second voice information corresponding to an initial function point may be played at a preset time interval.

[0181] In addition, before playing the above voice information, the playback volume of the voice playback module can be increased to a preset value so that the user can clearly understand the initial function point to be selected.

[0182] Step 604: for the first voice information corresponding to any initial function point, determine whether a response voice signal corresponding to the first voice information is received. If so, execute step 605; if not, end the process.

[0183] Step 605: When the response voice signal is received, the response voice signal is recognized to obtain a recognition result.

[0184] Step 606: When the recognition result indicates that the initial function point is selected, the initial function point corresponding to the recognition result is determined as the target function point.

[0185] The following is a unified description of steps 604 to 606:

[0186] The above-mentioned response voice signal refers to the response voice signal made by the user in response to the first voice signal and the second voice information of the output initial function point. For example, the response voice signal is "select this function", or "yes", or "do not select this function", or "no".

[0187] In the embodiment of the present application, after the corresponding first voice signal and second voice signal are output for any initial function point, it can be determined whether a response voice signal for the initial function point is received.

[0188] Optionally, when receiving a response voice signal corresponding to the initial function point, the response voice signal may be recognized to obtain a recognition result. If the recognition result indicates that the user has selected the initial function point (for example, the response voice signal is "select this function"), it means that the target function point corresponding to the user's selected trigger operation is the initial function point, and therefore the initial function point corresponding to the recognition result may be determined as the target function point.

[0189] Optionally, if the recognition result indicates that the user does not select the initial function point (for example, the response voice signal is "do not select this function"), it means that the target function point corresponding to the user's selected trigger operation is not the above initial function point, so the initial function point corresponding to the recognition result may not be used as the target function point. Furthermore, the initial function point may be deleted, that is, the first voice information and the second voice information corresponding to the initial function point are no longer played.

[0190] Optionally, if the response voice signal corresponding to the initial function point is not received after a preset period of time, the initial function point corresponding to the recognition result may not be used as the target function point, and the first voice information and the second voice information corresponding to the next initial function point may be played.

[0191] In addition, for each initial function point played, corresponding to the first voice information and the second voice information, the user can determine whether to select the initial function point by sliding on the display interface. For example, if the user selects the initial function point, slide to the left, and if the user does not select the initial function point, slide to the right.

[0192] In one embodiment, for the first voice information and the second voice information corresponding to each initial function point played, the control terminal may output a function information layer through the top layer of the display interface while playing the first voice information and the second voice information, and the function information layer may include text description information of the function information corresponding to the initial function point, and the font size of the text description information is larger than the font size in the display interface. The function information layer may include a first selection button for determining the initial function point as a target function point, and a second selection button for determining the initial function point as a target function point.

[0193] Based on this, the user can determine whether to determine the current initial function point as the target function point corresponding to the trigger operation by voice response or by clicking the first selection button and the second selection button.

[0194] In addition, in one embodiment, when the user selects the initial function point, the control terminal can further determine whether the initial function point includes a sub-function point. If it does, the first voice information and the second voice information corresponding to the sub-function point can continue to be played through voice, or the sub-function information layer can continue to be output, and the sub-function information layer includes text description information corresponding to the sub-function point.

[0195] Based on this, the user can further select the function corresponding to the sub-function point.

[0196] For example, suppose the text description information output by the function layer is "whether to select the temperature function", and the temperature function may include control sub-function points; if the first selection button "yes" is selected, then the output "the temperature is set to 25 degrees at this time, whether to choose to increase the temperature" can continue. If 1 is selected, the temperature is increased according to the preset step length, or an output box is output, and the user enters the increased temperature value, or the user enters the increased temperature value by voice, or there is a maximum value button, and the user can directly choose to adjust to the maximum value. If 2 is selected, the temperature is lowered according to the preset step length, or an output box is output, and the user enters the lowered temperature value, or the user enters the lowered temperature value by voice, or there is a minimum value button, and the user can directly choose to adjust to the minimum value.

[0197] In one embodiment, when the control terminal outputs a display interface, if it is detected that no trigger operation from the user is received within a preset time period, historical trigger operations for the display interface within a preset historical time period may be obtained.

[0198] Afterwards, multiple selection function points can be determined according to the historical trigger operation, and the selection function information corresponding to each selection function point can be obtained. The selection function point is a function point that may be selected in the display interface, and the selection function information is function information related to the corresponding selection function point.

[0199] Afterwards, the voice function information corresponding to each selected function point may be polled and played, and the voice function information may include third voice information used to indicate whether the selected function point is selected, and fourth voice information corresponding to the selected function information.

[0200] Optionally, when receiving a response voice message for any selected function point, the response voice message may be recognized to obtain a response recognition result. Afterwards, when it is determined that the response recognition result indicates that the user has selected the selected function point, the selected function point may be directly responded to.

[0201] The technical solution provided by the embodiment of the present application determines whether the initial function point is one. If so, the first voice information used to indicate whether the initial function point is selected and the second voice information corresponding to the initial function point are played according to the preset voice playback mode; if not, in the case of multiple initial function points, the first voice information and the second voice information corresponding to each initial function point are played in a polling manner according to the preset voice playback mode; for the first voice information corresponding to any initial function point, it is determined whether the response voice signal corresponding to the first voice information is received, and if so, in the case of receiving the above-mentioned response voice signal, the response voice signal is recognized to obtain a recognition result; in the case where the above-mentioned recognition result indicates the selection of the initial function point, the initial function point corresponding to the above-mentioned recognition result is determined as the target function point. This technical solution feeds back the function information of the initial function point in the form of voice playback of the function information of the initial function point. Since the function information of the initial function point is played according to the preset voice playback mode, it can avoid the situation where the user triggers the function point, and realizes that the user confirms the target function point corresponding to the trigger operation based on the voice playback function information, thereby realizing more accurate determination of the target function point corresponding to the trigger operation.

[0202] See also Figure 7 , is a flow chart of an embodiment of an interface response method of a control terminal provided in an embodiment of the present application. Figure 7 The process shown is illustrated by taking a visually impaired user clicking on a control terminal as an example. Figure 7 As shown, the process may include the following:

[0203] When a visually impaired user is operating a function in the display interface of the control terminal, if there is no mistake, it will be executed normally; if there is a mistake (failure to accurately click any function point), the control terminal can increase the volume of the audio playback module to a preset value.

[0204] Optionally, an error area is predetermined for each function point, and the initial function point corresponding to the trigger point of the user's trigger operation is determined. Among the determined initial function points, the function points can be played in order from near to far from the trigger point to represent the question of whether the user clicks on the initial function point, and the function information of the initial function point can be played.

[0205] For example, when the user clicks the off button of the air conditioner, the user does not click the off button due to visual impairment, so the functions or displays near the off button, such as power on, mode, and light, are not within the range. Then there are two functions within the range, which are power on, mode from near to far. Therefore, the first power on function can be announced by voice, and the user is asked whether the power on function needs to be executed. At this time, the relevant text with a relatively large font is displayed on the screen, and the user can manually select yes or no without speaking. If the user chooses to click "Yes", then no voice reply is required. If the user chooses voice, then there is no need to click "Yes" or "No".

[0206] In addition, when the user has just opened the control terminal and does not know how to perform the desired operation, the control terminal can determine the status of the equipment in the user's home and the maximum number of historical operations or the function point of the last operation of the user when it detects that the user has not performed a trigger operation for a long time. As a result, 3 or more voice broadcasts can be generated, automatically asking whether to operate a certain selection function point. For example, the user has opened an empty terminal and has not operated it for a long time, but his home has a running air conditioner, and the associated functions are to turn off the air conditioner, adjust the temperature of the air conditioner, etc. At this time, according to the priority of frequency of use, the selection function point corresponding to the air conditioner is broadcast first. For example, the frequency of use of adjusting the air conditioner temperature is higher, so the selection function point of adjusting the air conditioner temperature can be played first according to the preset voice playback mode.

[0207] The technical solution provided in the embodiment of the present application can be assisted by the basic needs of the user, so that the user can accurately select the target function point to be triggered, improve the user experience, and thus achieve more intelligent interaction with visually impaired users.

[0208] See also Figure 8 , which is a block diagram of an embodiment of an interface response device for a control terminal provided in an embodiment of the present application. Figure 8 The device shown can be applied to a control terminal, which includes a preset display interface, and the display interface includes at least one function point. Figure 8 As shown, the device may include:

[0209] A first determining module 81 is configured to, upon receiving a trigger operation for a display interface and determining that the trigger operation does not trigger any function point, determine at least one pre-trigger function point triggered by the trigger operation;

[0210] A second determining module 82, configured to determine a target function point from at least one of the pre-trigger function points;

[0211] The response module 83 is used to respond to the target function point.

[0212] like Fig. 9 As shown, an embodiment of the present application provides a structural schematic diagram of an electronic device, including a processor 91, a communication interface 92, a memory 93 and a communication bus 94, wherein the processor 91, the communication interface 92, and the memory 93 communicate with each other through the communication bus 94.

[0213] Memory 93, used for storing computer programs;

[0214] In one embodiment of the present application, the processor 91 is used to implement the interface response method of the control terminal provided by any one of the aforementioned method embodiments when executing the program stored in the memory 93, including:

[0215] Upon receiving a trigger operation for a display interface and determining that the trigger operation does not trigger any function point, determining at least one pre-trigger function point triggered by the trigger operation;

[0216] Determining a target function point from at least one of the pre-trigger function points;

[0217] Respond to the target function point.

[0218] An embodiment of the present application further provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps of the interface response method of the control terminal provided in any of the aforementioned method embodiments are implemented.

[0219] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0220] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a general hardware platform, and of course, by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the relevant technology can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0221] It should be understood that the terms used herein are only for the purpose of describing specific example embodiments and are not intended to be limiting. Unless the context clearly indicates otherwise, the singular forms "one", "an" and "said" as used herein may also be meant to include plural forms. The terms "include", "comprise", "contain", and "have" are inclusive, and therefore specify the existence of stated features, steps, operations, elements and / or parts, but do not exclude the existence or addition of one or more other features, steps, operations, elements, parts, and / or combinations thereof. The method steps, processes, and operations described herein are not interpreted as necessarily requiring them to be performed in the specific order described or illustrated, unless the execution order is clearly indicated. It should also be understood that additional or alternative steps may be used.

[0222] The foregoing is merely a specific embodiment of the present invention, which enables those skilled in the art to understand or implement the present invention. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but rather to the widest scope consistent with the principles and novel features claimed herein.

Claims

1. A method for controlling an interface response of a terminal, characterized in that: Applied to a control terminal, the control terminal includes a preset display interface, the display interface includes at least one function point, and the method includes: Upon receiving a trigger operation for a display interface and determining that the trigger operation does not trigger any function point, determining at least one pre-trigger function point triggered by the trigger operation; Determining a target function point from at least one of the pre-trigger function points; Respond to the target function point.

2. The method according to claim 1, characterized in that Each of the function points corresponds to a trigger area, and determining that the trigger operation does not trigger any function point includes: Acquire a trigger point in the display interface corresponding to the trigger operation; In the case where it is determined that the trigger point does not belong to any of the trigger areas, determining that the trigger operation does not trigger any function point; The determining of at least one pre-trigger function point triggered by the trigger operation includes: At least one pre-trigger function point triggered by the trigger operation is determined according to the trigger point and the trigger area of ​​each of the function points.

3. The method according to claim 2, characterized in that Each of the function points corresponds to an error area, the error area is larger than the trigger area corresponding to the function point and includes the trigger area; The determining, according to the trigger point and the trigger area of ​​each of the function points, at least one pre-trigger function point triggered by the trigger point includes: determining whether the trigger point belongs to at least one of the error regions; In the case where it is determined that the trigger point belongs to at least one of the error regions, a function point corresponding to the error region to which the trigger point belongs is determined as a pre-trigger function point.

4. The method according to claim 3, characterized in that The method further comprises: In the case where it is determined that the trigger point does not belong to any of the error regions, determining the shortest distance between the trigger point and a boundary of each of the plurality of adjacent trigger regions; Determining whether each of the shortest distances is less than a preset distance threshold; When it is determined that the shortest distance is less than the distance threshold, the function point corresponding to the shortest distance is determined as the pre-trigger function point.

5. The method according to claim 2, characterized in that: The determining, according to the trigger point and the trigger area of ​​each of the function points, at least one pre-trigger function point triggered by the trigger operation includes: Determine the shortest distance between the trigger point and a boundary of each of the trigger areas in a plurality of adjacent trigger areas; Determining whether each of the shortest distances is less than a preset distance threshold; When it is determined that the shortest distance is less than the distance threshold, the function point corresponding to the shortest distance is determined as the pre-trigger function point.

6. The method according to claim 1, characterized in that The step of determining a target function point from at least one of the pre-trigger function points comprises: Determining at least one initial function point from at least one of the pre-trigger function points; Acquiring function information of at least one of the initial function points; Feedback the functional information of at least one of the initial functional points; In case of receiving a confirmation operation for any of the function information, the initial function point corresponding to the function information is determined as a target function point.

7. The method according to claim 6, characterized in that The step of determining at least one initial function point from at least one of the pre-trigger function points comprises: In the case where it is determined that there is one pre-trigger function point, determining the pre-trigger function point as an initial function point; In the case where it is determined that there are multiple pre-trigger function points, at least one initial function point is determined from the multiple pre-trigger function points.

8. The method according to claim 7, characterized in that Each of the function points is used to control a preset smart home device, and determining at least one initial function point from the plurality of pre-trigger function points includes: Determine the operating status of the smart home device corresponding to each of the pre-trigger function points; For each of the pre-trigger function points, determining whether the operation state of the smart home device corresponding to the pre-trigger function point is in operation; When it is determined that the operating state of the smart home device corresponding to the pre-trigger function point is in operation, the pre-trigger function point is determined as the initial function point.

9. The method according to claim 7, characterized in that: The step of determining at least one initial function point from the plurality of pre-trigger function points comprises: For each of the pre-trigger function points, obtaining the historical time point at which the pre-trigger function point was most recently triggered; In the case where it is determined that the historical time point is within a preset historical time period, the pre-trigger function point is determined as an initial function point.

10. The method according to claim 6, characterized in that The feeding back the function information of at least one of the initial function points includes: Obtain text description information of the function information corresponding to each of the initial function points; A function information layer is outputted at the top layer of the display interface, wherein the function information layer includes the text description information of the initial function point and a selection button for the text description information; wherein the font size of the text description information is larger than the font size in the display interface.

11. The method according to claim 10, characterized in that The selection button includes a first selection button and a second selection button, and when a confirmation operation for any of the function information is received, determining the initial function point corresponding to the function information as the target function point includes: In case of receiving a first trigger operation for the first selection button, determining the initial function point as a target function point; The method further comprises: When a second trigger operation for the second selection button is received, the function information layer is closed; when it is determined that there is a next initial function point, a next function information layer corresponding to the next initial function point is output at the top layer of the display interface.

12. The method according to claim 6, characterized in that The feeding back the function information of at least one of the initial function points includes: In the case where there is only one initial function point, playing the first voice information indicating whether the initial function point is selected and the second voice information corresponding to the function information of the initial function point according to the preset voice playing mode; In the case that there are multiple initial function points, the first voice information and the second voice information corresponding to each initial function point are played in turn according to a preset voice playing mode.

13. The method according to claim 12, characterized in that The step of, upon receiving a confirmation operation for any of the function information, determining the initial function point corresponding to the function information as a target function point comprises: For the first voice information corresponding to any of the initial function points, determining whether a response voice signal corresponding to the first voice information is received; When receiving the response voice signal, recognizing the response voice signal to obtain a recognition result; In the case where the recognition result indicates the selection of the initial function point, the initial function point corresponding to the recognition result is determined as the target function point.

14. The method according to claim 1, characterized in that The method further comprises: When the control terminal outputs the display interface and does not receive any trigger operation within a preset time period, obtaining historical trigger operations for the display interface within a preset historical time period; Determine a plurality of selection function points according to the historical trigger operation, and obtain selection function information corresponding to each of the selection function points; Polling and playing the voice function information corresponding to each of the selected function points, the voice function information including third voice information used to indicate whether the selected function point is selected, and fourth voice information corresponding to the selected function information; When receiving the response voice information for any of the selected function points, recognizing the response voice information to obtain a response recognition result; In the case where the response recognition result indicates that the selection function point is selected, the selection function point is responded to.

15. An interface response device for a control terminal, characterized in that: Applied to a control terminal, the control terminal includes a preset display interface, the display interface includes at least one function point, and the device includes: A first determining module is used to determine at least one pre-trigger function point triggered by the trigger operation when receiving a trigger operation on the display interface and determining that the trigger operation does not trigger any function point; A second determination module, configured to determine a target function point from at least one of the pre-trigger function points; The response module is used to respond to the target function point.

16. An electronic device, characterized in that: include: A processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus; The memory is used to store computer programs; the processor is used to implement the interface response method of the control terminal described in any one of claims 1-14 when executing the computer program.

17. A storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the interface response method of the control terminal described in any one of claims 1 to 14 is implemented.

Citation Information

Patent Citations

  • Video unit, and audible device and navigation device provided with same

    CN101539817A

  • Method and device for responding to touch messages on mobile terminal

    CN103677518A

  • Navigation bar display method, navigation bar display apparatus and mobile terminal

    CN107451205A

  • Page elimination control method, terminal and computer readable storage medium

    CN110362367A

  • Display method, display device and electronic equipment

    CN113296648A