Interactive control method, electronic device and storage medium

Abstract

The present application relates to an interactive control method and, an electronic device and a storage medium. The method collects a second gaze point of user's eyeball on a display interface when no UI element of a user interface on the display interface is selected by a first gaze point, and selects a target UI element from the display interface according to the first gaze point and the second gaze point, and controls the target UI element, so that the target UI element that the user wants to select can be accurately determined, solving a technical issue of non-target UI elements being mistakenly selected, and improving the user experience.

Description

[Technical Field]

[0001] This application relates to the field of human-computer interaction technology, specifically to an interactive control method, electronic device and storage medium. [Previous Technology]

[0002] Existing eye-tracking solutions rely on accurately estimating the user's gaze point for human-computer interaction. This means the user must fix their gaze on the target area of ​​a specific UI element on the display interface, or within a fixed distance of that UI element, to trigger the corresponding function of that UI element. These solutions place extremely high demands on the accuracy of the eye-tracking device; even slight positional deviations can lead to misselection of UI elements, affecting the user experience. [Summary of the Invention]

[0003] In view of the above, it is necessary to provide an interactive control method, an electronic device and a storage medium to solve the technical problem of misselection of UI elements.

[0004] In a first aspect, this application provides an interactive control method, the method comprising: acquiring a first gaze point of a user's eye on a display interface; acquiring a second gaze point of the user's eye on the display interface when the first gaze point does not select any user interface UI element on the display interface; selecting a target UI element from the display interface based on the first gaze point and the second gaze point, and controlling the target UI element.

[0005] In some embodiments of this application, selecting a target UI element from the display interface based on the first gaze point and the second gaze point includes: determining a first distance between the first gaze point and each UI element on the display interface, and determining a second distance between the second gaze point and each UI element on the display interface; determining a third distance between the first gaze point and the second gaze point, and determining the trajectory distance of the first gaze point moving to the second gaze point; determining the acquisition time difference between the first gaze point and the second gaze point; determining a confidence score for each UI element based on the first distance, the second distance, the third distance, the trajectory distance, and the acquisition time difference; and selecting the UI element corresponding to the highest confidence score as the target UI element.

[0006] In some embodiments of this application, after selecting a UI element as the target UI element from the display interface based on the first gaze point and the second gaze point, the method further includes: displaying the target UI element using a preset display mode, wherein the preset display mode includes one or more of the following modes: highlight display, magnified display, and floating display.

[0007] In some embodiments of this application, controlling the target UI element includes: displaying the functional interface or application interface corresponding to the target UI element; or responding to the user's preset operation and displaying the functional interface or application interface corresponding to the target UI element.

[0008] In some embodiments of this application, determining the trajectory distance from the first gaze point to the second gaze point includes: determining the movement trajectory formed when the first gaze point moves to the second gaze point; determining a preset number of trajectory points on the movement trajectory; calculating a fourth distance between every two adjacent trajectory points; and using the sum of all fourth distances as the trajectory distance.

[0009] In some embodiments of this application, determining the confidence score of each UI element based on the first distance, the second distance, the third distance, the trajectory distance, and the acquisition time difference includes: determining the movement speed of the first gaze point relative to each UI element when it moves to the second gaze point based on the first distance, the second distance, and the acquisition time difference; and determining the confidence score of the corresponding UI element based on the second distance, the third distance, the trajectory distance, and the movement speed.

[0010] In some embodiments of this application, the confidence score of the UI element is calculated according to the following formula: where CRn is the confidence score of the nth UI element, is the second distance between the second gaze point and the nth UI element on the display interface, Vn is the moving speed of the first gaze point relative to the nth UI element when it moves to the second gaze point, dG1G2 is the third distance, SG1G2 is the trajectory distance, W1 is the first preset weight, W2 is the second preset weight, and n is a positive integer.

[0011] In some embodiments of this application, the method further includes: responding to the operation of the first gaze point selecting a UI element on the display interface, using the UI element as the target UI element, and controlling the target UI element.

[0012] In a second aspect, this application provides an electronic device, the electronic device including a memory and a processor: the memory is used to store program instructions; the processor is used to read and execute the program instructions stored in the memory, and when the program instructions are executed by the processor, the electronic device performs the above-described interactive control method.

[0013] In a third aspect, this application provides a computer storage medium storing program instructions, which, when executed by a processor, implement the interactive control method described above.

[0014] The above-mentioned technical solution of this application, when no user interface UI element is selected on the display interface at the first gaze point, collects the second gaze point of the user's eye on the display interface, and selects the target UI element from the display interface based on the first gaze point and the second gaze point, and controls the target UI element. In this way, the target UI element that the user wants to select can be accurately determined, solving the technical problem of non-target UI elements being mistakenly selected and improving the user experience.

Implementation Method

[0015] In order to better understand the above-mentioned objectives, features and advantages of this application, the application will be described in detail below with reference to the accompanying drawings and specific embodiments.

[0016] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein in the specification of this application is for the purpose of describing an embodiment in one instance only and is not intended to be limiting of the application.

[0017] It should be noted that the terms "first," "second," "third," "fourth," etc. (if any) in the specification, claims, and drawings of this application are used to distinguish similar objects, and not to describe a specific order or sequence. In the embodiments of this application, the words "exemplary" or "for example" are used to indicate that they are examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design solutions. Specifically, the use of the words "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.

[0018] It should also be noted that the methods disclosed in the embodiments of this application or the methods shown in the flowcharts include one or more steps for implementing the method. Without departing from the scope of the claim, the execution order of multiple steps can be interchanged, and some steps can also be deleted. Some embodiments will be described below with reference to the accompanying drawings. Unless otherwise specified, the following embodiments and features can be combined with each other.

[0019] Existing eye-tracking solutions rely on accurately estimating the user's gaze point for human-computer interaction. This means the user must fix their gaze on the target area of ​​a specific user interface (UI) element on the display screen, or within a fixed distance of that UI element, to trigger the corresponding function of that UI element. These solutions place extremely high demands on the accuracy of the eye-tracking device; even slight positional deviations can lead to misselection of UI elements, affecting the user experience.

[0020] In view of this, embodiments of this application provide an interactive control method to solve the technical problem of misselection of UI elements.

[0021] The method is applied in an electronic device. The electronic device displays a display interface. When a user needs to operate the display interface, the method acquires the user's first gaze point and second gaze point on the display interface, and uses the first gaze point and second gaze point to determine the UI element selected by the user on the display interface, thereby improving the accuracy of the user's eye selection of the target UI element, and improving the smoothness of human-computer interaction and user experience.

[0022] Referring to Figure 1, a flowchart of an interactive control method provided in some embodiments of this application is shown. The method illustrated in Figure 1 includes one or more steps, but does not constitute a limitation of this application. Furthermore, the order of the steps in the method is merely an example, and the order of the steps can be changed. Additional steps may be added or steps may be reduced without departing from the disclosure of this application. The method includes the following steps.

[0023] Step S101: Collect the first gaze point of the user's eye on the display interface.

[0024] In some embodiments of this application, the electronic device acquires eye images using an infrared camera. Since the infrared camera emits an infrared light source when acquiring eye images, and this light source reflects off the corneal surface to form a corneal reflection point, the eye image includes a corneal reflection point. The electronic device uses algorithms such as edge detection and threshold segmentation to identify the position of the pupil in the eye image and determine the position of the corneal reflection point; it calculates the relative position between the pupil center and the corneal reflection point based on the pupil position and the corneal reflection point position, and determines the gaze direction of the eye based on the relative position, where changes in the relative position reflect eye movement; the gaze direction of the eye is converted into coordinates on the display interface to obtain a first gaze point.

[0025] Referring to Figure 2, this is a schematic diagram of a display interface provided in an embodiment of this application. The display interface 20 displays at least one UI element 21. In some embodiments of this application, the UI element 21 includes, but is not limited to, illustrations, buttons, input boxes, function menus, cards, lists, images or videos, notification messages, etc. A first gaze point is displayed on the display interface 20. In practical applications, the first gaze point may not be displayed on the display interface 20.

[0026] Step S102: Determine whether the first gaze point has selected UI element 21 on the display interface 20.

[0027] In some embodiments of this application, the electronic device determines whether the first gaze point is located within the hit box of any UI element 21 on the display interface 20; if the first gaze point is located within the hit box of the UI element 21 on the display interface 20, it is determined that the first gaze point has selected the UI element 21 on the display interface 20; if the first gaze point is not located within the hit box of the UI element 21 on the display interface 20, it is determined that the first gaze point has not selected the UI element 21 on the display interface 20. The hit box of the UI element 21 refers to a preset area on the display interface 20 that covers the area of ​​the UI element 21, and the size of the hit box can be equal to or greater than the size of the area of ​​the UI element 21.

[0028] In some embodiments of this application, if the first gaze point selects UI element 21 on the display interface 20, step S103 is executed; if the first gaze point does not select UI element 21 on the display interface 20, step S104 is executed.

[0029] Step S103: Respond to the operation of the first gaze point selecting UI element 21 on the interactive interface, take the UI element 21 as the target UI element 21, and control the target UI element 21.

[0030] In some embodiments of this application, controlling the target UI element 21 includes displaying the functional interface or application interface corresponding to the target UI element 21. For example, if the target UI element 21 is an application icon, the electronic device can display the application interface corresponding to the application icon after using the application icon as the target UI element 21. For example, if the target UI element 21 is a menu, the electronic device can display the functional interface corresponding to the menu after using the menu as the target UI element 21.

[0031] In some embodiments of this application, controlling the target UI element 21 includes: responding to a user's preset operation and displaying the functional interface or application interface corresponding to the target UI element 21. In some embodiments of this application, the preset operation can be a user's voice command or gesture. After designating the UI element 21 as the target UI element 21, the electronic device responds to the user's preset operation and displays the functional interface or application interface corresponding to the target UI element 21, which can avoid the problem of accidental operation of the user interface and improve the user experience.

[0032] In some embodiments of this application, after a UI element 21 is selected as the target UI element 21, the electronic device highlights, enlarges, or floats the target UI element 21 to prompt the user to select the target UI element 21 and improve the user experience.

[0033] Step S104: When the first gaze point does not select any UI element 21 on the display interface 20, the user's eyeball is captured as a second gaze point on the display interface 20.

[0034] In this embodiment of the application, the specific implementation of collecting the second gaze point of the user's eye on the display interface 20 is the same as the implementation of collecting the first gaze point of the user's eye on the display interface 20, and will not be described again here.

[0035] Step S105: Select a UI element 21 from the display interface 20 as the target UI element 21 based on the first gaze point and the second gaze point, and control the target UI element 21.

[0036] The following will describe in detail the implementation of selecting a UI element 21 from the display interface 20 as the target UI element 21 based on the first gaze point and the second gaze point, in conjunction with the method flowchart in Figure 3.

[0037] Referring to Figure 3, a flowchart of a method for determining a target UI element 21 provided in an embodiment of this application is shown. The method illustrated in Figure 3 includes one or more steps, but does not constitute a limitation of this application. Furthermore, the order of the steps in the method is only an example, and the order of the steps can be changed. Additional steps may be added or steps may be reduced without departing from the disclosure of this application. The method includes the following steps.

[0038] Step S301: Determine the first distance between the first gaze point and each UI element 21 on the display interface 20, and determine the second distance between the second gaze point and each UI element 21 on the display interface 20.

[0039] Referring to Figure 4, which is a schematic diagram of the gaze point provided in an embodiment of this application. The display interface 20 displays at least one UI element 21. For example, the specific process of determining the first distance and the second distance is explained using two UI elements 21 as an example. For ease of description, the two UI elements 21 are divided into the first UI element and the second UI element.

[0040] The electronic device determines the coordinates of a first gaze point, a second gaze point, a first UI element, and a second UI element; determines a first distance between the first gaze point and the first UI element based on the coordinates of the first gaze point and the first UI element, denoted as d11; determines a first distance between the first gaze point and the second UI element based on the coordinates of the first gaze point and the second UI element, denoted as d21; determines a second distance between the second gaze point and the first UI element based on the coordinates of the second gaze point and the first UI element, denoted as d12; and determines a second distance between the second gaze point and the second UI element based on the coordinates of the second gaze point and the second UI element, denoted as d22.

[0041] Step S302: Determine the third distance between the first gaze point and the second gaze point, and determine the trajectory distance of the first gaze point moving to the second gaze point.

[0042] In this embodiment of the application, the electronic device determines the third distance based on the coordinates of the first gaze point and the coordinates of the second gaze point.

[0043] In some embodiments of this application, determining the trajectory distance from the first gaze point to the second gaze point includes: determining the movement trajectory formed when the first gaze point moves to the second gaze point; determining a preset number of trajectory points on the movement trajectory; calculating a fourth distance between every two adjacent trajectory points; and using the sum of all fourth distances as the trajectory distance.

[0044] In some embodiments of this application, a preset number (e.g., n+1, where n is a positive integer) of trajectory points on the action trajectory can be determined as P0, P1, P2, ..., Pn, where P0 is the first gaze point and Pn is the second gaze point. The fourth distance between any two adjacent trajectory points (e.g., trajectory points Pi, Pi+1, where i is an integer between 0 and n) is calculated according to a formula, where d(Pi, Pi+1) represents the distance between trajectory points Pi and Pi+1, (xi, yi) are the coordinates of trajectory point Pi, and (xi+1, yi+1) are the coordinates of trajectory point Pi+1. The electronic device sums the distances between every two adjacent trajectory points P0, P1, P2, ..., Pn to obtain the trajectory distance. Specifically, the electronic device can calculate the trajectory distance according to a formula, where SG1G2 represents the trajectory distance.

[0045] Step S303: Determine the acquisition time difference between the first gaze point and the second gaze point.

[0046] In some embodiments of this application, the electronic device records the acquisition time point of the first gaze point and the acquisition time point of the second gaze point, and uses the difference between the two acquisition time points as the acquisition time difference.

[0047] Step S304: Determine the confidence score of each UI element 21 based on the first distance, the second distance, the third distance, the trajectory distance and the acquisition time difference.

[0048] In some embodiments of this application, determining the confidence score of each UI element 21 based on the first distance, the second distance, the third distance, the trajectory distance, and the acquisition time difference includes: determining the movement speed of the first gaze point relative to each UI element 21 when it moves to the second gaze point based on the first distance, the second distance, and the acquisition time difference; and determining the confidence score of the corresponding UI element 21 based on the second distance, the third distance, the trajectory distance, and the movement speed.

[0049] In some embodiments of this application, the moving speed of the first gaze point relative to each UI element 21 when it moves to the second gaze point can be calculated according to the formula, where dn1 is the first speed of the nth UI element 21 and the first gaze point, dn2 is the second speed of the nth UI element 21 and the second gaze point, tG2 is the acquisition time point of the second gaze point, tG1 is the acquisition time point of the first gaze point, and Vn represents the moving speed of the first gaze point relative to the nth UI element 21 when it moves to the second gaze point.

[0050] In some embodiments of this application, determining the confidence score of the corresponding UI element 21 based on the second distance, the third distance, the trajectory distance, and the moving speed includes: calculating the confidence score of the corresponding UI element 21 according to a formula, where CRn is the confidence score of the nth UI element 21, is the second distance between the second gaze point and the nth UI element 21 on the display interface 20, Vn is the moving speed of the first gaze point relative to the nth UI element 21 when it moves to the second gaze point, dG1G2 is the third distance, SG1G2 is the trajectory distance, W1 is the first preset weight, W2 is the second preset weight, and n is a positive integer. In some embodiments of this application, W1 and W2 can be set to 1.

[0051] Step S305: Take the UI element 21 corresponding to the highest confidence score as the target UI element 21.

[0052] In some embodiments of this application, the electronic device uses the UI element 21 corresponding to the highest confidence score as the target UI element 21.

[0053] In some embodiments of this application, after determining the target UI element 21, the target UI element 21 is controlled in response to a user's preset operation, for example, displaying the function interface or application interface corresponding to the target UI element 21. The preset operation can be a user's voice command or gesture.

[0054] In some embodiments of this application, steps S301-S304 complete the calculation of the confidence score of UI element 21. The electronic device can also re-acquire the second gaze point, and execute steps S301-S304 based on the first gaze point and the updated second gaze point, and recalculate the confidence score of each UI element 21, and accumulate the multiple calculation results, and take the UI element 21 corresponding to the largest confidence score in the accumulated results as the target UI element 21. After determining the target UI element 21, the user does not need to input preset operations, and the electronic device can directly control the target UI element 21, thereby simplifying the interaction process and improving the user experience.

[0055] In the above technical solution of this application, the electronic device can determine the confidence score of each UI element based on the first distance, the second distance, the third distance, the trajectory distance and the acquisition time difference, and take the UI element corresponding to the highest confidence score as the target UI element. This can accurately determine the target UI element that the user wants to select, avoid the technical problem of non-target UI elements being mistakenly selected, and improve the user experience.

[0056] Referring to Figure 5, this is a structural diagram of an electronic device provided in an embodiment of this application. The electronic device 60 may include at least one memory 61, a processor 62, a sensor 63, and a display 64. The memory 61 includes a computer-readable storage medium for storing multiple logical instructions, which the processor 62 can execute to perform the aforementioned interactive control method. The electronic device 60 may be a smart glasses device, a mobile phone, a smartwatch, or similar device.

[0057] It is understood that in some embodiments, sensor 63 includes, but is not limited to, an infrared camera.

[0058] Wherein, when the logical instructions in the aforementioned computer-readable storage medium can be implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium.

[0059] The computer-readable storage medium may be configured to store software programs or computer-executable programs, such as the program instructions corresponding to the interactive control method in the embodiments of this application. The processor 62 executes functional applications and image processing by running the software programs, instructions, or modules stored in the computer-readable storage medium, thereby implementing the interactive control method in the above embodiments.

[0060] In this embodiment of the application, the computer-readable storage medium includes non-volatile computer-readable memory, such as magnetic disks, memory, etc. It is understood that the computer-readable storage medium may also include other non-volatile computer-readable memory, such as plug-in hard disks, smart media cards (SMC), secure digital (SD) cards, flash memory cards, at least one flash memory device and / or other non-volatile solid-state memory devices.

[0061] In this embodiment, the processor 62 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The processor 62 is the control center of the electronic device 60, and can be connected to other external devices and / or systems / modules / units through various interfaces and lines to provide interactive control functions to the applications of other external devices and / or systems / modules / units.

[0062] This embodiment also provides a computer program product. When the computer program product is run on a computer, the computer performs the above-mentioned related steps to realize the interactive control method in the above embodiment.

[0063] In this embodiment, the device, computer storage medium, computer program product or chip are all used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can be referred to the beneficial effects in the corresponding method provided above, and will not be repeated here.

[0064] Based on the above description of the embodiments, those skilled in the art can clearly understand that, for the sake of convenience and brevity, the division of the above functional modules is only used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0065] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative. For instance, the division of the module or unit is merely a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or elements may be combined or integrated into another device, or some features may be ignored or not executed. Furthermore, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interface; the indirect coupling or communication connection of the apparatus or unit may be electrical, mechanical, or other forms.

[0066] The unit described as a separate component may or may not be physically separate. The component shown as a unit may be one physical unit or multiple physical units, that is, it may be located in one place or distributed in multiple different places. Some or all of the units can be selected to achieve the purpose of the solution in this embodiment according to actual needs.

[0067] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or software functional units.

[0068] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiments of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. The software product is stored in a storage medium and includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned storage medium includes: USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks, and other media capable of storing program code.

[0069] In summary, the present invention meets the requirements for an invention patent, and therefore a patent application is filed in accordance with the law. However, the above description is only a preferred embodiment of the present invention, and all equivalent modifications or variations made by those skilled in the art based on the inventive spirit of the present invention should be included within the scope of the following patent application. [Simplified Explanation of the Diagram]

[0070] Figure 1 is a flowchart of an interactive control method provided in some embodiments of this application. Figure 2 is a schematic diagram of a display interface provided in an embodiment of this application. Figure 3 is a flowchart of a method for determining a target UI element provided in an embodiment of this application. Figure 4 is a schematic diagram of a gaze point provided in an embodiment of this application. Figure 5 is a structural diagram of an electronic device provided in an embodiment of this application.

Claims

1. An interactive control method, improved in that the method includes: Collect the user's first gaze point on the display interface; When no user interface (UI) element on the display surface is selected by the first gaze point, a second gaze point of the user's eye on the display surface is acquired; based on the first gaze point and the second gaze point, a target UI element is selected from the display surface, and the target UI element is controlled, wherein selecting the target UI element from the display surface based on the first gaze point and the second gaze point includes: determining a first distance between the first gaze point and each UI element on the display surface, and determining a second distance between the second gaze point and each UI element on the display surface; determining a third distance between the first gaze point and the second gaze point, and determining the trajectory distance of the first gaze point moving to the second gaze point; determining the acquisition time difference between the first gaze point and the second gaze point; determining a confidence score for each UI element based on the first distance, the second distance, the third distance, the trajectory distance, and the acquisition time difference; and selecting the UI element corresponding to the highest confidence score as the target UI element.

2. The interactive control method as described in request item 1, wherein, After selecting a UI element as the target UI element from the display interface based on the first gaze point and the second gaze point, the method further includes: displaying the target UI element using a preset display mode, wherein the preset display mode includes one or more of the following modes: highlighted display, magnified display, and floating display.

3. The interactive control method as described in request item 1, wherein, Controlling the target UI element includes: displaying the functional interface or application interface corresponding to the target UI element; or responding to the user's preset operation and displaying the functional interface or application interface corresponding to the target UI element.

4. The interactive control method as described in claim 1, wherein, Determining the trajectory distance from the first gaze point to the second gaze point includes: determining the movement trajectory formed when the first gaze point moves to the second gaze point; determining a preset number of trajectory points on the movement trajectory; calculating a fourth distance between every two adjacent trajectory points; and using the sum of all fourth distances as the trajectory distance.

5. The interactive control method as described in request item 1, wherein, The step of determining the confidence score of each UI element based on the first distance, the second distance, the third distance, the trajectory distance, and the acquisition time difference includes: determining the movement speed of the first gaze point relative to each UI element when it moves to the second gaze point based on the first distance, the second distance, and the acquisition time difference; and determining the confidence score of the corresponding UI element based on the second distance, the third distance, the trajectory distance, and the movement speed.

6. The interactive control method as described in claim 5, wherein, The confidence score of the UI element is calculated according to the following formula: where CRn is the confidence score of the nth UI element, is the second distance between the second gaze point and the nth UI element on the display interface, Vn is the moving speed of the first gaze point relative to the nth UI element when it moves to the second gaze point, dG1G2 is the third distance, SG1G2 is the trajectory distance, W1 is the first preset weight, W2 is the second preset weight, and n is a positive integer.

7. The interactive control method as described in request item 1, wherein, The method further includes: responding to the first gaze point's operation of selecting a UI element on the display interface, using the UI element as the target UI element, and controlling the target UI element.

8. An electronic device, improved in that the electronic device includes a memory and a processor: the memory is used to store program instructions; the processor is used to read and execute the program instructions stored in the memory, wherein when the program instructions are executed by the processor, the electronic device performs an interactive control method as described in any one of claims 1 to 7.

9. A computer storage medium, improved in that the computer storage medium stores program instructions that, when executed by a processor, implement the interactive control method as described in any one of claims 1 to 7.

Images