Application interface display method and device, electronic equipment and readable storage medium

By receiving eye or touch input on electronic devices, the application interface is displayed and launched directly in the first area of ​​the application folder, solving the problem of long operation paths for users to launch applications and achieving fast startup.

CN115562538BActive Publication Date: 2026-06-30VIVO SOFTWARE TECHNOLOGY CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
VIVO SOFTWARE TECHNOLOGY CO LTD
Filing Date
2022-10-27
Publication Date
2026-06-30

AI Technical Summary

Technical Problem

In electronic devices, users need to open a folder and swipe to the target application's page to launch an application, which is a long operation path and makes launching the application inconvenient.

Method used

By receiving eye or touch input from the user, the application icon is displayed in the first area of ​​the target application folder, and the application interface is launched directly in response to the user's second input, reducing the operation path.

Benefits of technology

Users can launch the application directly without opening the folder, simplifying the operation path and improving startup efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115562538B_ABST
    Figure CN115562538B_ABST
Patent Text Reader

Abstract

This application discloses an application interface display method and apparatus, an electronic device, and a readable storage medium, belonging to the field of electronic device technology. The application interface display method includes: receiving a first input from a user; responding to the first input, displaying a first application icon from the target application folder in a first area of ​​the target application folder; receiving a second input from the user to the first area; and responding to the second input, displaying a first application interface corresponding to the first application icon.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application belongs to the field of electronic equipment technology, specifically relating to an application interface display method and apparatus, electronic equipment, and readable storage medium. Background Technology

[0002] Currently, when using electronic devices, users often categorize and display various applications by creating different application folders. However, when a folder contains many applications and is further divided into pages, launching a specific application requires the user to first open the folder containing that application, scroll through the folder to the page containing the application, and then input an action to launch it. This lengthy process makes it inconvenient for users to quickly launch applications within a folder. Summary of the Invention

[0003] The purpose of this application is to provide an application interface display method and apparatus, electronic device and readable storage medium, which can reduce the operation path for users to launch applications in the application folder, and facilitate users to quickly launch the corresponding applications.

[0004] In a first aspect, embodiments of this application provide an application interface display method, the method comprising: receiving a first input from a user; responding to the first input by displaying a first application icon in a first area of ​​a target application folder; receiving a second input from the user to the first area; and responding to the second input by displaying a first application interface corresponding to the first application icon.

[0005] Secondly, embodiments of this application provide an application interface display device, the device comprising: a receiving unit for receiving a first input from a user; a display unit for displaying a first application icon in a first area of ​​a target application folder in response to the first input; the receiving unit further for receiving a second input from the user to the first area; and the display unit further for displaying a first application interface corresponding to the first application icon in response to the second input.

[0006] Thirdly, embodiments of this application provide an electronic device, which includes a processor and a memory. The memory stores programs or instructions that can run on the processor. When the programs or instructions are executed by the processor, they implement the steps of the application interface display method as described in the first aspect.

[0007] Fourthly, embodiments of this application provide a readable storage medium storing a program or instructions that, when executed by a processor, implement the steps of the application interface display method as described in the first aspect.

[0008] Fifthly, embodiments of this application provide a chip including a processor and a communication interface, the communication interface being coupled to the processor, the processor being used to run programs or instructions to implement the steps of the application interface display method as described in the first aspect.

[0009] In a sixth aspect, embodiments of this application provide a computer program product stored in a storage medium, which is executed by at least one processor to implement the steps of the application interface display method as described in the first aspect.

[0010] In the application interface display method provided in this application embodiment, the electronic device receives and responds to a user's first input, displaying a first application icon from the target application folder within a first area of ​​the target application folder. Based on this, the electronic device receives and responds to a user's second input to the first area, displaying a first application interface corresponding to the first application icon. Through this application interface display method, when the electronic device receives the user's target input (i.e., the first input), it displays a first application icon within the first area of ​​the target application folder. Based on this, the electronic device then directly launches the first application corresponding to the first application icon based on the user's second input to the first area, i.e., displays the first application interface. In this way, the user does not need to open the target application folder. After the user triggers the electronic device to display the first application icon within the first area of ​​the target application folder through input to the electronic device, the user can directly launch the application corresponding to the application icon displayed in the first area by inputting into the first area of ​​the target application folder, reducing the user's operation path to launch the application. Attached Figure Description

[0011] Figure 1 A flowchart illustrating the application interface display method provided in this application embodiment;

[0012] Figure 2 One of the schematic diagrams of the application interface display method provided in the embodiments of this application;

[0013] Figure 3 The second schematic diagram of the application interface display method provided in the embodiments of this application;

[0014] Figure 4 The third schematic diagram of the application interface display method provided in the embodiments of this application;

[0015] Figure 5 This is one of the operation interface diagrams of the application interface display method provided in the embodiments of this application;

[0016] Figure 6 This is the second operation interface diagram of the application interface display method provided in the embodiments of this application;

[0017] Figure 7 The third diagram shows the operation interface of the application interface display method provided in the embodiments of this application;

[0018] Figure 8 The fourth diagram shows the operation interface of the application interface display method provided in the embodiments of this application.

[0019] Figure 9 The fifth diagram shows the operation interface of the application interface display method provided in the embodiments of this application;

[0020] Figure 10 This is a structural block diagram of the application interface display device provided in the embodiments of this application;

[0021] Figure 11 A structural block diagram of the electronic device provided in the embodiments of this application;

[0022] Figure 12 This is a schematic diagram of the hardware structure of the electronic device provided in the embodiments of this application. Detailed Implementation

[0023] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.

[0024] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.

[0025] The first aspect of this application proposes an application interface display method. The execution subject of the application interface display method provided in this application embodiment can be an application interface display device, which can be determined according to actual usage requirements; this application embodiment does not impose any limitations. To more clearly describe the application interface display method provided in this application embodiment, the following method embodiments will executively describe the application interface display method using an application interface display device as the execution subject.

[0026] The application interface display method provided in this application embodiment will be described in detail below with reference to the accompanying drawings, through specific embodiments and application scenarios.

[0027] like Figure 1 As shown, this application embodiment provides an application interface display method, which may include the following steps S102 to S108:

[0028] S102: Receive the user's first input.

[0029] The application interface display method proposed in this application embodiment is applied to an electronic device, which may include a camera. In practical applications, the aforementioned electronic device may specifically be a smartphone, laptop, tablet computer, or other electronic device that includes a camera, and no specific limitation is made herein.

[0030] Furthermore, the aforementioned first input is associated with the target application folder in the electronic device.

[0031] In practical applications, the aforementioned first input can specifically be voice input, which may include the name of the target application folder. The first input can also be input from the user's gaze, touch input, etc. Those skilled in the art can set the specific form of the first input according to the actual situation, and no specific limitations are made here.

[0032] In the case where the first input is the user's gaze input on the target application folder, the location of the user's viewpoint can be determined based on the user's gaze information. If the user's viewpoint is located in the area where the target application folder is located, it is considered that the user has performed the first input on the target application folder.

[0033] The aforementioned user gaze information may include pupil position information and corneal reflector information. It is understood that, based on the principle of pupil-corneal reflector technology, when the relative position of the light source and the user's head remains constant, the reflector point of the user's cornea reflecting infrared light remains essentially unchanged. However, the position of the pupil changes depending on the object being viewed. Therefore, the direction of the user's gaze can be determined by the relative direction of the user's pupil and the corneal reflector. By using the user's pupil position information and corneal reflector information, the point where the user's gaze falls, i.e., the user's viewpoint, can be calculated.

[0034] In practical applications, specifically, when a user uses an electronic device, the device can capture images of the user's eyes using its onboard camera. Based on these images, the electronic device establishes a three-dimensional coordinate system and determines the pupil position and corneal reflection point information within this system. Further, using pupil-corneal reflection technology, the device determines the user's gaze direction and viewpoint position on the display screen based on the pupil position and corneal reflection point information. Then, the device compares the user's viewpoint position with the folder area of ​​each application folder on the display screen. If the user's viewpoint is within the area of ​​a target application folder, the device considers the target application folder to be the application folder the user intends to access.

[0035] S104: In response to the first input, display the first application icon in the first area of ​​the target application folder.

[0036] The first input is associated with the target application folder and is used to instruct the user to perform a target operation on the target application folder, such as launching an application in the target application folder.

[0037] Furthermore, the target application folder contains at least two application icons, with each application icon corresponding to one application.

[0038] Furthermore, the aforementioned first area is used to highlight application icons. An application icon is displayed in the first area, and the user can directly control the electronic device to display the program interface of the application corresponding to the application icon in the first area through touch operations on the first area. That is, the user can directly launch the application corresponding to the application icon in the first area through touch operations on the first area.

[0039] Furthermore, in practical applications, after the electronic device responds to the first input, a second area will be displayed in the target application folder. This second area is used to display at least one application icon. Users can control the electronic device to enter the folder interface of the target application folder by touching the second area. That is, users can directly open the target application folder by touching the second area.

[0040] In other words, in the application interface display method proposed in this application embodiment, when the electronic device receives the user's first input on the target application folder, if the electronic device detects that the user's viewpoint is within the area where the target application folder is located, the electronic device divides the target application folder into two areas, namely the first area and the second area, for display. Simultaneously, the first application icon in the target application folder is displayed in a larger size within the first area, and other application icons in the target application folder, excluding the first application icon, are displayed normally or in a smaller size within the second area.

[0041] In practical applications, those skilled in the art can directly set the display positions of the first and second regions within the target application folder. For example, the middle area of ​​the target application folder can be set as the first region, while the edge area of ​​the target application folder can be set as the second region. Alternatively, the lower right area of ​​the target application folder can be set as the first region, while other areas within the target application folder can be set as the second region.

[0042] In addition, in practical applications, electronic devices can also limit the specific locations of the first and second areas in the target application folder based on the user's historical operation habits, such as the historical location of the user's clicks on the target application folder, so as to ensure that the user's operation on the first and second areas can meet the user's operation habits.

[0043] S106: Receive the user's second input to the first area.

[0044] The second input is the user's touch input to the first area, which can specifically be a single click, double click, swipe, or input along a preset trajectory. Those skilled in the art can set the specific form of the second input according to the actual situation, and no specific restrictions are imposed here.

[0045] S108: In response to the second input, display the first application interface corresponding to the first application icon.

[0046] Wherein, the first application icon is the application icon of the first application, and the first application interface is the application interface of the first application.

[0047] Specifically, when a first application icon is displayed in the first area of ​​the target application folder, the user can directly launch the first application corresponding to the first application icon by touching the first area, i.e., by the second input, thus displaying the aforementioned first application interface.

[0048] In addition, in practical applications, users can also directly open the target application folder by entering the second input in the second area of ​​the target application folder, that is, directly expand and display the folder contents in the target application folder.

[0049] Specifically, the electronic device acquires the user's click event on the target application icon in the target application folder and determines the target click location corresponding to the click event. If the target click location is in the first area of ​​the target application folder, the name of the application corresponding to the application icon displayed in the first area is determined as the target application name. If the target click location is in the second area of ​​the target application folder, the launcher on the electronic device will launch the target application folder to expand and display its contents in the folder interface. Based on this, the electronic device further determines the target application name corresponding to the user's click location in the folder interface. Further, the launcher, based on the aforementioned target application name, notifies the AMS (Activity Manager Service, a process management and scheduling module in the system) on the electronic device to create a target application process to display the program interface of the target application.

[0050] In practical applications, electronic devices can also determine the user's intention to manipulate the target application folder or the application icons within it based on the user's gaze information, and automatically open the target application folder or launch the aforementioned first application based on the user's intention.

[0051] In addition, in practical applications, while the electronic device responds to the user's first input by displaying the icons of each application in the target application folder in different areas, it can also enlarge the target application folder as a whole, so that the user can operate on the first area of ​​the target application folder to launch the corresponding application, or facilitate the user to operate on the second area of ​​the target application folder to open the target application folder.

[0052] The application interface display method provided in this application embodiment allows the electronic device to receive and respond to a user's first input, displaying a first application icon from the target application folder within a first area of ​​the target application folder. Based on this, the electronic device receives and responds to a user's second input to the first area, displaying a first application interface corresponding to the first application icon. In other words, through this application interface display method, when the electronic device receives the user's target input (i.e., the first input), it displays a first application icon within the first area of ​​the target application folder. Furthermore, based on the user's second input to the first area, the electronic device directly launches the first application corresponding to the first application icon, i.e., displays the first application interface. This eliminates the need for the user to open the target application folder. After the user triggers the electronic device to display the first application icon within the first area of ​​the target application folder through input, the user can directly launch the application corresponding to the displayed application icon within the first area by inputting into the first area of ​​the target application folder, reducing the user's operation path to launch the application.

[0053] In this embodiment of the application, the target application folder includes at least two application icons. The first application icon is the application icon that is first when the at least two application icons are sorted according to the first target order, which is the order of the probability of a user clicking the at least two application icons.

[0054] Specifically, in the application interface display method provided in this application embodiment, when the electronic device receives the user's first input on the target application folder, if the electronic device detects that the user's viewpoint falls within the area where the target application folder is located, the electronic device divides the target application folder into a first area and a second area for display, and enlarges the application icon with the highest user click probability in the target application folder, i.e., the first application icon, in the first area of ​​the target application folder, and displays other application icons in the target application folder normally or in a smaller size in the second area of ​​the target application folder.

[0055] In the embodiments provided in this application, the target application folder includes at least two application icons. The first application icon is the application icon that appears first when the at least two application icons are sorted according to a first target order, which is the order of the probability of the user clicking the at least two application icons. Thus, when the electronic device receives the user's first input regarding the target application folder, the application icon with the highest historical click probability (i.e., the first application icon) is highlighted in the target application folder, making the display method of each application icon in the target application folder more consistent with the user's historical operation habits of the target application folder.

[0056] In this embodiment of the application, after S104, the application interface display method further includes the following S110 to S114:

[0057] S110: Obtain at least three historical line-of-sight trajectories of the user in the first coordinate system, and determine the speed threshold of the user's line-of-sight swiping based on the historical line-of-sight trajectories.

[0058] The first coordinate system mentioned above is the system coordinate system of the electronic device. Specifically, the system coordinate system is the two-dimensional coordinate system of the electronic device's system settings on its display screen. The format of the system coordinate system of different models of electronic devices may be the same or different, and no specific restrictions are made here.

[0059] Furthermore, the aforementioned historical gaze trajectory is the sliding trajectory of the user's gaze on the display screen of the electronic device during the second historical period. By analyzing the user's historical gaze trajectory, the user's gaze sliding habits when viewing the display screen of the electronic device can be determined.

[0060] Furthermore, the aforementioned speed threshold is used to determine whether the user intends to swipe. If the user's visual swipe speed is greater than the speed threshold, it indicates that the user intends to swipe, and the electronic device automatically controls its display interface or its operation controls based on the user's swipe intention. Conversely, if the user's visual swipe speed is less than or equal to the speed threshold, it indicates that the user does not intend to swipe, and the electronic device does not respond.

[0061] Specifically, the electronic device captures images of the user's eyes during a second historical period using its onboard camera. It records the points where the user's gaze falls on the electronic device's display screen and the coordinates of each gaze point in a first coordinate system. Based on these gaze points, at least three historical gaze trajectories are determined for the user during the second historical period. Furthermore, the user's gaze-sliding habits while viewing the electronic device's display screen are analyzed based on these historical gaze trajectories, thereby determining the speed threshold for the user's gaze sliding.

[0062] S112: Monitor the user's viewpoint according to the target time interval, obtain the user's actual line-of-sight trajectory in the first coordinate system, and determine the actual speed of the user's line-of-sight sliding based on the actual line-of-sight trajectory.

[0063] The aforementioned actual gaze trajectory refers to the sliding trajectory of the user's gaze within the target application folder area. By analyzing the user's actual gaze trajectory, the actual speed at which the user's gaze slides within the target application folder area can be determined.

[0064] Specifically, during the use of the electronic device, the device captures images of the user's eyes at target time intervals using its imaging device. Based on these images, it determines the points where the user's gaze falls on the display screen of the electronic device, as well as the coordinates of each gaze point in a first coordinate system, thereby monitoring the user's viewpoint at the aforementioned target time intervals. Furthermore, the electronic device analyzes the monitored user viewpoints to determine the user's actual gaze trajectory in the first coordinate system, and then determines the actual speed of the user's gaze movement based on this trajectory.

[0065] The target time interval mentioned above is relatively small. In practical applications, those skilled in the art can set the specific value of the target time interval according to the actual situation, and no specific restrictions are imposed here.

[0066] S114: If the actual speed is greater than the speed threshold, switch the first application icon in the first area to the second application icon according to the first target sequence.

[0067] Wherein, the first target order is the probability order of a user clicking at least two application icons in the target application folder, the first application icon is the application icon that is first when the at least two application icons are sorted according to the first target order, and the second application icon is the application icon that is next in order when the application icons in the target application folder are sorted according to the first target order.

[0068] Specifically, in the application interface display method provided in this application embodiment, when the first application icon (the one with the highest user click probability) in the first area of ​​the target application folder is highlighted, and other application icons in the target application folder are displayed normally in the second area of ​​the target application folder, the electronic device captures an image of the user's eyes using its imaging device, and analyzes the user's gaze information based on the image to determine the user's gaze swiping trajectory. Further, the electronic device determines the actual speed at which the user's gaze swips within the area of ​​the target application folder based on the user's gaze swiping trajectory, and compares this actual speed with a speed threshold determined based on the user's historical gaze trajectories.

[0069] Based on this, if the actual speed at which the user swipes within the target application folder's area of ​​vision exceeds the aforementioned speed threshold, it indicates that the user intends to swipe. In this case, the first application icon in the first area is moved to the second area for display, and the second application icon, which is next in order from the first application icon in the second area, is moved to the first area for highlighting.

[0070] Among them, the first application icon is the application icon with the highest click probability in the target application folder, and the second application icon is the application icon with the second highest click probability in the target application folder.

[0071] Based on this, in practical application, if the electronic device detects another user's intention to swipe based on the user's eye movement and swipe speed while a second application icon is displayed in the first area, then the second application icon in the first area will be moved to the second area for display, and a third application icon in the second area will be moved to the first area for display. The third application icon is the next in order of appearance in the target application folder when all application icons are sorted according to the first target order. This process continues, with the electronic device continuously updating the application icons displayed in the first area based on the user's swipe intentions.

[0072] In other words, in the application interface display method provided in this application embodiment, when the electronic device detects that the user has the intention to slide based on the user's line-of-sight swiping trajectory and line-of-sight swiping speed, the electronic device sequentially highlights each application icon in the target application folder in the first area according to the first target order, that is, according to the order in which the probability of the user clicking each application icon in the target application folder is from large to small.

[0073] For example, such as Figure 5 As shown, the first interface 402 of the electronic device displays a first application folder 404 and a second application folder 406. The first application folder 404 includes a first application icon 408, a second application icon 410, a third application icon 412, and a fourth application icon 414. The probability of a user clicking each application icon in the first application folder 404, arranged from highest to lowest, is: second application icon 410 > third application icon 412 > first application icon 408 > fourth application icon 414. Based on this, when the electronic device detects that the user's viewpoint falls within the area of ​​the first application folder 404, such as... Figure 6 As shown, the first application folder 404 is enlarged and divided into a first area 416 and a second area 418. The second application icon 410 is highlighted in the first area 416, while the first application icon 408, the third application icon 412, and the fourth application icon 414 are displayed in the second area 418.

[0074] Furthermore, if the electronic device detects that the actual speed of the user's gaze swiping is greater than a speed threshold, such as... Figure 7As shown, the second application icon 410 is switched to the second area 418 for display, while the third application icon 412 in the second area 418 is switched to the first area 416 for highlighting. Furthermore, if the electronic device detects again that the actual speed of the user's gaze swiping exceeds a speed threshold, such as... Figure 8 As shown, the third application icon 412 is switched to the second area 418 for display, while the first application icon 408 in the second area 418 is switched to the first area 416 for highlighting. Based on this, the electronic device receives and responds to the user's click input on the first application icon 408, such as... Figure 9 As shown, the electronic device directly launches the first application corresponding to the first application icon 408, that is, displays the program interface 420 of the first application corresponding to the first application icon 408, which is the contact list interface.

[0075] In the embodiments provided in this application, after displaying a first application icon in the first area, the electronic device determines a speed threshold for the user's eye movement based on at least three historical eye movement trajectories in the user's system coordinate system, and determines the actual speed of the user's eye movement based on the user's actual eye movement trajectory. Based on this, if the determined actual speed is greater than the speed threshold, the first application icon in the first area is switched to a second application icon according to a first target sequence. In this way, without manual user operation, the electronic device automatically updates the application icons displayed in the first area according to the aforementioned first target sequence when the actual speed of the user's eye movement exceeds the speed threshold, reducing the operation path for the user to launch the application corresponding to the application icon, thereby facilitating the user to quickly launch the corresponding application.

[0076] In this embodiment of the application, the above-mentioned application interface display method may further include the following steps S116 to S122:

[0077] S116: Obtain the historical coordinate point set of the user clicking the target application folder in the first coordinate system, and determine the initial polygon based on the historical coordinate point set.

[0078] The first coordinate system mentioned above is a two-dimensional coordinate system on the display screen of an electronic device.

[0079] Furthermore, the aforementioned set of historical coordinate points includes n historical coordinate points, where n is a positive integer greater than or equal to 4. The historical coordinate points are determined based on the user's click position on the target application folder within the first historical time period.

[0080] Specifically, in the application interface display method provided in this application, during the process of dividing the target application folder into a first region and a second region, n touch points of the user clicking on the target application folder within a first historical time period are obtained, and the position coordinates of the n touch points in the aforementioned first coordinate system are determined to obtain n historical coordinate points, thereby obtaining a set of historical coordinate points. Based on this, by sequentially connecting the n historical coordinate points in the set of historical coordinate points, an n-sided polygon, namely the aforementioned initial polygon, is obtained.

[0081] The historical coordinates are determined based on the user's click position on the target application folder within the first historical time period. Thus, the area where the initial polygon is located can be considered as the user's habitual area for clicking the target application folder. When dividing the target application folder into regions using this initial polygon, the resulting first region is more in line with the user's operating habits.

[0082] Furthermore, the aforementioned first historical period is a period of time prior to the current moment. The specific duration of this first historical period can be set by those skilled in the art according to the actual situation, and no specific restrictions are imposed here.

[0083] S118: Perform equidistant shrinkage on the initial polygon to obtain the target triangle.

[0084] The boundary shape of the first region is a regular shape, such as a square or rectangle, and the initial polygon can be a convex or concave polygon. Therefore, after determining the initial polygon, it needs to be further processed to determine the regular first region.

[0085] Specifically, in the process of determining the first region based on the initial polygon, the first region can be determined based on the inscribed circle of the initial polygon.

[0086] The initial polygon can be a convex or concave polygon. Therefore, in the application interface display method provided in this application, to ensure the accuracy of the determination of the first and second regions, in the process of dividing the target application folder into the first and second regions according to the initial polygon, the initial polygon is specifically subjected to iterative shrinking processing to shrink it equidistantly by the target distance, thereby shrinking the initial polygon into a regular target triangle, and then dividing the target application folder into the first and second regions according to the target triangle and the target distance.

[0087] S120: Determine the target circle based on the inscribed circle of the target triangle and the target distance.

[0088] Specifically, after obtaining a regular target triangle by equidistantly shrinking the target distance of the initial polygon, a target circle is determined by taking the center of the inscribed circle of the target triangle (i.e., the center of the target triangle) as the target circle center and the sum of the radius of the inscribed circle of the target triangle and the target distance as the target radius, so that the target application folder can be divided into a first region and a second region according to the target circle.

[0089] S122: Define the target circumscribed rectangle, which is parallel to the target application file, as the first region.

[0090] It is understood that a circle can have an infinite number of circumscribed rectangles. In the application interface display method provided in this application embodiment, after determining the target circle, the target circumscribed rectangle parallel to the target application file is determined as the first region. At the same time, the region in the target application folder other than the target circumscribed rectangle is determined as the second region, thereby realizing the regional division of the target application folder.

[0091] For example, such as Figure 2 As shown, an initial polygon 202 is obtained based on the historical coordinate point set of the target application folder 200 clicked by the user. A first polygon 204 is obtained by equidistantly shrinking the initial polygon 202 by a first distance d. A second polygon 206 is obtained by equidistantly shrinking the first polygon 204 by a first distance d. A target triangle 208 is obtained by equidistantly shrinking the second polygon 206 by a first distance. Based on this, the shrinkage distance of the target triangle 208 relative to the initial polygon 202 is determined to be D = 3 × d, and the center and radius of the inscribed circle 218 of the target triangle 208 are determined. Further, the target circle 210 is determined with the center of the inscribed circle 218 as the target center, and the sum of the radius of the inscribed circle 218 and the shrinkage distance D as the target radius R. Furthermore, a target circumscribed rectangle 212 parallel to the target circle 210 and the target application folder 200 is determined, and the area of ​​the target application folder 200 located within the target circumscribed rectangle 212 is defined as the first region 214, and the area of ​​the target application folder 200 located outside the target circumscribed rectangle 212 is defined as the second region 216.

[0092] The embodiments provided in this application obtain a set of historical coordinate points of user clicks on a target application folder in a first coordinate system, determine an initial polygon based on the historical coordinate point set, perform equidistant indentation processing on the initial polygon to obtain a target triangle, and the indentation distance of the initial polygon is the target distance; determine a target circle based on the incircle of the target triangle and the target distance; and determine the target circumscribed rectangle parallel to the target application folder as the first region. In this way, on the one hand, dividing the target application folder into regions based on the user's historical click habits ensures that the resulting first region better matches the user's operating habits; on the other hand, the accuracy of the region division of the target application folder is ensured by a series of processing steps on the initial polygon formed by the user's historical coordinate point set of clicks on the target application folder.

[0093] In this embodiment of the application, the step of determining the initial polygon based on the historical coordinate point set may specifically include the following steps S124 to S130:

[0094] S124: Determine the first target coordinate point in the historical coordinate point set based on the coordinate information of each coordinate point in the historical coordinate point set.

[0095] Among them, the coordinate information of each coordinate point in the above-mentioned historical coordinate point set is the coordinate position information of each coordinate point in the historical coordinate point set in the first coordinate system.

[0096] Specifically, in the application interface display method provided in this application, after obtaining the historical coordinate point set of the user clicking the target application folder in the first coordinate system, the ordinate values ​​of each coordinate point in the historical coordinate point set are compared, and the coordinate point with the smallest ordinate value is determined as the aforementioned first target coordinate point. Where the number of coordinate points with the smallest ordinate value is greater than one, the abscissa values ​​of the coordinate points with the smallest ordinate values ​​are further compared, and the coordinate point with the smallest abscissa value is determined as the aforementioned first target coordinate point.

[0097] In addition, it should be noted that in practical applications, those skilled in the art can set the rules for determining the first target coordinate point according to the actual situation. For example, the coordinate point with the largest vertical coordinate value can be determined as the first target coordinate point. If there is more than one coordinate point with the largest vertical coordinate value, the coordinate point with the largest horizontal coordinate value among the coordinate points with the largest vertical coordinate value can be determined as the first target coordinate point. No specific restrictions are imposed here.

[0098] S126: Establish a second coordinate system with the first target coordinate point as the origin, and update the coordinate position information of each coordinate point in the historical coordinate point set according to the second coordinate system to obtain the target coordinate point set.

[0099] The second coordinate system mentioned above is the folder coordinate system of the target application folder, which is a two-dimensional coordinate system.

[0100] Specifically, in practical applications, after determining the first target coordinate point, the first target coordinate point can be used as the origin, with the straight line parallel to the upper and lower boundaries of the target application folder as the x-axis and the straight line parallel to the left and right boundaries of the target application folder as the y-axis to establish the second coordinate system.

[0101] Based on this, the coordinate position information of each coordinate point in the historical coordinate point set is updated according to the second coordinate system. That is, with the first target coordinate point as the origin of the second coordinate system, the coordinate positions of each coordinate point in the historical coordinate point set are transformed according to the relative position information of the first target coordinate point and other coordinate points in the historical coordinate point set, so as to determine the coordinate position information of each coordinate point in the historical coordinate point set in the second coordinate system, thereby obtaining the target coordinate point set after coordinate transformation.

[0102] S128: Based on the distance information between each coordinate point in the target coordinate point set (excluding the first target coordinate point) and the first target coordinate point, as well as the angle information between the line connecting each coordinate point and the first target coordinate point and one half axis of the horizontal coordinate axis of the second coordinate system, determine the second target order of each coordinate point in the target coordinate point set.

[0103] Specifically, after determining the aforementioned set of target coordinate points, the distances between each coordinate point in the set (excluding the first target coordinate point) and the first target coordinate point are determined; that is, the distances between each coordinate point in the set (excluding the first target coordinate point) and the origin of the second coordinate system are determined. Simultaneously, the angles between the lines connecting each of the aforementioned coordinate points and the first target coordinate point and one half-axis of the horizontal axis of the second coordinate system are determined, such as the angle between the lines connecting the aforementioned coordinate points and the first target coordinate point and the positive half-axis of the x-axis of the second coordinate system.

[0104] The angle between the line connecting each coordinate point and the first target coordinate point and the positive x-axis of the second coordinate system can be determined by the following formula (1):

[0105]

[0106] Where α represents the coordinate point (x i ,y i The angle between the line connecting the first target coordinate point (x0, y0) and the positive x-axis of the second coordinate system is the value of the angle between the line connecting the first target coordinate point (x0, y0) and the first target coordinate point (x0, y0). In practical applications, the first target coordinate point is the origin of the second coordinate system, i.e., x0 = y0 = 0.

[0107] Furthermore, in determining the angle between the line connecting each coordinate point and the first target coordinate point and the positive x-axis of the second coordinate system, the positive x-axis can be used as the starting line. Rotating counter-clockwise increases the angle, while rotating clockwise decreases it. Those skilled in the art can set specific criteria for determining these angle values ​​according to actual circumstances; no specific limitations are imposed here.

[0108] Furthermore, the specific distance values ​​between each coordinate point and the first target coordinate point can be determined using the following formula (2):

[0109]

[0110] Where, d i Represents the coordinates of the point (x) i ,y i The distance between (x0, y0) and the first target coordinate point (x0, y0).

[0111] Based on this, the coordinate points in the target coordinate point set, excluding the first target coordinate point, are sorted according to the ascending order of the angle between the line connecting each coordinate point to the origin of the second coordinate system and one half-axis of the horizontal axis of the second coordinate system, to determine the second target order of the coordinate points in the target coordinate point set. The first target coordinate point is in the first position of the second target order. Furthermore, if two or more coordinate points have the same angle value, the coordinate points are sorted according to the ascending order of the distance between the coordinate point and the origin of the second coordinate system.

[0112] Furthermore, in practical applications, the second target order of the coordinate points in the target coordinate point set can be determined according to the descending order of the included angle values ​​corresponding to each coordinate point. Those skilled in the art can set the rules for determining the above-mentioned second target order according to the actual situation, and no specific restrictions are imposed here.

[0113] S130: Connect the coordinate points in the target coordinate point set according to the second target order to obtain the initial polygon.

[0114] Specifically, after determining the second target order of each coordinate point in the target coordinate point set, the coordinate points in the target coordinate point set are connected sequentially according to the second target order to obtain the above-mentioned initial polygon. The area where the initial polygon is located can be considered as the user's habitual area when clicking on the target application folder.

[0115] For example, such as Figure 3As shown, the target coordinate point set includes six coordinate points: N0(0,0), N1(6,2), N2(3,3), N3(6,6), N4(-6,9), and N5(-8,4). N0(0,0) is the origin of the second coordinate system. Based on this, the angles between N0(0,0) and the other five coordinate points are determined. The angles between N2(3,3) and N3(6,6) and N0(0,0) are the same. Therefore, the distances between N2(3,3) and N3(6,6) and N0(0,0) are determined. Based on this, and following the order of angles and distances from smallest to largest, the second target order for each coordinate point in the target coordinate point set is determined as follows: N0(0,0), N1(6,2), N2(3,3), N3(6,6), N4(-6,9), N5(-8,4). Furthermore, by sequentially connecting the coordinate points in the target coordinate point set according to the determined second target order, the initial polygon 302 can be obtained.

[0116] In the embodiments provided in this application, during the process of determining the initial polygon based on the historical coordinate point set, a first target coordinate point in the historical coordinate point set is determined based on the coordinate information of each coordinate point in the historical coordinate point set. Then, a folder coordinate system for the target application folder, i.e., the aforementioned second coordinate system, is established with the first target coordinate point as the origin. The coordinate position information of each coordinate point in the historical coordinate point set is updated according to the second coordinate system to obtain the target coordinate point set. Based on this, a second target order is determined for each coordinate point in the target coordinate point set, based on the distance information between each coordinate point in the target coordinate point set (excluding the first target coordinate point) and the first target coordinate point, as well as the angle information between the line connecting each coordinate point to the first target coordinate point and one half-axis of the horizontal coordinate axis of the second coordinate system. The coordinate points in the target coordinate point set are then connected according to the second target order to obtain the initial polygon. This ensures the rationality of the initial polygon determination, thereby guaranteeing the accuracy of subsequent region division of the target application folder based on this initial polygon.

[0117] In this embodiment of the application, one vertex of the initial polygon corresponds to a coordinate point in the target coordinate point set. Based on this, the step of performing equidistant shrinkage processing on the initial polygon may specifically include the following S132 to S136:

[0118] S132: Obtain the first vector and the second vector corresponding to each coordinate point in the target coordinate point set.

[0119] In this context, the first and second vectors of a coordinate point are the neighboring edge vectors of the vertex corresponding to that coordinate point.

[0120] Specifically, it can be understood that each vertex in the initial polygon corresponds to two adjacent edges. For each vertex, the first vector and the second vector mentioned above correspond to the two adjacent edges of that vertex, respectively. The directions of the first vector and the second vector are the construction directions of the corresponding adjacent edges when connecting the coordinate points in the order of the second objective mentioned above. The magnitudes of the first vector and the second vector are the same as the side lengths of the corresponding adjacent edges.

[0121] For example, such as Figure 3 As shown, the two adjacent vectors of coordinate point N0 are respectively and The two adjacent vectors of coordinate point N1 are respectively and The two adjacent vectors of coordinate point N2 are respectively and The two adjacent vectors of coordinate point N3 are respectively and The two adjacent vectors of coordinate point N4 are respectively and The two adjacent vectors of coordinate point N5 are respectively and

[0122] S134: Determine the sine of the angle between the first and second vectors at each coordinate point.

[0123] Specifically, taking coordinate point N0 as an example, after determining the first vector and the second vector of coordinate point N0, the sine value of the angle between the first vector and the second vector of coordinate point N0 can be determined according to the following formula (3):

[0124]

[0125] in, Let N0 be the first vector. Let A be the second vector of coordinate point N0, and let A be the angle between the first and second vectors of coordinate point N0.

[0126] S136: If the sine value corresponding to the second target coordinate point is zero, delete the vertex corresponding to the second target coordinate point. If the sine value corresponding to the second target coordinate point is not zero, update the position of the vertex corresponding to the second target coordinate point according to the sine value corresponding to the second target coordinate point, the first vector, and the second vector, until the number of vertices of the initial polygon is three.

[0127] The second target coordinate point mentioned above is any coordinate point in the set of target coordinate points.

[0128] Specifically, during the equidistant shrinking process of the initial polygon, for each vertex in the initial polygon, that is, for each coordinate point in the target coordinate point set, the sine value of the angle between the first vector and the second vector corresponding to each coordinate point is calculated. If the sine value of the angle between the first vector and the second vector corresponding to a certain coordinate point is zero, it means that the first vector and the second vector corresponding to that coordinate point are collinear, that is, the two adjacent edges corresponding to that coordinate point are collinear. In this case, the coordinate point is directly deleted, that is, the vertex corresponding to that coordinate point in the initial polygon is deleted, and the two adjacent vertices on both sides of that vertex are directly connected.

[0129] If the sine of the angle between the first and second vectors corresponding to a certain coordinate point is not zero, then the coordinate position of that coordinate point is updated based on the sine of the first and second vectors corresponding to that coordinate point, as well as the sine of the angle between the first and second vectors. This updates the position of the vertex corresponding to that coordinate point in the initial polygon. By shrinking each coordinate point in the target coordinate point set, one shrinking process of the initial polygon is completed. This process is iterated and repeated until only three coordinate points remain in the target coordinate point set, i.e., only three vertices remain in the initial polygon, resulting in the aforementioned target triangle.

[0130] In each shrinking process, for coordinate points where the sine of the angle between the corresponding first and second vectors is not zero, taking coordinate point N0 as an example, the coordinate position of the coordinate point can be updated using the following formula (4):

[0131]

[0132] Where N0′ is the coordinate point of coordinate point N0 after the position is updated. For vectors The standardized vector, For vectors The standardized vector.

[0133] For example, such as Figure 4 As shown, for coordinate point N0, its adjacent edge vectors are respectively and Due to vectors sum vector Non-collinear, vectors sum vector The sine of the angle A between the vectors is not zero. At this time, the position coordinates of the coordinate point N0 are updated according to the above formula (4) to obtain the target coordinate point N0′ after the position is updated. The target coordinate point N0′ is the coordinate point corresponding to the coordinate point N0 after shrinking the coordinate point N0 by a distance d.

[0134] In the embodiments provided in this application, one vertex of the initial polygon corresponds to one coordinate point in the target coordinate point set. Based on this, during the equidistant shrinking process of the initial polygon, the adjacent edge vectors (i.e., the first vector and the second vector) of the vertex corresponding to each coordinate point in the target coordinate point set are obtained, and the sine value of the angle between the first vector and the second vector for each coordinate point is determined. Furthermore, if the sine value corresponding to any coordinate point in the target coordinate point set (i.e., the second target coordinate point) is zero, the vertex corresponding to that second target coordinate point is deleted. If the sine value corresponding to the second target coordinate point is not zero, the position of the vertex corresponding to the second target coordinate point is updated according to the sine value, the first vector, and the second vector, until the number of vertices of the initial polygon is three. In this way, by iteratively shrinking the initial polygon into a target triangle, the accuracy and rationality of the target triangle determination are ensured, thereby guaranteeing the accuracy of subsequent region division of the target application folder based on this target triangle.

[0135] In this embodiment of the application, the step of determining the speed threshold of the user's eye movement based on the historical eye movement trajectory may specifically include the following steps S138 and S140, and the step of determining the actual speed of the user's eye movement based on the actual eye movement trajectory may specifically include the following steps S142 and S144:

[0136] S138: Determine the curve parametric equation for each historical line of sight based on the coordinate point information on each historical line of sight trajectory.

[0137] The coordinate information includes the coordinate position of each coordinate point in each historical line of sight, i.e., the point where the line of sight lands, as well as the recording time.

[0138] Specifically, after acquiring at least three historical line-of-sight trajectories of the user in the first coordinate system, the curve parametric equation of each historical line-of-sight trajectory is constructed based on the coordinate position of each coordinate point (i.e., the point where the line of sight falls) and the recording time.

[0139] In practical applications, the curve parametric equation for each historical line-of-sight trajectory can be determined using the following formula (5):

[0140]

[0141] Among them, (a0,a1,a2,a3,a4,a5) should satisfy (b0, b1, b2, b3, b4, b5) should satisfy

[0142]

[0143] S140: Determine the maximum speed of each historical line of sight based on the curve parameter equation of each line of sight, and determine the user's line of sight sliding speed threshold based on the maximum speed of at least three historical line of sight.

[0144] Specifically, after determining the curve parametric equation for each historical line of sight, the maximum speed of the user's line of sight sliding in each historical line of sight is determined by further analyzing the curve parametric equation.

[0145] Specifically, in practical applications, the maximum speed of the user's line of sight sliding in each historical line of sight can be determined by differentiating the curve parametric equation of each historical line of sight.

[0146] Based on this, after determining the maximum speed of the user's eye movement in each historical eye trajectory, the speed threshold mentioned above is determined according to the maximum speed of each historical eye trajectory.

[0147] Specifically, in practical applications, the speed threshold can be determined by averaging the maximum speed of the user's line of sight movement in each historical line of sight trajectory.

[0148] S142: Obtain the first and second viewpoints in the actual line-of-sight trajectory.

[0149] The first viewpoint is the user's actual viewpoint, and the second viewpoint is the user's viewpoint at the moment preceding the first viewpoint.

[0150] S144: Based on the coordinate information of the first viewpoint and the second viewpoint and the monitoring time information, determine the actual speed at which the user slides their line of sight between the first viewpoint and the second viewpoint.

[0151] Specifically, during the monitoring of user viewpoints at target time intervals, for each user viewpoint identified, the user's line-of-sight sliding speed at the current user viewpoint is determined using the coordinate information of that user viewpoint and the historical viewpoints of the user monitored at the previous moment, as well as the monitoring time information. That is, during the monitoring of user viewpoints at target time intervals, based on the coordinates of the monitored actual viewpoint (the first viewpoint mentioned above), the previously monitored user viewpoint (the second viewpoint mentioned above), and the monitoring time, the actual speed at which the user's line of sight slides between the first and second viewpoints is determined, and this actual speed is used as the actual speed at which the user's line of sight slides at the user's actual viewpoint.

[0152] Based on this, once it is determined that the actual speed at which the user's gaze slides at the user's actual viewpoint is greater than the aforementioned speed threshold, the electronic device will automatically update the application icons displayed in the first area of ​​the target application folder according to the aforementioned first target sequence.

[0153] In practical applications, the user's first viewpoint K can be specifically determined using the following formula (6). t1 (x1, y1) and the second viewpoint K t2 The actual speed v of the line of sight sliding between (x2, y2) 12 To confirm:

[0154]

[0155] The embodiments provided in this application determine the curve parametric equation of each historical line of sight based on the coordinate point information on each historical line of sight trajectory. Then, based on the curve parametric equation of each historical line of sight trajectory, the maximum speed value of each historical line of sight trajectory is determined, and a speed threshold is determined based on the maximum speed values ​​of at least three historical line of sight trajectories. Furthermore, a first viewpoint and a second viewpoint in the actual line of sight trajectory are obtained, where the first viewpoint is the user's actual viewpoint and the second viewpoint is the user's viewpoint at the moment preceding the first viewpoint. Then, based on the coordinate information of the first and second viewpoints and the monitoring time information, the actual speed at which the user slides their gaze between the first and second viewpoints is determined. This ensures that the determined speed threshold more closely matches the user's gaze sliding habits, while also ensuring the accuracy of determining the actual speed of the user's gaze sliding. This, in turn, ensures accurate control of switching the application icons displayed in the first area based on the comparison between the user's actual gaze speed and the speed threshold.

[0156] In this embodiment of the application, the above-mentioned application interface display method may further include the following steps S146 to S152:

[0157] S146: Obtain user operation information on the target application folder and each application icon in the target application folder during the target time period.

[0158] Specifically, the aforementioned operation information may include the number of times the user clicked the target application folder to open the target application folder during the third historical time period, and the number of times the user clicked the individual application icons in the target application folder to open the individual applications during the third historical time period.

[0159] Furthermore, the duration of the aforementioned third historical period can be 3 days, 5 days, 1 week, etc. Those skilled in the art can set the specific duration of the aforementioned third historical period according to the actual situation, and no specific restrictions are imposed here.

[0160] S148: Determine the initial probability of the user clicking each application icon based on the operation information, and obtain the initial probability matrix.

[0161] Specifically, in the application interface display method provided in this application embodiment, the number of times the user clicks the target application folder and each application icon within it during a third historical time period is obtained. Based on this, the electronic device determines the initial probability of the user clicking each application icon according to the number of times the user clicks the target application folder and each application icon within the target application folder during the third historical time period, and integrates the initial probabilities of each application icon to obtain an initial probability matrix. For example, π0=(p0,p1,...,p m-1 ), where p0 is the initial probability of the first application icon, p1 is the initial probability of the second application icon, and so on, p m-1 Let m be the initial probability of the m-th application icon.

[0162] Specifically, in practical applications, the initial probability of each application icon can be determined by dividing the number of times the user clicks the application icon in the third historical period by the number of times the user clicks the target application folder in the third historical period.

[0163] S150: Determine the conditional probability of the user clicking each application icon based on the operation information, and obtain the transition probability matrix.

[0164] For each app icon, the conditional probability refers to the probability that a user will click on the same app icon again after clicking on an app icon.

[0165] In practical applications, for each application icon, the electronic device can determine the conditional probability of the user clicking each application icon in the target application folder, based on the number of times the user clicks the application icon in the third historical time period and the number of times the user clicks each application icon in the target application folder after clicking the application icon.

[0166] For example, a user clicks the first application icon 10 times within the third historical time period. After the first click, the user clicks the first application icon once more, the second application icon 6 times, and the third application icon 3 times. Based on this, the electronic device determines that, given the user's current click is on the first application icon, the conditional probability of the user clicking the first application icon next time is 0.1, the conditional probability of the user clicking the second application icon next time is 0.6, and the conditional probability of the user clicking the third application icon next time is 0.3.

[0167] Based on this, the conditional probabilities of the user clicking each application icon are integrated to obtain the transition probability matrix P of the user clicking each application icon in the target application folder.

[0168] For example,

[0169] Where, p 00 Let p be the conditional probability that, given that the user clicks the first application icon in the current application click, the user will click the first application icon again in the next application click. 0(m-1) Let p be the conditional probability that the user's next click will be the m-th application icon, given that the application icon clicked by the user in the current click is the first application icon. (m-1)0 Let p be the conditional probability that the user's next click will be the first application icon, given that the application icon clicked by the user in the current click is the m-th application icon. (m-1)(m-1) Given that the application icon clicked by the user this time is the m-th application icon, the application icon clicked by the user next time will also be the m-th application icon, and so on.

[0170] S152: Determine the target convergence probability of the user clicking each application icon based on the initial probability matrix and the transition probability matrix, and determine the first target order based on the target convergence probability.

[0171] The aforementioned target convergence probability can be used to represent the stable probability distribution of a user clicking each application icon. The order of probability of a user clicking each application icon can be determined by the target convergence probability, which is the first target order mentioned above.

[0172] Specifically, after determining the target convergence probability of a user clicking each application icon, the first target order of each application icon is determined according to the order of the target convergence probability of the user clicking each application icon from largest to smallest.

[0173] In practical applications, the target convergence probability of a user clicking each application icon can be determined using the following formula (7):

[0174] π n =π n-1 ×P=π0×P n (7)

[0175] Where, π n Let π be the target convergence probability, π0 be the initial probability matrix mentioned above, P be the transition probability matrix mentioned above, and n be an integer close to positive infinity.

[0176] The embodiments provided in this application acquire user operation information on a target application folder and each application icon within that folder during a target time period. Based on this operation information, an initial probability matrix is ​​obtained, representing the initial probability of the user clicking each application icon. A transition probability matrix is ​​also obtained, representing the conditional probability of the user clicking each application icon. Furthermore, based on the initial and transition probability matrices, a target convergence probability is determined for each application icon clicked, and a first target order is determined based on this target convergence probability. Thus, by determining the update order of the application icons displayed in the first region—the aforementioned first target order—based on a Markov chain, the accuracy of the first target order determination is ensured, thereby guaranteeing the accuracy of the update control of the application icons displayed in the first region.

[0177] In this embodiment of the application, the above-mentioned application interface display method may further include the following steps S154 to S158:

[0178] S154: Obtain the user's pupil position information and corneal reflex point information.

[0179] Specifically, in the application interface display method proposed in this application embodiment, during the user's use of the electronic device, the electronic device captures an image of the user's eyes using its onboard camera. Based on this, the electronic device establishes a three-dimensional coordinate system based on the captured image of the user's eyes, and determines the pupil position information and corneal reflection point information of the user's eyes in the aforementioned three-dimensional coordinate system according to the image of the user's eyes.

[0180] S156: Determine the user's actual viewpoint coordinates based on pupil position information and corneal reflection point information.

[0181] Specifically, after acquiring the user's pupil position information and corneal reflection point information, the electronic device, based on pupil-corneal reflection technology, determines the user's line of sight direction and the actual viewpoint coordinates of the user's line of sight on the display screen of the electronic device according to the user's pupil position information and corneal reflection point information.

[0182] S158: Define the application folder whose coordinate range includes the actual viewpoint coordinates as the target application folder.

[0183] Specifically, after determining the actual viewpoint coordinates of the user's gaze on the display screen of the electronic device, if an application folder is displayed on the display screen of the electronic device, the electronic device compares the determined actual viewpoint coordinates with the area coordinate range of each application folder, and determines the application folder whose area coordinate range includes the user's actual viewpoint coordinates as the target application folder that the user wants to operate.

[0184] The embodiments provided in this application acquire the user's pupil position information and corneal reflection point information, and determine the user's actual viewpoint coordinates based on these information. Then, the application folder whose coordinates include the actual viewpoint coordinates is identified as the target application folder for the user's operation. In this way, by determining the user's actual viewpoint based on their pupil position information and corneal reflection point information, and then determining the target application folder based on that viewpoint, the accuracy of the target application folder determination is ensured, thereby guaranteeing the precision of subsequent operations on that target application folder.

[0185] The application interface display method provided in the first aspect of this application can be executed by an application interface display device. This application embodiment uses the execution of the above-described application interface display method by an application interface display device as an example to illustrate the application interface display device provided in the second aspect of this application.

[0186] like Figure 10 As shown, this application embodiment provides an application interface display device 1000, which may include the receiving unit 1002 and the display unit 1004 described below.

[0187] The receiving unit 1002 is used to receive the user's first input;

[0188] Display unit 1004 is configured to, in response to the first input, display the first application icon in the target application folder within the first area of ​​the target application folder;

[0189] The receiving unit 1002 is also used to receive a second input from the user to the first area;

[0190] The display unit 1004 is also used to respond to the second input by displaying the first application interface corresponding to the first application icon.

[0191] The application interface display device provided in this application embodiment allows an electronic device to receive and respond to a user's first input, displaying a first application icon from the target application folder within a first area of ​​the target application folder. Based on this, the electronic device receives and responds to a user's second input to the first area, displaying a first application interface corresponding to the first application icon. That is, through the above application interface display method, when the electronic device receives the user's target input (i.e., the first input), it displays the first application icon from the target application folder within the first area of ​​the target application folder. Based on this, the electronic device then directly launches the first application corresponding to the first application icon based on the user's second input to the first area, i.e., displays the first application interface. In this way, the user does not need to open the target application folder. After the user triggers the electronic device to display the first application icon in the first area of ​​the target application folder through input to the electronic device, the user can directly launch the application corresponding to the application icon displayed in the first area by inputting into the first area of ​​the target application folder, reducing the user's operation path to launch the application.

[0192] In this embodiment, the application interface display device 1000 further includes a processing unit 1006. After displaying the first application icon in the first area, the processing unit 1006 is configured to: acquire at least three historical gaze trajectories of the user in the first coordinate system, and determine the speed threshold of the user's gaze sliding based on the historical gaze trajectories; monitor the user's viewpoint according to the target time interval, obtain the user's actual gaze trajectory in the first coordinate system, and determine the actual speed of the user's gaze sliding based on the actual gaze trajectory; the display unit 1004 is further configured to: when the actual speed is greater than the speed threshold, switch the first application icon in the first area to the second application icon according to the first target order; wherein, the first coordinate system is the system coordinate system of the electronic device, the target application folder includes at least two application icons, the first target order is the probability order of the user clicking at least two application icons, the first application icon is the application icon that is first when the at least two application icons are sorted according to the first target order, and the second application icon is the application icon that is next in order in the first target order.

[0193] In the embodiments provided in this application, after displaying the first application icon in the first area, the electronic device determines the speed threshold of the user's gaze swiping based on at least three historical gaze trajectories in the user's system coordinate system, and determines the actual speed of the user's gaze swiping based on the user's actual gaze trajectory. Based on this, if the determined actual speed is greater than the speed threshold, the first application icon in the first area is switched to the second application icon according to the first target order. In this way, on the one hand, when the electronic device receives the user's first input regarding the target application folder, the application icon with the highest historical click probability (i.e., the first application icon) is highlighted in the target application folder, making the display method of each application icon in the target application folder more consistent with the user's historical operation habits of the target application folder. On the other hand, without manual operation by the user, the electronic device automatically updates the application icons displayed in the first area according to the aforementioned first target order when the actual speed of the user's gaze is greater than the speed threshold, reducing the operation path for the user to launch the application corresponding to the application icon, thereby facilitating the user to quickly launch the corresponding application.

[0194] In this embodiment of the application, the processing unit 1006 is specifically used to: obtain a set of historical coordinate points of the user clicking on the target application folder in the first coordinate system, and determine an initial polygon based on the set of historical coordinate points; perform equidistant shrinkage processing on the initial polygon to obtain a target triangle, and the shrinkage distance of the initial polygon is the target distance; determine a target circle based on the incircle of the target triangle and the target distance; and determine the target circumscribed rectangle parallel to the target application folder as the first region.

[0195] The embodiments provided in this application obtain a set of historical coordinate points of user clicks on a target application folder in a first coordinate system, determine an initial polygon based on the historical coordinate point set, perform equidistant indentation processing on the initial polygon to obtain a target triangle, and the indentation distance of the initial polygon is the target distance; determine a target circle based on the incircle of the target triangle and the target distance; and determine the target circumscribed rectangle parallel to the target application folder as the first region. In this way, on the one hand, dividing the target application folder into regions based on the user's historical click habits ensures that the resulting first region better matches the user's operating habits; on the other hand, the accuracy of the region division of the target application folder is ensured by a series of processing steps on the initial polygon formed by the user's historical coordinate point set of clicks on the target application folder.

[0196] In this embodiment of the application, the processing unit 1006 is specifically used to: determine a first target coordinate point in the historical coordinate point set based on the coordinate information of each coordinate point in the historical coordinate point set; establish a second coordinate system with the first target coordinate point as the origin, update the coordinate position information of each coordinate point in the historical coordinate point set according to the second coordinate system to obtain a target coordinate point set, wherein the second coordinate system is the folder coordinate system of the target application folder; determine a second target order of each coordinate point in the target coordinate point set based on the distance information between each coordinate point in the target coordinate point set other than the first target coordinate point and the first target coordinate point, and the angle information between the line connecting each coordinate point and the first target coordinate point and one half axis of the horizontal coordinate axis of the second coordinate system; and connect each coordinate point in the target coordinate point set according to the second target order to obtain an initial polygon.

[0197] In the embodiments provided in this application, during the process of determining the initial polygon based on the historical coordinate point set, a first target coordinate point in the historical coordinate point set is determined based on the coordinate information of each coordinate point in the historical coordinate point set. Then, a folder coordinate system for the target application folder, i.e., the aforementioned second coordinate system, is established with the first target coordinate point as the origin. The coordinate position information of each coordinate point in the historical coordinate point set is updated according to the second coordinate system to obtain the target coordinate point set. Based on this, a second target order is determined for each coordinate point in the target coordinate point set, based on the distance information between each coordinate point in the target coordinate point set (excluding the first target coordinate point) and the first target coordinate point, as well as the angle information between the line connecting each coordinate point to the first target coordinate point and one half-axis of the horizontal coordinate axis of the second coordinate system. The coordinate points in the target coordinate point set are then connected according to the second target order to obtain the initial polygon. This ensures the rationality of the initial polygon determination, thereby guaranteeing the accuracy of subsequent region division of the target application folder based on this initial polygon.

[0198] In this embodiment of the application, one vertex of the initial polygon corresponds to one coordinate point in the target coordinate point set. The processing unit 1006 is specifically used to: obtain the first vector and the second vector corresponding to each coordinate point in the target coordinate point set, wherein the first vector and the second vector are the adjacent edge vectors of the vertex corresponding to each coordinate point; determine the sine value of the vector angle between the first vector and the second vector of each coordinate point; if the sine value corresponding to the second target coordinate point is zero, delete the vertex corresponding to the second target coordinate point; if the sine value corresponding to the second target coordinate point is not zero, update the position of the vertex corresponding to the second target coordinate point according to the sine value corresponding to the second target coordinate point, the first vector, and the second vector, until the number of vertices of the initial polygon is three, wherein the second target coordinate point is any coordinate point in the target coordinate point set.

[0199] In the embodiments provided in this application, one vertex of the initial polygon corresponds to one coordinate point in the target coordinate point set. Based on this, during the equidistant shrinking process of the initial polygon, the adjacent edge vectors (i.e., the first vector and the second vector) of the vertex corresponding to each coordinate point in the target coordinate point set are obtained, and the sine value of the angle between the first vector and the second vector for each coordinate point is determined. Furthermore, if the sine value corresponding to any coordinate point in the target coordinate point set (i.e., the second target coordinate point) is zero, the vertex corresponding to that second target coordinate point is deleted. If the sine value corresponding to the second target coordinate point is not zero, the position of the vertex corresponding to the second target coordinate point is updated according to the sine value, the first vector, and the second vector, until the number of vertices of the initial polygon is three. In this way, by iteratively shrinking the initial polygon into a target triangle, the accuracy and rationality of the target triangle determination are ensured, thereby guaranteeing the accuracy of subsequent region division of the target application folder based on this target triangle.

[0200] In this embodiment, the processing unit 1006 is specifically used to: determine the curve parameter equation of each historical line-of-sight trajectory based on the coordinate point information on each historical line-of-sight trajectory; determine the maximum speed of each historical line-of-sight trajectory based on the curve parameter equation of each historical line-of-sight trajectory, and determine a speed threshold based on the maximum speed of at least three historical line-of-sight trajectories; obtain a first viewpoint and a second viewpoint in the actual line-of-sight trajectory, wherein the first viewpoint is the user's actual viewpoint, and the second viewpoint is the user's viewpoint at the moment before the first viewpoint; and determine the actual speed at which the user slides their line of sight between the first viewpoint and the second viewpoint based on the coordinate information of the first viewpoint and the second viewpoint and the monitoring time information.

[0201] The embodiments provided in this application determine the curve parametric equation of each historical line of sight based on the coordinate point information on each historical line of sight trajectory. Then, based on the curve parametric equation of each historical line of sight trajectory, the maximum speed value of each historical line of sight trajectory is determined, and a speed threshold is determined based on the maximum speed values ​​of at least three historical line of sight trajectories. Furthermore, a first viewpoint and a second viewpoint in the actual line of sight trajectory are obtained, where the first viewpoint is the user's actual viewpoint and the second viewpoint is the user's viewpoint at the moment preceding the first viewpoint. Then, based on the coordinate information of the first and second viewpoints and the monitoring time information, the actual speed at which the user slides their gaze between the first and second viewpoints is determined. This ensures that the determined speed threshold more closely matches the user's gaze sliding habits, while also ensuring the accuracy of determining the actual speed of the user's gaze sliding. This, in turn, ensures accurate control of switching the application icons displayed in the first area based on the comparison between the user's actual gaze speed and the speed threshold.

[0202] In this embodiment of the application, the processing unit 1006 is further configured to: obtain user operation information on the target application folder and each application icon in the target application folder during the target time period; determine the initial probability of the user clicking each application icon based on the operation information to obtain an initial probability matrix; determine the conditional probability of the user clicking each application icon based on the operation information to obtain a transition probability matrix; determine the target convergence probability of the user clicking each application icon based on the initial probability matrix and the transition probability matrix; and determine the first target order based on the target convergence probability.

[0203] The embodiments provided in this application acquire user operation information on a target application folder and each application icon within that folder during a target time period. Based on this operation information, an initial probability matrix is ​​obtained, representing the initial probability of the user clicking each application icon. A transition probability matrix is ​​also obtained, representing the conditional probability of the user clicking each application icon. Furthermore, based on the initial and transition probability matrices, a target convergence probability is determined for each application icon clicked, and a first target order is determined based on this target convergence probability. Thus, by determining the update order of the application icons displayed in the first region—the aforementioned first target order—based on a Markov chain, the accuracy of the first target order determination is ensured, thereby guaranteeing the accuracy of the update control of the application icons displayed in the first region.

[0204] In this embodiment of the application, the processing unit 1006 is further configured to: acquire the user's pupil position information and corneal reflection point information; determine the user's actual viewpoint coordinates based on the pupil position information and corneal reflection point information; and determine the application folder whose coordinate range includes the actual viewpoint coordinates as the target application folder.

[0205] The embodiments provided in this application acquire the user's pupil position information and corneal reflective point information, and determine the user's actual viewpoint coordinates based on these information. Then, the application folder whose coordinates include the actual viewpoint coordinates is identified as the target application folder for the user's operation. In this way, by determining the user's actual viewpoint based on their pupil position information and corneal reflective point information, and then determining the target application folder based on that viewpoint, the accuracy of the target application folder determination is ensured, thereby guaranteeing the precision of subsequent operations on that target application folder.

[0206] The application interface display device 1000 in this embodiment can be an electronic device or a component within an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices besides a terminal. For example, the electronic device can be a mobile phone, tablet computer, laptop computer, PDA, in-vehicle electronic device, mobile internet device (MID), augmented reality (AR) / virtual reality (VR) device, robot, wearable device, ultra-mobile personal computer (UMPC), netbook, or personal digital assistant (PDA), etc. It can also be a server, network attached storage (NAS), personal computer (PC), television (TV), ATM, or self-service machine, etc. This embodiment does not specifically limit the functionality of the electronic device.

[0207] The application interface display device 1000 in this embodiment can be a device with an operating system. This operating system can be Android, iOS, or other possible operating systems; this embodiment does not specifically limit the specific operating system.

[0208] The application interface display device 1000 provided in the second aspect embodiment of this application can realize... Figure 1 The various processes implemented in the method implementation examples will not be described again here to avoid repetition.

[0209] Optionally, such as Figure 11 As shown, this application embodiment also provides an electronic device 1100, including a processor 1102 and a memory 1104. The memory 1104 stores a program or instructions that can run on the processor 1102. When the program or instructions are executed by the processor 1102, they implement the various steps of the application interface display method embodiment of the first aspect described above and can achieve the same technical effect. To avoid repetition, they will not be described again here.

[0210] It should be noted that the electronic devices in the embodiments of this application include the aforementioned mobile electronic devices and non-mobile electronic devices.

[0211] Figure 12 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of this application.

[0212] The electronic device 1200 includes, but is not limited to, components such as: radio frequency unit 1201, network module 1202, audio output unit 1203, input unit 1204, sensor 1205, display unit 1206, user input unit 1207, interface unit 1208, memory 1209, and processor 1210.

[0213] Those skilled in the art will understand that the electronic device 1200 may also include a power supply (such as a battery) for supplying power to various components. The power supply may be logically connected to the processor 1210 through a power management system, thereby enabling functions such as managing charging, discharging, and power consumption through the power management system. Figure 12 The electronic device structure shown does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.

[0214] The electronic device 1200 of this application embodiment can be used to implement the various steps of the application interface display method embodiment of the first aspect described above.

[0215] The user input unit 1207 is used to receive the user's first input.

[0216] Display unit 1206 is configured to display the first application icon in the target application folder in response to the first input.

[0217] The user input unit 1207 is also used to receive a second input from the user to the first area.

[0218] The display unit 1206 is also used to respond to the second input by displaying the first application interface corresponding to the first application icon.

[0219] In this embodiment, the electronic device receives and responds to a user's first input, displaying a first application icon from the target application folder within a first area of ​​the target application folder. Then, the electronic device receives and responds to a user's second input to the first area, displaying a first application interface corresponding to the first application icon. That is, in this embodiment, when the electronic device receives the user's target input (the first input), it displays the first application icon from the target application folder within the first area of ​​the target application folder. Based on this, the electronic device then directly launches the first application corresponding to the first application icon based on the user's second input to the first area, i.e., displays the first application interface. In this way, the user does not need to open the target application folder. After the user triggers the electronic device to display the first application icon in the first area of ​​the target application folder through input, the user can directly launch the application corresponding to the application icon displayed in the first area by inputting into the first area of ​​the target application folder, reducing the user's operation path for launching applications.

[0220] Optionally, after displaying the first application icon in the first area, the processor 1210 is further configured to: acquire at least three historical gaze trajectories of the user in the first coordinate system, and determine the speed threshold of the user's gaze sliding based on the historical gaze trajectories; monitor the user's viewpoint according to the target time interval, obtain the user's actual gaze trajectory in the first coordinate system, and determine the actual speed of the user's gaze sliding based on the actual gaze trajectory; the display unit 1206 is further configured to: when the actual speed is greater than the speed threshold, switch the first application icon in the first area to the second application icon according to the first target order; wherein, the first coordinate system is the system coordinate system of the electronic device, the target application folder includes at least two application icons, the first target order is the probability order of the user clicking at least two application icons, the first application icon is the application icon that is first when the at least two application icons are sorted according to the first target order, and the second application icon is the application icon that is next in order in the first target order.

[0221] In the embodiments provided in this application, after displaying the first application icon in the first area, the electronic device determines the speed threshold of the user's gaze swiping based on at least three historical gaze trajectories in the user's system coordinate system, and determines the actual speed of the user's gaze swiping based on the user's actual gaze trajectory. Based on this, if the determined actual speed is greater than the speed threshold, the first application icon in the first area is switched to the second application icon according to the first target order. In this way, on the one hand, when the electronic device receives the user's first input regarding the target application folder, the application icon with the highest historical click probability (i.e., the first application icon) is highlighted in the target application folder, making the display method of each application icon in the target application folder more consistent with the user's historical operation habits of the target application folder. On the other hand, without manual operation by the user, the electronic device automatically updates the application icons displayed in the first area according to the aforementioned first target order when the actual speed of the user's gaze is greater than the speed threshold, reducing the operation path for the user to launch the application corresponding to the application icon, thereby facilitating the user to quickly launch the corresponding application icon.

[0222] Optionally, the processor 1210 is specifically used to: obtain a set of historical coordinate points of the user clicking on the target application folder in the first coordinate system, and determine an initial polygon based on the set of historical coordinate points; perform equidistant shrinkage processing on the initial polygon to obtain a target triangle, and the shrinkage distance of the initial polygon is the target distance; determine a target circle based on the incircle of the target triangle and the target distance; and determine the target circumscribed rectangle parallel to the target application folder as the first region.

[0223] The embodiments provided in this application obtain a set of historical coordinate points of user clicks on a target application folder in a first coordinate system, determine an initial polygon based on the historical coordinate point set, perform equidistant indentation processing on the initial polygon to obtain a target triangle, and the indentation distance of the initial polygon is the target distance; determine a target circle based on the incircle of the target triangle and the target distance; and determine the target circumscribed rectangle parallel to the target application folder as the first region. In this way, on the one hand, dividing the target application folder into regions based on the user's historical click habits ensures that the resulting first region better matches the user's operating habits; on the other hand, the accuracy of the region division of the target application folder is ensured by a series of processing steps on the initial polygon formed by the user's historical coordinate point set of clicks on the target application folder.

[0224] Optionally, the processor 1210 is specifically used to: determine a first target coordinate point in the historical coordinate point set based on the coordinate information of each coordinate point in the historical coordinate point set; establish a second coordinate system with the first target coordinate point as the origin, update the coordinate position information of each coordinate point in the historical coordinate point set according to the second coordinate system to obtain a target coordinate point set, wherein the second coordinate system is the folder coordinate system of the target application folder; determine a second target order of each coordinate point in the target coordinate point set based on the distance information between each coordinate point in the target coordinate point set other than the first target coordinate point and the first target coordinate point, as well as the angle information between the line connecting each coordinate point and the first target coordinate point and one half axis of the horizontal coordinate axis of the second coordinate system; and connect each coordinate point in the target coordinate point set according to the second target order to obtain an initial polygon.

[0225] In the embodiments provided in this application, during the process of determining the initial polygon based on the historical coordinate point set, a first target coordinate point in the historical coordinate point set is determined based on the coordinate information of each coordinate point in the historical coordinate point set. Then, a folder coordinate system for the target application folder, i.e., the aforementioned second coordinate system, is established with the first target coordinate point as the origin. The coordinate position information of each coordinate point in the historical coordinate point set is updated according to the second coordinate system to obtain the target coordinate point set. Based on this, a second target order is determined for each coordinate point in the target coordinate point set, based on the distance information between each coordinate point in the target coordinate point set (excluding the first target coordinate point) and the first target coordinate point, as well as the angle information between the line connecting each coordinate point to the first target coordinate point and one half-axis of the horizontal coordinate axis of the second coordinate system. The coordinate points in the target coordinate point set are then connected according to the second target order to obtain the initial polygon. This ensures the rationality of the initial polygon determination, thereby guaranteeing the accuracy of subsequent region division of the target application folder based on this initial polygon.

[0226] Optionally, a vertex of the initial polygon corresponds to a coordinate point in the target coordinate point set. The processor 1210 is specifically used to: obtain a first vector and a second vector corresponding to each coordinate point in the target coordinate point set, wherein the first vector and the second vector are adjacent edge vectors of the vertex corresponding to each coordinate point; determine the sine value of the angle between the first vector and the second vector of each coordinate point; if the sine value corresponding to the second target coordinate point is zero, delete the vertex corresponding to the second target coordinate point; if the sine value corresponding to the second target coordinate point is not zero, update the position of the vertex corresponding to the second target coordinate point according to the sine value, the first vector, and the second vector, until the number of vertices of the initial polygon is three, wherein the second target coordinate point is any coordinate point in the target coordinate point set.

[0227] In the embodiments provided in this application, one vertex of the initial polygon corresponds to one coordinate point in the target coordinate point set. Based on this, during the equidistant shrinking process of the initial polygon, the adjacent edge vectors (i.e., the first vector and the second vector) of the vertex corresponding to each coordinate point in the target coordinate point set are obtained, and the sine value of the angle between the first vector and the second vector for each coordinate point is determined. Furthermore, if the sine value corresponding to any coordinate point in the target coordinate point set (i.e., the second target coordinate point) is zero, the vertex corresponding to that second target coordinate point is deleted. If the sine value corresponding to the second target coordinate point is not zero, the position of the vertex corresponding to the second target coordinate point is updated according to the sine value, the first vector, and the second vector, until the number of vertices of the initial polygon is three. In this way, by iteratively shrinking the initial polygon into a target triangle, the accuracy and rationality of the target triangle determination are ensured, thereby guaranteeing the accuracy of subsequent region division of the target application folder based on this target triangle.

[0228] Optionally, the processor 1210 is specifically configured to: determine the curve parametric equation of each historical line-of-sight trajectory based on the coordinate point information on each historical line-of-sight trajectory; determine the maximum speed of each historical line-of-sight trajectory based on the curve parametric equation of each historical line-of-sight trajectory, and determine a speed threshold based on the maximum speed of at least three historical line-of-sight trajectories; acquire a first viewpoint and a second viewpoint in the actual line-of-sight trajectory, wherein the first viewpoint is the user's actual viewpoint, and the second viewpoint is the user's viewpoint at the moment before the first viewpoint; and determine the actual speed at which the user slides their line of sight between the first viewpoint and the second viewpoint based on the coordinate information of the first viewpoint and the second viewpoint and the monitoring time information.

[0229] The embodiments provided in this application determine the curve parametric equation of each historical line of sight based on the coordinate point information on each historical line of sight trajectory. Then, based on the curve parametric equation of each historical line of sight trajectory, the maximum speed value of each historical line of sight trajectory is determined, and a speed threshold is determined based on the maximum speed values ​​of at least three historical line of sight trajectories. Furthermore, a first viewpoint and a second viewpoint in the actual line of sight trajectory are obtained, where the first viewpoint is the user's actual viewpoint and the second viewpoint is the user's viewpoint at the moment preceding the first viewpoint. Then, based on the coordinate information of the first and second viewpoints and the monitoring time information, the actual speed at which the user slides their gaze between the first and second viewpoints is determined. This ensures that the determined speed threshold more closely matches the user's gaze sliding habits, while also ensuring the accuracy of determining the actual speed of the user's gaze sliding. This, in turn, ensures accurate control of switching the application icons displayed in the first area based on the comparison between the user's actual gaze speed and the speed threshold.

[0230] Optionally, the processor 1210 is further configured to: acquire user operation information on the target application folder and each application icon in the target application folder during the target time period; determine the initial probability of the user clicking each application icon based on the operation information, and obtain an initial probability matrix; determine the conditional probability of the user clicking each application icon based on the operation information, and obtain a transition probability matrix; determine the target convergence probability of the user clicking each application icon based on the initial probability matrix and the transition probability matrix, and determine the first target order based on the target convergence probability.

[0231] The embodiments provided in this application acquire user operation information on a target application folder and each application icon within that folder during a target time period. Based on this operation information, an initial probability matrix is ​​obtained, representing the initial probability of the user clicking each application icon. A transition probability matrix is ​​also obtained, representing the conditional probability of the user clicking each application icon. Furthermore, based on the initial and transition probability matrices, a target convergence probability is determined for each application icon clicked, and a first target order is determined based on this target convergence probability. Thus, by determining the update order of the application icons displayed in the first region—the aforementioned first target order—based on a Markov chain, the accuracy of the first target order determination is ensured, thereby guaranteeing the accuracy of the update control of the application icons displayed in the first region.

[0232] Optionally, the processor 1210 is further configured to: acquire the user's pupil position information and corneal reflective point information; determine the user's actual viewpoint coordinates based on the pupil position information and corneal reflective point information; and determine the application folder whose coordinate range includes the actual viewpoint coordinates as the target application folder.

[0233] The embodiments provided in this application acquire the user's pupil position information and corneal reflective point information, and determine the user's actual viewpoint coordinates based on these information. Then, the application folder whose coordinates include the actual viewpoint coordinates is identified as the target application folder for the user's operation. In this way, by determining the user's actual viewpoint based on their pupil position information and corneal reflective point information, and then determining the target application folder based on that viewpoint, the accuracy of the target application folder determination is ensured, thereby guaranteeing the precision of subsequent operations on that target application folder.

[0234] It should be understood that, in this embodiment, the input unit 1204 may include a graphics processing unit (GPU) 12041 and a microphone 12042. The GPU 12041 processes image data of still images or videos obtained by an image capture device (such as a camera) in video capture mode or image capture mode. The display unit 1206 may include a display panel 12061, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, or the like. The user input unit 1207 includes a touch panel 12071 and at least one of other input devices 12072. The touch panel 12071 is also called a touch screen. The touch panel 12071 may include a touch detection device and a touch controller. Other input devices 12072 may include, but are not limited to, physical keyboards, function keys (such as volume control buttons, power buttons, etc.), trackballs, mice, and joysticks, which will not be described in detail here.

[0235] The memory 1209 can be used to store software programs and various data. The memory 1209 may primarily include a first storage area for storing programs or instructions and a second storage area for storing data. The first storage area may store the operating system, application programs or instructions required for at least one function (such as sound playback, image playback, etc.). Furthermore, the memory 1209 may include volatile memory or non-volatile memory, or both. The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus RAM (DRRAM). The memory 1209 in this embodiment includes, but is not limited to, these and any other suitable types of memory.

[0236] Processor 1210 may include one or more processing units; optionally, processor 1210 integrates an application processor and a modem processor, wherein the application processor mainly handles operations involving the operating system, user interface, and applications, and the modem processor mainly handles wireless communication signals, such as a baseband processor. It is understood that the aforementioned modem processor may also not be integrated into processor 1210.

[0237] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the application interface display method embodiment described above and achieve the same technical effect. To avoid repetition, they will not be described again here.

[0238] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.

[0239] This application also provides a chip, which includes a processor and a communication interface. The communication interface and the processor are coupled. The processor is used to run programs or instructions to implement the various processes of the application interface display method embodiment described in the first aspect above, and can achieve the same technical effect. To avoid repetition, it will not be described again here. It should be understood that the chip mentioned in this application embodiment can also be called a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.

[0240] This application provides a computer program product, which is stored in a storage medium and executed by at least one processor to implement the various processes of the application interface display method embodiment of the first aspect described above, and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0241] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0242] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods of the various embodiments of this application.

[0243] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

Claims

1. An application interface display method, characterized by, include: Receive the user's first input; In response to the first input, the first application icon in the target application folder is displayed in a first area of ​​the target application folder; Receive the user's second input to the first area; In response to the second input, the first application interface corresponding to the first application icon is displayed; The target application folder includes at least two application icons. After displaying the first application icon in the first area of ​​the target application folder, the application interface display method further includes: Obtain at least three historical gaze trajectories of the user in the first coordinate system, and determine the speed threshold of the user's gaze sliding based on the historical gaze trajectories; The user's viewpoint is monitored according to the target time interval to obtain the user's actual line-of-sight trajectory in the first coordinate system, and the actual speed of the user's line-of-sight sliding is determined based on the actual line-of-sight trajectory. If the actual speed is greater than the speed threshold, the first application icon in the first area is switched to the second application icon according to the first target sequence; Wherein, the first coordinate system is the system coordinate system of the electronic device, the first target order is the probability order of the user clicking the at least two application icons, the first application icon is the application icon that is first when the at least two application icons are sorted according to the first target order, and the second application icon is the application icon that is next in order in the first target order.

2. The application interface display method according to claim 1, wherein The application interface display method further includes: Obtain the historical coordinate point set of the user clicking the target application folder in the first coordinate system, and determine the initial polygon based on the historical coordinate point set; The initial polygon is equidistantly shrunk to obtain the target triangle, where the shrunk distance of the initial polygon is the target distance. The target circle is determined based on the inscribed circle of the target triangle and the target distance; The first region is defined as the target circumscribed rectangle that is parallel to the target application folder.

3. The application interface display method according to claim 2, wherein, Determining the initial polygon based on the historical coordinate point set includes: Based on the coordinate information of each coordinate point in the historical coordinate point set, determine the first target coordinate point in the historical coordinate point set; A second coordinate system is established with the first target coordinate point as the origin. The coordinate position information of each coordinate point in the historical coordinate point set is updated according to the second coordinate system to obtain the target coordinate point set. The second coordinate system is the folder coordinate system of the target application folder. Based on the distance information between each coordinate point in the target coordinate point set (excluding the first target coordinate point) and the first target coordinate point, and the angle information between the line connecting each coordinate point and the first target coordinate point and one half axis of the horizontal axis of the second coordinate system, the second target order of each coordinate point in the target coordinate point set is determined. Connect the coordinate points in the target coordinate point set according to the second target sequence to obtain the initial polygon.

4. The application interface display method according to claim 3, characterized in that, One vertex of the initial polygon corresponds to a coordinate point in the target coordinate point set, and the equidistant shrinking process of the initial polygon includes: Obtain the first vector and the second vector corresponding to each coordinate point in the target coordinate point set, wherein the first vector and the second vector are the neighboring edge vectors of the vertex corresponding to each coordinate point; Determine the sine of the angle between the first and second vectors at each coordinate point; If the sine value corresponding to the second target coordinate point is zero, delete the vertex corresponding to the second target coordinate point. If the sine value corresponding to the second target coordinate point is not zero, update the position of the vertex corresponding to the second target coordinate point according to the sine value corresponding to the second target coordinate point, the first vector, and the second vector, until the number of vertices of the initial polygon is three, wherein the second target coordinate point is any coordinate point in the set of target coordinate points.

5. The application interface display method according to claim 1, characterized in that, Determining the speed threshold of the user's gaze swipe based on the historical gaze trajectory includes: Based on the coordinate point information on each historical line of sight trajectory, determine the curve parametric equation for each historical line of sight trajectory; Based on the curve parameter equation of each historical line of sight, determine the maximum speed of each historical line of sight, and determine the user's line of sight sliding speed threshold based on the maximum speed of the at least three historical line of sight. Determining the actual speed of the user's eye movement based on the actual eye trajectory includes: Obtain the first viewpoint and the second viewpoint in the actual line-of-sight trajectory, wherein the first viewpoint is the user's actual viewpoint, and the second viewpoint is the user's viewpoint at the moment before the first viewpoint; Based on the coordinate information of the first viewpoint and the second viewpoint and the monitoring time information, the actual speed at which the user slides their line of sight between the first viewpoint and the second viewpoint is determined.

6. The application interface display method according to any one of claims 1 to 5, characterized in that, The application interface display method further includes: Obtain user operation information on the target application folder and each application icon in the target application folder within the target time period; Based on the operation information, the initial probability of the user clicking each application icon is determined, and an initial probability matrix is ​​obtained; Based on the operation information, the conditional probability of the user clicking each application icon is determined, and the transition probability matrix is ​​obtained; The target convergence probability of a user clicking each application icon is determined based on the initial probability matrix and the transition probability matrix, and the first target order is determined based on the target convergence probability.

7. An application interface display device, characterized in that, include: The receiving unit is used to receive the user's first input; The display unit is configured to, in response to the first input, display the first application icon in the target application folder within a first area of ​​the target application folder; The receiving unit is also configured to receive a second input from the user to the first area; The display unit is further configured to respond to the second input by displaying the first application interface corresponding to the first application icon; The target application folder includes at least two application icons, and the application interface display device further includes: The processing unit is used to acquire at least three historical line-of-sight trajectories of the user in the first coordinate system, and to determine the speed threshold of the user's line-of-sight sliding based on the historical line-of-sight trajectories. The processing unit is further configured to monitor the user's viewpoint according to the target time interval, obtain the user's actual line-of-sight trajectory in the first coordinate system, and determine the actual speed of the user's line-of-sight sliding based on the actual line-of-sight trajectory. The display unit is also used for: If the actual speed is greater than the speed threshold, the first application icon in the first area is switched to the second application icon according to the first target sequence; Wherein, the first coordinate system is the system coordinate system of the electronic device, the first target order is the probability order of the user clicking the at least two application icons, the first application icon is the application icon that is first when the at least two application icons are sorted according to the first target order, and the second application icon is the application icon that is next in order in the first target order.

8. The application interface display device according to claim 7, characterized in that, The processing unit is also used for: Obtain the historical coordinate point set of the user clicking the target application folder in the first coordinate system, and determine the initial polygon based on the historical coordinate point set; The initial polygon is equidistantly shrunk to obtain the target triangle, where the shrunk distance of the initial polygon is the target distance. The target circle is determined based on the inscribed circle of the target triangle and the target distance; The first region is defined as the target circumscribed rectangle that is parallel to the target application folder.

9. The application interface display device according to claim 8, characterized in that, The processing unit is specifically used for: Based on the coordinate information of each coordinate point in the historical coordinate point set, determine the first target coordinate point in the historical coordinate point set; A second coordinate system is established with the first target coordinate point as the origin. The coordinate position information of each coordinate point in the historical coordinate point set is updated according to the second coordinate system to obtain the target coordinate point set. The second coordinate system is the folder coordinate system of the target application folder. Based on the distance information between each coordinate point in the target coordinate point set (excluding the first target coordinate point) and the first target coordinate point, and the angle information between the line connecting each coordinate point and the first target coordinate point and one half axis of the horizontal axis of the second coordinate system, the second target order of each coordinate point in the target coordinate point set is determined. Connect the coordinate points in the target coordinate point set according to the second target sequence to obtain the initial polygon.

10. The application interface display device according to claim 9, characterized in that, One vertex of the initial polygon corresponds to a coordinate point in the target coordinate point set, and the processing unit is specifically used for: Obtain the first vector and the second vector corresponding to each coordinate point in the target coordinate point set, wherein the first vector and the second vector are the neighboring edge vectors of the vertex corresponding to each coordinate point; Determine the sine of the angle between the first and second vectors at each coordinate point; If the sine value corresponding to the second target coordinate point is zero, delete the vertex corresponding to the second target coordinate point. If the sine value corresponding to the second target coordinate point is not zero, update the position of the vertex corresponding to the second target coordinate point according to the sine value corresponding to the second target coordinate point, the first vector, and the second vector, until the number of vertices of the initial polygon is three, wherein the second target coordinate point is any coordinate point in the set of target coordinate points.

11. The application interface display device according to claim 7, characterized in that, The processing unit is specifically used for: Based on the coordinate point information on each historical line of sight trajectory, determine the curve parametric equation for each historical line of sight trajectory; Based on the curve parameter equation of each historical line of sight, determine the maximum speed of each historical line of sight, and determine the user's line of sight sliding speed threshold based on the maximum speed of the at least three historical line of sight. Obtain the first viewpoint and the second viewpoint in the actual line-of-sight trajectory, wherein the first viewpoint is the user's actual viewpoint, and the second viewpoint is the user's viewpoint at the moment before the first viewpoint; Based on the coordinate information of the first viewpoint and the second viewpoint and the monitoring time information, the actual speed at which the user slides their line of sight between the first viewpoint and the second viewpoint is determined.

12. The application interface display device according to any one of claims 7 to 11, characterized in that, The processing unit is also used for: Obtain user operation information on the target application folder and each application icon in the target application folder within the target time period; Based on the operation information, the initial probability of the user clicking each application icon is determined, and an initial probability matrix is ​​obtained; Based on the operation information, the conditional probability of the user clicking each application icon is determined, and the transition probability matrix is ​​obtained; The target convergence probability of a user clicking each application icon is determined based on the initial probability matrix and the transition probability matrix, and the first target order is determined based on the target convergence probability.

13. An electronic device, characterized in that, It includes a processor and a memory, the memory storing a program or instructions that can run on the processor, the program or instructions being executed by the processor to implement the steps of the application interface display method as described in any one of claims 1 to 6.

14. A readable storage medium, characterized in that, The readable storage medium stores a program or instructions that, when executed by a processor, implement the steps of the application interface display method as described in any one of claims 1 to 6.

Citation Information

Patent Citations

  • Application display method and device

    CN111666010A