How to navigate the user interface
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- APPLE INC
- Filing Date
- 2026-01-20
- Publication Date
- 2026-06-16
Smart Images

Figure 2026097794000001_ABST
Abstract
Claims
1. It is a method, In an electronic device that communicates with one or more input devices, including a display generation component and an eye-tracking device, The first user interface, including individual user interface elements associated with the second user interface, is displayed via the aforementioned display generation component. While the first user interface is displayed, the eye-tracking device detects that the user's gaze is directed towards the individual user interface elements, In response to detecting input including the user's gaze directed towards the individual user interface elements, Navigating to the second user interface based on the determination that the user's gaze has been directed towards the individual user interface element for a longer period than a time threshold, A method comprising: navigating to a second user interface without waiting for the user's gaze to remain directed toward the individual user interface element for a longer period than the time threshold, based on the determination that a selection input has been detected via one or more input devices when the user's gaze has been directed toward the individual user interface element for a period shorter than the time threshold.
2. The method according to claim 1, wherein the selection input includes individual gestures performed by the user's hand, which are detected by a hand-tracking device communicating with the electronic device.
3. The method according to claim 1 or 2, wherein the individual user interface elements are displayed at a first size, and navigating to the second user interface includes displaying the second user interface at a second size that is larger than the first size.
4. The method according to any one of claims 1 to 3, wherein, before detecting the input including the gaze of the user directed toward the individual user interface element, the individual user interface element is displayed on the background with a visual characteristic having a first value, and navigating to the second user interface includes displaying the second user interface on the background with a visual characteristic having a second value different from the first value.
5. The method according to any one of claims 1 to 4, wherein navigating to the second user interface includes displaying the second user interface with lighting effects that affect one or more other representations displayed via the display generation component.
6. While the user's gaze is directed towards the individual user interface element, and before the user's gaze is directed towards the individual user interface element for a longer period than the time threshold, and before navigating to the second user interface, the eye-tracking device detects that the user's gaze is no longer directed towards the individual user interface element. In response to detecting that the user's gaze is no longer directed towards the individual user interface element, the navigation to the second user interface is discontinued. The method according to any one of claims 1 to 5, further comprising:
7. While the user's gaze is directed towards the individual user interface element, and before the user's gaze is directed towards the individual user interface element for a longer period than the time threshold, and before navigating to the second user interface, the display generation component displays a visual indication that the continuous gaze directed towards the individual user interface element triggers navigation to the second user interface. The method according to any one of claims 1 to 6, further comprising:
8. The method according to claim 7, wherein the visual display includes animation of the individual user interface elements that extend to the second user interface.
9. The method according to claim 7 or 8, wherein displaying the visual display includes initiating the animation of the content of the second user interface.
10. The method according to any one of claims 7 to 9, wherein the first user interface includes a background on which the individual user interface elements are displayed, and the visual display includes obscuring the display of the background.
11. The method according to any one of claims 1 to 10, wherein navigating to the second user interface includes changing the relative simulated depth between the first user interface and the second user interface.
12. Before detecting the input directed to the individual user interface elements, the first user interface is displayed with a visual characteristic having a first value. After navigating to the second user interface, the second user interface is displayed on top of the first user interface, which is displayed with the visual characteristics having a second value different from the first value. The first user interface includes a second separate user interface element associated with the third user interface, and the method is as follows: While the second user interface is displayed on the first user interface, which is displayed with the visual characteristics having the second value, input is received via one or more input devices to navigate from the second user interface to the third user interface. In response to receiving the input navigating from the second user interface to the third user interface, the display of the second user interface on the first user interface is discontinued, while maintaining the display of the first user interface with the visual characteristics having the second value, and the third user interface is displayed on the first user interface. The method according to any one of claims 1 to 11.
13. In response to detecting that the user's gaze is directed towards the individual user interface element, an animation corresponding to navigation to the second user interface is initiated. In response to detecting the input, including the user's gaze directed towards the individual user interface element, In accordance with the determination that the user's gaze continues to be directed towards the individual user interface element for a longer period than the time threshold, the navigation to the second user interface and the animation corresponding to the navigation to the second user interface are completed over the time threshold. Navigate to the second user interface without completing the animation corresponding to navigating to the second user interface over the time threshold, in accordance with the determination that the selection input is detected via one or more input devices when the user's gaze is directed towards the individual user interface element for a period shorter than the time threshold. The method according to any one of claims 1 to 12, further comprising:
14. One or more processors, Memory and An electronic device comprising one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by the one or more processors, and the one or more programs are The first user interface, including individual user interface elements associated with the second user interface, is displayed via the display generation component. While the first user interface is being displayed, the eye-tracking device detects that the user's gaze is directed towards the individual user interface elements. In response to detecting input including the user's gaze directed towards the individual user interface elements, In accordance with the determination that the user's gaze has been directed towards the individual user interface element for a longer period than a time threshold, the user is navigated to the second user interface. An electronic device including a command to navigate to a second user interface without waiting for the user's gaze to remain directed at the individual user interface element for a longer period than the time threshold, based on the determination that a selection input has been detected via one or more input devices when the user's gaze is directed at the individual user interface element for a period shorter than the time threshold.
15. A non-temporary computer-readable storage medium for storing one or more programs, wherein the one or more programs include instructions, and when the instructions are executed by one or more processors of an electronic device, the electronic device... The first user interface, including individual user interface elements associated with the second user interface, is displayed via the display generation component. While the first user interface is displayed, the eye-tracking device detects that the user's gaze is directed towards the individual user interface elements. In response to detecting input, including the user's gaze directed towards the individual user interface elements: In accordance with the determination that the user's gaze has been directed towards the individual user interface element for a longer period than a time threshold, the user is navigated to the second user interface. A non-temporary computer-readable storage medium that, upon determination that a selection input is detected via one or more input devices when the user's gaze is directed towards the individual user interface element for a period shorter than the time threshold, causes the user to navigate to the second user interface without waiting for the gaze to remain directed towards the individual user interface element for a period longer than the time threshold.
16. One or more processors, Memory and Means for displaying a first user interface, including individual user interface elements associated with a second user interface, via the display generation component, Means for detecting, via the eye-tracking device, that the user's gaze is directed towards the individual user interface elements while the first user interface is being displayed, In response to detecting input including the user's gaze directed towards the individual user interface elements, A means for navigating to the second user interface, based on the determination that the user's gaze has been directed towards the individual user interface element for a longer period than a time threshold, Means for navigating to the second user interface without waiting for the user's gaze to remain directed at the individual user interface element for a longer period than the time threshold, based on the determination that a selection input has been detected via one or more input devices when the user's gaze is directed at the individual user interface element for a period shorter than the time threshold, Electronic devices, including those mentioned above.
17. An information processing device for use in an electronic device, wherein the information processing device is Means for displaying a first user interface, including individual user interface elements associated with a second user interface, via the display generation component, Means for detecting, via the eye-tracking device, that the user's gaze is directed towards the individual user interface elements while the first user interface is being displayed, In response to detecting input including the user's gaze directed towards the individual user interface elements, A means for navigating to the second user interface, based on the determination that the user's gaze has been directed towards the individual user interface element for a longer period than a time threshold, An information processing apparatus comprising: means for navigating to a second user interface without waiting for the user's gaze to remain directed toward the individual user interface element for a longer period than the time threshold, based on a determination that a selection input has been detected via one or more input devices when the user's gaze has been directed toward the individual user interface element for a period shorter than the time threshold.
18. One or more processors, Memory and A device comprising one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs include instructions that execute any one of the methods according to any one of claims 1 to 13. Electronic devices.
19. A non-temporary computer-readable storage medium for storing one or more programs, wherein the one or more programs include instructions, and when the instructions are executed by one or more processors of an electronic device, the electronic device is caused to perform the method according to any one of claims 1 to 13.
20. One or more processors, Memory and Means for carrying out the method described in any one of claims 1 to 13, An electronic device equipped with the following features.
21. An information processing device for use in an electronic device, wherein the information processing device is An information processing apparatus comprising means for performing the method described in any one of claims 1 to 13.
22. It is a method, In an electronic device that communicates with a display generation component and an eye-tracking device, The user interface is provided via the display generation component, A first control element, which is displayed in a first appearance and is selectable for performing a first operation, Displaying a user interface that includes individual user interface elements, which include individual parts of individual user interface elements that are displayed with individual visual characteristics having a first value, While the user interface is displayed, the eye-tracking device detects that the user's gaze is directed towards the first control element, In response to detecting that the user's gaze is directed towards the first control element, The first control element is updated to have a second appearance different from the first appearance, such that an individual part of the first control element having the second appearance is displayed overlaid on a part of the individual part of the individual user interface element. A method comprising displaying the individual portion of the individual user interface element with the individual visual characteristics having a second value different from the first value.
23. The aforementioned individual user interface element includes a second individual part, Before detecting that the user's gaze is directed toward the first control element, the second individual part is displayed with the individual visual characteristics having the first value, In response to the detection that the user's gaze is directed towards the first control element, the second individual portion of the individual user interface element continues to be displayed with the individual visual characteristics having the first value. The method according to claim 22.
24. Each individual user interface element includes a third individual part between the individual part and the second individual part. Before detecting that the user's gaze is directed toward the first control element, the third individual part is displayed with the individual visual characteristics having the first value. The method according to claim 23, wherein, in response to detection that the user's gaze is directed toward the first control element, the third individual portion of the individual user interface element is displayed with the individual visual characteristic having a third value between the first value and the second value.
25. The method according to any one of claims 22 to 24, wherein updating the first control element to have the second appearance includes displaying a text description associated with the first control element, the text description associated with the first control element not being displayed before detecting that the user's gaze was directed towards the first control element.
26. The method according to any one of claims 22 to 25, wherein when the gaze of the user directed toward the first control element is detected, the first control element and the individual user interface elements are displayed on a third user interface displayed with the individual visual characteristics having the second value.
27. The display generation component enables the display of a second user interface, which includes a first individual control element and a second individual control element, wherein a portion of the second user interface is displayed with the individual visual characteristics having the first value. While the second user interface is displayed, the eye-tracking device detects that the user's gaze is directed towards the first individual control element, In response to detecting that the user's gaze is directed towards the first individual control element, the first individual control element is visually highlighted relative to the second individual control element. While the user's gaze is directed towards the first individual control element, and while the first individual control element is visually highlighted relative to the second individual control element, individual gestures performed by the user's hand are detected via a hand tracking device communicating with the electronic device. In response to detecting the individual gestures performed by the user's hands, In accordance with the determination that the individual gesture corresponds to a request to display one or more selectable options associated with the first individual control element, the display generation component displays the one or more selectable options associated with the first individual control element overlaid on the portion of the second user interface displayed with the individual visual characteristics having the second value, The method according to any one of claims 22 to 26, further comprising:
28. The first control element is one of a plurality of control elements that can be selected to display different user interfaces of the application. The individual user interfaces are the user interfaces of the application. The method according to any one of claims 22 to 27.
29. Before detecting that the user's gaze is directed toward the first control element, the first control element is displayed at a first depth in the three-dimensional environment relative to the individual user interface. In response to the detection that the user's gaze is directed toward the first control element, the first control element is displayed to the individual user interface at a second depth different from the first depth of the three-dimensional environment. The method according to any one of claims 22 to 28.
30. While the user's gaze is directed towards the first control element, a first portion of the selection input is detected via a hand tracking device communicating with the electronic device. After detecting the first portion of the selection input, the second portion of the selection input is detected via the hand tracking device. In response to detecting the second portion of the selection input: When the second portion of the selection input is detected, the determination that the user's gaze is no longer directed towards the first control element is made to initiate an operation associated with the first control element, The method according to any one of claims 22 to 29, further comprising:
31. The individual user interface element includes a first selectable object and a second individual part, the second individual part being displayed with the individual visual characteristics having the first value, and the method is While the individual user interface elements including the first selectable object are being displayed, the selection of the first selectable object is detected. In response to detecting the selection of the first selectable object: The method according to any one of claims 22 to 30, further comprising displaying a representation of the first selectable object overlaid on a second individual portion of the individual user interface element that is displayed in the individual visual characteristics having a second value different from the first value.
32. The individual user interface element includes a third individual part that surrounds the second individual part. In response to the detection of the selection of the first selectable object, the second individual portion of the individual user interface element is displayed with the individual visual characteristic having the second value, and the third individual portion of the individual user interface element is displayed with the individual visual characteristic having a third value between the first value and the second value. The method according to claim 31.
33. The individual user interface element includes a first set of representations corresponding to a set of categories and a second set of representations corresponding to subcategories of the set of categories, and the method is While the aforementioned individual user interface elements are being displayed, scroll input is received via one or more input devices. In response to receiving the aforementioned scroll input, In accordance with the determination that the scroll input is directed to the first plurality of representations, the first plurality of representations are scrolled at a first speed according to the scroll input, and the second plurality of representations are scrolled at a second speed. The method according to any one of claims 22 to 32, further comprising: determining that the scroll input is directed to the second plurality of representations, and scrolling the second plurality of representations at a third speed different from the second speed according to the scroll input.
34. The individual user interface elements include a first set of representations corresponding to multiple categories, The second set of multiple expressions corresponds to subcategories of the aforementioned multiple categories, The second plurality of representations are overlaid on the first plurality of representations. The method according to any one of claims 22 to 33.
35. One or more processors, Memory and An electronic device comprising one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by the one or more processors, and the one or more programs are The user interface is provided via the display generation component, A first control element, which is displayed in a first appearance and is selectable for performing a first operation, A user interface is displayed, which includes individual user interface elements, which include individual parts of individual user interface elements that are displayed with individual visual characteristics having a first value, While the user interface is displayed, the eye-tracking device detects that the user's gaze is directed towards the first control element. In response to detecting that the user's gaze is directed towards the first control element, The first control element is updated to have a second appearance different from the first appearance, such that an individual part of the first control element having the second appearance is displayed overlaid on a part of the individual part of the individual user interface element. An electronic device including instructions for displaying the individual portion of the individual user interface element with the individual visual characteristics having a second value different from the first value.
36. A non-temporary computer-readable storage medium for storing one or more programs, wherein the one or more programs include instructions, and when the instructions are executed by one or more processors of an electronic device, the electronic device... The user interface is provided via the display generation component, A first control element, which is displayed in a first appearance and is selectable for performing a first operation, A user interface is displayed that includes individual user interface elements, which include individual parts of individual user interface elements that are displayed with individual visual characteristics having a first value, While the user interface is displayed, the eye-tracking device detects that the user's gaze is directed towards the first control element. In response to detecting that the user's gaze is directed towards the first control element, The first control element is updated to have a second appearance different from the first appearance, such that an individual part of the first control element having the second appearance is displayed overlaid on a part of the individual user interface element. A non-temporary computer-readable storage medium that displays the individual parts of the individual user interface elements with the individual visual characteristics having a second value different from the first value.
37. One or more processors, Memory and The user interface is provided via the display generation component, A first control element, which is displayed in a first appearance and is selectable for performing a first operation, A means for displaying a user interface, including an individual user interface element which includes an individual part of an individual user interface element which is displayed with an individual visual characteristic having a first value, Means for detecting, via the eye-tracking device, that the user's gaze is directed towards the first control element while the user interface is being displayed, In response to detecting that the user's gaze is directed towards the first control element, Means for updating the first control element to have a second appearance different from the first appearance, such that an individual part of the first control element having the second appearance is displayed overlaid on a part of the individual part of the individual user interface element, Means for displaying the individual portion of the individual user interface element with the individual visual characteristics having a second value different from the first value, Electronic devices, including those mentioned above.
38. An information processing device for use in an electronic device, wherein the information processing device is The user interface is provided via the display generation component, A first control element, which is displayed in a first appearance and is selectable for performing a first operation, A means for displaying a user interface, including an individual user interface element which includes an individual part of an individual user interface element which is displayed with an individual visual characteristic having a first value, Means for detecting, via the eye-tracking device, that the user's gaze is directed towards the first control element while the user interface is being displayed, In response to detecting that the user's gaze is directed towards the first control element, Means for updating the first control element to have a second appearance different from the first appearance, such that an individual part of the first control element having the second appearance is displayed overlaid on a part of the individual part of the individual user interface element, An information processing apparatus comprising means for displaying the individual portion of the individual user interface element with the individual visual characteristics having a second value different from the first value.
39. One or more processors, Memory and A device comprising one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by the one or more processors, and the one or more programs include instructions that execute any one of the methods according to any one of claims 22 to 34. Electronic devices.
40. A non-temporary computer-readable storage medium for storing one or more programs, wherein the one or more programs include instructions, and when the instructions are executed by one or more processors of an electronic device, the electronic device is caused to perform the method according to any one of claims 22 to 34.
41. One or more processors, Memory and Means for carrying out the method described in any one of claims 22 to 34, An electronic device equipped with the following features.
42. An information processing device for use in an electronic device, wherein the information processing device is An information processing apparatus comprising means for performing the method described in any one of claims 22 to 34.
43. It is a method, In an electronic device that communicates with one or more input devices, including a display generation component and an eye-tracking device, The user interface is provided via the display generation component, The first expression of the first category among multiple categories, Displaying a user interface that includes a first individual representation of a first subcategory among a first plurality of subcategories of the first category described above, While the user interface is displayed, scroll input is detected via one or more input devices. In response to receiving the aforementioned scroll input, When the aforementioned scroll input is detected, according to the determination that the user's gaze is directed to the first representation of the first category, Navigating to the second representation of the second category among the aforementioned multiple categories, Displaying the first individual representation of the first subcategory among the second plurality of subcategories of the second category in the user interface, When the scroll input is detected, according to the determination that the user's gaze is directed to the first individual representation of the first subcategory, A method further comprising navigating to a second individual representation of a second subcategory among the first plurality of subcategories, without navigating to the second representation of the second category.
44. While the first representation of the first category and the first individual representation of the first subcategory are displayed, the first representation of the first category is displayed with respect to the first individual representation of the first subcategory at a first depth, and an input is detected via one or more input devices to select the first individual representation of the first subcategory. In response to detecting the input that selects the first individual representation of the first subcategory, the display generation component displays the first individual representation of the first subcategory, which is associated with the first individual representation of the first category, and is displayed to the second user interface at a second depth greater than the first depth. The method according to claim 43, further comprising:
45. The method according to claim 43 or 44, wherein the first representation of the first category includes a card corresponding to the first category, and the second representation of the second category includes a card corresponding to the second category.
46. While the first representation of the first category and the second representation of the second category are being displayed, an input is detected via one or more input devices to select the first representation of the first category, In response to detecting the input that selects the first representation of the first category, To display a second user interface associated with the first representation of the first category via the display generation component, To remove emphasis from the display of the second expression in the second category, The method according to any one of claims 43 to 45, further comprising:
47. While displaying the first representation of the first category and the first individual representation of the first subcategory, the system detects input via one or more input devices to select the first representation of the first category. In response to detecting the input that selects the first representation of the first category: To display a second user interface associated with the first representation of the first category via the display generation component, while maintaining the display of the first individual representation of the first subcategory. The method according to any one of claims 43 to 46, further comprising:
48. While displaying the first representation of the first category, an input is detected via one or more input devices to select the first representation of the first category, In response to detecting the input that selects the first representation of the first category: To display a second user interface associated with the first representation of the first category via the display generation component, the second user interface comprising the second representation of the first category and one or more representations of the content associated with the first category, The method according to any one of claims 43 to 47, further comprising:
49. The input for selecting the first representation of the first category is received while displaying the first individual representation of the first subcategory, the second user interface includes the first individual representation of the first subcategory, and the method is While the second user interface is displayed, a second scroll input directed to the first individual representation of the first subcategory is detected via one or more input devices, The method of claim 48, further comprising navigating to the second individual representation of the second subcategory among the first plurality of subcategories in response to the detection of the second scroll input.
50. While the second user interface is displayed, individual inputs are detected via one or more input devices that are directed to individual representations of individual content associated with the first category, In response to detecting each of the aforementioned inputs, In accordance with the determination that the individual input includes gaze input that satisfies one or more first criteria detected via the eye-tracking device, the individual content is displayed via the display generation component. The individual input includes input from the user's hand detected via a hand-tracking device communicating with the electronic device, and the individual content is displayed via the display generation component in accordance with the determination that the input from the user's hand satisfies one or more second criteria; and the individual content is not displayed via the display generation component in accordance with the determination that the individual input includes gaze input detected via the eye-tracking device that does not satisfy one or more first criteria. In accordance with the determination that the individual input includes input from the user's hand that does not meet one or more of the second criteria detected via the hand tracking device, the display generation component shall cease displaying the individual content. The method according to claim 48 or 49, further comprising:
51. While the second user interface is displayed, individual inputs are detected via one or more input devices to select individual representations of individual content associated with the first category, In response to detecting the individual inputs, the individual content is displayed via the display generation component. The method according to any one of claims 48 to 50, further comprising:
52. While displaying the second user interface surrounded by an environment having visual characteristics having a first value, detecting individual inputs via one or more input devices to select individual representations of individual content associated with the first category, In response to detecting the individual inputs, the display of the environment surrounding the second user interface is updated to have the visual characteristics having a second value different from the first value. The method according to any one of claims 48 to 51, further comprising:
53. While the first individual representation of the first subcategory and the second individual representation of the second subcategory are being displayed, an input is detected via one or more input devices to select the first individual representation of the first subcategory. In response to detecting the input that selects the first individual expression of the first subcategory, the display of the second individual expression of the second subcategory is changed. The method according to any one of claims 43 to 52, further comprising:
54. The method according to claim 53, wherein, prior to detecting the input for selecting the first individual representation of the first subcategory, the second individual representation of the second subcategory is displayed in a first position within the user interface, and changing the display of the second individual representation of the second subcategory includes displaying the second individual representation of the second subcategory in a second position different from the first position within the user interface.
55. The method according to claim 53 or 54, wherein, prior to detecting the input for selecting the first individual representation of the first subcategory, the second individual representation of the second subcategory is displayed in the foreground displayed via the display generation component, and changing the display of the second individual representation of the second subcategory includes displaying the second individual representation of the second subcategory in the background displayed via the display generation component.
56. The method according to any one of claims 53 to 55, wherein changing the display of the second individual expression of the second subcategory includes discontinuing the display of the second individual expression of the second subcategory.
57. Navigating to the second representation of the second category among the aforementioned multiple categories includes scrolling through the representations of the multiple categories at a first speed and scrolling through the representations of the first multiple subcategories at a second speed. Navigating to the second individual representation of the second subcategory among the first multiple subcategories means scrolling the representation of the first multiple subcategory at a third speed different from the second speed. The method according to any one of claims 43 to 56, including the method described in any one of claims 43 to 56.
58. The method according to any one of claims 43 to 57, wherein the first individual representation of the first subcategory among the first plurality of subcategories and the second individual representation of the second subcategory among the first plurality of subcategories are overlaid on the first representation of the first category and the second representation of the second category.
59. One or more processors, Memory and An electronic device comprising one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by the one or more processors, and the one or more programs are The user interface is provided via the display generation component, The first expression of the first category among multiple categories, A user interface is displayed, which includes a first individual representation of a first subcategory among a first plurality of subcategories of the aforementioned first category, While the user interface is displayed, scroll input is detected via one or more input devices. In response to receiving the aforementioned scroll input, When the aforementioned scroll input is detected, according to the determination that the user's gaze is directed to the first representation of the first category, Navigate to the second representation of the second category among the aforementioned multiple categories, The first individual representation of the first subcategory among the second plurality of subcategories of the second category is displayed in the user interface. When the scroll input is detected, according to the determination that the user's gaze is directed to the first individual representation of the first subcategory, An electronic device including instructions for navigating to a second individual representation of a second subcategory among a plurality of first subcategories, without navigating to the second representation of the second category.
60. A non-temporary computer-readable storage medium for storing one or more programs, wherein the one or more programs include instructions, and when the instructions are executed by one or more processors of an electronic device, the electronic device... The user interface is provided via the display generation component, The first expression of the first category among multiple categories, A user interface is displayed that includes a first individual representation of a first subcategory among a first plurality of subcategories of the first category described above, While the user interface is displayed, scroll input is detected via one or more input devices. In response to receiving the aforementioned scroll input, When the aforementioned scroll input is detected, according to the determination that the user's gaze is directed to the first representation of the first category: Navigate to the second representation of the second category among the aforementioned multiple categories. The first individual representation of the first subcategory among the second plurality of subcategories of the second category is displayed in the user interface. When the scroll input is detected, according to the determination that the user's gaze is directed to the first individual representation of the first subcategory: A non-temporary computer-readable storage medium that allows navigation to a second individual representation of a second subcategory among the first plurality of subcategories, without navigating to the second representation of the second category.
61. One or more processors, Memory and The user interface is provided via the display generation component, The first expression of the first category among multiple categories, Means for displaying a user interface, including a first individual representation of a first subcategory among a first plurality of subcategories of the first category, While the user interface is displayed, means for detecting scroll input via one or more input devices, In response to receiving the aforementioned scroll input, When the aforementioned scroll input is detected, according to the determination that the user's gaze is directed to the first representation of the first category, Means for navigating to a second representation of a second category among the aforementioned multiple categories, Means for displaying a first individual representation of a first subcategory among a second plurality of subcategories of the second category in the user interface, When the scroll input is detected, according to the determination that the user's gaze is directed to the first individual representation of the first subcategory, Means for navigating to a second individual representation of a second subcategory among the first plurality of subcategories, without navigating to the second representation of the second category, Electronic devices, including those mentioned above.
62. An information processing device for use in an electronic device, wherein the information processing device is The user interface is provided via the display generation component, The first expression of the first category among multiple categories, Means for displaying a user interface, including a first individual representation of a first subcategory among a first plurality of subcategories of the first category, While the user interface is displayed, means for detecting scroll input via one or more input devices, In response to receiving the aforementioned scroll input, When the aforementioned scroll input is detected, according to the determination that the user's gaze is directed to the first representation of the first category, Means for navigating to a second representation of a second category among the aforementioned multiple categories, Means for displaying a first individual representation of a first subcategory among a second plurality of subcategories of the second category in the user interface, When the scroll input is detected, according to the determination that the user's gaze is directed to the first individual representation of the first subcategory, An information processing device comprising means for navigating to a second individual representation of a second subcategory among a plurality of first subcategories, without navigating to the second representation of the second category.
63. One or more processors, Memory and A device comprising one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by the one or more processors, and the one or more programs include instructions that execute any one of the methods according to any one of claims 43 to 58, Electronic devices.
64. A non-temporary computer-readable storage medium for storing one or more programs, wherein the one or more programs include instructions, and when the instructions are executed by one or more processors of an electronic device, the electronic device is caused to perform the method according to any one of claims 43 to 58.
65. One or more processors, Memory and Means for carrying out the method described in any one of claims 43 to 58, An electronic device equipped with the following features.
66. An information processing device for use in an electronic device, wherein the information processing device is An information processing apparatus comprising means for performing the method described in any one of claims 43 to 58.
67. In an electronic device that communicates with one or more input devices, including a display generation component and an eye-tracking device: A first individual user interface is generated via the aforementioned display generation component, While the first individual user interface is being displayed, input is received via one or more input devices corresponding to a request to navigate from the first individual user interface to a second individual user interface. In response to receiving the input corresponding to the request to navigate from the first individual user interface to the second individual user interface, the display generation component displays the second individual user interface, which is displayed with a first level of immersion, While displaying the second individual user interface shown in the first level of immersion, the first input is detected via one or more input devices. Upon detecting the first input, and in accordance with the determination that the first input satisfies a first set of one or more criteria, the display of the second individual user interface is stopped, and the first individual user interface is displayed via the display generation component. After discontinuing the display of the second individual user interface, the third individual user interface is displayed via the display generation component at a second level of immersion higher than the first level of immersion. While displaying the third individual user interface at the second level of immersion, receiving a second input via one or more input devices, In response to detecting the second input, The display of the third user interface is maintained in accordance with the determination that the second input satisfies the first set of one or more criteria, The display of the third user interface is discontinued in accordance with the determination that the second input satisfies a second set of one or more criteria, Methods that include...
68. The method according to claim 67, wherein the first set of one or more criteria is satisfied based on gaze user input without non-gaze user input, and the second set of one or more criteria requires non-gaze user input.
69. The second individual user interface is the user interface of the first application, and the method is While a fourth separate user interface of a second application, distinct from the first application, is displayed with the first level of immersion, the fourth separate user interface is navigated to a fifth separate user interface, which detects a third input via one or more input devices. The method according to claim 67 or 68, further comprising detecting the third input and, in accordance with the determination that the third input satisfies one or more criteria of the first set, ceasing to display the fourth individual user interface and displaying the fifth individual user interface via the display generation component.
70. The second individual user interface is the user interface of the first application, and the method is While a fourth separate user interface of a second application, distinct from the first application, is displayed at a third level of immersion lower than the first level of immersion, the fourth separate user interface is navigated from a fifth separate user interface and detects a third input via one or more input devices. The method according to any one of claims 67 to 69, further comprising detecting the third input and, in accordance with the determination that the third input satisfies one or more criteria of the first set, ceasing to display the fourth individual user interface and displaying the fifth individual user interface via the display generation component.
71. The second individual user interface is the user interface of the first application, and the method is While a fourth separate user interface of a second application, distinct from the first application, is displayed at a third level of immersion higher than the first level and lower than the second level, the fourth separate user interface is navigated to a fifth separate user interface, which detects a third input via one or more input devices. The method according to any one of claims 67 to 70, further comprising detecting the third input and, in accordance with the determination that the third input satisfies one or more criteria of the first set, ceasing to display the fourth individual user interface and displaying the fifth individual user interface via the display generation component.
72. The second individual user interface is the user interface of the first application, and the method is While a fourth separate user interface of a second application, distinct from the first application, is displayed with the second level of immersion, the fourth separate user interface is navigated to a fifth separate user interface, which detects a third input via one or more input devices. In response to detecting a third input, The method according to any one of claims 67 to 71, further comprising: maintaining the display of the fourth individual user interface in accordance with the determination that the third input satisfies the first set of one or more criteria.
73. In accordance with the determination that the third individual user interface is the user interface of the first application, the second set of one or more criteria is the first set of one or more criteria. In accordance with the determination that the third individual user interface is a user interface of a second application different from the first application, the second set of one or more criteria is one or more second criteria different from the one or more first criteria. The method according to any one of claims 67 to 71.
74. The method according to any one of claims 67 to 73, wherein the third individual user interface is displayed in response to the detection of a third input via one or more input devices, which includes eye-gaze user input but does not include non-eye-gaze user input.
75. The method according to any one of claims 67 to 74, wherein the third individual user interface is displayed in response to the detection of a third input, including gaze user input and non-gaze user input, via one or more input devices.
76. Displaying the first individual user interface while displaying individual user interface elements via the display generation component, While the third individual user interface is displayed at the second level of immersion, the display of the individual user interface elements is obscured, The method according to any one of claims 67 to 74, further comprising:
77. Displaying the first individual user interface while displaying individual user interface elements via the display generation component, To display the second individual user interface at the first level of immersion while maintaining the display of the individual user interface elements, The method according to any one of claims 67 to 76, further comprising:
78. The method according to any one of claims 67 to 77, wherein the third individual user interface is a user interface for a health-related application.
79. The method according to any one of claims 67 to 78, wherein the second individual user interface is a user interface for a content consumption application.
80. The method according to any one of claims 67 to 79, wherein the third separate user interface is navigated from the first separate user interface, and displaying the third separate user interface with a second level of immersion includes discontinuing the display of the first separate user interface.
81. The method according to any one of claims 67 to 80, wherein displaying the second individual user interface at the first level of immersion includes maintaining the display of at least a portion of the first individual user interface.
82. The method according to any one of claims 67 to 81, wherein the third individual user interface includes one or more control elements, and the second set of one or more criteria is satisfied when the second input is directed to individual control of the one or more control elements for navigating away from the third individual user interface.
83. In accordance with the determination that the user's hand has been detected at a first position via a hand tracking device, one or more control elements are displayed at the first individual positions of the third individual user interface. In accordance with the determination that the user's hand is detected via the hand tracking device at a second position different from the first position, one or more control elements are displayed at the second individual position, different from the first individual position, on the third individual user interface. The method according to claim 82.
84. The method according to claim 82 or 83, wherein the one or more controls include a second separate control for performing an action other than navigating away from the third separate user interface.
85. While the second individual user interface is displayed at the first level of immersion, individual inputs, including gaze directed towards a predetermined part of the second individual user interface, are detected via the eye-tracking device. In response to detecting each of the aforementioned inputs, The representation of the first individual user interface and the representation of the second individual user interface are displayed in a hierarchical arrangement via the display generation component, The method according to any one of claims 67 to 84, further comprising:
86. While the representation of the first individual user interface and the representation of the second individual user interface are displayed in the hierarchical arrangement, a second individual input, including gaze directed towards the representation of the first individual user interface, is detected via the eye-tracking device. Upon detecting the second individual input, the display of the second individual user interface is stopped, and the first individual user interface is displayed via the display generation component. The method according to claim 85, further comprising:
87. The first individual user interface includes individual user interface elements, and the method is While the first individual user interface is being displayed, the eye-tracking device detects the gaze of the user of the electronic device directed towards the individual user interface elements displayed in the first individual user interface, While detecting the user's gaze directed towards the individual user interface element, and before the user's gaze is directed towards the individual user interface element for a longer period than a time threshold, the display of the content of the first individual user interface is gradually obscured. The method according to any one of claims 67 to 86, further comprising detecting that the user's gaze has been directed towards the individual user interface element for a longer period than the time threshold, discontinuing the display of the content of the first individual user interface, and displaying the third individual user interface at a second level of immersion via the display generation component.
88. The method according to any one of claims 67 to 87, wherein the input corresponding to the request to navigate from the first individual user interface to the second individual user interface includes an individual gesture performed by the user's hand, followed by a movement of the hand in an individual direction while maintaining the individual gesture performed by the hand, as detected by a hand-tracking device communicating with the electronic device.
89. One or more processors, Memory and An electronic device comprising one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by the one or more processors, and the one or more programs are A first individual user interface is generated via the aforementioned display generation component, While the first individual user interface is being displayed, input is received via one or more input devices in response to a request to navigate from the first individual user interface to a second individual user interface. Upon receiving the input corresponding to the request to navigate from the first individual user interface to the second individual user interface, the display generation component displays the second individual user interface, which is displayed with a first level of immersion. While displaying the second individual user interface shown in the first level of immersion, the first input is detected via one or more input devices. Upon detecting the first input, and in accordance with the determination that the first input satisfies a first set of one or more criteria, the display of the second individual user interface is stopped, and the first individual user interface is displayed via the display generation component. After discontinuing the display of the second individual user interface, the third individual user interface is displayed via the display generation component at a second level of immersion higher than the first level of immersion. While displaying the third individual user interface at the second level of immersion, a second input is received via one or more input devices. In response to detecting the second input, In accordance with the determination that the second input satisfies the first set of one or more criteria, the display of the third user interface is maintained. An electronic device including a command to discontinue displaying the third user interface in accordance with a determination that the second input satisfies a second set of one or more criteria.
90. A non-temporary computer-readable storage medium for storing one or more programs, wherein the one or more programs include instructions, and when the instructions are executed by one or more processors of an electronic device, the electronic device... The first individual user interface is displayed via the aforementioned display generation component. While the first individual user interface is being displayed, input corresponding to a request to navigate from the first individual user interface to the second individual user interface is received via one or more input devices. Upon receiving the input corresponding to the request to navigate from the first individual user interface to the second individual user interface, the display generation component causes the second individual user interface, which is displayed with a first level of immersion, to be displayed. While displaying the second individual user interface shown in the first level of immersion, the first input is detected via one or more input devices. Upon detecting the first input, and in accordance with the determination that the first input satisfies a first set of one or more criteria, the display of the second individual user interface is stopped, and the first individual user interface is displayed via the display generation component. After discontinuing the display of the second individual user interface, the display generation component is used to display a third individual user interface with a second level of immersion higher than the first level of immersion. While the third individual user interface is displayed at the second level of immersion, a second input is received via one or more input devices. In response to detecting the second input, In accordance with the determination that the second input satisfies the first set of one or more criteria, the display of the third user interface is maintained. A non-temporary computer-readable storage medium that stops displaying the third user interface in accordance with the determination that the second input satisfies a second set of one or more criteria.
91. One or more processors, Memory and Means for displaying a first individual user interface via the aforementioned display generation component, Means for receiving inputs via one or more input devices while the first individual user interface is being displayed, corresponding to requests to navigate from the first individual user interface to a second individual user interface, In response to receiving the input corresponding to the request to navigate from the first individual user interface to the second individual user interface, the display generation component provides means for displaying the second individual user interface, which is displayed with a first level of immersion, While displaying the second individual user interface shown in the first level of immersion, means for detecting a first input via one or more input devices, In response to detecting the first input, means for stopping the display of the second individual user interface and displaying the first individual user interface via the display generation component, in accordance with the determination that the first input satisfies a first set of one or more criteria, After discontinuing the display of the second individual user interface, means for displaying a third individual user interface via the display generation component with a second level of immersion higher than the first level of immersion, Means for receiving a second input via one or more input devices while displaying the third individual user interface at the second level of immersion, In response to detecting the second input, Means for maintaining the display of the third user interface in accordance with the determination that the second input satisfies the first set of one or more criteria, Means for ceasing the display of the third user interface in accordance with the determination that the second input satisfies a second set of one or more criteria, Electronic devices, including those mentioned above.
92. An information processing device for use in an electronic device, wherein the information processing device is Means for displaying a first individual user interface via the display generation component, Means for receiving inputs via one or more input devices while the first individual user interface is being displayed, corresponding to requests to navigate from the first individual user interface to a second individual user interface, In response to receiving the input corresponding to the request to navigate from the first individual user interface to the second individual user interface, the display generation component provides means for displaying the second individual user interface, which is displayed with a first level of immersion, While displaying the second individual user interface shown in the first level of immersion, means for detecting a first input via one or more input devices, In response to detecting the first input, means for stopping the display of the second individual user interface and displaying the first individual user interface via the display generation component, in accordance with the determination that the first input satisfies a first set of one or more criteria, After discontinuing the display of the second individual user interface, means for displaying a third individual user interface via the display generation component with a second level of immersion higher than the first level of immersion, Means for receiving a second input via one or more input devices while displaying the third individual user interface at the second level of immersion, In response to detecting the second input, Means for maintaining the display of the third user interface in accordance with the determination that the second input satisfies the first set of one or more criteria, An information processing apparatus comprising means for ceasing the display of the third user interface in accordance with a determination that the second input satisfies a second set of one or more criteria.
93. One or more processors, Memory and A device comprising one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs include instructions that execute any one of the methods according to any one of claims 67 to 88, Electronic devices.
94. A non-temporary computer-readable storage medium for storing one or more programs, wherein the one or more programs include instructions, and when the instructions are executed by one or more processors of an electronic device, the electronic device is caused to perform the method according to any one of claims 67 to 88.
95. One or more processors, Memory and Means for carrying out the method described in any one of claims 67 to 88, An electronic device equipped with the following features.
96. An information processing device for use in an electronic device, wherein the information processing device is An information processing apparatus comprising means for performing the method described in any one of claims 67 to 88.