Touch screen runner user interface element
By introducing a rotary wheel user interface element in response to touch input into the graphical user interface, the problem of inaccurate input methods in the prior art is solved, and fast and accurate user interaction and fine manipulation of media content items is achieved.
Patent Information
- Application Number
- CN202380066749.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-09-19
- Filing Date
- 2023-09-20
- Publication Date
- 2025-05-06
AI Technical Summary
The prior art is difficult to provide accurate and fast user input methods in graphical user interfaces, especially in high-end graphic editing and video editing software.
By introducing a rotor user interface element into the graphical user interface, the rotation of the rotor is animated in response to the user's touch swipe input, and the display of media content items is modified in real time according to the rotation speed.
It realizes the precise interaction between users and graphical user interface elements, provides a fast and accurate input method, and improves the fine manipulation ability of media content items.
Smart Images

Figure CN119948436A_ABST
Abstract
Description
[0001] Incorporation by Reference; Disclaimer
[0002] The following applications are hereby incorporated by reference: Application No. 18 / 470,297 filed on September 19, 2023; Application No. 63 / 409,625 filed on September 23, 2022. Applicant hereby revokes any disclaimer regarding claim scope in the parent case or its prosecution history, and informs the USPTO that the claims in this application may be broader than any claims in the parent case. Technical Field
[0003] The present disclosure generally relates to a jogwheel user interface (UI) element for providing various user inputs to an application or operating system. Background Art
[0004] Many high-end graphics editing and video editing software applications perform best on a desktop computer that utilizes a keyboard and mouse for in-application navigation. This type of application often relies on precise input from the user, which is difficult to achieve using other input methods. Summary of the invention
[0005] In some embodiments, at least a partial view of a wheel user interface (UI) element is displayed on a graphical user interface (GUI), wherein the wheel UI element is operable to manipulate one or more auxiliary elements. In response to a touch swipe input for controlling the wheel UI element, the rotation of the wheel UI element is animated based on the touch swipe input. The rotation of the wheel UI element includes rotating the wheel UI element at an initial rotation speed based on the touch swipe input, and after the touch swipe input stops, reducing the rotation speed of the wheel UI element until the rotation speed of the wheel UI element reaches zero. While the rotation of the wheel UI element is animated, the display of the media content items is continuously modified at a modification rate corresponding to the rotation speed of the wheel UI element.
[0006] In one embodiment, a computing device, such as a tablet or a tablet device with a touch screen display, presents a wheel UI element and an arrangement of media content items on a GUI. The computing device receives a touch input at a first area of the GUI and performs some operations in response to the touch input. These operations include: determining the distance between the touch input and the wheel UI element; selecting a modification to the arrangement of media content items; and animating the rotation of the wheel UI element over a period of time while animating the modification to the arrangement of media content items.
[0007] Particular embodiments provide at least the following advantages. A user of a tablet or tablet computing device can interact with elements displayed on the GUI without the visual of the element being manipulated being obscured by the user's thumb, finger, or input device. In contrast, the wheel UI element provides a convenient, fast, and accurate method of providing input to a computing device via a touch screen display for controlling elements of the GUI and a large number of other functions. In addition, the granularity of operating auxiliary elements based on touch input received by the wheel UI element is much finer than the possible granularity of touch input manipulation of the auxiliary element itself.
[0008] In one or more embodiments, the user input for rotating the wheel UI element causes the display associated with the media content item to be updated. Updating the display may include, for example, modifying the media content item, traversing the media content item, selecting the media content item, and selecting the position along the timeline associated with the media item.
[0009] The details of one or more embodiments are set forth in the following drawings and detailed description. Other features, aspects, and potential advantages will be apparent from the detailed description and drawings, and from the claims. BRIEF DESCRIPTION OF THE DRAWINGS
[0010] Figure 1 is a simplified illustration of an example graphical user interface (GUI) showing a wheel user interface (UI) element in one or more embodiments.
[0011] Figure 2 is a simplified illustration of an example GUI showing a wheel UI element in one or more embodiments.
[0012] Figure 3 is a simplified illustration of an example GUI showing touch input on a wheel UI element in one or more embodiments.
[0013] Figure 4 is a simplified illustration of an example GUI showing touch input on a wheel UI element in one or more embodiments.
[0014] Figure 5 is a simplified illustration of an example GUI showing touch input on a wheel UI element in one or more embodiments.
[0015] Figure 6 is a simplified illustration of an example GUI showing multiple wheel UI elements in one or more embodiments.
[0016] Figure 7 is a simplified illustration of an example GUI showing a wheel UI element in one or more embodiments.
[0017] Figure 8is a simplified illustration of an example GUI showing a wheel UI element in one or more embodiments.
[0018] Fig. 9 is a simplified illustration of an example GUI showing a wheel UI element in one or more embodiments.
[0019] Fig.10 is a simplified illustration of an example GUI showing a wheel UI element in one or more embodiments.
[0020] Fig.11 is a simplified illustration of an example GUI showing a wheel UI element in one or more embodiments.
[0021] Fig.12 is a simplified illustration of an example GUI showing a wheel UI element in one or more embodiments.
[0022] Fig.13 is a simplified illustration of an example GUI showing a wheel UI element in one or more embodiments.
[0023] Fig.14 is a simplified illustration of an example GUI showing touch input on a wheel UI element in one or more embodiments.
[0024] Fig.15 is a simplified illustration of an example GUI showing touch input on a wheel UI element in one or more embodiments.
[0025] Fig.16 is a flowchart of an example process for interacting with a GUI using a wheel UI element in one or more embodiments.
[0026] Fig.17 is a flowchart of an example process for interacting with a GUI using a wheel UI element in one or more embodiments.
[0027] Fig.18 is a flowchart of an example process for interacting with a GUI using a wheel UI element in one or more embodiments.
[0028] Fig.19 is a flowchart of an example process for interacting with a GUI using a wheel UI element in one or more embodiments.
[0029] Fig. 20 is a flowchart of an example process for interacting with a GUI using a wheel UI element in one or more embodiments.
[0030] Fig.21 It is possible Figures 1 to 20A block diagram of an example computing device that illustrates features and processes.
[0031] FIG. 22A to FIG. 22R Various examples of selectable and / or informational UI elements are shown, either alone or in association with an example wheel UI element.
[0032] Like reference symbols in the various drawings indicate like elements. DETAILED DESCRIPTION
[0033] Wheel UI element
[0034] Figure 1 It is a simplified diagram of an example GUI 100 showing a wheel UI element 102 in one or more embodiments. For ease of reading, the wheel UI element 102 may be referred to as a "wheel" in this specification and the corresponding drawings. Therefore, the "wheel" mentioned herein should be interpreted as a wheel UI element. The wheel UI element 102 may have any shape that can rotate around an axis of rotation (the center of the entire circle around which the circle rotates). Some example shapes include, but are not limited to, circular, oval, elliptical, gear-shaped, a shape similar to a watch bezel, a continuous disc, a hollow disc, a multi-sided polygon, a knob, a dial, and the like. In some examples, three-dimensional shapes such as a sphere, an ellipsoid, a torus, a torus, a property surface, and the like can be used. In other embodiments, a partial view of the shape of the wheel UI element 102 may be displayed in the GUI 100. In some methods, the wheel UI element 102 may be partially displayed on the GUI 100. For example, when the wheel UI element 102 is shaped like a circle or a disk, the GUI 100 may display a portion of the full circle wheel UI element 102, for example, approximately a quarter circle (90°), approximately a half circle (180°), approximately three quarters circle (270°), and so on.
[0035] exist Figure 1 In the embodiment, the GUI 100 shows a partial view of the wheel UI element 102 (appearing to be approximately a semicircle), wherein a plurality of tick marks are provided in the outer edge 108 of the wheel UI element 102 to indicate the rotation of the wheel UI element 102 and the current position of the wheel UI element 102. In various methods, the wheel UI element 102 may include a plurality of tick marks on the outer edge 108. Figure 1 In addition, the scale lines may have more or fewer scale lines than those shown in FIG. Figure 1 . For example, triangles, rectangles, circles, or any other shapes may be used for the tick marks. In some approaches, the wheel UI element 102 and / or the individual tick marks may have one or more indicators associated therewith, such as an angle of rotation, a number indicating a parameter setting, a minimum and / or maximum setting, and / or the like.
[0036] The wheel UI element 102 is configured to respond to touch inputs by a user of the GUI 100. Thus, in some embodiments, the GUI 100 is configured to be displayed on a touch screen display. In response to certain touch inputs, the wheel UI element 102 will rotate around its axis of rotation (which may appear on the GUI 100, be located outside the GUI 100, or be located on the GUI 100 but not displayed). The manner in which the wheel UI element 102 rotates may be based on any of the following: aspects of the wheel UI element 102, one or more characteristics of the touch input, one or more aspects of the GUI, user settings, and the like.
[0037] Touch input may include swipe touch input, tap touch input, drag and drop touch input, double-click touch input, multi-touch input (in which multiple contact points are in contact with the touch screen display at the same time), contactless "hover" touch input, multi-pressure touch input (in which the pressure intensity of the touch input varies from one touch input to another, or the pressure intensity varies during the same touch input), or any other touch input that can be sensed by a touch screen interface (such as a touch screen display).
[0038] For example, a tap input received by the wheel UI element 102 can cause the second element displayed on the GUI 100 to be selected, and the second element is highlighted or otherwise marked for selection before the tap input. In one example, a hovering touch input on a specific area of the GUI 100 can cause the wheel UI element 102 to be called from a closed or hidden state, thereby allowing the user to interact with the wheel UI element 102. In another example, a double-click touch input can cause the time period displayed by the timeline in the media editing application to change, such as increasing / decreasing the time scale displayed by the timeline, thereby making the fine-grained manipulation of the media content items displayed by the timeline more difficult / easier, specifically depending on how the timeline scale changes. In one example, a heavy pressure touch input can cause faster movement, and a lighter pressure touch input can cause slower movement, and vice versa. According to one example, a swipe touch input on the wheel UI element 102 combined with a concurrent tap touch input received at another location in the GUI 100 may cause the element located at the tap touch input to be selected and the selected element to be manipulated based on the swipe touch input received by the wheel UI element 102.
[0039] In some embodiments, the wheel UI element 102 may be associated with one or more additional UI elements, each of which may have one or more sub-elements associated therewith. Figure 1A UI element 104 is shown that is configured to close and / or hide the wheel UI element 102 in response to touch input received by the UI element 104. The UI element 104 is shown as a circle with an "X" disposed therein, but any shape, graphic, icon, and / or text may be used to represent an action that can be selected via the UI element 104.
[0040] In some embodiments, UI element 104 can be used to close and / or hide the wheel UI element 102 when the wheel UI element 102 is open and operable; however, when the wheel UI element 102 is closed or hidden, UI element 104 can be displayed on GUI 100 and can be operated to open and / or restore the wheel UI element 102.
[0041] In some embodiments, UI element 106 can be associated with wheel UI element 102. UI element 106 may include any number of sub-elements (e.g., sub-element 106a, sub-element 106b, etc.), wherein each sub-element 106a, 106b is configured to perform a specified task or function. For example, sub-element 106a may be selected by a user (e.g., via touch input), and when selected, wheel UI element 102 is locked to the current position relative to other displayed contents on GUI. In another example, sub-element 106b may be selected by a user (e.g., via touch input), and when selected, reverse the functional response to the rotation of wheel UI element 102 (e.g., clockwise rotation may cause an action, and counterclockwise rotation may cause an opposite action). The selection of sub-element 106b may switch the response to the same direction as rotating wheel UI element 102.
[0042] In various approaches, the functionality, appearance, design, or some other aspect of the wheel UI element 102 may be modified, deleted, added, and / or changed in some manner. The allowable changes may be pre-set and selectable by a user (e.g., from a displayed list, via voice commands, using touch input gestures, through a preferences or settings menu, etc.). In one approach, one or more UI elements displayed on the GUI 100 associated with the wheel UI element 102 may be configured to modify, delete, add, and / or change the wheel UI element 102.
[0043] Some example aspects of the wheel UI element 102 that can be manipulated include, but are not limited to: the color of the wheel UI element 102, the size of the wheel UI element 102, the position of the wheel UI element 102 on the GUI 100, the input response direction of the wheel UI element 100, the sensitivity of the wheel UI element 100, the number of wheel UI elements displayed on the GUI 100, the transparency of the wheel UI element 102, the covering characteristics of the wheel UI element 102, the inertia of the wheel UI element 102, the method for revealing and hiding the wheel UI element 102, the part of the wheel UI element 102 displayed on the GUI 100, etc. These various aspects will be described in more detail with respect to other figures.
[0044] In various embodiments, Figure 1 More or fewer UI elements may be associated with the wheel UI element 102 than shown in FIG. 2. Furthermore, in one or more embodiments, the functionality associated with any of the UI elements associated with the wheel UI element 102 may differ from those described herein.
[0045] Wheel Input
[0046] Figure 2 is a simplified illustration of an example GUI 200 showing a wheel UI element 102 in one or more embodiments. The GUI 200 and wheel UI element 102 may be configured to be displayed on a touch screen display such as a tablet or tablet computing device. The tablet computing device may be placed on a surface or stand to interact with a user and / or held by a user. When the user holds the tablet computing device, the user's hands may be placed on the left and right sides of the tablet computing device, respectively. Figure 2 200, thumb 110 is located near the wheel UI element 102 on the left side of the GUI, while thumb 112 is located on the opposite side (right side) of the GUI 200, simulating a user holding a tablet computing device (the remaining fingers of the user's hand are hidden below the tablet computing device below the GUI 200). This orientation represents a tablet computer or tablet computing device held by a user, wherein the user provides input to the touch screen display of the tablet computer or tablet via the user's thumbs 110, 112. Although thumbs 110, 112 are shown in the figures for input, any finger and / or tool (stylus, knuckles, palm, nails, etc.) can be used to provide input to the various GUI and wheel UI elements described in the various figures. For the remaining description of the figures, the thumb will be shown to represent the touch input location.
[0047] Figure 33 is a simplified illustration of an example GUI 300 showing touch input on a wheel UI element 102 in one or more embodiments. Thumb 110 provides a swipe touch input 114 in an upward direction relative to other elements displayed on GUI 300 (e.g., a video player 120 showing children in front of a car). GUI 300 shows a media editing application, but the use of wheel UI element 102 is not limited to such an environment. Wheel UI element 102 can be used in any application or operating system environment where precise control of auxiliary elements is required and / or useful.
[0048] In a media editing application, a video player 120 displays current visual content corresponding to the position of a current position indicator 116 along a timeline 121. The timeline 121 is a time-based arrangement of media content items 122 (e.g., a wheel graphic, a stone wheel, a Ferris wheel, IMG_9223, etc.) at a particular point in time, which together form a media presentation (which may include various types of media content items, such as video clips, animation clips, audio clips, images, filters, transitions, etc.). On the timeline 121, earlier times are displayed on the left, while later times are displayed on the right, with a series of tick marks and time-based indicators providing context about the position of the current position indicator 116 in the media presentation.
[0049] exist Figure 3 In some embodiments, touch input 114 received by wheel UI element 102 may result in several operations being performed. In one embodiment, touch input 114 received by wheel UI element 102 causes current position indicator 116 to move along timeline 121 in a direction corresponding to the direction of movement indicated by touch input 114. As shown, touch input 114 is in an upward direction, which is converted into a leftward movement 118 of current position indicator 116 along timeline 121. As shown, since touch input 114 is received by wheel UI element 102, current position indicator 116 has moved relative to media content items 122 scattered on timeline 121 to move from left to right. Figure 2 The initial position above the "IMG_9223" media clip shown in the figure is positioned above the "Stone Wheel" media clip.
[0050] In one embodiment, the touch input 114 received by the wheel UI element 102 causes the wheel UI element 102 to rotate in a direction corresponding to the direction of movement indicated by the touch input 114. Since the touch input 114 is in an upward direction, it can be translated into a counterclockwise movement of the wheel UI element 102.
[0051] In other embodiments, the upward touch input 114 can result in a clockwise rotation of the wheel UI element 102. In one embodiment, the upward touch input 114 can result in the current position indicator 116 moving to the right along the timeline 121.
[0052] In one or more embodiments, the position of the wheel UI element 102 is used to map user input to the rotation of the wheel UI element 102. As an example, when the wheel UI element 102 is located on the left side of the GUI 300, upward movement causes counterclockwise rotation of the wheel UI element 102, and downward movement causes clockwise rotation of the wheel UI element 102. When the user drags the same wheel UI element 102 to the right side of the interface, the computing device modifies the mapping of user input to the rotation of the wheel UI element 102. When the wheel UI element 102 is located on the right side of the GUI 300, upward movement causes clockwise rotation, and downward movement of the wheel causes counterclockwise rotation of the wheel UI element 102.
[0053] Figure 4 4 is a simplified illustration of an example GUI 400 showing a touch input on a wheel UI element in one or more embodiments. The thumb 110 provides a swipe touch input 126 in a downward direction relative to the orientation of other elements displayed on the GUI 400 (e.g., a video player 120 showing children in front of a car).
[0054] In some embodiments, the touch input 126 received by the wheel UI element 102 can cause several operations to be performed. In one embodiment, the touch input 126 received by the wheel UI element 102 causes the current position indicator 116 to move along the timeline 121 in a direction corresponding to the direction of movement indicated by the touch input 126. As shown, the touch input 126 is in a downward direction, which is converted into a rightward movement 124 of the current position indicator 116 along the timeline 121. As shown, since the touch input 126 is received by the wheel UI element 102, the current position indicator 116 has moved relative to the media content items 122 scattered on the timeline 121 to move from the right to the left. Figure 2 The initial position above the "IMG_9223" media clip shown in the figure is positioned above the "Ferris Wheel" media clip.
[0055] In one embodiment, the touch input 126 received by the wheel UI element 102 causes the wheel UI element 102 to rotate in a direction corresponding to the direction of movement indicated by the touch input 126. Since the touch input 126 is in a downward direction, it can be translated into a clockwise movement of the wheel UI element 102.
[0056] In other embodiments, the downward touch input 126 may result in a counterclockwise rotation of the wheel UI element 102. In one embodiment, the downward touch input 126 may result in the current position indicator 116 moving to the left along the timeline 121.
[0057] Figure 5 is a simplified illustration of an example GUI 500 showing touch input on a wheel UI element in one or more embodiments. The thumb 110 provides a swipe touch input 128 in a downward circular direction, similar to the curvature of the wheel UI element 102. This curved touch input 128 is recognized by the wheel UI element 102 based on the movement from the initial contact point to the last contact point and the corresponding direction of movement (in this case, downward and left).
[0058] In some embodiments, touch input 128 received by the wheel UI element 102 may cause several operations to be performed. These operations will be related to Figure 4 The operations are similar to those described in , in that curved touch input 128 is recognized and treated as the same as linear or vertical touch input (such as Figure 4 The same as the touch input 126).
[0059] In one embodiment, touch input 128 received by wheel UI element 102 causes current position indicator 116 to move along timeline 121 in a direction corresponding to the direction of movement indicated by touch input 128. As shown, touch input 128 is in a downward direction, which is translated into a rightward movement 124 of current position indicator 116 along timeline 121. As shown, since touch input 128 is received by wheel UI element 102, current position indicator 116 has moved relative to media content items 122 dispersed on timeline 121 to move from right to left. Figure 2 121 is positioned above the "Ferris Wheel" media clip. In addition, the portion of the video displayed in the video player 120 can be updated based on the current position within the media presentation (formed by the combination of media content items 122 arranged according to the timeline 121). However, for simplicity, the portion of the media presentation shown in the video player 120 will not change in the various figures described herein, which does not limit this function in the embodiments described herein.
[0060] In one embodiment, the touch input 128 received by the wheel UI element 102 causes the wheel UI element 102 to rotate in a direction corresponding to the direction of movement indicated by the touch input 128. Because the touch input 128 is in a downward direction, it can be translated into a clockwise movement of the wheel UI element 102.
[0061] In other embodiments, the downward touch input 128 may result in a counterclockwise rotation of the wheel UI element 102. In one embodiment, the downward touch input 128 may result in the current position indicator 116 moving to the left along the timeline 121.
[0062] In some embodiments, the location of a touch input on the wheel UI element 102 can cause changes in the way the touch input is translated into movement or manipulation of other elements in the GUI, as described in more detail later.
[0063] In one or more embodiments, in response to the manipulation of the auxiliary element (such as moving through the media content items, traversing the timeline 121, etc.) reaching a stop sign, the rotation of the wheel UI element 102 can be interrupted and / or stopped. The stop sign may include a bookmark, the end or beginning of the content, a chapter separator, a page break, a section break, a keyword being searched in the text, etc. Once the auxiliary element being manipulated reaches the stop sign, the rotation of the wheel UI element 102 will end, indicating that the stop sign has been reached. In one method, the user can move past the stop sign by providing another touch input in the same direction as the previous direction of movement. When arriving at another stop sign, the same process can be used (e.g., stop the wheel UI element 102, receive another touch input, and move past the stop sign).
[0064] In a similar embodiment, if the user attempts to manipulate an auxiliary element by rotating the wheel UI element 102, and the auxiliary element has reached a limit (e.g., the volume of the media content item increases to the maximum volume, the media content moves to the end of the timeline 121, the object is located at the edge of the GUI 500, etc.), the rotation of the wheel UI element 102 will stop, indicating that the auxiliary element being manipulated has reached a limit. Any additional attempt to move beyond the limit will cause the wheel UI element 102 to resist the movement, and may provide the user with audible feedback and / or tactile feedback indicating that the limit has been reached.
[0065] Multiple wheel UI elements
[0066] Figure 6 6 is a simplified illustration of an example GUI 600 showing multiple wheel UI elements in one or more embodiments. The wheel UI element 102 is shown on the left side of the GUI 600, while simultaneously displayed on the GUI 600 is a second wheel UI element 130 displayed on the right side of the GUI 600. The controls, design, and appearance of the second wheel UI element 130 are opposite to those of the wheel UI element 102, so that the second wheel UI element 130 can be operated by the user's right thumb, finger, or hand.
[0067] Each of the wheel UI elements 102, 130 may have the same appearance, may be inverted images of each other, or may have different appearances. In another embodiment, the wheel UI elements 102, 130 may perform the same function or different functions. For example, the wheel UI element 102 may be configured to manipulate the media content items 122 on the timeline 121, and the second wheel UI element 130 may be configured to navigate in a list, a directory, or a material directory to add to the media presentation.
[0068] In another embodiment, multiple wheel UI elements can be nested and share a common axis of rotation. In this embodiment, the inner wheel UI element can be manipulated individually by touch input from the outer wheel UI element. Each nested wheel UI element in the nested wheel UI element can have a different look and feel to separate them from each other, or can have a consistent look and feel. In addition, the nested wheel UI elements can perform different functions, either for the same auxiliary element on the GUI, or for different elements of the GUI.
[0069] In one example, the inner wheel UI element may control the current position indicator 116 along the timeline 121 , while the outer wheel UI element may control the position of the selected media content item relative to the timeline 121 .
[0070] In another example, the inner wheel UI element may control selection of a media content item from available media content items from "Project Media," while the outer wheel UI element may control one or more visual parameters (e.g., color, hue, brightness, contrast, applied filters, etc.) of the selected content media item.
[0071] The portion of the wheel UI element that is displayed
[0072] Any portion of the complete visual representation of the wheel may be included in the display on the GUI. Figures 1 to 6 The wheel UI element shown in is a partial display that includes approximately half a circle (eg, approximately 90°). Figure 7 7 is a simplified illustration of an example GUI 700 showing a wheel UI element 132 as a complete circle in one or more embodiments. The operation of the wheel UI element 132 proceeds as previously described, i.e., linear and / or circular touch inputs may be received and converted into rotations of the wheel UI element 132. Based on the degree of rotation of the wheel UI element 132, one or more auxiliary elements within the GUI 700 may be manipulated, such as by moving a current position indicator 116, adjusting the volume of one or more media content items 122, moving the relative position of one or more media content items 122, changing the length of one or more media content items 122, and the like.
[0073] Figure 8 800 is a simplified illustration of an example GUI 800 showing a wheel UI element 134 as a large portion of a circle in one or more embodiments. Specifically, the wheel UI element 134 displays a circle of approximately 270°. The operation of the wheel UI element 134 is performed as previously described, that is, linear and / or circular touch inputs can be received and converted into rotations of the wheel UI element 134. Based on the degree of rotation of the wheel UI element 134, one or more auxiliary elements within the GUI 700 can be manipulated, such as by clipping one or more media content items 122, expanding one or more media content items 122, navigating in a directory of additional media content to place on the timeline 121, and the like.
[0074] Wheel UI element overlay
[0075] Fig. 9 is a simplified illustration of an example GUI 900 showing a wheel UI element 136 in one or more embodiments. In one embodiment, the wheel UI element 136 can be overlaid anywhere on the GUI 900, wherein any elements of the GUI 900 that may exist below the wheel UI element 136 are obscured by the wheel UI element 136. In another embodiment, at least a portion of one or more elements located below the wheel UI element 136 can be modified to accommodate the wheel UI element 136 above these elements and make it easier for the user to see and interact with the wheel UI element 136.
[0076] like Fig. 9 As shown, the wheel UI element 136 is located on the left side of the GUI 900 and is overlaid on a portion of the video player 120 and the timeline 121. In this example GUI 900, the portion 138 of the video player 120 and the timeline 121 below the wheel UI element 136 is faded in some manner. For example, the portion 138 of the element below the wheel UI element 136 can be displayed with a dashed line, with a darker line and edge relative to other portions of the element, with a blurred line, with a softened line, etc. In this way, users of the GUI 900 can more easily identify the controls of the wheel UI element 136 without being visually distracted by the elements below the wheel UI element 136.
[0077] According to one approach, the lines and / or edges of the wheel UI element 136 may be emphasized relative to other elements of the GUI 900 to help the user identify the controls of the wheel UI element 136 .
[0078] In another embodiment, the wheel UI element 136 may have a degree of transparency, which allows the elements below the wheel UI element 136 to be partially visible rather than completely obscured. This allows for easier identification of the wheel UI element and any elements associated with it (e.g., a selection button, a lock button, etc.).
[0079] According to another embodiment, the wheel UI element 136 may be completely opaque and completely obscure any portion of the elements below the wheel UI element 136 .
[0080] Corner placement of wheel UI element
[0081] Figures 10 to 13 is a simplified illustration of an example GUI showing a wheel UI element in a corner of the GUI in one or more embodiments. Fig.10 An example GUI 1000 is shown having a corner wheel UI element 140 located in the upper left corner of the GUI 1000. Additionally, in one or more embodiments, a portion 142 of an element positioned below the corner wheel UI element 140 can be de-emphasized relative to other portions of the element and / or the corner wheel UI element 140 can be emphasized relative to other elements of the GUI 1000. In some embodiments, this effect can be omitted.
[0082] Fig.11 An example GUI 1100 is shown having a corner wheel UI element 144 located in the upper right corner of the GUI 1100. Additionally, in one or more embodiments, a portion 146 of an element located below the corner wheel UI element 144 can be de-emphasized relative to other portions of the element and / or the corner wheel UI element 144 can be emphasized relative to other elements of the GUI 1100. In some embodiments, this effect can be omitted.
[0083] Fig.12 An example GUI 1200 is shown having a corner wheel UI element 148 located in the lower left corner of the GUI 1200. Additionally, in one or more embodiments, the portion of the element located below the corner wheel UI element 148 can be de-emphasized relative to other portions of the element, and / or the corner wheel UI element 148 can be emphasized relative to other elements of the GUI 1200. However, in Fig.12 In the example, no element is located below the corner wheel UI element 148 to show this effect. In addition, this effect can be omitted in this or any other embodiment.
[0084] Fig.13An example GUI 1300 is shown having a corner wheel UI element 150 located in the lower right corner of the GUI 1300. Additionally, in one or more embodiments, the portion 152 of the element located below the corner wheel UI element 150 can be de-emphasized relative to other portions of the element and / or the corner wheel UI element 150 can be emphasized relative to other elements of the GUI 1300. In some embodiments, this effect can be omitted.
[0085] The touch input position relative to the wheel UI element
[0086] In one or more embodiments, the position of a touch input relative to a specific portion of a wheel UI element can be used to determine how to respond to the touch input. Specifically, when the touch input moves farther from a point located on the wheel UI element, for the same amount of rotational input provided by the touch input, the rotation transmitted to the wheel UI element is less. In some embodiments, the point located on the wheel UI element can be the axis of rotation of the wheel UI element. In one method, the point located on the wheel UI element can be the inner edge or outer edge of the farthest range of the wheel. In various other embodiments, some other predetermined point associated with the wheel UI element can be used as a measuring point to determine the distance between the touch input and the wheel UI element.
[0087] Fig.14 1 is a simplified illustration of an example GUI 1400 showing a touch input 156 on a wheel UI element 102 in one or more embodiments. The touch input 156 can be up / down to rotate the wheel UI element 102 in a clockwise / counterclockwise direction while moving the current position indicator 116 in a corresponding direction along the timeline 121.
[0088] In some embodiments, a touch input may be provided to the wheel UI element 102 at any location in the GUI, and the farther the input is from the wheel UI element 102, the smaller the change that will be produced to the auxiliary elements controlled by the rotation of the wheel UI element 102. This is because for a circular object like the wheel UI element 102, the amount of rotation obtained from the rotation input (which may be a linear touch input or a curved touch input applied to the wheel, as described herein) is inversely proportional to the distance of the rotation input from the axis of rotation. In other words, a rotation input that is farther from the axis moves (rotates) the wheel less, while a rotation input that is closer to the axis of rotation moves (rotates) the wheel more.
[0089] exist Fig.14, location 154 of touch input 156 is located on wheel UI element 102 near a specific point of wheel UI element 102 for measuring distance to the touch input (such as the axis of rotation of wheel UI element 102), rather than toward an edge of wheel UI element 102 or completely outside of the wheel UI element. Because touch input 156 is positioned near the specific point of wheel UI element 102 for measuring distance to the touch input, the movement imparted on current location indicator 116 is greater than when the touch input is located on the edge of wheel UI element 102 and / or when the touch input leaves wheel UI element 102 and is away from the specific point of wheel UI element 102. In some approaches, touch input 156 may start near the specific point of wheel UI element 102 for measuring distance to the touch input and then extend away from the specific point to allow the user to start moving quickly and then optimize the movement to be slower and slower as the touch input moves away from the specific point of wheel UI element 102 for measuring distance to the touch input.
[0090] Fig.15 is a simplified illustration of an example GUI showing touch input on a wheel UI element in one or more embodiments.
[0091] Fig.15 is a simplified illustration of an example GUI 1500 showing touch input 160 for a wheel UI element 102 in one or more embodiments. The touch input 160 can be related to Fig.14 The touch input 156 in the figure moves upward / downward by approximately the same distance. The touch input 160 can rotate the wheel UI element 102 in a clockwise / counterclockwise direction while moving the current position indicator 116 in the corresponding direction along the timeline 121 by a distance that is less than Fig.14 The movement caused by touch input 156 is assigned a movement distance of current position indicator 116.
[0092] exist Fig.15 In the example, because location 158 of touch input 160 is located outside the edge of wheel UI element 102, away from the specific point of wheel UI element 102 used to measure the distance to the touch input, the movement imparted on current position indicator 116 is smaller than if the touch input was located closer to the specific point of wheel UI element 102 used to measure the distance to the touch input. Touch input 160 can be located at different Fig.15 , such as on the wheel UI element 102 itself, and then move out or in Fig.15 The location shown in .
[0093] In addition, in one or more embodiments, the wheel UI element 102 can be configured to exhibit inertia. A touch input (such as a quick swipe or flick) can initiate the wheel UI element 102 to rotate at a rotation rate corresponding to the speed of the touch input (average speed, peak speed, final speed when contact stops, etc.). Once the touch input stops, the wheel UI element 102 can begin to slow down, but will continue to rotate for a period of time after the touch input stops due to the perceived inertia of the wheel itself.
[0094] Calling and positioning the wheel UI element
[0095] The position of the wheel UI element can be selected by the user at any time. In one method, the wheel UI element can be called and / or repositioned on the GUI using touch input.
[0096] For example, to invoke the wheel UI element, a user may select and / or hover over a specific portion of the GUI that may be designated by an icon, graphic, text, or some other identifying feature that lets the user know that the wheel UI element will propagate from that location. When the user invokes the wheel UI element via touch input at the invocation location, an animation of the wheel UI element may be displayed, showing it being revealed from the side, top, or bottom of the GUI near the invocation location.
[0097] In another approach, the wheel UI element can appear at a pre-specified position regardless of the calling position. This can occur using a reveal animation or by showing the wheel UI element without animation.
[0098] In one embodiment, the user can touch a designated position on or outside the GUI, and drag to the middle of the GUI to reveal the wheel UI element. In this embodiment, if the user keeps in contact with the touch input of the touch screen, the user can interact with the wheel UI element to receive input, responding to the input by manipulating a certain auxiliary element of the GUI. When the user releases the touch input, the wheel UI element can be hidden. The automatic hiding function can have a delay, wherein the wheel UI element is still visible (and operable) on the GUI for a period of time after the continuous touch input terminates, and then hides after the period of time. This allows the user to have some time to interact with the wheel UI element after performing the first action, without the need to recall or display the wheel UI element each time the user wishes to use the wheel UI element.
[0099] Once the wheel UI element is displayed on the GUI, it can behave like a floating element above the GUI, allowing the user to move the wheel UI element to any position on the GUI as needed. This repositioning can be used to ensure that the wheel UI element does not overlap content of the GUI that the user needs to see / interact with. As the wheel UI element is moved in the GUI, its appearance can change to accommodate its new position on the GUI.
[0100] In one example, movement of the wheel UI element from the left to the right will cause the wheel UI element to flip its appearance horizontally and possibly reverse its response to touch input received via the wheel UI element.
[0101] In another example, moving the wheel UI element from the top to the bottom of the GUI will cause the wheel UI element to flip its appearance vertically and possibly reverse its response to touch input received via the wheel UI element.
[0102] Moving the wheel UI element may be accomplished using a drag and drop input or any other touch input that may specify a new position for the wheel UI element.
[0103] In another approach, one or more pre-specified positions and appearances of the wheel UI element may be specified, and the user may select from among these positions when placing the wheel UI element on the GUI.
[0104] In one approach, the wheel UI element may overlay other content of the GUI, with various possible treatments being performed on the possible overlaid content, as discussed herein in several embodiments.
[0105] If a user attempts to move the wheel UI element to an undesirable and / or disallowed position on the GUI (e.g., because content is in a position designated as disallowed to overlay an object), the wheel UI element can quickly return to an allowed position. In another approach, the wheel UI element can "bounce" from a disallowed position to an allowed position. Additionally, audible feedback and / or tactile feedback can be provided to the user indicating a problem with the desired position.
[0106] The appearance of the wheel UI element
[0107] The appearance of the wheel UI element may be selected and / or modified by the user at any time. In one approach, the appearance of the wheel UI element may be modified via a menu interface, where various options are presented to the user for selection. In another embodiment, a selectable UI element associated with the wheel UI element may be touched (and possibly held), while manipulation of the wheel itself may cause selection of one of the various options pre-specified for the wheel UI element.
[0108] Some aspects of the wheel UI element that may be selected and / or modified may include, but are not limited to: the color of the wheel UI element, the size of the wheel UI element, the number of wheel UI elements displayed on the GUI, the transparency of the wheel UI element, the overlay characteristics of the wheel UI element, the method for showing and hiding the wheel UI element, the portion of the wheel UI element to be displayed on the GUI, and the like.
[0109] In one embodiment, touch and hold input can increase and / or reduce the size of the wheel UI element.For example, touching, holding and dragging the outer ring of the wheel UI element can allow the user to intuitively increase or reduce the wheel UI element.
[0110] In another embodiment, multi-touch input can be used to expand and / or contract the wheel UI element. For example, a pinch touch input can cause the wheel UI element to shrink or contract in size, while an expand or pinch-to-zoom touch input can cause the wheel UI element to expand or increase in size. Of course, these functions can be reversed relative to receiving multi-touch input (e.g., pinch to expand / increase, expand to shrink / contract).
[0111] Example Process
[0112] In order to enable the reader to clearly understand the technical concepts described herein, the following process describes the specific steps performed in a specific order. However, one or more steps of a specific process can be rearranged and / or omitted while remaining within the expected scope of the technology disclosed herein. In addition, different processes and / or their steps can be combined, recombined, rearranged, omitted and / or performed in parallel to create different processing flows that are also within the expected scope of the technology disclosed herein. In addition, although for the sake of clarity, the following process can omit or briefly summarize some details of the technology disclosed herein, the details described in the above paragraphs can be combined with the process steps described below to obtain a more complete and comprehensive understanding of these processes and the technology disclosed herein.
[0113] Fig.16 16 is a flow diagram of an example process 1600 for interacting with a GUI using a wheel UI element in one or more embodiments. In various approaches, more or fewer operations can be included in process 1600 than those shown and described herein.
[0114] In operation 1602, the computing device displays a partial view of a wheel UI element on a GUI. In some embodiments, the GUI is configured to display on a touch screen display. The wheel UI element can be responsive to triggers such as user inputs that call the wheel UI element, applications or operating systems that request the wheel UI element, some conditions of parameters satisfied in applications or operating systems of computing devices, etc. The wheel UI element is associated with the display of one or more media content items such as directories, lists, thumbnail view arrangements, folders, etc., and the wheel UI element is illustrated in a manner that a user can understand that can be used for interaction, such as moving, copying, deleting, adding to media presentations, sampling, etc., various media content items.
[0115] In operation 1604, the computing device receives a touch swipe input for controlling the wheel UI element. In one embodiment, the touch swipe input can be received via a touch screen display. In addition, the touch screen display can be controlled by a tablet computer or a tablet computing device.
[0116] A touch swipe input may have one or more distinguishable characteristics that can be determined by a computing device when the touch input is received. In some embodiments, the touch input characteristics may be used at least in part to determine a response to a touch swipe input. Some example characteristics include, but are not limited to, the distance between the initial contact point and the last contact point associated with the touch input (e.g., the length of the touch input), the approximate direction of the touch input (e.g., horizontal, vertical, left, right, up, down, or a combination of directions that can be combined into a vector representation consisting of two directions), the pressure of the touch input (which can be measured by a touch screen display capable of detecting touch pressure), the speed of movement of the touch input, the number of touch inputs received simultaneously, the number of consecutive touch inputs received within a predetermined time period (double-click, triple-click, etc.), the contact range size of the touch input (palm, finger, stylus), configurable input using a dedicated touch device (e.g., a touch stylus), and the like.
[0117] In operation 1606, in response to the touch swipe input, the computing device animates the rotation of the wheel UI element based on the touch swipe input. In one embodiment, the animated rotation of the wheel UI element may include a rotation mark (e.g., a tick mark) displayed on the wheel UI element in a direction consistent with the touch input. In one method, when the outer edge of the wheel UI element is not smooth, animating the wheel UI element may include moving the not smooth edge of the wheel UI element in a direction consistent with the touch input.
[0118] In one or more embodiments, the rotation of the wheel UI element includes: (a) rotating the wheel UI element at an initial rotation speed based on the touch swipe input, wherein due to the perceived inertia of the wheel UI element, the wheel UI element continues to rotate after the touch swipe input stops, and (b) after the touch swipe input stops, reducing the rotation speed of the wheel UI element until the rotation speed of the wheel UI element reaches zero. In other words, once the touch input ends (e.g., the user lifts off the contact point from the touch screen display), the wheel UI element will continue to rotate, but the speed will slow down from the initial rotation speed until it stops.
[0119] In operation 1608, while displaying the rotation of the wheel UI element in an animated manner, the computing device continuously modifies the display of at least one of the one or more media content items. The modification rate for modifying the display of at least one of the one or more media content items corresponds to the rotation speed of the wheel UI element. Therefore, when the touch input is completed and the wheel UI element begins to decelerate, the modification of the display of at least one of the one or more media content items will begin to decelerate until the rotation and modification stop simultaneously.
[0120] According to one embodiment, at least initially, the extent of rotation of the wheel UI element may be proportional to the length of the touch swipe input.
[0121] If another touch input is received on the wheel UI element before the rotation stops due to the first touch input, the wheel UI element will respond to the second touch input by rotating at a speed based on the initial rotation of the second touch swipe input. In one approach, the second touch input can be adjusted by any remaining rotation provided by the first touch input, particularly when the second touch input is in a substantially opposite direction to the first touch input.
[0122] In another embodiment, upon receiving the second touch input, the wheel UI element may stop rotating in the direction generated by the first touch input and then begin rotating in a direction consistent with the second touch input and at an initial rate consistent with the second touch input.
[0123] The computing device may modify the one or more media content items in any perceptible manner based on the touch swipe input to the wheel UI element. Some example modifications include, but are not limited to: a currently displayed media content item in the one or more media content items, audio characteristics associated with at least one of the one or more media content items, image characteristics of at least one of the one or more media content items, and the like.
[0124] By modifying the currently displayed media content items, different media content items can be selected and displayed, for example, in a video or image viewer in a GUI. In other words, the GUI changes from displaying a first media content item of one or more media content items (e.g., a video of a child playing football) to displaying a second media content item of one or more media content items (e.g., a photo of a trip to Hawaii). Audio characteristics include any one of maximum volume, minimum volume, relative volume level, average loudness, root mean square (RMS) volume, etc. Image characteristics include any one of color, contrast, hue, brightness, applied filters, cropping area, size, aspect ratio, format, metadata, blur, etc.
[0125] In one or more embodiments, the computing device can determine the approximate direction of the touch swipe input. Based on the approximate direction of the touch input, the computing device can map the approximate direction of the touch swipe input to the clockwise rotation of the wheel UI element or the counterclockwise rotation of the wheel UI element. In one example, the downward touch input on the right side of the wheel UI element causes a clockwise rotation, and the upward touch input on the right side of the wheel UI element causes a counterclockwise rotation. In another example, the downward touch input on the left side of the wheel UI element causes a counterclockwise rotation, and the upward touch input on the left side of the wheel UI element causes a clockwise rotation. According to another example, the left touch input on the top side of the wheel UI element causes a counterclockwise rotation, and the right touch input on the top side of the wheel UI element causes a clockwise rotation. In another example, the left touch input on the bottom side of the wheel UI element causes a clockwise rotation, and the right touch input on the bottom side of the wheel UI element causes a counterclockwise rotation.
[0126] According to one or more embodiments, animating the rotation of the wheel UI element includes rotating at least a circular element of the wheel UI element in one of a clockwise direction or a counterclockwise direction based on the mapping operation.
[0127] In one method, when a stop sign associated with one or more media content items is reached while modifying the display of one or more media content items (such as a bookmark, a chapter separator, a page break, a section break, a keyword being searched for in the text, etc.), the computing device can immediately stop the rotation of the wheel UI element. In other words, when the wheel UI element rotates to navigate among the various media content items, if there is a stop sign at a certain point in the media content items (within a particular media content item or between two media content items), the wheel UI element will stop immediately, and the traversal of the various media content items will stop at the stop sign.
[0128] In one approach, the rotation speed of the wheel UI element may decrease linearly at a constant rate or at a decreasing rate (stopping faster as the rotation speed decreases) until the rotation speed of the wheel UI element reaches zero, causing the rotation to slowly stop.
[0129] In another approach, the rotation speed of the wheel UI element may decrease at a non-linear falling or decaying rate until the rotation speed of the wheel UI element reaches zero, causing the wheel UI element to stop abruptly.
[0130] In one or more embodiments, the rotation of the wheel UI element can cause an audible indication of the rotation to be output. For example, while displaying the rotation of the wheel UI element in an animated manner, the computing device can output audio clicks at a frequency proportional to the rotation speed of the wheel UI element. In other words, when the wheel rotates faster, these audio clicks can be faster, and when the wheel rotates slower, the audio clicks can be slower.
[0131] According to one embodiment, one or more characteristics of the wheel UI element may be adjustable. Adjustment may be performed via selectable elements on the GUI, menus, voice commands, etc. The characteristics of the wheel UI element include, but are not limited to, the color of the wheel UI element, the size of the wheel UI element, the position of the wheel UI element on the GUI, the input response direction of the wheel UI element, the sensitivity of the wheel UI element, the number of wheel UI elements displayed on the GUI, the transparency of the wheel UI element, the coverage characteristics of the wheel UI element, the inertia of the wheel UI element, methods for revealing and hiding the wheel UI element, a portion of the wheel UI element to be displayed on the GUI, and the like.
[0132] Fig.17 17 is a flow diagram of an example process 1700 for interacting with a GUI using a wheel UI element in one or more embodiments. In various approaches, more or fewer operations can be included in process 1700 than those shown and described herein.
[0133] In operation 1702, the computing device displays a wheel UI element on a GUI. In one embodiment, the GUI can be displayed on a touch screen display.
[0134] In operation 1704, the computing device presents an arrangement of one or more media content items while displaying the carousel UI element. The media content items may include videos, images, audio clips, animations, transitions, and the like.
[0135] In operation 1706, the computing device receives a touch input at a first area of the GUI. In one embodiment, the touch input may be received via a touch screen display. In addition, the touch screen display may be controlled by a tablet computer or a tablet computing device.
[0136] The touch input may have one or more distinguishable characteristics that can be determined by the computing device when the touch input is received. In some embodiments, the touch input characteristics may be used at least in part to determine the response to the touch input. Some example characteristics include, but are not limited to, the distance between the initial contact point and the last contact point associated with the touch swipe input (e.g., the length of the touch swipe input), the approximate direction of the touch input (e.g., horizontal, vertical, left, right, up, down, or a combination of directions that can be combined into a vector representation consisting of two directions), the pressure of the touch input (which can be measured by a touch screen display capable of detecting touch pressure), the speed of movement of the touch input, the number of touch inputs received simultaneously, the number of consecutive touch inputs received within a predetermined time period (double-click, triple-click, etc.), the contact range size of the touch input (palm, finger, stylus), configurable input using a dedicated touch device (e.g., a touch stylus), and the like.
[0137] In operation 1708, in response to the touch input, the computing device determines the distance between: (a) a first location within the GUI associated with a first area of the GUI (e.g., a point at which a tap touch input was detected, an average placement of a swipe touch input, a closest point in a swipe touch input, a farthest point in a touch swipe input, etc.), and (b) a second location associated with a wheel UI element (e.g., an axis of rotation or some other pre-specified point on or near the wheel UI element).
[0138] In one embodiment, the second position may be associated with and / or set to a particular tick mark displayed near an edge of the wheel UI element, and / or may be the portion of the wheel closest to the touch input location.
[0139] Upon determining the distance, the computing device selects a modification to the arrangement of one or more media content items in operation 1710. In one approach, the modification may be based on: a) the distance between the first location and the second location, and b) one or more characteristics of the touch input.
[0140] In some embodiments, a touch input may have one or more discernible characteristics that can be used, at least in part, to determine a response to the touch input. Some example characteristics include, but are not limited to, the distance between the initial contact point and the last contact point associated with the touch input (e.g., the length of a touch swipe input), the approximate direction of the touch input (e.g., horizontal, vertical, left, right, up, down, or a combination of directions that can be combined into a vector representation having two directions), the pressure of the touch input (which can be measured by a touch screen display capable of detecting touch pressure), the speed of movement of the touch input, the area, portion, and / or element of the GUI that is visually displayed at the location where the touch input is detected, and the like.
[0141] Modification of one or more media content items may include any change to the appearance, position, content, inclusion, exclusion, or other aspects of the media content items displayed on the GUI (including modifying media content items hidden from the GUI view, at least before performing the modification). Some example modifications include, but are not limited to: moving and / or positioning media content items relative to other elements and / or media content items displayed on the GUI, deleting media content items from a collection of media content items, adding media content items to a collection of media content items, repositioning the position of media content items on the timeline relative to other media content items on the timeline, revealing properties and / or information about the media content items, changing the size (zooming in / out) for displaying at least one media content item relative to other elements displayed on the GUI, exchanging one media content item for another media content item, duplicating media content items, clipping media content items, extending media content items, changing the volume of one or more media content items simultaneously, changing the image properties of one or more media content items simultaneously, displaying one or more separate tracks (audio, video, background, etc.) of media content items, and the like.
[0142] In operation 1712, the computing device animates the rotation of the wheel UI element so that it rotates from a first wheel position to a second wheel position. The degree of rotation of the wheel UI element can be based on: a) the distance between the first position and the second position, and b) one or more characteristics of the touch input. In other words, the distance between the touch screen contact point and the wheel UI element is used to determine how much rotation is given to the wheel UI element. In one method, the farther the distance between the touch screen contact point and the wheel UI element, the smaller the amount of rotation given to the wheel. Conversely, the shorter the distance between the touch screen contact point and the wheel UI element, the greater the amount of rotation given to the wheel.
[0143] In one approach, the computing device detects the length of the swipe motion of the touch input to determine an extent of rotation of the wheel UI element that is proportional to the length of the swipe motion.
[0144] According to one or more embodiments, for the same specific length of the swipe motion, as the distance between the first position and the second position decreases, the degree of rotation of the wheel UI element increases in proportion to the specific length of the swipe motion.
[0145] In some embodiments, for the same specific length of the swipe motion, as the distance between the first position and the second position increases, the degree of rotation of the wheel UI element decreases proportionally to the specific length of the swipe motion.
[0146] In operation 1714 , the computing device animates a modification to the arrangement of the one or more media content items while animating the rotation of the wheel UI element from the first wheel position to the second wheel position.
[0147] According to one embodiment, one or more characteristics of the wheel UI element may be adjustable. Adjustment may be performed via selectable elements on the GUI, menus, voice commands, etc. The characteristics of the wheel UI element include, but are not limited to, the color of the wheel UI element, the size of the wheel UI element, the position of the wheel UI element on the GUI, the input response direction of the wheel UI element, the sensitivity of the wheel UI element, the number of wheel UI elements displayed on the GUI, the transparency of the wheel UI element, the coverage characteristics of the wheel UI element, the inertia of the wheel UI element, methods for revealing and hiding the wheel UI element, a portion of the wheel UI element to be displayed on the GUI, and the like.
[0148] Fig.18 18 is a flow diagram of an example process 1800 for interacting with a GUI using a wheel UI element in one or more embodiments. In various approaches, more or fewer operations can be included in process 1800 than those shown and described herein.
[0149] In operation 1802, the computing device displays at least a partial view of a wheel UI element on the GUI. The partial view may be a portion around the circular UI element, such as 30°, 45°, 90°, 180°, 270°, 360°, or some other portion of the circular UI element, for receiving touch input and controlling at least one auxiliary element on the GUI.
[0150] In operation 1804, the computing device displays a first media content item at a first timeline position relative to the timeline while displaying a partial view of the wheel UI element. In this way, the timeline, the media content items on the timeline, and the wheel UI element are all displayed on the GUI at the same time. This allows a user to interact with the wheel UI element in various ways to control a certain aspect of the media content item, the timeline, and / or other media content items displayed on the timeline or that can be displayed on the timeline.
[0151] In one or more embodiments, the timeline can be similar in appearance and / or function to Figures 1 to 15 Timeline 121 shown and described in .
[0152] Reference again Fig.18 In operation 1806, the computing device receives a touch input for controlling the wheel UI element. In one embodiment, the touch input can be received via a touch screen display. In addition, the touch screen display can be controlled by a tablet computer or a tablet computing device.
[0153] A touch input may have one or more distinguishable characteristics that can be determined by a computing device when the touch input is received. In some embodiments, the touch input characteristics may be used at least in part to determine a response to the touch input. Some example characteristics include, but are not limited to, the distance between the initial contact point and the last contact point associated with a touch swipe input (e.g., the length of the touch swipe input), the approximate direction of the touch input (e.g., horizontal, vertical, left, right, up, down, or a combination of directions that can be combined into a vector representation having two directions), the pressure of the touch input (which can be measured by a touch screen display capable of detecting touch pressure), the speed of movement of the touch input, the area, portion, and / or element of the GUI visually displayed at the location where the touch input is detected, the number of touch inputs received simultaneously, the number of consecutive touch inputs received within a predetermined time period (double-click, triple-click, etc.), the contact range size of the touch input (palm, finger, stylus), configurable input using a dedicated touch device (e.g., a touch stylus), and the like.
[0154] In operation 1808, in response to the touch input, the computing device animates the rotation of the wheel UI element from the first wheel position to the second wheel position. The rotation is based at least in part on the touch input.
[0155] In operation 1810 , the computing device animates movement of a first media content item relative to the timeline from a first timeline position to a second timeline position while animating rotation of a wheel UI element from a first wheel position to a second wheel position.
[0156] In one embodiment, the difference between the first timeline position and the second timeline position corresponds to the difference between the first wheel position and the second wheel position. In other words, the amount of rotation of the wheel indicates how far the media content item is temporarily moved along the timeline. When determining how far to move the media content item, other factors may also be considered, such as the distance of the touch input from a specific point of the wheel UI element, the pressure of the touch input, the movement speed of the touch input, etc.
[0157] In one embodiment, a heavier pressure touch input can move a media content item further on the timeline than a lighter pressure touch input. In another embodiment, a lighter pressure touch input can move a media content item further on the timeline than a heavier pressure touch input.
[0158] In one embodiment, a higher velocity touch swipe input may move media content items further on the timeline than a slower velocity touch swipe input.
[0159] According to one embodiment, when the difference between the first wheel position and the second wheel position is large or increases during touch input, the media content item will move a larger amount on the timeline (e.g., the difference between the first timeline position and the second timeline position is larger) than when the difference between the first wheel position and the second wheel position is small, which results in the media content item moving a smaller amount on the timeline (e.g., the difference between the first timeline position and the second timeline position is smaller).
[0160] In an alternative embodiment, the smaller the difference between the first wheel position and the second wheel position, the greater the difference between the first timeline position and the second timeline position, and the larger the difference between the first wheel position and the second wheel position, the smaller the difference between the first timeline position and the second timeline position.
[0161] According to one embodiment, in response to the first media content item moving to the second timeline position, computing device can detect the second media content item located along the timeline, and the second media content item is at least partially located between the first timeline position and the second timeline position. This comprises that only a part of the second media content item and / or all are located at the situation of the position (for example, between the first timeline position and the second timeline position) that the first media content item will be moved to. In these cases, computing device moves the second media content item along the timeline in the direction identical with the direction of movement of the first media content item. In other words, computing device promotes every other media content item that contacts with the first media content item when moving the first media content item along the timeline. After the first media content item first contacts, promote other media content items with identical distance in the direction identical with the first media content item.
[0162] In one embodiment, in response to the first media content item moving to the second timeline position, the computing device detects the second media content item that is at least partially located between the first timeline position and the second timeline position along the timeline. In this case, the computing device is editing the part of the second media content item that overlaps owing to the first media content item moving to the second timeline position. In another embodiment, the computing device can rewrite the part of the second media content item that overlaps owing to the first media content item moving to the second timeline position with a part for the first media content item. In another embodiment, the overlapping portion of the second media content item can be retained, and the second media content item can be moved to another passage of the timeline, so that the user can visually identify the overlapping portion.
[0163] In one embodiment, in response to the first media content item moving to the second timeline position, the computing device detects the second media content item that is at least partially located between the first timeline position and the second timeline position along the timeline. In this case, the computing device visually reverses at least a portion of the movement of the first media content item (moving in the opposite direction after moving toward the second media content item along the first direction) to the third position on the timeline. The computing device determines where the third position will be located so that the first media content item is positioned adjacent to the second media content item. This avoids the first media content item from overlapping the second media content item. In other words, if the user attempts to move the first media content item to the position occupied on the timeline, the animation of the first media content item will "bounce" back to the position allowed (it is as far away as possible from the second media content item, for example adjacent and close to the second media content item) from the attempted position.
[0164] In one embodiment, the difference between the first timeline position and the second timeline position can be proportional to the difference between the first wheel position and the second wheel position. The proportional relationship can be 1:1, 1:2, 2:1, or some other ratio or multiplier that converts the degree of rotation of the wheel into movement of the first media content item along the timeline.
[0165] In certain embodiments, a portion of the wheel UI element may be displayed to the left of the center of the GUI, and the timeline may be displayed horizontally with time increasing to the right (eg, Figure 1 In this embodiment, a nearly downward swipe touch input (straight down, down and left, down and right) can cause the first media content item to move to the right relative to the timeline, while a nearly upward swipe touch input (straight up, up and left, up and right) causes the first media content item to move to the left relative to the timeline.
[0166] In another specific embodiment, a portion of the wheel UI element can be displayed to the left of the center of the GUI, and the timeline can be displayed horizontally with time increasing to the right (e.g., Figure 1 In this embodiment, an approximately downward swipe touch input (straight down, down and left, down and right) can cause the first media content item to move to the left relative to the timeline, while an approximately upward swipe touch input (straight up, up and left, up and right) causes the first media content item to move to the right relative to the timeline.
[0167] According to a specific embodiment, the part of the wheel UI element can be displayed on the right side of the GUI center, and the timeline can be displayed horizontally, and the time increases to the right. In this embodiment, an approximate downward swipe touch input (straight line downward, downward and left, downward and right) can make the first media content item move to the right relative to the timeline, and an approximate upward swipe touch input (straight line upward, upward and left, upward and right) makes the first media content item move to the left relative to the timeline.
[0168] According to another specific embodiment, the part of the wheel UI element can be displayed on the right side of the GUI center, and the timeline can be shown horizontally, and the time increases to the right. In this embodiment, the approximate downward swipe touch input (straight line downward, downward and left, downward and right) can make the first media content item move to the left relative to the timeline, and the approximate upward swipe touch input (straight line upward, upward and left, upward and right) makes the first media content item move to the right relative to the timeline.
[0169] Before receiving a touch input for controlling a wheel UI element, a computing device may receive a first user input that positions the wheel UI element to a first position on the GUI. The first user input may be a drag-and-drop input, a first tap-move-second tap operation, a selection of a menu item, a selection of a UI element configured to allow the wheel UI element to move on the GUI, etc. In response to the first user input, the computing device configures the wheel UI element to respond to subsequent touch inputs based on the first position (and / or one or more characteristics of subsequent touch inputs). This configuration may consider that the wheel UI element moves from one side of the GUI to the other, thereby reversing an input gesture (e.g., for interacting with different thumbs or fingers). In another method, the size of the wheel UI element may be considered in this configuration so that the user can interact with the wheel intuitively and the user can anticipate the final effect of the auxiliary elements of the GUI.
[0170] In one embodiment, one or more characteristics of the wheel UI element may be adjustable by the user through interaction with the GUI or some other input to the computing device. Some example characteristics of the wheel UI element include, but are not limited to, the color of the wheel UI element, the size of the wheel UI element, the position of the wheel UI element on the GUI, the input response direction of the wheel UI element, the sensitivity of the wheel UI element, the number of wheel UI elements displayed on the GUI, the transparency of the wheel UI element, the coverage characteristics of the wheel UI element, the inertia of the wheel UI element, methods for revealing and hiding the wheel UI element, and the portion of the wheel UI element to be displayed on the GUI, etc.
[0171] In one or more embodiments, the rotation of the wheel UI element can cause an audible indication of the rotation to be output. For example, while animating the rotation of the wheel UI element, the computing device can output audio clicks at a frequency proportional to the rotation speed of the wheel UI element. In other words, when the wheel rotates faster, these audio clicks can be faster, and when the wheel rotates slower, the audio clicks can be slower. Specific sounds and volume levels can be user-selectable.
[0172] In another embodiment, tactile feedback proportional to the rotation speed of the wheel UI element may be provided by the computing device.
[0173] Fig.19 19 is a flow diagram of an example process 1900 for interacting with a GUI using a wheel UI element in one or more embodiments. In various approaches, more or fewer operations can be included in process 1900 than those shown and described herein.
[0174] In operation 1902, the computing device displays at least a partial view of a wheel UI element on the GUI. The partial view may be a portion around the circular UI element, such as 30°, 45°, 90°, 180°, 270°, 360°, or some other portion of the circular UI element, for receiving touch input and controlling at least one auxiliary element on the GUI.
[0175] In operation 1904, the computing device displays a position indicator for selecting a position in one or more media content items while displaying a partial view of the wheel UI element. In this way, the timeline, the media content items on the timeline, and the wheel UI element are all displayed on the GUI at the same time. This allows the user to interact with the wheel UI element in various ways to control a certain aspect of the media content items, the timeline, and / or other media content items displayed on the timeline or that can be displayed on the timeline.
[0176] In one or more embodiments, the timeline can be similar in appearance and / or function to Figures 1 to 15 Timeline 121 shown and described in .
[0177] Reference again Fig.19 In operation 1906, the computing device receives a touch input for controlling the wheel UI element. In one embodiment, the touch input can be received via a touch screen display. In addition, the touch screen display can be controlled by a tablet computer or a tablet computing device.
[0178] A touch input may have one or more distinguishable characteristics that can be determined by a computing device when the touch input is received. In some embodiments, the touch input characteristics may be used at least in part to determine a response to the touch input. Some example characteristics include, but are not limited to, the distance between the initial contact point and the last contact point associated with a touch swipe input (e.g., the length of the touch swipe input), the approximate direction of the touch input (e.g., horizontal, vertical, left, right, up, down, or a combination of directions that can be combined into a vector representation having two directions), the pressure of the touch input (which can be measured by a touch screen display capable of detecting touch pressure), the speed of movement of the touch input, the area, portion, and / or element of the GUI visually displayed at the location where the touch input is detected, the number of touch inputs received simultaneously, the number of consecutive touch inputs received within a predetermined time period (double-click, triple-click, etc.), the contact range size of the touch input (palm, finger, stylus), configurable input using a dedicated touch device (e.g., a touch stylus), and the like.
[0179] In operation 1908, in response to the touch input, the computing device animates the rotation of the wheel UI element from the first wheel position to the second wheel position. The rotation is based at least in part on the touch input. In one example, a longer touch input causes a relatively larger rotation of the wheel UI element, while a shorter touch input causes a relatively smaller rotation of the wheel UI element.
[0180] In operation 1910, the computing device animates the movement of a position indicator on a timeline relative to any other media content items displayed along the timeline, the movement being from a first clip position to a second clip position, while animating the rotation of a wheel UI element from a first wheel position to a second wheel position.
[0181] In some approaches, the difference between the first clip position and the second clip position corresponds to the difference between the first wheel position and the second wheel position, eg, the greater the rotation of the wheel, the greater the movement of the current position indicator.
[0182] In one embodiment, the computing device may receive a second touch input (via the GUI, the wheel UI element, and / or elements thereof), and in response to receiving the second touch input, the computing device may clip a portion of at least one media content item positioned along the timeline at a current position indicator corresponding to a second clipping position.
[0183] In another embodiment, portions of one or more media content items may be clipped by moving at least one adjacent media content item in a direction of contraction of the one or more media content items relative to the timeline (towards the portion of the one or more media content items removed by the clipping operation).
[0184] In an alternative embodiment, the portion of one or more media content items may be clipped by extending a portion of at least one adjacent media content item to add additional media content in a direction of contraction of the one or more media content items relative to the timeline.
[0185] In one embodiment, the computing device may receive a second touch input (via the GUI, the wheel UI element, and / or elements thereof), and in response to receiving the second touch input, the computing device may expand the one or more media content items to add additional media content of the one or more media content items from a position of the current position indicator along the timeline corresponding to the second clip position.
[0186] In another embodiment, the computing device may extend the one or more media content items by moving at least one adjacent media content item in a direction of extension of the one or more media content items relative to the timeline.
[0187] In an alternative embodiment, the computing device may extend the one or more media content items by overwriting a portion of at least one adjacent media content item in a direction in which the one or more media content items extend relative to the timeline.
[0188] In various embodiments, based on touch input, rotation of the wheel UI element from a first wheel position to a second wheel position can cause the position indicator to move on the timeline in frame-by-frame increments, thereby allowing the user to increment the video being displayed on the video player one frame at a time to perform precise video editing operations.
[0189] In more embodiments, based on touch input, rotation of the wheel UI element from a first wheel position to a second wheel position can cause the position indicator to move on the timeline in increments on a sub-frame basis, thereby allowing the user to increment a sub-frame of a single frame at a time in the video displayed on the video player for more precise video editing operations, and to be able to manipulate individual frames of the video to add / delete / change its content or content associated with the video frame (for example, one or more audio tracks corresponding to the frame being manipulated).
[0190] Fig. 20 is a flow diagram of an example process 2000 for interacting with a GUI using a wheel UI element in one or more embodiments. In various approaches, more or fewer operations can be included in process 2000 than those shown and described herein.
[0191] In operation 2002, the computing device displays at least a partial view of a wheel UI element on a GUI. The partial view may be a portion around a circular UI element, such as 30°, 45°, 90°, 180°, 270°, 360°, or some other portion of the circular UI element, for receiving touch input and controlling at least one auxiliary element on the GUI.
[0192] In operation 2004, the computing device displays a first media content item among multiple media content items in the content display area of the GUI while displaying a partial view of the wheel UI element. In this way, the available media content items in the content display area of the GUI and the wheel UI element are displayed on the GUI at the same time. This allows the user to interact with the wheel UI element in various ways to control certain aspects of the media content items.
[0193] In operation 2006, the computing device receives a touch input for controlling the wheel UI element. In one embodiment, the touch input can be received via a touch screen display. In addition, the touch screen display can be controlled by a tablet computer or a tablet computing device.
[0194] A touch input may have one or more distinguishable characteristics that can be determined by a computing device when the touch input is received. In some embodiments, the touch input characteristics may be used at least in part to determine a response to the touch input. Some example characteristics include, but are not limited to, the distance between the initial contact point and the last contact point associated with a touch swipe input (e.g., the length of the touch swipe input), the approximate direction of the touch input (e.g., horizontal, vertical, left, right, up, down, or a combination of directions that can be combined into a vector representation having two directions), the pressure of the touch input (which can be measured by a touch screen display capable of detecting touch pressure), the speed of movement of the touch input, the area, portion, and / or element of the GUI visually displayed at the location where the touch input is detected, the number of touch inputs received simultaneously, the number of consecutive touch inputs received within a predetermined time period (double-click, triple-click, etc.), the contact range size of the touch input (palm, finger, stylus), configurable input using a dedicated touch device (e.g., a touch stylus), and the like.
[0195] In operation 2008, in response to the touch input, the computing device animates the rotation of the wheel UI element from the first wheel position to the second wheel position. The rotation is based at least in part on the touch input. In one example, a longer touch input causes a relatively larger rotation of the wheel UI element, while a shorter touch input causes a relatively smaller rotation of the wheel UI element.
[0196] In operation 210, the computing device selects a second media content item corresponding to a second wheel position of the wheel UI element from a plurality of media content items. In other words, the rotation of the wheel UI element causes the selected current media content item to change from one media content item to another media content item. The number of media content items traversed during the rotation of the wheel UI element can be proportional to the degree of rotation of the wheel UI element.
[0197] In operation 2012 , the computing device modifies a content display area of the GUI to transition from displaying a first media content item to displaying a second media content item while animating rotation of the wheel UI element from a first wheel position to a second wheel position.
[0198] Media content items can be displayed in the media content player portion of the GUI (similar to Figure 3 In this way, the wheel UI element can be used to select specific media content displayed in the media content player portion without actively searching and navigating among the available media content items using a series of touch inputs (such as through a menu interface, in a catalog, on a thumbnail display view, in a gallery view, etc.).
[0199] Before receiving a touch input for controlling a wheel UI element, a computing device may receive a first user input that positions the wheel UI element to a first position on the GUI. The first user input may be a drag-and-drop input, a first tap-move-second tap operation, a selection of a menu item, a selection of a UI element configured to allow the wheel UI element to move on the GUI, etc. In response to the first user input, the computing device configures the wheel UI element to respond to subsequent touch inputs based on the first position (and / or one or more characteristics of subsequent touch inputs). This configuration may consider that the wheel UI element moves from one side of the GUI to the other, thereby reversing an input gesture (e.g., for interacting with different thumbs or fingers). In another method, the size of the wheel UI element may be considered in this configuration so that the user can interact with the wheel intuitively and the user can anticipate the final effect of the auxiliary elements of the GUI.
[0200] In one embodiment, one or more characteristics of the wheel UI element may be adjustable by the user through interaction with the GUI or some other input to the computing device. Some example characteristics of the wheel UI element include, but are not limited to, the color of the wheel UI element, the size of the wheel UI element, the position of the wheel UI element on the GUI, the input response direction of the wheel UI element, the sensitivity of the wheel UI element, the number of wheel UI elements displayed on the GUI, the transparency of the wheel UI element, the coverage characteristics of the wheel UI element, the inertia of the wheel UI element, methods for revealing and hiding the wheel UI element, and the portion of the wheel UI element to be displayed on the GUI, etc.
[0201] In one or more embodiments, the rotation of the wheel UI element can cause an audible indication of the rotation to be output. For example, while animating the rotation of the wheel UI element, the computing device can output audio clicks at a frequency proportional to the rotation speed of the wheel UI element. In other words, when the wheel rotates faster, these audio clicks can be faster, and when the wheel rotates slower, the audio clicks can be slower. Specific sounds and volume levels can be user-selectable.
[0202] In another embodiment, tactile feedback proportional to the rotation speed of the wheel UI element may be provided by the computing device.
[0203] User interface elements
[0204] Fig.22A Shown is an example of a selectable and / or informational UI element 2202 that may be associated with a wheel UI element.
[0205] Fig. 22B Shown is an example of a selectable and / or informational UI element 2204 that may be associated with a wheel UI element.
[0206] Fig. 22C An example of a selectable and / or informational UI element 2206 is shown that may be associated with a wheel UI element.
[0207] Fig.22D An example of a selectable and / or informational UI element 2208 is shown that may be associated with a wheel UI element.
[0208] Fig.22E An example of a selectable and / or informational UI element 2210 is shown that may be associated with a wheel UI element.
[0209] Fig.22F Shown is an example of a selectable and / or informational UI element 2212 that may be associated with a wheel UI element.
[0210] Figure 22G An example of a text description UI element associated with wheel UI element 2214 is shown.
[0211] Fig.22H An example of a current position indicator UI element associated with the wheel UI element 2216 is shown.
[0212] Fig.22I Examples of text description UI elements and current position indicator UI elements associated with an isometric and / or three-dimensional display of a wheel UI element 2218 are shown.
[0213] Fig.22J Examples of text description UI elements and current position indicator UI elements associated with an isometric and / or three-dimensional display of a wheel UI element 2220 are shown.
[0214] Figure 22K An example of a text description UI element and a current position indicator UI element associated with the wheel UI element 2222 is shown.
[0215] Figure 22L An example of a text description UI element and a current position indicator UI element associated with the wheel UI element 2224 is shown.
[0216] Figure 22M An example of a text description UI element and a current position indicator UI element associated with the wheel UI element 2226 is shown.
[0217] Fig.22N An example of a text description UI element and a current position indicator UI element associated with the wheel UI element 2228 is shown.
[0218] Fig.22O An example of a text description UI element and a current position indicator UI element associated with the wheel UI element 2230 is shown.
[0219] Figure 22P An example of a text description UI element and a current position indicator UI element associated with the wheel UI element 2232 is shown.
[0220] Figure 22Q An example of a text description UI element and a current position indicator UI element associated with the wheel UI element 2234 is shown.
[0221] Figure 22R Examples of graphical UI elements and current position indicator UI elements associated with wheel UI element 2236 are shown.
[0222] Graphical User Interface
[0223] The present disclosure describes above various GUIs for implementing various features, processes, or workflows. These GUIs can be presented on various electronic devices, including but not limited to laptop computers, desktop computers, computer terminals, television systems, tablet computers, e-book readers, and smart phones. One or more of these electronic devices may include a touch-sensitive surface. The touch-sensitive surface can process multiple simultaneous input points, including processing data related to the pressure, degree, or position of each input point. Such processing can facilitate gestures performed using multiple fingers, including pinching and swiping.
[0224] When the present disclosure refers to "selecting" a user interface element in a GUI, these terms are understood to include clicking or "hovering" over a user interface element with a mouse or other input device, or touching, tapping, or gesturing on a user interface element with one or more fingers or a stylus. A user interface element may be a virtual button, menu, selector, switch, slider, brush, knob, thumbnail, link, icon, radio button, check box, and any other mechanism for receiving input from a user or providing feedback to a user.
[0225] Although Figures 1 to 15 The use of the wheel UI element is shown with respect to a GUI for a particular media editing application, but any application may benefit from using the wheel UI element to receive user input. Some other functions that may use the wheel UI element include, but are not limited to: manual focus of the camera, F-stop adjustment of the camera, image and video parameter adjustment, navigation input for browsing content (web pages, images in a photo library, files in a directory, etc.), adjusting the rotation of images, videos, media, etc., adjusting the size of graphical elements in the GUI, adjusting the size of images, videos, media, etc., moving and / or placing objects in the GUI, pixel-by-pixel adjustment of images / videos, playhead manipulation along a timeline, volume adjustment, and the like.
[0226] privacy
[0227] As described above, one aspect of the present technology is to collect and use data from various sources to improve the delivery of inspiring content or any other content that may be of interest to users. The present disclosure contemplates that in some instances, these collected data may include personal information data that uniquely identifies or can be used to contact or locate a specific person. Such personal information data may include demographic data, location-based data, phone numbers, email addresses, twitter IDs, home addresses, data or records related to the user's health or fitness level (e.g., vital sign measurements, medication information, exercise information), date of birth, or any other identifying information or personal information.
[0228] The present disclosure recognizes that the use of such personal information data in the present technology can be used to benefit users. For example, the personal information data can be used to deliver targeted content that users are more interested in. Therefore, the use of such personal information data enables users to have planned control over the content delivered. In addition, the present disclosure also anticipates other uses of personal information data that benefit users. For example, health and fitness data can be used to provide insights into the user's overall health status, or can be used as positive feedback to individuals who use technology to pursue health goals.
[0229] The disclosure anticipates that entities responsible for the collection, analysis, disclosure, transmission, storage or other purposes of such personal information data will comply with sound privacy policies and / or privacy measures. Specifically, such entities should implement and adhere to the use of privacy policies and measures that are recognized as meeting or exceeding the industry or government requirements for maintaining the privacy and security of personal information data. Such policies should be easy for users to access and should be updated as changes in the collection and / or use of data occur. Personal information from users should be collected for legal and reasonable entity purposes and should not be shared or sold outside these legal purposes. In addition, such collection / sharing should be carried out after receiving the informed consent of the user. In addition, such entities should consider taking any necessary steps to protect and safeguard access to such personal information data, and ensure that other entities with access to personal information data comply with the privacy policies and procedures of other entities. In addition, such entities can subject themselves to third-party assessments to prove that they comply with widely accepted privacy policies and practices. In addition, policies and practices should be adapted to specific types of personal information data collected and / or accessed, and to applicable laws and standards including considerations of special jurisdictions. For example, in the United States, the collection or acquisition of certain health data may be governed by federal and / or state laws, such as the Health Insurance Portability and Accountability Act (HIPAA); while health data in other countries may be subject to other regulations and policies and should be handled accordingly. Therefore, different privacy measures should be advocated for different types of personal data in each country.
[0230] Regardless of the foregoing, the present disclosure also contemplates implementation schemes in which users selectively block the use or access of personal information data. That is, the present disclosure contemplates that hardware elements and / or software elements may be provided to prevent or block access to such personal information data. For example, the technology of the present invention may be configured to allow users to choose to "opt in" or "opt out" to participate in the collection of personal information data at any time during or after registration for the service. In another example, a user may choose not to provide emotion-related data for a target content delivery service. In another example, a user may choose to limit the length of time that emotion-related data is retained, or completely prohibit the development of basic emotional conditions. In addition to providing "opt-in" and "opt-out" options, the present disclosure also contemplates providing notifications related to access or use of personal information. For example, a user may be notified that their personal information data will be accessed when downloading an application, and then the user may be reminded again just before the personal information data is accessed by the application.
[0231] In addition, it is the intention of the present disclosure that personal information data should be managed and processed in a manner that minimizes the risk of unintentional or unauthorized access or use. Once the data is no longer needed, the risk can be minimized by limiting the collection of data and deleting the data. In addition, and when applicable, including in certain health-related applications, data de-identification can be used to protect the privacy of users. De-identification can be facilitated by removing specific identifiers (e.g., date of birth, etc.), controlling the amount or specificity of stored data (e.g., collecting location data at the city level rather than at the address level), controlling how the data is stored (e.g., aggregating data between users), and / or other methods when appropriate.
[0232] Thus, while the present disclosure broadly covers the use of personal information data to implement one or more of the various disclosed embodiments, the present disclosure also contemplates that various embodiments may also be implemented without access to such personal information data. That is, various embodiments of the present technology will not fail to function properly due to the lack of all or a portion of such personal information data. For example, content may be selected and delivered to a user by inferring preferences based on non-personal information data or an absolute minimum amount of personal information, such as content requested by a device associated with the user, other non-personal information available to a content delivery service, or publicly available information.
[0233] Example system architecture
[0234] Fig.21 It is achievable Figures 1 to 202100. The computing device 2100 may include a memory interface 2102, one or more data processors, an image processor, and / or a central processing unit 2104, and a peripheral device interface 2106. The memory interface 2102, one or more processors 2104, and / or the peripheral device interface 2106 may be separate components or may be integrated into one or more integrated circuits. The various components in the computing device 2100 may be coupled via one or more communication buses or signal lines.
[0235] Sensors, devices, and subsystems may be coupled to the peripherals interface 2106 to facilitate multiple functions. For example, a motion sensor 2110, a light sensor 2112, and a proximity sensor 2114 may be coupled to the peripherals interface 2106 to facilitate orientation, lighting, and proximity functions. Other sensors 2116 may also be connected to the peripherals interface 2106, such as a global navigation satellite system (GNSS) (e.g., a GPS receiver), a temperature sensor, a biometric sensor, a magnetometer, or other sensing device to facilitate related functions.
[0236] The camera subsystem 2120 and optical sensor 2122 (e.g., a charge coupled device (CCD) or complementary metal oxide semiconductor (CMOS) optical sensor) may be used to facilitate camera functions, such as recording photos and video clips. The camera subsystem 2120 and optical sensor 2122 may be used to collect images of the user to be used during user authentication, for example, by performing facial recognition analysis.
[0237] Communication functions may be facilitated by one or more wireless communication subsystems 2124, which may include radio frequency receivers and transmitters and / or optical (e.g., infrared) receivers and transmitters. The specific design and implementation of the communication subsystems 2124 may depend on the communication network over which the computing device 2100 is intended to operate. For example, the computing device 2100 may include a device designed to communicate over a GSM network, a GPRS network, an EDGE network, a Wi-Fi or WiMax network, and a Bluetooth® network. TM Network-operated communication subsystem 2124. Specifically, the wireless communication subsystem 2124 may include a hosting protocol so that the device 100 can be configured as a base station for other wireless devices.
[0238] The audio subsystem 2126 can be coupled to a speaker 2128 and a microphone 2130 to facilitate voice-enabled functions such as speaker identification, voice replication, digital recording, and telephone functions. For example, the audio subsystem 2126 can be configured to facilitate processing voice commands, voiceprints, and voice authentication.
[0239] I / O subsystem 2140 may include touch surface controller 2142 and / or other input controller 2144. Touch surface controller 2142 may be coupled to touch surface 2146. Touch surface 2146 and touch surface controller 2142 may detect contact and movement or interruption thereof, for example, using any of a variety of touch-sensitive technologies, including but not limited to capacitive, resistive, infrared, and surface acoustic wave technologies, as well as other proximity sensor arrays or other elements for determining one or more points of contact with touch surface 2146.
[0240] Other input controllers 2144 may be coupled to other input / control devices 2148, such as one or more buttons, rocker switches, thumb wheels, infrared ports, USB ports, and / or pointer devices such as styluses. One or more buttons (not shown) may include an up / down button for volume control of the speaker 2128 and / or microphone 2130.
[0241] In one implementation, pressing the button for a first duration may unlock the touch surface 2146; and pressing the button for a second duration longer than the first duration may turn the power of the computing device 2100 on or off. Pressing the button for a third duration may activate a voice control or voice command module that enables a user to speak a command into the microphone 2130 to cause the device to execute the spoken command. The user may customize the function of one or more buttons. For example, the touch surface 2146 may also be used to implement virtual or soft buttons and / or a keyboard.
[0242] In some implementations, the computing device 2100 can present recorded audio and / or video files, such as MP3, AAC, and MPEG files. In some implementations, the computing device 2100 can include an iPod, for example. TM MP3 player function.
[0243] The memory interface 2102 may be coupled to the memory 2150. The memory 2150 may include a high-speed random access memory and / or a non-volatile memory, such as one or more magnetic disk storage devices, one or more optical storage devices, and / or a flash memory (e.g., NAND, NOR). The memory 2150 may store an operating system 2152, such as Darwin, RTXC, LINUX, UNIX, OS X, WINDOWS, or an embedded operating system, such as VxWorks.
[0244] The operating system 2152 may include instructions for handling basic system services and for performing hardware-related tasks. In some implementations, the operating system 2152 may be a kernel (e.g., a UNIX kernel). In some implementations, the operating system 2152 may include instructions for providing a wheel UI element. For example, the operating system 2152 may implement the reference Figures 1 to 20 Describes the wheel UI element characteristics.
[0245] The memory 2150 may also store communication instructions 2154 that facilitate communication with one or more additional devices, one or more computers, and / or one or more servers. The memory 2150 may include graphical user interface instructions 2156 that facilitate graphical user interface processing; sensor processing instructions 2158 that facilitate sensor-related processing and functions; phone instructions 2160 that facilitate phone-related processes and functions; electronic message processing instructions 2162 that facilitate electronic message processing and functions; web browsing instructions 2164 that facilitate web browsing-related processes and functions; media processing instructions 2166 that facilitate media processing-related processes and functions; GNSS / navigation instructions 2168 that facilitate GNSS and navigation-related processes and instructions; and / or camera instructions 2170 that facilitate camera-related processes and functions.
[0246] The memory 2150 may store software instructions 2172 to facilitate other processes and functions, such as reference Figures 1 to 20 The wheel UI element process and functionality.
[0247] The memory 2150 may also store other software instructions 2174, such as network video instructions that facilitate processes and functions related to network video; and / or network shopping instructions that facilitate processes and functions related to network shopping. In some specific implementations, the media processing instructions 2166 are divided into audio processing instructions and video processing instructions to facilitate processes and functions related to audio processing and processes and functions related to video processing, respectively.
[0248] Each of the instructions and applications identified above may correspond to an instruction set for performing one or more of the functions described above. These instructions need not be implemented as separate software programs, processes, or modules. Memory 2150 may include additional instructions or fewer instructions. In addition, various functions of computing device 2100 may be implemented in hardware and / or software, including in one or more signal processing and / or application specific integrated circuits.
[0249] To assist the Patent Office and any reader of any patent issuing upon this application in interpreting the appended claims, Applicants wish to note that they do not intend for any of the appended claims or claim elements to invoke 35 U.S.C. 112(f) unless the words “means for” or “step for” are expressly used in a particular claim.
Claims
1. A method comprising: displaying a partial view of a carousel user interface (UI) element on a graphical user interface (GUI), wherein the carousel UI element is associated with display of one or more media content items; Receiving a touch swipe input for controlling the wheel UI element; In response to the touch swipe input: Displaying the rotation of the wheel UI element in an animated manner based on the touch swipe input, wherein the rotation of the wheel UI element comprises: (a) rotating the wheel UI element at an initial rotation speed based on the touch swipe input, wherein the wheel UI element continues to rotate after the touch swipe input stops, and (b) after stopping the touch swipe input: reducing the rotation speed of the wheel UI element until the rotation speed of the wheel UI element reaches zero; as well as While displaying the rotation of the wheel UI element in an animated manner, the display of at least one of the one or more media content items is continuously modified, wherein a modification rate for modifying the display of at least one of the one or more media content items corresponds to the rotation speed of the wheel UI element.
2. The method according to claim 1, further comprising: determining an approximate direction of the touch swipe input; as well as Mapping the general direction of the touch swipe input to one of: a clockwise rotation of the wheel UI element or a counterclockwise rotation of the wheel UI element, The animation-displaying the rotation of the wheel UI element includes rotating at least a circular element of the wheel UI element in one of a clockwise direction and a counterclockwise direction based on the mapping operation.
3. The method of claim 1 , wherein reducing the rotation speed of the wheel UI element until the rotation speed of the wheel UI element reaches zero comprises: When a stop sign associated with the one or more media content items is reached while modifying the display of the one or more media content items, the rotation of the wheel UI element is immediately stopped. 4 . The method of claim 1 , wherein reducing the rotation speed of the wheel UI element until the rotation speed of the wheel UI element reaches zero comprises reducing the rotation speed linearly at a constant rate or at a decreasing rate. 5 . The method of claim 1 , wherein reducing the rotational speed of the wheel UI element until the rotational speed of the wheel UI element reaches zero comprises reducing the rotational speed at a decreasing rate.
6. The method of claim 1 , wherein modifying the display of the at least one of the one or more media content items comprises modifying one or more of: image characteristics of the at least one of the one or more media content items; a currently displayed media content item of the one or more media content items; or Audio characteristics associated with the at least one media content item of the one or more media content items.
7. The method according to claim 1, further comprising: While animating the rotation of the wheel UI element, audio clicks are output at a frequency proportional to the rotation speed of the wheel UI element. The method of claim 1 , wherein an extent of the rotation of the wheel UI element is proportional to a length of the touch swipe input.
9. The method of claim 1, wherein one or more characteristics of the wheel UI element are adjustable.
10. A non-transitory computer readable medium comprising instructions that, when executed by one or more hardware processors, cause a set of operations to be performed, the set of operations comprising: displaying a partial view of a carousel user interface (UI) element on a graphical user interface (GUI), wherein the carousel UI element is associated with display of one or more media content items; Receiving a touch swipe input for controlling the wheel UI element; In response to the touch swipe input: Displaying the rotation of the wheel UI element in an animated manner based on the touch swipe input, wherein the rotation of the wheel UI element comprises: (a) rotating the wheel UI element at an initial rotation speed based on the touch swipe input, wherein the wheel UI element continues to rotate after the touch swipe input stops, and (b) after stopping the touch swipe input: reducing the rotation speed of the wheel UI element until the rotation speed of the wheel UI element reaches zero; as well as While displaying the rotation of the wheel UI element in an animated manner, the display of at least one of the one or more media content items is continuously modified, wherein a modification rate for modifying the display of at least one of the one or more media content items corresponds to the rotation speed of the wheel UI element.
11. A system comprising: one or more hardware processors; and The non-transitory computer readable medium of claim 10.
12. A method comprising: Displaying a wheel UI element on a graphical user interface (GUI); While displaying the wheel UI element: presenting an arrangement of one or more media content items; receiving a touch input at a first area of the GUI; and In response to the touch input: determining a distance between: (a) a first location within the GUI associated with the first area of the GUI, and (b) a second location associated with the wheel UI element; selecting a modification to the arrangement of the one or more media content items based on: a) the distance between the first position and the second position, and b) one or more characteristics of the touch input; animating rotation of the wheel UI element from a first wheel position to a second wheel position, the extent of the rotation being based on: a) the distance between the first position and the second position, and b) the one or more characteristics of the touch input; as well as The modification to the arrangement of the one or more media content items is animated while the rotation of the wheel UI element from the first wheel position to the second wheel position is animated.
13. The method of claim 12, wherein the one or more characteristics of the touch input include a length of a swipe motion of the touch input, and wherein the extent of the rotation of the wheel UI element is proportional to the length of the swipe motion.
14. The method of claim 12, wherein the one or more characteristics of the touch input include a length of a swipe motion of the touch input, and wherein: For the same specific length of the swipe motion, as the distance between the first position and the second position increases, the extent of the rotation of the wheel UI element decreases in proportion to the specific length of the swipe motion.
15. The method of claim 12, wherein the one or more characteristics of the touch input include a length of a swipe motion of the touch input, and wherein: For the same specific length of the swipe motion, as the distance between the first position and the second position decreases, the extent of the rotation of the wheel UI element increases in proportion to the specific length of the swipe motion.
16. The method of claim 12, wherein the second position associated with the wheel UI element is associated with a rotation axis of the wheel UI element.
17. The method of claim 12, wherein the second position associated with the wheel UI element is associated with a particular tick mark displayed near an edge of the wheel UI element.
18. The method of claim 12, wherein the one or more characteristics of the touch input are selected from the group consisting of: a distance between an initial contact point and a last contact point associated with the touch input, a general direction of the touch input, a pressure of the touch input, and a moving speed of the touch input.
19. A method according to claim 12, wherein one or more characteristics of the wheel UI element are adjustable, and the one or more characteristics are selected from the group consisting of: the size of the wheel UI element, the position of the wheel UI element on the GUI, the input response direction of the wheel UI element, and the portion of the wheel UI element to be displayed on the GUI.
20. A non-transitory computer readable medium comprising instructions that, when executed by one or more hardware processors, cause performance of the method of claim 12.
21. A system comprising: one or more processors; as well as A non-transitory computer readable medium comprising instructions which, when executed by the one or more processors, cause performance of the method of claim 12.
Citation Information
Patent Citations
Head-Mounted Devices With Head Straps
US20250093910A1