Drag gesture animation

By monitoring the speed and trajectory of the user's drag gestures and applying cubic splines or Bessel functions, the problem of unnatural object movement in touch screen interaction is solved, achieving smooth and controlled static bit movement.

CN112055842BActive Publication Date: 2024-12-06GOOGLE LLC
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN201980029214.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2018-05-08
Filing Date
2019-04-17
Publication Date
2024-12-06
Estimated Expiration
2039-04-17

AI Technical Summary

Technical Problem

In touch screen interaction, object movement caused by user dragging gestures is unnatural, especially when the user's finger speed does not match the predetermined speed, object movement may be disconnected and feels unsmooth.

Method used

By monitoring the object movement speed and trajectory caused by the user, calculate the final speed of the object and select the appropriate cubic spline or Bessel function to smoothly move the object to stationary based on constraints such as maximum acceleration, maximum velocity, and maximum time amount, select the appropriate cubic spline or Bessel function to smoothly move the object to stationary according to constraints such as maximum acceleration, maximum velocity, and maximum amount of time. Location.

Benefits of technology

The smooth and natural feeling of object movement is achieved, allowing developers to create controlled animation effects by controlling maximum acceleration and speed, ensuring that the movement process of the object at rest is controlled and smooth.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112055842B_ABST
    Figure CN112055842B_ABST
Patent Text Reader

Abstract

Methods, systems, and apparatus for animating a drag gesture are disclosed, including a computer program encoded on a computer storage medium. In one aspect, a method includes an action of receiving a user input of dragging a user interface element across a display along a user-induced path. The action further includes moving the user interface element across the display along the user-induced path. The action further includes determining that the user input has ended. The action further includes determining an additional path and a speed for the user interface element to move along the additional path based on the user-induced path and the speed of the user input. The action further includes moving the user interface element along the additional path to a stationary position at the speed determined for the user interface element to move along the additional path.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims the benefit of U.S. Application No. 62 / 668,598, filed May 8, 2018, the contents of which are incorporated herein by reference. Technical Field

[0003] This manual relates to graphical interfaces. Background Art

[0004] A graphical user interface is a user interface that allows a user to interact with an electronic device through graphical icons and visual indicators, rather than solely text-based output, typed command labels, or text navigation. Summary of the invention

[0005] A user interacting with a touch screen may flick an object across the screen using the user's finger. When the user touches the screen, the object may follow the path of the user's finger. Once the user has released his finger from the screen, the device may complete the movement of the object by moving the object to a final resting position at a predetermined speed. If the speed of the user's finger does not match the predetermined speed, the device's movement of the object and the user's movement of the object may appear disconnected and unnatural.

[0006] In order to give the movement of the object controlled by the device a smooth and natural feel, the device can monitor the speed and trajectory of the object movement caused by the user. When the user releases the user's finger from the screen, the device can calculate the speed of the object. The device can use the object speed caused by the end user to select the speed at which the object moves to its resting position. The device can select the object movement characteristics that meet several constraints, such as the maximum acceleration of the object, the maximum speed of the object, and the maximum amount of time the device will move the object to the resting position.

[0007] When the device moves the object to its resting position, the path of the object can be a cubic spline that includes the position of the object when the user releases the user's finger from the screen and the resting position of the object. Other points on the cubic spline may be specific to the type of object being moved. In some cases, the path can be a straight line between the position of the object when the user releases the user's finger from the screen and the resting position.

[0008] The velocity of the object when the device moves the object to the stationary position may correspond to a cubic Bessel function. The initial device-controlled velocity of the object may be the velocity caused by the end user, and the final device-controlled velocity may be zero. The device may select a cubic Bessel function that conforms to the maximum acceleration of the object, the maximum velocity of the object, and the maximum amount of time the device moves the object to the stationary position. The device then moves the object along the selected path at the selected velocity.

[0009] According to innovative aspects of the subject matter described in the present application, a method of animating a drag gesture includes the following actions: receiving, by a computing device including a display, user input to drag a user interface element across the display along a user-induced path; moving, by the computing device, the user interface element across the display along the user-induced path; determining, by the computing device, that the user input has ended; in response to determining that the user input has ended, determining an additional path and a speed for the user interface element to move along the additional path based on: (i) the user-induced path, and (ii) the speed of the user input; and moving, by the computing device, the user interface element to a stationary position along the additional path at the speed determined for the user interface element to move along the additional path.

[0010] These and other embodiments may optionally include one or more of the following features. The action further includes determining the position of the user interface element when the user input ends. The action of determining the additional path and the speed at which the user interface element moves along the additional path is based on the position of the user interface element when the user input ends. The action of determining the additional path and the speed at which the user interface element moves along the additional path includes selecting the additional path and the speed from a predetermined path and speed group. The action further includes determining a user interface element type of the user interface element. The action of determining the additional path and the speed at which the user interface element moves along the additional path is based on the user interface element type of the user interface element.

[0011] The actions further include: receiving, by the computing device, additional user input that drags an additional user interface element along a user-induced path across a display; moving, by the computing device, the additional user interface element along the user-induced path across the display; determining, by the computing device, that the additional user input has ended; determining that the additional user interface element is a different user interface element type; in response to determining that the additional user input has ended, determining an additional path and different speeds for user interface element movement along the additional path based on: (i) the user-induced path, (ii) the speed of the additional user input, and (iii) that the additional user interface element is a different user interface element type; and moving, by the computing device, the additional user interface element to a stationary position along the additional path at the different speeds at which the user interface element moves along the additional path. The actions of determining the additional path and the speed for user interface element movement along the additional path include determining the stationary position based on the user-induced path and the speed of the user input. The actions further include determining that a distance of the user-induced path does not satisfy a threshold distance; and determining that the stationary position is an original position of the user interface element based on determining that the distance of the user-induced path does not satisfy the threshold distance.

[0012] The action further includes determining that a distance of the user-induced path satisfies a threshold distance; and based on determining that the distance of the user-induced path satisfies the threshold distance, determining that the resting position is a position other than the original position of the user interface element. The action of determining an additional path and an additional speed for the user interface element to move along the additional path is further based on a maximum acceleration of the user interface element, a maximum speed of the user interface element, and a maximum time to move the user interface element along the additional path to the resting position. The additional path corresponds to a cubic spline that includes the resting position and the position of the user interface element when the user input ends. The speed corresponds to a cubic Bezier easing function. The action further includes determining a speed of the user input when the user input has ended. The user-induced path is along a path fixed by the computing device.

[0013] According to another innovative aspect of the subject matter described in the present application, a method for animating a drag gesture includes the following actions: displaying, by a computing device, a user interface element in a first position on a graphical user interface of the computing device; in response to receiving, by the computing device, a user input that starts at the first position and moves along a first trajectory, moving the user interface element along the first trajectory; and in response to termination of the user input at a second position: determining, by the computing device, an initial velocity of the user interface element at the second position; determining, by the computing device, a second trajectory of the user interface element that starts at the second position and is based at least in part on the determined initial velocity of the user interface element; and moving, by the computing device, the user interface element along the second trajectory.

[0014] These and other embodiments may optionally include one or more of the following features. The second trajectory is based at least in part on one or more predetermined parameters. The predetermined parameters include one or more of the following: a maximum velocity of the user interface element, a maximum acceleration rate of the user interface element, and a maximum time of the second trajectory. The action further includes determining a third position on the graphical user interface, and terminating the second trajectory at the third position. The action of determining the second trajectory includes determining a distance to the third position, calculating a deceleration rate required to reduce the initial velocity to zero within the determined distance, and if the calculated deceleration rate is greater than or equal to the maximum acceleration rate, applying a deceleration to the user interface element at the calculated rate. The action of determining the second trajectory further includes: if the calculated deceleration rate is less than the maximum acceleration rate: calculating a peak velocity so that an initial acceleration from the initial velocity to the peak velocity at the maximum acceleration rate followed by a deceleration from the peak velocity to zero at the maximum acceleration rate will reach zero at the third position; and if the peak velocity is less than or equal to the maximum velocity, applying an initial acceleration from the initial velocity to the peak velocity at the maximum acceleration rate, and applying a deceleration from the peak velocity to zero at the maximum acceleration rate.

[0015] The action of determining the second trajectory includes: if the peak rate is greater than the maximum rate, applying an initial acceleration from the initial rate to the maximum rate at the maximum acceleration rate, maintaining the maximum rate for the intermediate distance, and applying a deceleration from the peak rate to zero at the maximum acceleration rate. The intermediate distance is calculated so that the deceleration from the peak rate to zero at the maximum acceleration rate will reach zero at the third position. The action of determining the second trajectory includes: if the initial rate is in a direction away from the third position, applying a first deceleration from the initial rate to zero at the maximum acceleration rate before applying the initial acceleration from zero. If the distance between the first position and the second position is below the threshold distance, determining that the third position is located at the first position. Moving the user interface element along the first trajectory includes: calculating an anchor point based on the position of the user input; and moving one or more points of the user interface element along a corresponding cubic spline based on the anchor point using a cubic Bezier easing function.

[0016] Other embodiments of this aspect include corresponding systems, apparatus, and computer programs recorded on computer storage devices, each configured to perform the operations of the described methods.

[0017] The subject matter described in this application can have one or more of the following advantages. A computing device can move an object to a stationary position in a controlled and smooth manner. A developer creating animations for different objects moved by a device can create smooth animations by specifying the maximum acceleration and velocity of the object controlled by the device and the maximum time of the device-controlled movement of the object. With these constraints, the device can determine a cubic Bessel function of the object's velocity that moves the object to a stationary position in a controlled manner.

[0018] The details of one or more implementations of the subject matter described in this specification are set forth in the accompanying drawings and the description below. Other features, aspects, and advantages of the subject matter will become apparent from the description, drawings, and claims. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 Illustration of a sample interface for animating and completing a drag gesture.

[0020] Figure 2 Illustrate an example system for animating and completing a drag gesture.

[0021] Figure 3 Illustrate an example process for animating and completing a drag gesture.

[0022] Figure 4 Examples of computing devices and mobile computing devices are illustrated.

[0023] In the drawings, like reference numerals refer to corresponding parts throughout. DETAILED DESCRIPTION

[0024] Figure 1 An example interface for animating and completing a drag gesture is illustrated. Briefly, and as described in more detail below, a user is interacting with a computing device 100 that includes a touch screen 106. The user uses the user's hand 102 to move an icon 104 from a location 108 to a location 110. The computing device 100 may constrain the icon to the edge of the touch screen 106. In this case, the computing device may move the icon 104 from the location 110 to the location 112 in a smooth and controlled manner that matches the movement of the user's hand 102. Figure 1 Some indicia of may include letters (e.g., a, b, c, etc.) and may represent different instances of the same object at different times. For example, 100a and 100b both represent the same computing device, which may be referred to as computing device 100, computing device 100a, or computing device 100b. As another example, finger 102a and finger 102b may represent the same finger at different points in time.

[0025] Computing device 100 may be a phone, tablet, smartwatch, laptop, desktop computer, or any other type of computing device with a display. A user may interact with the computing device via touch screen 106, a mouse, a stylus, or any other type of pointing device. Figure 1 In the example shown, the user interacts with the computing device 100 by touching the touch screen 106. The computing device 100 can display several icons on the touch screen 106. For example, the computing device 100 can include a browser icon, an email icon, a phone icon, a calendar icon, a contact and a map icon 104. The icons displayed on the touch screen 106 form part of the graphical user interface displayed by the computing device 100. These icons are examples of user interface elements. The user can select an icon to open a corresponding application. The computing device 100 can limit the placement of icons to the periphery of the touch screen 106, so that the interior of the touch screen 106 remains open for the user to view the open applications.

[0026] The map icon 104a may be located at a location 108 on the touch screen 106. The location 108 may be referred to as a first location of the map icon 104a. The user may wish to move the map icon 104a from the location 108 to a location 112. The user may touch the touch screen 106a at the location 108 with a finger 102a to initiate the movement of the map icon 104a. The user may drag the finger 102a along the path 112 and release the finger 102b from the screen at the location 110. The location 110 may be referred to as a second location of the map icon 104a. When the user drags the finger 102 along the path 112, the computing device 100a may respond by moving the map icon 104a along the path 112 as the user moves the finger 102. The movement of the finger 102a along the path 112 may be referred to as a first trajectory.

[0027] Computing device 100a can calculate speed 116 of finger movement along path 112, distance 114 of path 112, direction 115 of path 112, and acceleration 118 of finger movement along path 112. Computing device 100 can determine that location 112 is a stationary location of map icon 104b based on speed 116, distance 114, direction 115, and acceleration 118. For example, because computing device 100a may limit the placement of icons to the periphery of touch screen 106a, computing device 100a can determine that direction 115 is toward location 112, and distance 114 is greater than a threshold distance to initiate movement from location 108 to location 112. Location 112 can be a third location called map icon 104a. As another example, in the case where speed 116 is large, computing device 100a can compare distance 114 with a lower threshold distance. A greater speed 116 may indicate a greater likelihood that the user intends to move the map icon 104a from the location 108 to the location 112, so the computing device 100a may compare the distance 114 to a lower threshold distance.

[0028] The computing device 100b may generate a path 120 for the map icon 104b using one or more of the speed 116, the distance 114, the acceleration 118, and the direction 115. Based on one or more of the speed 116, the distance 114, the acceleration 118, and the direction 115, the computing device 100b may generate a speed 126 and an acceleration 124. The generated motion for the map icon 104b along the path 120 may be referred to as a second trajectory. The computing device 100b may calculate the speed 126 and the acceleration 124 to comply with one or more time, speed, and acceleration constraints. For example, the computing device 100b may set a limit of 200 milliseconds for the map icon 104b to move from the location 110 to the location 112. The computing device 100b may also set limits for the speed 126 and the acceleration 124. The computing device 100b calculates the speed 126 and the acceleration 124 that satisfy the time, speed, and acceleration constraints. In some implementations, time, acceleration, and speed limits may be set by the developer of the corresponding application, and each type of graphical element that a user may manipulate may have different time and speed limits.

[0029] In some embodiments, when calculating the speed 126 and the acceleration 124, the computing device 100b may select from predetermined speeds and accelerations. For example, the computing device 100b may have six predetermined speeds and accelerations, and each may be ranked according to preferences that may be set by a developer. The computing device 100b may apply the distance 122 and the time limit of the path 120 to a first speed and acceleration of the predetermined speeds and accelerations. If the first speed and acceleration can meet the time limit, the computing device 100b may select the first speed and acceleration as the speed 126 and acceleration 124 of the path 120. If the first speed and acceleration do not meet the time limit, the computing device 100b may compare additional speeds and accelerations until a speed and acceleration that meets the time limit is identified.

[0030] In some implementations, the speed 116 of the icon 104b when the user removes the finger 102b from the display 106a may also be a factor in determining the speed and acceleration of the path 120. For example, the computing device 100b may determine the speed of the map icon 104b at the location 110 as the initial speed 126. If the speed of the map icon 104b at the location 110 is within the speed limit, the computing device 100b may calculate the acceleration to meet the time limit for the map icon 104b to stop at the location 112. In some implementations, the computing device 100b may apply the speed 116 of the map icon 104b at the location 110 to the predetermined speed and acceleration. The computing device 100b may identify the speed and acceleration that meet the time limit, where the speed is closest to the speed 116 of the map icon 104b at the location 110.

[0031] In some implementations, computing device 100b may move the map icon without jerkiness or at a constant acceleration. In this case, computing device 100b may calculate acceleration 124 based on distance 122 and velocity 116 of map icon 104b at location 110. Acceleration 124 may cause the velocity of map icon 104c to be zero at location 112. In this case, if the value of acceleration 124 is negative, then acceleration 124 may be equivalently referred to as deceleration or negative acceleration.

[0032] In some embodiments, different types of graphical elements may have different speed and acceleration limits. For example, a larger icon may have a lower acceleration limit than a smaller icon to give the user the impression that the larger icon is more difficult to move. Smaller icons may appear brighter and have a higher acceleration limit. The map icon 104 may have a higher acceleration and speed limit than the drop-down menu.

[0033] In the above example, map icon 104 can be located in different places around display 106. Map icon 104 can be located at position 108, position 112, or other positions around the perimeter of display 106. Other user interface elements may be limited to two positions. For example, a drop-down menu may be limited to two positions. The first position may be closed and not on display 106. The second position may be open. The user can open the drop-down menu by swiping the user's finger 102 up or down from the edge of display 106.

[0034] The user drags the open menu from the edge of the display 106. The computing device 100 calculates the distance the user's finger 102 has moved across the display 106 and the speed at which the user's finger 102 was traveling when the user removed the user's finger 102 from the display 106.

[0035] The computing device 100 determines whether to open the menu based on the user's movement. The computing device 100 calculates a distance threshold based on the speed of the user's finger 102. If the distance of the user's finger 102 exceeds the distance threshold, the computing device 100 opens the drop-down menu. A higher speed may correspond to a lower distance threshold. If the user's finger moves at 10 centimeters per second, the distance threshold may be 2 centimeters. If the user's finger moves at 3 centimeters per second, the distance threshold may be 4 centimeters. In some embodiments, the distance threshold may be a percentage of the total distance that the drop-down menu is used to open. For example, if the user's finger moves at three centimeters per second, the distance threshold may be fifty percent of the full-open distance, or if the user's finger moves at ten centimeters per second, the distance threshold may be twenty percent of the full-open distance.

[0036] If the distance of the user's movement is greater than the distance threshold, the computing device 102 opens the menu. The computing device 102 accesses the motion parameters of the drop-down menu. The parameters may include the maximum time for the computing device 102 to complete the menu opening and the maximum acceleration of the drop-down menu. The computing device 102 may select from several different movements to complete the menu opening. The movements may be ranked so that the computing device 102 selects the highest ranked movement that meets the maximum time and maximum acceleration parameters. Each predetermined movement may include different segments. The initial segment may be a deceleration segment, followed by a constant speed segment, and then another deceleration segment. In the case where the maximum time constraint may require the computing device 102 to increase the menu speed from the final speed when the user removes the user's finger, the initial segment may be an acceleration segment.

[0037] In some embodiments, computing device 102 can calculate a menu speed for completing menu opening by applying motion parameters to the calculated speed and the remaining distance. Computing device 102 can calculate the acceleration of the menu given the following: (i) the speed of the user's finger when the user removes the user's finger from display 106, which is also the menu speed; (ii) the remaining distance for the menu to open; and (iii) the requirement that the menu speed is zero when the menu reaches the opening point. If the calculated acceleration is less than the maximum acceleration, computing device 102 decelerates the menu from the speed of the menu when the user removes the user's finger to zero while opening the menu. Such calculations in which the acceleration is constant may be useful in situations where the developer wishes to minimize jerkiness.

[0038] If the distance of the user's movement is less than the distance threshold, computing device 102 closes the menu. The movement of the menu closing may be similar to the movement of opening the menu. Computing device 102 can calculate the speed of the menu when the user removes the user's finger and the distance the user moves the menu. Computing device 102 can use these two parameters and apply them to the acceleration and time constraints of the menu. Computing device 102 can select a predetermined motion curve based on the speed of the menu, the distance traveled, the maximum acceleration, and the maximum time. In some embodiments, computing device 102 can continue to move the menu in the opening direction before returning the menu to the closed position to slow the menu to a stop. In the case where the menu may be moving quickly when the user removes the user's finger, this operation may provide the appearance of a smooth closure.

[0039] In some embodiments, the user may use a double-click or double-tap to open an application. For example, the user may double-tap the map icon 104 to open a map application. In some embodiments, the user may move the map icon 104 in two dimensions. In some embodiments, the computing device 102 may limit the static positions of the map icon 104 and other user interface elements to positions on a fixed grid. In some embodiments, more than one icon or user interface element may not occupy the same position on the display 106 or in a fixed grid. In the case where the user gestures to an icon to occupy the same position as another icon, the computing device 102 may use various criteria to find different static positions for the icon.

[0040] Figure 2 An example system 200 for animating and completing a drag gesture is illustrated. Briefly, and as described in more detail below, the system 200 detects a user moving a user interface element across a display 205 of the system 200. Through the user movement of the user interface element, the user can move the user interface element toward a resting position without moving the user interface element all the way to the resting position. The system 200 completes the movement of the user interface element to the resting position in a controlled and smooth manner that is an extension of the user movement.

[0041] System 200 includes a display 205 in communication with an input device 210 and a graphical interface generator. The graphical interface generator 215 can generate a graphical user interface for display on the display 205. The graphical interface generator 215 can generate various user interface elements to provide to the display 205. A user can interact with the user interface elements through the input device 210. The user interface elements can be icons, menus, windows, or any other type of object that a user can move. The input device can be a touch screen, a mouse, a stylus, or any other type of similar input device.

[0042] System 200 includes a path detector 220, which is configured to detect the path along which the user moves the user interface element. Some user interface elements may have paths that are limited by system 200. For example, system 200 may limit the path of a drop-down menu. System 200 may limit the menu to only travel up and down on display 205 in a path parallel to the edge of display 205. Other user interface elements such as icons may not have a limited path. For example, the user may be able to move an icon around display 205 along a circular path. In some examples, the user interface element may accurately track the determined movement of the user input before release, while in other examples, the user input may substantially track the determined movement of the user input before release.

[0043] System 200 includes a speed detector 225 that is configured to detect the speed of a user interface element as the user moves the user interface element around display 205. In some implementations, system 200 can limit the speed at which a user can move a user interface element. For example, system 200 can limit the speed of a larger user interface element to provide the illusion that the larger user interface element is "heavier." In this case, system 200 may not limit the speed of smaller user interface elements or provide a higher maximum speed for smaller user interface elements. In some implementations, system 200 may not limit the speed at which a user can move any user interface element.

[0044] The system includes an acceleration detector 230 that is configured to detect acceleration of a user interface element as the user moves the user interface element around the display 205. In some embodiments, the system 200 can limit the acceleration at which the user can change the speed of the user interface element. For example, the system 200 can limit the acceleration of larger user interface elements to provide the illusion that the larger user interface element is "heavier." In this case, the system 200 may not limit the acceleration of smaller user interface elements or provide a higher maximum speed for smaller user interface elements. In some embodiments, the system 200 may not limit the acceleration at which the user can change the speed of any user interface element.

[0045] The path detector 220 is also configured to detect the point at which the user input stops. In some embodiments, the stop of the user input can be a trigger for the path detector 220 to provide data identifying the detected path, detected speed, and detected acceleration to the next stage of the system 200.

[0046] The next stage of system 200 includes a threshold comparator 235 that is configured to determine whether system 200 should move the user interface element back to the original location before the user interacted with the user interface element, or whether system 200 should move the user interface element to a new resting location. Threshold comparator 235 communicates with resting location identifier 240 and user interface element type identifier 245 to determine where to move the user interface element.

[0047] The user interface element type identifier 245 compares the user interface element with the user interface element type storage 250 and identifies the type of the user interface element manipulated by the user. The static position identifier 240 can identify the static position of the user interface element based on the user element interface type. For example, a drop-down menu may have a static position. The static position may be a menu at the shown position. The original position of the drop-down menu may be hidden. As another example, an icon may have multiple possible static positions and the original position where the icon was located before the user interacted with the icon.

[0048] In some embodiments, the static position identifier 240 can use the identified path, speed, and acceleration to identify the static position. The static position identifier can infer the path based on the speed and direction of the path when the user input stops. For example, the user may be moving the user interface element toward the corner of the display 205 at a speed of ten centimeters per second. Based on this speed, the static position identifier 240 can determine that the static position of the user interface element is the corner of the display 205. As another example, the user may move the user interface element toward the corner of the display 205 at one centimeter per second. Based on this speed, the static position identifier 240 can determine that the static position of the user interface element is one centimeter farther along the path inferred from the user's path. As another example, the user may be moving the user interface element toward the corner of the display 205 at a speed of one centimeter per second. The length of the path caused by the user is five millimeters. Based on these parameters, the static position identifier 240 can determine that the static position of the user interface element is the original position of the user interface element before the user moves the user interface element.

[0049] Threshold comparator 235 determines whether the user has moved the user interface element beyond a threshold distance such that system 200 should move the user interface element to a stationary position rather than returning to the original position. Threshold comparator 235 may use the original position of the user interface element, the identified stationary position of the user interface element, the distance of the path caused by the user, and the remaining distance to the stationary position. Threshold comparator 235 may access the threshold distance stored in threshold distance storage 255. If threshold comparator 235 determines that the length of the path caused by the user is greater than the threshold distance, system 200 moves the user interface element to the stationary position. If threshold comparator 235 determines that the length of the path caused by the user is less than the threshold distance, system 200 moves the user interface element back to the stationary position.

[0050] In some embodiments, the threshold comparator 235 can adjust the threshold distance based on the speed of the user interface element. For example, if the user-induced speed of the user interface element is ten centimeters per second, the threshold distance can be one centimeter. If the user-induced speed of the user interface element is one centimeter per second, the threshold distance can be five centimeters.

[0051] In some implementations, the threshold distance can be based on a ratio of the distance between the original position and the resting position. For example, the threshold distance can be half the distance between the resting position and the original position. If the distance of the path caused by the user is less than half the distance between the resting position and the original position, the system 200 moves the user interface element back to the original position. If the distance of the path caused by the user is greater than half the distance between the resting position and the original position, the system 200 moves the user interface element to the resting position.

[0052] System 200 proceeds to the next stage to determine the path along which the system will move the user interface element. The next stage includes path calculator 260, velocity calculator 265, and acceleration calculator 270. Path calculator 260 is configured to calculate the path along which system 200 moves the user interface element. Velocity calculator 265 is configured to calculate the velocity of the user interface element as system 200 moves the user interface element along the calculated path. Acceleration calculator 270 is configured to calculate the acceleration of the user interface element as system 200 moves the user interface element along the calculated path.

[0053] Path calculator 260 calculates the path along which system 200 moves the user interface element. In the case where system 200 moves the user interface element to a new resting position, the calculated path is the shortest distance between the resting position and the position of the user interface element when the user input stops. In the case where system 200 moves the user interface element to the original position, the calculated path is the shortest distance between the original position and the position of the user interface element when the user input stops. In some embodiments, the path can be curved to move the user interface element around other graphical interface elements on display 205.

[0054] The speed calculator 265 and the acceleration calculator 270 calculate the speed and acceleration of the user interface element for movement along the calculated path based on the speed of the user interface element at the end of the user input, the remaining distance to the stationary position, and the constraints for movement stored in the maximum speed, acceleration, and time storage 275. In some embodiments, the speed calculator 265 and the acceleration calculator 270 apply the maximum amount of time and the maximum acceleration to move the user interface element to the stationary position to the system 200. For example, the speed calculator 265 and the acceleration calculator 270 can calculate a constant acceleration of the user interface element along the calculated path. The initial speed along the calculated path can be the speed of the user interface element at the end of the user input, and the final speed is zero at the stationary position. As long as the time for the system 200 to move the user interface element is less than the maximum time constraint, the acceleration can be constant. In some embodiments, the constraints can also include a maximum speed. The constraints can be defined by one or more predetermined parameters corresponding to one or more of the maximum acceleration, the maximum time, and the maximum speed.

[0055] In some embodiments, the speed calculator 265 and the acceleration calculator 270 can be selected from predetermined speed and acceleration curves. The predetermined speed and acceleration curves can be stored in the speed and acceleration curve storage 280. The speed calculator 265 and the acceleration calculator 270 can apply the speed, maximum time constraint, and maximum acceleration constraint caused by the end user of the user interface element to the predetermined speed and acceleration curve. The predetermined speed and acceleration curves can be ranked so that if a higher ranked curve meets the constraints, the system 200 will select the higher ranked curve. The speed calculator 265 and the acceleration calculator 270 can apply the speed, maximum time constraint, and maximum acceleration constraint caused by the end user of the user interface element to the highest ranked curve. If the highest ranked curve does not meet the constraints, the speed calculator 265 and the acceleration calculator 270 apply the constraints to the next highest ranked curve until a predetermined curve that meets the constraints is found. In some embodiments, there are six predetermined speed and acceleration curves.

[0056] Each predetermined curve may include one or more different segments. Each segment may be selected from an acceleration segment, a constant speed segment, and a deceleration segment. The top-ranked curve may include, for example, an acceleration segment, a constant speed segment, and a deceleration segment. The acceleration segment may include an acceleration from the end-user-induced speed to the maximum speed at a maximum acceleration. The constant speed segment may maintain the speed at the maximum speed. The deceleration segment may include a negative acceleration from the maximum speed to zero at a maximum acceleration. The top-ranked curve may be selected if it satisfies constraints such as a maximum time and if the remaining distance to the stationary position is sufficient to complete the curve.

[0057] The second ranked curve may include only, for example, constant speed segments and deceleration segments. The second ranked curve may be selected if the first ranked curve does not satisfy the constraints. For example, if the velocity induced by the end user is equal to the maximum velocity and the first ranked curve will cause the velocity to exceed the maximum velocity, the second ranked curve may be selected. The constant speed segment may maintain the velocity at the maximum velocity. The deceleration segment may include a negative acceleration from the maximum velocity to zero at the maximum acceleration. The second ranked curve may be selected if it satisfies the constraints such as the maximum time and if the remaining distance to the stationary position is sufficient to complete the curve.

[0058] If the first and second ranked curves do not satisfy the constraints, the third ranked curve may be selected. For example, if the time required for the first ranked curve or the second ranked curve exceeds the maximum time, the second ranked curve may be selected. The second ranked curve may include only, for example, acceleration segments and deceleration segments. The acceleration segment may include an acceleration from the end user caused speed to the peak speed at the maximum acceleration. The deceleration segment may include a negative acceleration from the peak speed to zero at the maximum acceleration. The peak speed is less than or equal to the maximum speed. If the third ranked curve satisfies the constraints such as the maximum time and if the remaining distance to the stationary position is sufficient to complete the curve, the third ranked curve may be selected.

[0059] If the first, second, and third ranked curves do not satisfy the constraints, the fourth ranked curve may be selected. For example, if the time required for the first ranked curve, the second ranked curve, or the third ranked curve exceeds the maximum time, the fourth ranked curve may be selected. The fourth ranked curve may include only, for example, a deceleration segment. The deceleration segment may include a negative acceleration from the peak speed to zero at the maximum acceleration. If the third ranked curve satisfies the constraint of, for example, the maximum time and if the remaining distance to the stationary position is sufficient to complete the curve, the fourth ranked curve may be selected. In some embodiments, the deceleration segment may include a negative acceleration from the peak speed to zero at an acceleration rate higher than the maximum acceleration so as to satisfy one or both of the maximum time constraint and the remaining distance to the stationary position.

[0060] If the velocity caused by the end user is in a direction away from the resting position, the fifth or sixth ranked curve may be selected. The first and sixth ranked curves may include an additional initial deceleration segment. The initial deceleration segment may include a negative acceleration from the velocity caused by the end user to zero at a maximum acceleration. After the initial deceleration to zero, the fifth and sixth ranked curves include an acceleration towards the resting position. The fifth and sixth ranked curves correspond to the first and third ranked curves, respectively, with an additional initial deceleration segment.

[0061] In some embodiments, constraints such as maximum time to travel along a path and maximum acceleration may be different for each type of user interface element. For example, a drop-down menu may have a maximum time to travel along a path of eight hundred milliseconds, a maximum acceleration of one centimeter per square second, and a maximum speed of five centimeters per second. An icon may have a maximum time to travel along a path of five hundred milliseconds, a maximum acceleration of two centimeters per square second, and a maximum speed of seven centimeters per second.

[0062] In some implementations, the predetermined speed and acceleration curves may be different for each type of user interface element. For example, a drop-down menu may have six predetermined speed and acceleration curves. An icon may have six different predetermined speed and acceleration curves, at least some of which may or may not overlap with the predetermined speed and acceleration curves of the drop-down menu.

[0063] User interface element mover 285 moves the user interface element along the path identified by path calculator 260 at the speed and acceleration identified by speed and acceleration calculators 265 and 270. User interface element mover 285 moves the user interface element and provides the movement data to graphical interface generator 215 for presentation on display 205.

[0064] Figure 3 An example process 300 for animating and completing a drag gesture is illustrated. In general, process 300 receives user input for moving a user interface element across a display. Process 300 completes the movement of the user interface element to a stationary position in a smooth and controlled manner. Process 300 will be described as being performed by a computer system including one or more computers, such as Figure 1 The system 100 shown, or Figure 2 The system 200 shown in FIG.

[0065] The system receives user input that drags a user interface element across a display along a user-induced path (310). For example, a user can use the user's finger to drag a drop-down menu from the top of the display. In some embodiments, the user-induced path is defined by the system, as is the case when a user pulls down a menu. In some embodiments, the user-induced path is a free-form path defined by the user, as is the case when a user moves an icon across a screen. The system moves the user interface element across the display along the user-induced path (320). For example, in response to the user input, the system moves the drop-down menu to follow the user input drag.

[0066] The system determines that the user input has ended (330). For example, the user removes the user's finger from the display. In some embodiments, when the user input ends, the system determines the position of the user interface element. For example, the drop-down menu may be two centimeters from the top of the display. In some embodiments, the system determines the length of the path caused by the user. For example, the system determines that the user moved the drop-down menu two centimeters.

[0067] In response to determining that the user input has ended, the system determines an additional path and additional speed of the user interface element based on (i) the path caused by the user and (ii) the speed of the user input (340). In some embodiments, the system compares the length of the user-induced input to a distance threshold. If the length of the user-induced input meets the distance threshold, the system moves the user interface element to a location different from where the user interface element was originally located. For example, if the user moves the drop-down menu by two centimeters and the distance threshold is one centimeter, the system will open the drop-down menu. If the length of the user-induced input does not meet the distance threshold, the system returns the user interface element to the original location of the user interface element before the user interacted with the user interface element. For example, if the user moves the drop-down menu by two centimeters and the distance threshold is three centimeters, the system will close the drop-down menu.

[0068] In some embodiments, the system determines whether to move the user interface element to the original position or to a position other than the original position based on the speed of the user interface element at the point where the user stops interacting with the user interface and based on the distance the user moves the user interface element. For example, if the user stops moving the user interface element two centimeters after the user moves the user interface element at a speed of one centimeter per second, the system may return the user interface element to the original position. If the user stops moving the user interface element at a speed of three centimeters per second, the system may move the user interface element to a position other than the original position.

[0069] In some implementations, the system determines the additional path and additional velocity of the user interface element based on the position of the user interface element when the user input ends. For example, the system may begin moving a drop-down menu at the position where the drop-down menu was when the user removed the user's finger.

[0070] In some embodiments, the system determines an additional path and additional speed of a user interface element from a predetermined path and speed group. For example, a developer may provide the system with six different predetermined speed curves for the system to use when selecting a predetermined speed curve for a path. In some embodiments, the system may select from different predetermined speed curves depending on the type of user interface element. For example, the system may select from six speed curves for a drop-down menu and from six different speed curves for an icon. In some embodiments, the predetermined path and speed curve move along a cubic spline at a speed based on a cubic Bezier easing function. Each type of user interface element may have a different cubic spline, which may be based on the position of the user interface element when the user input stops. In addition, each type of user interface element may move at a different cubic Bezier easing function speed. In some embodiments, each of the predetermined paths and speeds may correspond to a different cubic spline curve and a different cubic Bezier easing function. In some embodiments, the predetermined path may include an additional path that is an arc.

[0071] In some embodiments, the predefined path and speed profile may be adaptable depending on the type of system. For example, a predefined path and speed profile may be defined for a system with a nine inch diagonal display. For a system with a five inch diagonal display, the system may reduce the size of the predefined path by a ratio of five to nine. For a system with a fifteen inch diagonal display, the system may increase the size of the predefined path by a ratio of fifteen to nine. In any of these examples, the speed profile may be adjusted using a similar ratio, or the speed profile may not be adjusted. In some embodiments, the system may use pixel measurements instead of distance measurements.

[0072] In some embodiments, the predetermined path and speed curve may be adaptable, depending on the window size of the window in which the user is moving the user interface element. For example, a predefined path and speed curve may be defined for a window of ten centimeters by eight centimeters. For a window of twenty centimeters by twenty centimeters, the system may increase the size of the predetermined path by a ratio of one to two or three to five. For a window of six centimeters by six centimeters, the system may reduce the size of the predetermined path by a ratio of five to three or four to three. In any of these examples, the speed curve may be adjusted using a similar ratio, or the speed curve may not be adjusted. In some embodiments, the ratio may be based on the area or perimeter of the window. In some embodiments, the system may use pixel measurements instead of distance or area measurements.

[0073] In some embodiments, the system selects a velocity profile that meets the constraints of time and acceleration. For example, the system selects a velocity profile that causes the user interface element to start at a velocity at which the user input stops, reach a stationary position within the time constraint, and maintain an acceleration below a maximum value. The developer can set the maximum acceleration and time constraints. The predetermined velocity profiles can be ranked. The system can select the highest ranked velocity profile that meets the constraints. In some embodiments, the acceleration of the additional velocity profile is constant. In some embodiments, the additional velocity and the acceleration of the additional velocity are not constant. For example, the velocity can increase in a first portion of the velocity profile, then be constant in a second portion of the velocity profile, and then decrease to zero in a third portion of the velocity profile.

[0074] In some embodiments, the system determines the speed of the user input at the end of the user input. For example, the user quickly moves the user interface element across the display. When the user releases the user's finger from the display, the system will determine the instantaneous speed of the user input. In some embodiments, the speed of the user input can be based on the maximum speed of the user input, the median speed of the user input, the arithmetic mean of the user input, the geometric mean of the user input, or the minimum speed of the user input.

[0075] The system moves the user interface element to a stationary position along an additional path at an additional speed (350). In some embodiments, the user can move the additional user interface element along the same path. In the event that the additional user interface elements are of different types or the user moves the additional user interface elements at different speeds, the system can then select different speeds for the additional user interface elements. If the additional user interface elements are of different types, the additional user interface elements can have different constraints. The speed of the additional user interface elements when controlled by the system may be different because the speed of the additional user interface elements when the user input stops may be different. In some embodiments, the system can add after-effects when the user interface element reaches the stationary position. For example, the system can add a physics-based bounce depending on the user input rate, where the user interface element bounces more for higher user-induced speeds.

[0076] In addition to the above description, controls may be provided to the user that allow the user to select whether and when the systems, programs, or features described herein may enable the collection of information about the user (e.g., information about the user's social network, social actions or activities, profession, the user's preferences, or the user's current location), as well as whether the user is sent content or communications from a server. In addition, certain data may be processed in one or more ways before it is stored or used so that personally identifiable information is removed. For example, the user's identity may be processed so that personally identifiable information cannot be determined for the user, or the user's geographic location may be generalized (such as to a city, zip code, or state level) when location information is obtained so that the user's specific location cannot be determined. Thus, the user may have control over what information is collected about the user, how the information is used, and what information is provided to the user.

[0077] Figure 4 Examples of computing device 400 and mobile computing device 450 that can be used to implement the techniques described herein are shown. Computing device 400 is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. Mobile computing device 450 is intended to represent various forms of mobile devices, such as personal digital assistants, cellular phones, smart phones, and other similar computing devices. The components shown here, their connections and relationships, and their functions are examples only and are not meant to be limiting.

[0078] The computing device 400 includes a processor 402, a memory 404, a storage device 406, a high-speed interface 408 connected to the memory 404 and a plurality of high-speed expansion ports 410, and a low-speed interface 412 connected to a low-speed expansion interface 414 and the storage device 406. Each of the processor 402, the memory 404, the storage device 406, the high-speed interface 408, the high-speed expansion port 410, and the low-speed interface 412 is interconnected by various buses and can be installed on a general motherboard or in other suitable ways. The processor 402 can process instructions for execution within the computing device 400, including instructions stored in the memory 404 or stored on the storage device 406, to display graphical information for a GUI on an external input / output device such as a display 416 coupled to the high-speed interface 408. In other embodiments, multiple processors and / or multiple buses, as well as multiple memories and various types of memories, can be used appropriately. Moreover, multiple computing devices can be connected, each device providing a portion of the necessary operations (for example, as a server group, a blade server group, or a multi-processor system).

[0079] Memory 404 stores information within computing device 400. In some implementations, memory 404 is one or more volatile memory units. In some implementations, memory 404 is one or more non-volatile memory units. Memory 404 may also be another form of computer-readable medium, such as a magnetic disk or optical disk.

[0080] Storage device 406 can provide mass storage for computing device 400. In some embodiments, storage device 406 can be or include computer-readable media, such as floppy disk devices, hard disk devices, optical disk devices, tape devices, flash memory or other similar solid-state memory devices or device arrays, including devices in storage area networks or other configurations. Instructions can be stored in information carriers. When instructions are executed by one or more processing devices (e.g., processor 402), one or more methods, such as those described above, are executed. Instructions can also be stored by one or more storage devices (e.g., memory 404, storage device 406, or memory on processor 402) such as computer-readable or machine-readable media.

[0081] The high-speed interface 408 manages bandwidth-intensive operations for the computing device 400, while the low-speed interface 412 manages less bandwidth-intensive operations. This allocation of functions is merely an example. In some embodiments, the high-speed interface 408 is coupled to the memory 404, the display 416 (e.g., through a graphics processor or accelerator), and is coupled to a high-speed expansion port 410 that can accept various expansion cards. In an embodiment, the low-speed interface 412 is coupled to the storage device 406 and the low-speed expansion port 414. The low-speed expansion port 414, which can include various communication ports (e.g., USB, Bluetooth, Ethernet, wireless Ethernet), can be coupled to one or more input / output devices such as a keyboard, a pointing device, a scanner, or a network device such as a switch or a router, for example, through a network adapter.

[0082] As shown in the figures, computing device 400 can be implemented in a variety of different forms. For example, it can be implemented as a standard server 420, or many times implemented in such a server group. In addition, it can be implemented in a personal computer such as a laptop computer 422. It can also be implemented as part of a rack server system 424. Alternatively, components from computing device 400 can be combined with other components in a mobile device such as mobile computing device 450. Each such device can contain one or more of computing device 400 and mobile computing device 450, and the entire system can be composed of multiple computing devices that communicate with each other.

[0083] The mobile computing device 450 includes a processor 452, a memory 464, an input / output device such as a display 454, a communication interface 466, and a transceiver 468, among other components. The mobile computing device 450 may also be provided with a storage device, such as a micro drive or other device, to provide additional storage. Each of the processor 452, the memory 464, the display 454, the communication interface 466, and the transceiver 468 are interconnected using various buses, and several components may be mounted on a common motherboard or in other suitable ways.

[0084] Processor 452 may execute instructions within mobile computing device 450, including instructions stored in memory 464. Processor 452 may be implemented as a chipset including separate and multiple analog and digital processors. Processor 452 may provide, for example, coordination for other components of mobile computing device 450, such as control of a user interface, applications executed by mobile computing device 450, and wireless communications performed by mobile computing device 450.

[0085] Processor 452 can communicate with a user through control interface 458 and display interface 456 coupled to display 454. Display 454 can be, for example, a TFT (thin film transistor liquid crystal display) display or an OLED (organic light emitting diode) display or other suitable display technology. Display interface 456 may include appropriate circuits for driving display 454 to present graphics and other information to the user. Control interface 458 may receive commands from the user and convert them for submission to processor 452. In addition, external interface 462 may provide communication with processor 452, so as to enable close range communication between mobile computing device 450 and other devices. For example, external interface 462 may be provided for wired communication in some embodiments, or for wireless communication in other embodiments, and multiple interfaces may also be used.

[0086] Memory 464 stores information within mobile computing device 450. Memory 464 may be implemented as one or more of the following: one or more computer-readable media, one or more volatile storage units, or one or more non-volatile storage units. An expansion memory 474 may also be provided and connected to mobile computing device 450 via expansion interface 472, which may include, for example, a SIMM (single in-line memory module) card interface. Expansion memory 474 may provide additional storage space for mobile computing device 450, or may also store applications or other information for mobile computing device 450. Specifically, expansion memory 474 may include instructions for executing or supplementing the above-mentioned processes, and may also include security information. Thus, for example, expansion memory 474 may be configured as a security module for mobile computing device 450, and may be programmed with instructions that allow secure use of mobile computing device 450. In addition, secure applications may be securely provided via a SIMM card, as well as additional information, such as placing identification information on a SIMM card in an inviolable manner.

[0087] The memory may include, for example, flash memory and / or NVRAM memory (non-volatile random access memory), as discussed below. In some embodiments, instructions are stored in an information carrier that, when executed by one or more processing devices (e.g., processor 452), perform one or more methods, such as those described above. The instructions may also be stored by one or more storage devices, such as one or more computer or machine readable media (e.g., memory 464, expansion memory 474, or memory on processor 452). In some embodiments, the instructions may be received, for example, as a propagated signal via transceiver 468 or external interface 462.

[0088] The mobile computing device 450 may communicate wirelessly via a communication interface 466, which may include digital signal processing circuitry, if necessary. The communication interface 466 may provide communications in a variety of modes or protocols, such as GSM voice calls (Global System for Mobile Communications), SMS (Short Message Service), EMS (Enhanced Message Service) or MMS messages (Multimedia Message Service), CDMA (Code Division Multiple Access), TDMA (Time Division Multiple Access), PDC (Personal Digital Cellular), WCDMA (Wideband Code Division Multiple Access), CDMA2000, or GPRS (General Packet Radio Service), etc. For example, such communications may occur using radio frequencies through a transceiver 468. In addition, short-range communications may occur, such as using Bluetooth, WiFi, or other such transceivers. In addition, a GPS (Global Positioning System) receiver module 470 may provide additional navigation and location-related wireless data to the mobile computing device 450, which may be used appropriately by applications running on the mobile computing device 450.

[0089] Mobile computing device 450 may also communicate audibly using audio codec 460, which may receive spoken information from a user and convert it into usable digital information. Audio codec 460 may similarly generate audible sounds for the user, such as through a speaker, for example, in an earpiece of mobile computing device 450. Such sounds may include sounds from voice phone calls, may include recorded sounds (e.g., voice messages, music files, etc.), and may also include sounds generated by applications operating on mobile computing device 450.

[0090] Mobile computing device 450 can be implemented in many different forms, as shown in the drawings. For example, it can be implemented as a cellular phone 480. It can also be implemented as part of a smart phone 482, a personal digital assistant, or other similar mobile devices.

[0091] Various implementations of the systems and techniques described herein can be implemented in digital electronic circuitry, integrated circuitry, specially designed ASICs (application specific integrated circuits), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system that includes at least one programmable processor, which can be special purpose or general purpose, coupled to receive data and instructions from a storage system, at least one input device, and at least one output device, and to transmit data and instructions to the storage system, at least one input device, and at least one output device.

[0092] These computer programs (also referred to as programs, software, software applications or code) include machine instructions for a programmable processor and may be implemented in high-level procedural and / or object-oriented programming languages ​​and / or in assembly / machine language. As used herein, the terms machine-readable medium, computer-readable medium refer to any computer program product, apparatus and / or device (e.g., disk, optical disk, memory, programmable logic device (PLD)) for providing machine instructions and / or data to a programmable processor, including machine-readable media that receive machine instructions as machine-readable signals. The term machine-readable signal refers to any signal for providing machine instructions and / or data to a programmable processor.

[0093] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user, and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other kinds of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form, including sound, voice, or tactile input.

[0094] The systems and techniques described herein can be implemented in a computing system that includes a back-end component (e.g., as a data server), or includes a middleware component (such as an application server), or includes a front-end component (e.g., a client computer with a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described herein), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (LAN), a wide area network (WAN), and the Internet.

[0095] A computing system can include clients and servers. Clients and servers are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.

[0096] Although some embodiments have been described in detail above, other modifications are possible. For example, although the client application is described as accessing the delegate, in other embodiments, the delegate may be employed by other applications implemented by one or more processors, such as applications executed on one or more servers. In addition, the logic flows depicted in the accompanying drawings do not require the specific order or sequential order shown to achieve the desired results. In addition, other actions may be provided from the described flows, or actions may be eliminated, and other components may be added to or removed from the described systems. Therefore, other embodiments are within the scope of the appended claims.

Claims

1. A computer-implemented method comprising: receiving, by a computing device including a display, user input of dragging a user interface element along a user-induced path across the display; moving, by the computing device, the user interface element across the display along a path initiated by the user; determining, by the computing device, that the user input has ended; In response to determining that the user input has ended: ranking, by the computing device, a set of predetermined speed and acceleration profiles based at least in part on a maximum acceleration of the user interface element, a maximum speed of the user interface element, and a maximum time to move the user interface element to a stationary position along an additional path; selecting, by the computing device, the additional path and a speed for the user interface element to move along the additional path to the stationary location from the set of predetermined speed and acceleration profiles and based at least in part on the ranking; The rest position is determined based at least in part on: (i) the path caused by the user, (ii) the additional path, (iii) the type of the user interface element, and (iv) one or more candidate resting locations associated with the type of the user interface element; as well as The user interface element is moved, by the computing device, along the additional path to the stationary position at the speed for movement of the user interface element along the additional path.

2. The method according to claim 1, comprising: determining a position of the user interface element when the user input ends, Wherein determining the stationary position and the speed for moving the user interface element along the additional path is further based on the position of the user interface element when the user input ends.

3. The method according to claim 1, further comprising: receiving, by the computing device, additional user input that drags an additional user interface element across the display along the path induced by the user; moving, by the computing device, the additional user interface element across the display along a path initiated by the user; determining, by the computing device, that the additional user input has ended; determining that the additional user interface element is a different user interface element type; In response to determining that the additional user input has ended, determining the additional path and a different speed for the user interface element to move along the additional path based on: (i) the path caused by the user, (ii) the speed of the additional user input, and (iii) the additional user interface element is of the different user interface element type; as well as The additional user interface element is moved, by the computing device, along the additional path to the stationary position at the different speeds for movement of the user interface element along the additional path.

4. The method according to claim 1, comprising: determining that a distance of the path caused by the user does not satisfy a threshold distance; as well as In response to determining that the distance of the user-induced path does not satisfy a threshold distance, determining that the stationary location is an original location of the user interface element.

5. The method according to claim 1, comprising: Determining that a distance of the path caused by the user satisfies a threshold distance; as well as In response to determining that the distance of the user-induced path satisfies a threshold distance, determining that the stationary location is a location other than an original location of the user interface element.

6. The method according to claim 1, wherein: The additional path corresponds to a cubic spline that includes the static position and the position of the user interface element when the user input ends, and The velocity corresponds to a cubic Bezier easing function.

7. The method according to claim 1, comprising: A velocity of the user input is determined after the user input has ended.

8. The method according to claim 1, wherein: The user-induced path is along a path fixed by the computing device.

9. The method according to claim 1, wherein: The type of the user interface element is one of a drop-down menu or an icon.

10. A computer-implemented method comprising: displaying, by a computing device, a user interface element in a first location on a graphical user interface of the computing device; in response to receiving, by the computing device, a user input starting at the first location and moving on a first trajectory, moving the user interface element along the first trajectory; as well as In response to termination of the user input at the second location: ranking, by the computing device, a set of predetermined speed and acceleration profiles based at least in part on a maximum acceleration of the user interface element, a maximum velocity of the user interface element, and a maximum time to move the user interface element to a stationary position along a second trajectory; selecting, by the computing device, from the set of predetermined velocity and acceleration profiles and based at least in part on the ranking, the second trajectory and a velocity for the user interface element to move along the second trajectory to the stationary position; determining, by the computing device, the resting position of the user interface element based at least in part on one or more candidate resting positions associated with a type of the user interface element and the second trajectory; as well as The user interface element is moved, by the computing device, along the second trajectory.

11. The method according to claim 10, further comprising: determining the distance to the rest position, determining, by the computing device, an initial velocity of the user interface element at the second location, calculating the deceleration rate required to reduce the initial velocity to zero over the determined distance, and If the calculated deceleration rate is greater than or equal to the maximum acceleration rate, deceleration is applied to the user interface element at the calculated rate.

12. The method according to claim 11, further comprising: In response to determining that the calculated deceleration rate is less than the maximum acceleration rate: calculating a peak velocity such that an initial acceleration from the initial velocity to the peak velocity at the maximum acceleration rate followed by a deceleration from the peak velocity to zero at the maximum acceleration rate will reach zero at the stationary position; as well as If the peak rate is less than or equal to the maximum rate, the initial acceleration is applied at the maximum acceleration rate from the initial rate to the peak rate, and the deceleration is applied at the maximum acceleration rate from the peak rate to zero.

13. The method according to claim 12, further comprising: responsive to determining that the peak rate is greater than the maximum rate, applying the initial acceleration at the maximum acceleration rate from the initial rate to the maximum rate, maintaining the maximum rate for an intermediate distance, and applying the deceleration at the maximum acceleration rate from the peak rate to zero; Therein, the intermediate distance is calculated so that the deceleration from the peak velocity to zero at the maximum acceleration rate will reach zero at the stationary position.

14. The method according to claim 12, further comprising: In response to determining that the initial velocity is in the direction from which the stationary position is moving, a first deceleration is applied from the initial velocity to zero at the maximum acceleration rate before applying the initial acceleration from zero.

15. The method according to claim 10, wherein: If the distance between the first position and the second position is below a threshold distance, the stationary location is determined to be located at the first position.

16. The method according to claim 10, wherein: Moving the user interface element along the first trajectory includes: Calculating an anchor point based on the position of the user input; and One or more points of the user interface element are moved along a corresponding cubic spline based on the anchor point using a cubic Bezier easing function.

17. A computer readable medium comprising instructions which, when executed by a processor, cause the processor to perform the method according to any one of claims 1 to 16.

18. A system comprising one or more computers and one or more storage devices storing instructions, which when executed by the one or more computers cause the one or more computers to perform the method according to any one of claims 1 to 16.

Citation Information

Patent Citations

  • Method and system for rendering a sliding object

    US20150029231A1