A method and device for synchronizing tactile and visual feedback

By acquiring the tangential speed of the touch point rotation and controlling the movement of the touch screen in response to the label, the problem of asynchronous touch operation and visual feedback in human-computer interaction is solved, achieving synchronization of tactile and visual feedback and improving the user experience.

CN117043715BActive Publication Date: 2026-11-17BOE TECHNOLOGY GROUP CO LTD +1
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202280000421.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-03-09
Publication Date
2026-11-17
Estimated Expiration
2042-03-09

AI Technical Summary

Technical Problem

In human-computer interaction, when users perform touch operations quickly, the touch operation and visual feedback are easily out of sync, leading to visual delay and stuttering issues, especially in scenarios where virtual knobs are switching states.

Method used

By acquiring the tangential speed of the touch point rotation, the response tags on the touch screen are controlled to move sequentially to keep the tactile feedback and visual feedback synchronized. Dynamic or static visual feedback methods are used to adjust the moving speed and position of the response tags according to the tangential speed to ensure the synchronization of tactile and visual feedback.

Benefits of technology

It achieves synchronization of tactile and visual feedback during rapid user operations, reducing visual latency and stuttering, and improving the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117043715B_ABST
    Figure CN117043715B_ABST
Patent Text Reader

Abstract

This disclosure proposes a method and apparatus for synchronizing tactile and visual feedback, used to control the synchronization of tactile and visual feedback accompanying a user's touch operation, reducing visual feedback latency and avoiding a choppy visual experience. The method includes: acquiring the tangential speed of a touch point rotation, wherein the touch point is generated by a user performing a rotational touch operation within the coverage area of ​​a virtual knob displayed on a touchscreen, the touch operation being accompanied by tactile feedback; and controlling each response label displayed on the touchscreen to move sequentially according to the tangential speed, so that the tactile feedback and the visual feedback formed by the movement of each response label remain synchronized, wherein the step size of each response label's movement corresponds to a preset unit angle, and the number of times each response label moves is determined based on the number of preset unit angles included in the rotation angle of the virtual knob.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This disclosure relates to the field of human-computer interaction technology, and in particular to a method and apparatus for synchronizing tactile and visual feedback. Background Technology

[0002] In the field of human-computer interaction (HCI) technology, users interact with electronic devices through touch operations performed on a touchscreen. After a user performs a touch operation on the touchscreen of an electronic device, the device provides visual feedback by displaying an interface corresponding to that touch operation. Typically, after a user performs a touch operation, a certain amount of feedback time is required for the corresponding interface to display. However, in scenarios where users perform touch operations rapidly, this can easily lead to a lack of synchronization between the touch operation and the visual feedback.

[0003] For example, in some scenarios, users need to control a virtual knob on a touchscreen to switch the current state of the controlled quantity on the virtual knob. However, when the user quickly rotates the virtual knob to switch states, since the feedback time for state switching is usually fixed, the state switching cannot be completed synchronously when the user has finished rotating the virtual knob, resulting in a visual feedback delay, asynchrony, and a choppy visual experience for the user. Summary of the Invention

[0004] This disclosure provides a method and apparatus for synchronizing tactile and visual feedback, used to control the tactile and visual feedback accompanying a user's touch operation to remain synchronized, reduce the delay of visual feedback, and avoid a choppy visual experience.

[0005] In a first aspect, embodiments of this disclosure provide a method for synchronizing tactile and visual feedback, comprising:

[0006] The tangential speed of the rotation of the touch point is obtained. The touch point is generated by the user performing a rotational touch operation within the coverage area of ​​the virtual knob displayed on the touch screen. The touch operation is accompanied by haptic feedback.

[0007] According to the tangential speed, the various response tags displayed on the touch screen are controlled to move sequentially so that the tactile feedback and the visual feedback formed by the movement of each response tag are kept synchronized. The step size of each response tag's movement corresponds to a preset unit angle, and the number of times each response tag moves is determined according to the number of preset unit angles included in the rotation angle of the virtual knob.

[0008] As an optional implementation, it also includes:

[0009] Based on the tangential velocity, the visual feedback time for the target response label to move to the reference position is determined, wherein the target response label is determined based on the response labels displayed at the reference position before each response label moves sequentially and the number of times each response label moves.

[0010] When the visual feedback time is less than or equal to the time threshold, the content of each response label displayed on the touch screen is updated.

[0011] As an optional implementation, controlling the sequential movement of each response label displayed on the touchscreen according to the tangential speed includes:

[0012] When the visual feedback time is greater than the time threshold, the various response labels displayed on the touch screen are controlled to move sequentially according to the tangential speed, wherein the target response label is controlled to move to the reference position.

[0013] As an optional implementation, determining the visual feedback time for the target response label to move to the reference position based on the tangential velocity includes:

[0014] The rotation angle of the virtual knob is determined based on the tangential velocity and the size of the virtual knob.

[0015] Based on the distance between the target response label and the reference position, and the rotation angle, the visual feedback time for the target response label to move to the reference position is determined.

[0016] As an optional implementation, controlling the sequential movement of each response label displayed on the touchscreen according to the tangential speed includes:

[0017] The movement trajectory of each response label is determined based on the step size and number of times each response label moves;

[0018] For each response tag's movement trajectory, perform the following steps:

[0019] Interpolation is performed on the movement trajectory of the response tag to obtain the points passed by the response tag during its movement; based on the tangential velocity, the response tag is controlled to move sequentially to each point.

[0020] As an optional implementation, controlling the sequential movement of each response label displayed on the touchscreen according to the tangential speed includes:

[0021] The tangential velocity is used as the moving speed to control the various response labels displayed on the touch screen to move sequentially at a uniform speed.

[0022] As an optional implementation, controlling the sequential movement of each response label displayed on the touchscreen according to the tangential speed includes:

[0023] Obtain the rotation direction of the touch point, and determine the movement direction of each response label displayed on the touch screen based on the rotation direction;

[0024] Based on the tangential speed and the direction of movement, the various response labels displayed on the touch screen are controlled to move sequentially.

[0025] As an optional implementation method,

[0026] The response tags are arranged sequentially along the vertical axis; or,

[0027] The response tags are arranged sequentially along the horizontal axis; or,

[0028] The various response labels are arranged and displayed around the virtual knob.

[0029] Secondly, an embodiment of this disclosure provides a device for synchronizing tactile and visual feedback, comprising:

[0030] The speed acquisition unit is used to acquire the tangential speed of the touch point rotation. The touch point is generated by the user performing a rotational touch operation within the coverage area of ​​the virtual knob displayed on the touch screen. The touch operation is accompanied by haptic feedback.

[0031] A control movement unit is used to control the sequential movement of each response label displayed on the touch screen according to the tangential speed, so that the tactile feedback and the visual feedback formed by the movement of each response label are kept synchronized. The step size of each response label's movement corresponds to a preset unit angle, and the number of times each response label moves is determined according to the number of preset unit angles included in the rotation angle of the virtual knob.

[0032] As an optional implementation, the content update unit is also included for:

[0033] Based on the tangential velocity, the visual feedback time for the target response label to move to the reference position is determined, wherein the target response label is determined based on the response labels displayed at the reference position before each response label moves sequentially and the number of times each response label moves.

[0034] When the visual feedback time is less than or equal to the time threshold, the content of each response label displayed on the touch screen is updated.

[0035] As an optional implementation, the control movement unit is specifically used for:

[0036] When the visual feedback time is greater than the time threshold, the various response labels displayed on the touch screen are controlled to move sequentially according to the tangential speed, wherein the target response label is controlled to move to the reference position.

[0037] As an optional implementation, the update content unit is used for:

[0038] The rotation angle of the virtual knob is determined based on the tangential velocity and the size of the virtual knob.

[0039] Based on the distance between the target response label and the reference position, and the rotation angle, the visual feedback time for the target response label to move to the reference position is determined.

[0040] As an optional implementation, the control movement unit is specifically used for:

[0041] The movement trajectory of each response label is determined based on the step size and number of times each response label moves;

[0042] For each response tag's movement trajectory, perform the following steps:

[0043] Interpolation is performed on the movement trajectory of the response tag to obtain the points passed by the response tag during its movement; based on the tangential velocity, the response tag is controlled to move sequentially to each point.

[0044] As an optional implementation, the control movement unit is specifically used for:

[0045] The tangential velocity is used as the moving speed to control the various response labels displayed on the touch screen to move sequentially at a uniform speed.

[0046] As an optional implementation, the control movement unit is specifically used for:

[0047] Obtain the rotation direction of the touch point, and determine the movement direction of each response label displayed on the touch screen based on the rotation direction;

[0048] Based on the tangential speed and the direction of movement, the various response labels displayed on the touch screen are controlled to move sequentially.

[0049] As an optional implementation method,

[0050] The response tags are arranged sequentially along the vertical axis; or,

[0051] The response tags are arranged sequentially along the horizontal axis; or,

[0052] The various response labels are arranged and displayed around the virtual knob.

[0053] Thirdly, embodiments of this disclosure also provide a device for synchronizing tactile and visual feedback, the device including a processor and a memory, the memory for storing a program executable by the processor, the processor for reading the program in the memory and performing the following steps:

[0054] The tangential speed of the rotation of the touch point is obtained. The touch point is generated by the user performing a rotational touch operation within the coverage area of ​​the virtual knob displayed on the touch screen. The touch operation is accompanied by haptic feedback.

[0055] According to the tangential speed, the various response tags displayed on the touch screen are controlled to move sequentially so that the tactile feedback and the visual feedback formed by the movement of each response tag are kept synchronized. The step size of each response tag's movement corresponds to a preset unit angle, and the number of times each response tag moves is determined according to the number of preset unit angles included in the rotation angle of the virtual knob.

[0056] As an optional implementation, the processor is further configured to execute:

[0057] Based on the tangential velocity, the visual feedback time for the target response label to move to the reference position is determined, wherein the target response label is determined based on the response labels displayed at the reference position before each response label moves sequentially and the number of times each response label moves.

[0058] When the visual feedback time is less than or equal to the time threshold, the content of each response label displayed on the touch screen is updated.

[0059] As an optional implementation, the processor is specifically configured to execute:

[0060] When the visual feedback time is greater than the time threshold, the various response labels displayed on the touch screen are controlled to move sequentially according to the tangential speed, wherein the target response label is controlled to move to the reference position.

[0061] As an optional implementation, the processor is specifically configured to execute:

[0062] The rotation angle of the virtual knob is determined based on the tangential velocity and the size of the virtual knob.

[0063] Based on the distance between the target response label and the reference position, and the rotation angle, the visual feedback time for the target response label to move to the reference position is determined.

[0064] As an optional implementation, the processor is specifically configured to execute:

[0065] The movement trajectory of each response label is determined based on the step size and number of times each response label moves;

[0066] For each response tag's movement trajectory, perform the following steps:

[0067] Interpolation is performed on the movement trajectory of the response tag to obtain the points passed by the response tag during its movement; based on the tangential velocity, the response tag is controlled to move sequentially to each point.

[0068] As an optional implementation, the processor is specifically configured to execute:

[0069] The tangential velocity is used as the moving speed to control the various response labels displayed on the touch screen to move sequentially at a uniform speed.

[0070] As an optional implementation, the processor is specifically configured to execute:

[0071] Obtain the rotation direction of the touch point, and determine the movement direction of each response label displayed on the touch screen based on the rotation direction;

[0072] Based on the tangential speed and the direction of movement, the various response labels displayed on the touch screen are controlled to move sequentially.

[0073] As an optional implementation method,

[0074] The response tags are arranged sequentially along the vertical axis; or,

[0075] The response tags are arranged sequentially along the horizontal axis; or,

[0076] The various response labels are arranged and displayed around the virtual knob.

[0077] Fourthly, embodiments of this disclosure also provide a computer storage medium having a computer program stored thereon, which, when executed by a processor, is used to implement the steps of the method described in the first aspect above.

[0078] These or other aspects of this disclosure will become more apparent in the following description of embodiments. Attached Figure Description

[0079] To more clearly illustrate the technical solutions in the embodiments of this disclosure, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this disclosure. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0080] Figure 1A flowchart illustrating an implementation of a method for synchronizing tactile and visual feedback according to an embodiment of this disclosure;

[0081] Figure 2 A schematic diagram of a virtual knob provided in an embodiment of this disclosure;

[0082] Figure 3 A flowchart illustrating a specific implementation of haptic and visual feedback synchronization provided in this disclosure embodiment;

[0083] Figure 4A A schematic diagram of the display interface of a first type of touch screen provided in an embodiment of this disclosure;

[0084] Figure 4B This is a first human-computer interaction flowchart provided in the embodiments of this disclosure;

[0085] Figure 5A A schematic diagram of the display interface of a second type of touch screen provided in an embodiment of this disclosure;

[0086] Figure 5B This is a second human-computer interaction flowchart provided in the embodiments of this disclosure;

[0087] Figure 6A A schematic diagram of the display interface of a third touchscreen provided in an embodiment of this disclosure;

[0088] Figure 6B This is a third human-computer interaction flowchart provided in the embodiments of this disclosure;

[0089] Figure 7 A schematic diagram of a device for synchronizing tactile and visual feedback provided in an embodiment of this disclosure;

[0090] Figure 8 This is a schematic diagram of a device for synchronizing tactile and visual feedback, provided as an embodiment of this disclosure. Detailed Implementation

[0091] To make the objectives, technical solutions, and advantages of this disclosure clearer, the disclosure will be further described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this disclosure, and not all of them. Based on the embodiments of this disclosure, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this disclosure.

[0092] In this disclosure, the term "and / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent three cases: A alone, A and B simultaneously, and B alone. The character " / " generally indicates that the preceding and following related objects have an "or" relationship.

[0093] The application scenarios described in this disclosure are for the purpose of more clearly illustrating the technical solutions of this disclosure and do not constitute a limitation on the technical solutions provided in this disclosure. Those skilled in the art will understand that with the emergence of new application scenarios, the technical solutions provided in this disclosure are also applicable to similar technical problems. In the description of this disclosure, unless otherwise stated, "multiple" means two or more.

[0094] Example 1: In the field of human-computer interaction technology, users interact with electronic devices through touch operations performed on a touchscreen. After a user performs a touch operation on the touchscreen of an electronic device, the electronic device provides visual feedback corresponding to the touch operation by displaying an interface corresponding to that touch operation. Typically, after a user performs a touch operation, a certain amount of feedback time is required for the corresponding interface to be displayed. However, in scenarios where users perform touch operations quickly, it can easily lead to a lack of synchronization between the touch operation and the visual feedback. For example, in a certain scenario, a user needs to control a virtual knob on the touchscreen to switch the current state of the controlled quantity on the virtual knob. However, when the user quickly rotates the virtual knob to switch states, since the feedback time for state switching is usually fixed, the state switching cannot be completed synchronously when the user has finished rotating the virtual knob, resulting in a visual feedback delay, asynchrony, and a choppy visual experience for the user.

[0095] To address the aforementioned technical problems, this disclosure provides a method for synchronizing tactile and visual feedback. The core idea is to detect the touch point speed to obtain the tangential speed of the touch point's rotation, and then control the sequential movement of each response label corresponding to a virtual knob based on this tangential speed. As the touch point speed changes, the movement speed of each response label also changes accordingly, solving the problem of asynchronous or stuttering tactile and dynamic visual feedback when the virtual knob's rotation speed varies for different users. This embodiment uses the detection of touch screen touch point movement speed to adjust the dynamic visual feedback, reducing visual feedback latency and avoiding stuttering. This ensures that the tactile feedback accompanying the user's touch operation and the dynamic visual feedback generated in response to the touch operation remain synchronized, thereby effectively improving the user experience.

[0096] like Figure 1 As shown in the figure, the implementation flow of the method for synchronizing tactile and visual feedback provided in this embodiment is as follows:

[0097] Step 100: Obtain the tangential speed of the touch point rotation. The touch point is generated by the user performing a rotational touch operation within the coverage area of ​​the virtual knob displayed on the touch screen. The touch operation is accompanied by tactile feedback.

[0098] In practice, users can perform touch operations along the virtual knob, simulating the rotation of a physical knob in a real-world scenario. For example... Figure 2 As shown in the diagram, this embodiment provides a schematic of a virtual knob. When a user performs a rotation operation on the displayed virtual knob on the touchscreen, tactile feedback is also provided, such as through vibration or shaking, allowing the user to experience tactile perception while rotating the virtual knob. This more realistically simulates the tactile sensation of a user operating a physical knob in a real-world scenario.

[0099] In some embodiments, when a change in the angle of the contact point within the coverage area of ​​the virtual knob is detected, it is determined that the contact point is rotating, and the tangential velocity generated by the rotation of the contact point along the virtual knob is detected. Here, the tangential velocity in this embodiment refers to the instantaneous velocity of the contact point when it makes a curved motion (including circular motion), and the direction of the contact point's motion is along the tangential direction of the motion track (such as the contour of the virtual knob).

[0100] In some embodiments, sensors can detect whether the contact point rotates and the tangential velocity of that rotation. In this implementation, the rotation of the contact point generated by the user's touch operation does not need to strictly follow the circumference of the virtual knob. As long as it is within the coverage area of ​​the virtual knob and the angular change of the contact point is greater than or equal to an angle threshold, it is determined that the contact point has performed a rotation operation on the virtual knob, and this contact point is considered a valid contact point. The tangential velocity of the contact point's rotation can be detected. Similarly, if the contact point is outside the coverage area of ​​the virtual knob or the angular change of the contact point is less than the angle threshold, the contact point is determined to be an invalid contact point, and the above steps are not performed.

[0101] Step 101: According to the tangential speed, control the various response tags displayed on the touch screen to move sequentially, so that the tactile feedback and the visual feedback formed by the movement of each response tag are synchronized. The step size of each response tag's movement corresponds to a preset unit angle, and the number of times each response tag moves is determined according to the number of preset unit angles included in the rotation angle of the virtual knob.

[0102] In this embodiment, the tactile feedback perceived by the user while rotating the virtual knob is almost synchronous with the user's rotation process. In order to synchronize the movement of the response label perceived by the user visually with the tactile feedback, this embodiment controls the movement of each response label based on the tangential speed of the touch point rotation generated by the user's touch operation, so that the movement process of the touch point and the movement process of the response label are synchronized. The touch point is accompanied by tactile feedback during the movement, thus enabling the tactile feedback and visual feedback to be synchronized, improving the user experience.

[0103] In implementation, the virtual knob in this embodiment is marked with various rotation angles. Optionally, these rotation angles can be uniformly distributed or non-uniformly distributed. This embodiment does not impose too many limitations on the distribution of the rotation angles on the virtual knob. Since the preset unit angle remains unchanged, the step size of each response tag's movement is fixed each time. The number of movements is determined based on the number of preset unit angles contained in the rotation angle. For example, if the preset unit angle is 10 degrees and the rotation angle is 50 degrees, then each response tag moves 5 steps. In some embodiments, after detecting the rotation angle of the virtual knob, the number of preset unit angles contained in the rotation angle is first determined. Based on the number of preset unit angles, the number of times the response tag moves is determined. Then, the movement step size of the response tag corresponding to the preset unit angle is determined. Finally, according to the movement step size and the number of movements, each response tag is controlled to move sequentially according to a preset arrangement order. It should be noted that the preset unit angle in this embodiment is obtained by evenly dividing the maximum angle value of the virtual knob. The specific size of the preset unit angle can be defined according to the actual situation. This embodiment does not impose too many limitations on this.

[0104] Optionally, a preset unit angle is used to characterize the detection accuracy when detecting the rotation angle of the virtual knob. If the rotation angle obtained by the user rotating the virtual knob is lower than the preset unit angle, the rotation angle is determined to be invalid and will not control the movement of the response label.

[0105] In some embodiments, the tangential speed can be used as the moving speed of each response label, controlling each displayed response label to move to the corresponding position at the tangential speed. Visually, as the speed of the user's touch changes, the moving speed of each response label also changes. That is, if the user's touch speed is fast, then the moving speed of each response label is fast, and if the user's touch speed is slow, then the moving speed of each response label is slow, thereby achieving visual feedback synchronization.

[0106] In some embodiments, this embodiment also provides a method for responding to label switching, the specific implementation steps of which are as follows:

[0107] Step 1) Determine the visual feedback time for the target response label to move to the reference position based on the tangential velocity;

[0108] The target response label is determined based on the response labels displayed at the previously mentioned reference positions, and the number of times each response label moves. Optionally, the display order of the response labels is predefined, and each response label moves one or more times with a fixed step size. Each move changes the position of the response label. In some embodiments, all response labels move with the same step size, and all response labels move simultaneously with the same step size and number of moves. When any response label moves by one step size, it moves to an adjacent position according to a predefined arrangement (e.g., the next adjacent position, the previous adjacent position, the position to the left of the adjacent position, the position to the right of the adjacent position, and so on).

[0109] In some embodiments, a target response label is determined based on the order of the response labels, the response labels displayed at the previously mentioned reference position moving sequentially, and the number of times each response label moves. In this embodiment, the order of the response labels is predefined. Therefore, after determining the number of moves, based on the response labels displayed at the reference position and the number of moves, it is determined which response label will move to the reference position, thus identifying that response label as the target response label, i.e., the response label selected by the user by rotating the virtual knob.

[0110] In some embodiments, the reference position is used to display the target response label; in some embodiments, the reference position is a fixed position on the touch screen used to display the response label currently selected by the user, i.e., the target response label.

[0111] Optionally, the target response label is the response label selected by the user after rotating the virtual knob, corresponding to the rotated virtual knob. The target response label is determined based on the response labels displayed at the reference position before each response label is moved sequentially, as well as the number of times and direction of each response label's movement. The order of each response label is predefined, and during the movement, the labels move sequentially according to the step size, number of times, direction, and the order of their arrangement.

[0112] Optionally, in this embodiment, the target response label can be regarded as the current response label. If the user has not yet rotated the virtual knob at the current moment, the target response label can be regarded as the response label already displayed at the reference position. If the user has already rotated the virtual knob at the current moment, the target response label is the response label corresponding to the rotation angle of the virtual knob after rotation.

[0113] In some embodiments, this embodiment determines the visual feedback time for the target response label to move to the reference position through the following steps:

[0114] 1a) Determine the rotation angle of the virtual knob based on the tangential velocity and the size of the virtual knob;

[0115] In some embodiments, the rotation angle is determined based on the tangential velocity and the radius of the virtual knob, as shown in the following formula:

[0116] formula (1) for w = v / R;

[0117] Where w represents the rotation angle, v represents the tangential velocity, and R represents the radius.

[0118] 1b) Determine the visual feedback time for the target response label to move to the reference position based on the distance between the target response label and the reference position, and the rotation angle.

[0119] In some embodiments, the visual feedback time is determined by the following formula, as shown below:

[0120] Formula (2) is t = L / μw;

[0121] Where t represents the visual feedback time, L represents the distance between the target response label and the reference position, w represents the rotation angle, and μ represents a correction coefficient greater than 0.

[0122] Step 2) When the visual feedback time is less than or equal to the time threshold, update the content of each response label displayed on the touch screen.

[0123] The formula above shows that when L is constant, the larger w is, the smaller t is. As w increases to a certain extent, i.e., when the user rotates the virtual knob very quickly, t approaches 0. At this point, due to the limitations of computer processing power, if the dynamic visual feedback method of responding to label movement continues, it will cause screen stuttering and other desynchronization phenomena. Therefore, the dynamic visual feedback is adjusted to static visual feedback, i.e., there is no visual dynamic movement effect, but the content of each response label is directly modified, creating a visually immediate response, avoiding stuttering, and satisfying the user's human-computer interaction experience.

[0124] In implementation, when a user rotates the virtual knob to a certain angle, a target response label corresponding to that angle is displayed at a reference position. Simultaneously, during the period the user rotates the virtual knob, because the calculated visual feedback time is short, there is almost no time for the response label to move to simulate real-world physical displacement. Therefore, the response label does not change position; only its content changes. This creates a visually immediate and seamless response, synchronizing visual and tactile feedback, ensuring that the user's tactile and visual perceptions are synchronized.

[0125] In some embodiments, when the visual feedback time is greater than a time threshold, the various response labels displayed on the touch screen are controlled to move sequentially according to the tangential speed, wherein the target response label is controlled to move to the reference position.

[0126] During implementation, the extended feedback time during which the user rotates the virtual knob provides ample opportunity for the response labels to move, simulating real-world physical displacement. The target response label moves to a base position, and as it moves, the other response labels also move sequentially to their corresponding positions. Through this displacement, the response labels visually provide the user with the impression of real-world physical changes.

[0127] In some embodiments, the virtual knob rotates as the contact point rotates.

[0128] In some embodiments, this embodiment provides two visual feedback methods, including dynamic visual feedback and static visual feedback. The two visual feedback methods provided in this embodiment are explained below:

[0129] Static visual feedback refers to a situation where, when a user rotates a virtual knob on a touchscreen, the switching of response labels does not involve any displacement; only the content of the response labels changes. In practice, when the visual feedback time is less than or equal to a time threshold, the content of each response label displayed on the touchscreen is updated.

[0130] Dynamic visual feedback refers to the phenomenon where, when a user rotates a virtual knob on a touchscreen, the switching of response labels changes position, visually resembling a real-world physical change. In implementation, when the visual feedback time exceeds a time threshold, the various response labels displayed on the touchscreen are controlled to move sequentially based on the tangential speed, with the target response label moved to the reference position.

[0131] In some embodiments, the present disclosure may also determine whether to use dynamic or static visual feedback based on the determination of tangential velocity. The specific implementation process is as follows:

[0132] When the tangential speed is greater than the speed threshold, static visual feedback is used to switch the response label, that is, to update the content of each response label displayed on the touch screen.

[0133] When the tangential speed is less than or equal to the speed threshold, dynamic visual feedback is used to switch the response label. That is, according to the tangential speed, the various response labels displayed on the touch screen are controlled to move sequentially, wherein the target response label is controlled to move to the reference position.

[0134] In some embodiments, the reference position in this embodiment is a fixed display position on the touch screen, used to display the response label corresponding to the rotation angle of the current virtual knob. This embodiment does not impose too many limitations on the setting of the reference position.

[0135] In some embodiments, this embodiment provides an interpolation method that enables response tags to simulate more realistic physical movement scenarios during movement. Specific implementation details are shown below:

[0136] The movement trajectory of each response label is determined based on the step size and number of times each response label moves;

[0137] For each response tag's movement trajectory, perform the following steps:

[0138] Interpolation is performed on the movement trajectory of the response tag to obtain the points passed by the response tag during its movement; based on the tangential velocity, the response tag is controlled to move sequentially to each point.

[0139] In some embodiments, the tangential velocity can also be used as the moving speed to control the various response labels displayed on the touch screen to move at a uniform speed in sequence.

[0140] In practice, for each response tag, the response tag is controlled to move sequentially and uniformly to each point according to the tangential velocity.

[0141] In some embodiments, this embodiment can also control the direction of movement of each response tag according to the rotation direction of the contact point, as shown in the following specific implementation:

[0142] The rotation direction of the touch point is obtained, and the movement direction of each response label displayed on the touch screen is determined based on the rotation direction; based on the tangential speed and the movement direction, the movement of each response label displayed on the touch screen is controlled to move sequentially.

[0143] In implementation, the tangential velocity is used as the movement speed of each response label, and each response label is controlled to move to its corresponding position (each point) according to the movement direction of the response label corresponding to the movement direction. Optionally, the user controls the virtual knob to rotate via the touchscreen, and the response labels will move up and down to switch positions. When the virtual knob is rotated clockwise, all response labels move from top to bottom to switch positions; when the virtual knob is rotated counterclockwise, all response labels move from bottom to top to switch positions. Alternatively, the user controls the virtual knob to rotate via the touchscreen, and the response labels will move left and right. When the virtual knob is rotated clockwise, all response labels move from left to right to switch positions; when the virtual knob is rotated counterclockwise, all response labels move from right to left to switch positions. Alternatively, the user controls the virtual knob to rotate via the touchscreen, and the response labels will move diagonally. When the virtual knob is rotated clockwise, all response labels move from diagonally downward to diagonally upward to switch positions; when the virtual knob is rotated counterclockwise, all response labels move from diagonally upward to diagonally downward to switch positions.

[0144] In some embodiments, the display methods of the various response labels displayed on the touch screen in this embodiment are as follows:

[0145] (1) The various response tags are arranged sequentially along the vertical axis;

[0146] (2) The various response labels are arranged sequentially along the horizontal direction;

[0147] (3) The response labels are arranged and displayed around the virtual knob. The response labels may surround one side of the virtual knob, or they may completely surround the virtual knob, for example, the response labels may be evenly distributed around the virtual knob. This embodiment does not impose excessive limitations on this.

[0148] In some embodiments, the virtual knob and the response label are displayed simultaneously on the touch screen, and the virtual knob and the response label do not obstruct each other. This embodiment does not impose too many restrictions on the relative positional relationship between the virtual knob and the response label.

[0149] In some embodiments, the shape of the virtual knob in this embodiment includes, but is not limited to, at least one of a circle, an ellipse, or a graphic composed of curves. This embodiment does not impose too many restrictions on the shape of the virtual knob.

[0150] In some embodiments, response tags include, but are not limited to, icons, images, and text. The content of the response tags includes, but is not limited to, specified information, such as contacts in the address book, playlists in the music library, product models, etc. This embodiment does not impose excessive limitations on the size, shape, content, color, etc. of the response tags.

[0151] In some embodiments, all response labels may not be displayed on the touch screen at the same time; only some may be displayed. The target response label corresponding to the rotation angle of the current virtual knob may be displayed at the reference position. As the user rotates the virtual knob, the response labels may also be displayed sequentially by scrolling.

[0152] like Figure 3 As shown in the embodiments, this disclosure also provides a specific implementation process for synchronizing tactile and visual feedback, as follows:

[0153] Step 300: Receive the touch points generated by the user performing a rotation touch operation within the coverage area of ​​the virtual knob displayed on the touch screen;

[0154] Step 301: Calculate the tangential velocity of the contact rotation;

[0155] Step 302: Determine the rotation angle of the virtual knob based on the tangential velocity and the radius of the virtual knob;

[0156] Step 303: Determine the corresponding target response label based on the rotation angle of the virtual knob;

[0157] Step 304: Determine the visual feedback time for the target response label to move to the reference position based on the distance between the target response label and the reference position, as well as the rotation angle;

[0158] Step 305: Determine whether the visual feedback time is greater than the time threshold. If yes, proceed to step 306; otherwise, proceed to step 307.

[0159] Step 306: On the trajectory of each response tag, calculate the points passed by each response tag during its movement through interpolation, and control each response tag to move at a constant speed to the corresponding points according to the tangential velocity.

[0160] Step 307: Calculate the position that each response tag needs to be moved to, and update the content of each response tag according to the response tag that needs to be displayed at each position.

[0161] like Figure 4A As shown, this embodiment of the disclosure provides a touchscreen display interface. Taking a virtual knob on the left and response labels arranged vertically on the right as an example, the circular area with scales on the left represents the virtual knob, and the square area on the right represents the response labels. The response labels can store information specified by the developer, such as contacts in the address book, playlists in the music library, product models, etc. The user controls the left virtual knob to rotate through the touchscreen, and the response labels on the right will move up and down to switch positions. For example, when the virtual knob is rotated clockwise, all response labels move from top to bottom to switch positions; when the virtual knob is rotated counterclockwise, all response labels move from bottom to top to switch positions.

[0162] like Figure 4B As shown, a human-computer interaction process provided in this embodiment will be described, and the specific implementation process is as follows:

[0163] Step 400: The touchscreen receives a touch operation from the user, who performs a rotation by touching the virtual knob with their finger.

[0164] Step 401: Obtain the tangential velocity of the touch point generated by the touch operation along the rotation of the virtual knob;

[0165] Step 402: Determine the target response label corresponding to the rotation angle obtained after the virtual knob is rotated;

[0166] Step 403: Calculate the distance between the target response label and the reference position, and determine the visual feedback time based on the distance and rotation angle;

[0167] The reference position can be set to the position directly opposite the virtual knob.

[0168] Step 404: Determine whether the visual feedback time is greater than the time threshold. If yes, proceed to step 405; otherwise, proceed to step 406.

[0169] Step 405: Control each response label to move up and down sequentially according to the tangential speed, with the target response label moving to the reference position.

[0170] Step 406: Determine the position where each response tag needs to be moved, and modify the content of each response tag according to the response tag that needs to be displayed at that position.

[0171] like Figure 5A As shown, this embodiment of the disclosure provides a touchscreen display interface. Taking a virtual knob located on the lower side and response labels arranged horizontally on the upper side as an example, the circular area with scales on the lower side represents the virtual knob, and the square area on the upper side represents the response labels. The response labels can store information specified by the developer, such as contacts in the address book, playlists in the music library, product models, etc. When the user controls the rotation of the lower virtual knob through the touchscreen, the upper response labels will move left or right to switch positions. For example, when the virtual knob is rotated clockwise, all response labels move from left to right to switch positions; when the virtual knob is rotated counterclockwise, all response labels move from right to left to switch positions.

[0172] like Figure 5B As shown, a human-computer interaction process provided in this embodiment will be described, and the specific implementation process is as follows:

[0173] Step 500: The touchscreen receives a touch operation from the user, who performs a rotation by touching the virtual knob with their finger.

[0174] Step 501: Obtain the tangential velocity of the touch point generated by the touch operation along the rotation of the virtual knob;

[0175] Step 502: Determine the target response label corresponding to the rotation angle obtained after the virtual knob is rotated;

[0176] Step 503: Calculate the distance between the target response label and the reference position, and determine the visual feedback time based on the distance and rotation angle;

[0177] The reference position can be set to the position directly opposite the virtual knob.

[0178] Step 504: Determine whether the visual feedback time is greater than the time threshold. If yes, proceed to step 505; otherwise, proceed to step 506.

[0179] Step 505: Control each response label to move left and right sequentially according to the tangential speed, with the target response label moving to the reference position.

[0180] Step 506: Determine the position where each response label needs to be moved, and modify the content of each response label according to the response label that needs to be displayed at that position.

[0181] like Figure 6A As shown, this embodiment of the disclosure provides a touchscreen display interface. Taking a virtual knob on the left and response labels arranged around it as an example, the circular area with scales on the right represents the virtual knob, and the square area on the left represents the response labels. The response labels can store information specified by the developer, such as contacts in the address book, playlists in the music library, product models, etc. When the user controls the right virtual knob to rotate via the touchscreen, the response labels on the left will move diagonally up or down to switch positions. For example, when the virtual knob rotates clockwise, all response labels move diagonally from top to bottom; when the virtual knob rotates counterclockwise, all response labels move diagonally from bottom to top.

[0182] like Figure 6B As shown, a human-computer interaction process provided in this embodiment will be described, and the specific implementation process is as follows:

[0183] Step 600: The touchscreen receives a touch operation from the user, who performs a rotation by touching the virtual knob with their finger.

[0184] Step 601: Obtain the tangential velocity of the touch point generated by the touch operation along the rotation of the virtual knob;

[0185] Step 602: Determine the target response label corresponding to the rotation angle obtained after the virtual knob is rotated;

[0186] Step 603: Calculate the distance between the target response label and the reference position, and determine the visual feedback time based on the distance and rotation angle;

[0187] Step 604: Determine whether the visual feedback time is greater than the time threshold. If yes, proceed to step 605; otherwise, proceed to step 606.

[0188] Step 605: Control each response label to move diagonally upward or downward in sequence according to the tangential speed, with the target response label moving to the reference position.

[0189] Step 606: Determine the position where each response label needs to be moved, and modify the content of each response label according to the response label that needs to be displayed at that position.

[0190] In practice, when the distance between the target response label and the reference position is small (e.g., the response label the user wants to select is adjacent to the response label currently displayed at the reference position), the user's rotation speed is not fast, and the calculated visual feedback time is usually relatively long, allowing sufficient time for the response label to move to simulate real-world physical displacement. The response label on the right can choose dynamic visual feedback, meaning that the response label switching will result in displacement changes, and visually, the content of the response label is like a real-world physical change process. Conversely, when the distance is large (e.g., the response label the user wants to select is more than 3 response labels away from the response label currently displayed at the reference position), the user's rotation speed is fast, and the calculated visual feedback time is usually relatively short, or even close to 0. In this case, there is no time for the response label to move to simulate real-world physical displacement, and the response label on the right chooses static visual feedback, meaning that the response label does not actually change position, only the content of the response label changes, creating the visual feeling that the response label is in place in one step.

[0191] Example 2: Based on the same inventive concept, this embodiment of the present disclosure also provides a device for synchronizing tactile and visual feedback. Since this device is the same as the device in the method of this embodiment of the present disclosure, and the principle of the device in solving the problem is similar to that of the method, the implementation of the device can refer to the implementation of the method, and the repeated parts will not be described again.

[0192] like Figure 7 As shown, the device includes:

[0193] The speed acquisition unit 700 is used to acquire the tangential speed of the touch point rotation. The touch point is generated by the user performing a rotational touch operation within the coverage area of ​​the virtual knob displayed on the touch screen. The touch operation is accompanied by haptic feedback.

[0194] The control movement unit 701 is used to control the sequential movement of each response label displayed on the touch screen according to the tangential speed, so that the tactile feedback and the visual feedback formed by the movement of each response label are kept synchronized. The step size of each response label's movement corresponds to a preset unit angle, and the number of times each response label moves is determined according to the number of preset unit angles included in the rotation angle of the virtual knob.

[0195] As an optional implementation, the content update unit is also included for:

[0196] Based on the tangential velocity, the visual feedback time for the target response label to move to the reference position is determined, wherein the target response label is determined based on the response labels displayed at the reference position before each response label moves sequentially and the number of times each response label moves.

[0197] When the visual feedback time is less than or equal to the time threshold, the content of each response label displayed on the touch screen is updated.

[0198] As an optional implementation, the control movement unit 701 is specifically used for:

[0199] When the visual feedback time is greater than the time threshold, the various response labels displayed on the touch screen are controlled to move sequentially according to the tangential speed, wherein the target response label is controlled to move to the reference position.

[0200] As an optional implementation, the update content unit is used for:

[0201] The rotation angle of the virtual knob is determined based on the tangential velocity and the size of the virtual knob.

[0202] Based on the distance between the target response label and the reference position, and the rotation angle, the visual feedback time for the target response label to move to the reference position is determined.

[0203] As an optional implementation, the control movement unit 701 is specifically used for:

[0204] The movement trajectory of each response label is determined based on the step size and number of times each response label moves;

[0205] For each response tag's movement trajectory, perform the following steps:

[0206] Interpolation is performed on the movement trajectory of the response tag to obtain the points passed by the response tag during its movement; based on the tangential velocity, the response tag is controlled to move sequentially to each point.

[0207] As an optional implementation, the control movement unit 701 is specifically used for:

[0208] The tangential velocity is used as the moving speed to control the various response labels displayed on the touch screen to move sequentially at a uniform speed.

[0209] As an optional implementation, the control movement unit 701 is specifically used for:

[0210] Obtain the rotation direction of the touch point, and determine the movement direction of each response label displayed on the touch screen based on the rotation direction;

[0211] Based on the tangential speed and the direction of movement, the various response labels displayed on the touch screen are controlled to move sequentially.

[0212] As an optional implementation method,

[0213] The response tags are arranged sequentially along the vertical axis; or,

[0214] The response tags are arranged sequentially along the horizontal axis; or,

[0215] The various response labels are arranged and displayed around the virtual knob.

[0216] Example 3: Based on the same inventive concept, this disclosure also provides a device for synchronizing tactile and visual feedback. Since this device is the same as the device in the method of this disclosure, and the principle of the device in solving the problem is similar to that of the method, the implementation of this device can refer to the implementation of the method, and the repeated parts will not be described again.

[0217] like Figure 8 As shown, the device includes a processor 800 and a memory 801. The memory 801 stores programs executable by the processor 800. The processor 800 reads the programs from the memory 801 and performs the following steps:

[0218] The tangential speed of the rotation of the touch point is obtained. The touch point is generated by the user performing a rotational touch operation within the coverage area of ​​the virtual knob displayed on the touch screen. The touch operation is accompanied by haptic feedback.

[0219] According to the tangential speed, the various response tags displayed on the touch screen are controlled to move sequentially so that the tactile feedback and the visual feedback formed by the movement of each response tag are kept synchronized. The step size of each response tag's movement corresponds to a preset unit angle, and the number of times each response tag moves is determined according to the number of preset unit angles included in the rotation angle of the virtual knob.

[0220] As an optional implementation, the processor 800 is further configured to perform:

[0221] Based on the tangential velocity, the visual feedback time for the target response label to move to the reference position is determined, wherein the target response label is determined based on the response labels displayed at the reference position before each response label moves sequentially and the number of times each response label moves.

[0222] When the visual feedback time is less than or equal to the time threshold, the content of each response label displayed on the touch screen is updated.

[0223] As an optional implementation, the processor 800 is specifically configured to perform:

[0224] When the visual feedback time is greater than the time threshold, the various response labels displayed on the touch screen are controlled to move sequentially according to the tangential speed, wherein the target response label is controlled to move to the reference position.

[0225] As an optional implementation, the processor 800 is specifically configured to perform:

[0226] The rotation angle of the virtual knob is determined based on the tangential velocity and the size of the virtual knob.

[0227] Based on the distance between the target response label and the reference position, and the rotation angle, the visual feedback time for the target response label to move to the reference position is determined.

[0228] As an optional implementation, the processor 800 is specifically configured to perform:

[0229] The movement trajectory of each response label is determined based on the step size and number of times each response label moves;

[0230] For each response tag's movement trajectory, perform the following steps:

[0231] Interpolation is performed on the movement trajectory of the response tag to obtain the points passed by the response tag during its movement; based on the tangential velocity, the response tag is controlled to move sequentially to each point.

[0232] As an optional implementation, the processor 800 is specifically configured to perform:

[0233] The tangential velocity is used as the moving speed to control the various response labels displayed on the touch screen to move sequentially at a uniform speed.

[0234] As an optional implementation, the processor 800 is specifically configured to perform:

[0235] Obtain the rotation direction of the touch point, and determine the movement direction of each response label displayed on the touch screen based on the rotation direction;

[0236] Based on the tangential speed and the direction of movement, the various response labels displayed on the touch screen are controlled to move sequentially.

[0237] As an optional implementation method,

[0238] The response tags are arranged sequentially along the vertical axis; or,

[0239] The response tags are arranged sequentially along the horizontal axis; or,

[0240] The various response labels are arranged and displayed around the virtual knob.

[0241] Based on the same inventive concept, this disclosure also provides a computer storage medium storing a computer program that, when executed by a processor, performs the following steps:

[0242] The tangential speed of the rotation of the touch point is obtained. The touch point is generated by the user performing a rotational touch operation within the coverage area of ​​the virtual knob displayed on the touch screen. The touch operation is accompanied by haptic feedback.

[0243] According to the tangential speed, the various response tags displayed on the touch screen are controlled to move sequentially so that the tactile feedback and the visual feedback formed by the movement of each response tag are kept synchronized. The step size of each response tag's movement corresponds to a preset unit angle, and the number of times each response tag moves is determined according to the number of preset unit angles included in the rotation angle of the virtual knob.

[0244] Those skilled in the art will understand that embodiments of this disclosure can be provided as methods, systems, or computer program products. Therefore, this disclosure can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this disclosure can take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage and optical storage) containing computer-usable program code.

[0245] This disclosure is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this disclosure. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create a machine for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 Devices that specify the functions in one or more boxes.

[0246] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including an instruction device, which is implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0247] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0248] Obviously, those skilled in the art can make various modifications and variations to this disclosure without departing from its spirit and scope. Therefore, if such modifications and variations fall within the scope of the claims of this disclosure and their equivalents, this disclosure is also intended to include such modifications and variations.

Claims

1. A method for synchronizing tactile and visual feedback, wherein, The method includes: When a change in the angle of the touch point within the coverage area of ​​the virtual knob is detected, the tangential speed of the touch point's rotation is acquired. The touch point is generated by a user performing a rotational touch operation within the coverage area of ​​the virtual knob displayed on the touchscreen, and this touch operation is accompanied by haptic feedback. The virtual knob is circular, and various rotation angles are marked on it. Based on the tangential speed, the various response tags displayed on the touchscreen are controlled to move sequentially, so that the tactile feedback and the visual feedback formed by the movement of each response tag are kept synchronized. As the touch point rotates, the virtual knob also rotates accordingly. The step size of each response tag's movement corresponds to a preset unit angle, and the number of times each response tag moves is determined based on the number of preset unit angles included in the rotation angle of the virtual knob. The preset unit angle is obtained by dividing the maximum angle value of the virtual knob evenly. Based on the tangential velocity, the visual feedback time for the target response label to move to the reference position is determined, wherein the target response label is determined based on the response labels displayed at the reference position before each response label moves sequentially and the number of times each response label moves; the target response label is the response label selected by the user after rotating the virtual knob, corresponding to the virtual knob after the rotation. When the visual feedback time is less than or equal to the time threshold, the content of each response label displayed on the touch screen is updated, and the switching of the response labels does not involve any displacement change. When the visual feedback time is greater than the time threshold, the various response labels displayed on the touch screen are controlled to move sequentially according to the tangential speed. The target response label is controlled to move to the reference position, and the switching of the response label involves displacement changes. Visually, the content of the response label is the same as the process of physical change in the real world.

2. The method according to claim 1, wherein, The step of determining the visual feedback time for the target response label to move to the reference position based on the tangential velocity includes: The rotation angle of the virtual knob is determined based on the tangential velocity and the size of the virtual knob. Based on the distance between the target response label and the reference position, and the rotation angle, the visual feedback time for the target response label to move to the reference position is determined.

3. The method according to claim 1, wherein, The step of controlling the sequential movement of each response label displayed on the touchscreen according to the tangential velocity includes: The movement trajectory of each response label is determined based on the step size and number of times each response label moves; For each response tag's movement trajectory, perform the following steps: Interpolation is performed on the movement trajectory of the response tag to obtain the points passed by the response tag during its movement; based on the tangential velocity, the response tag is controlled to move sequentially to each point.

4. The method according to claim 1, wherein, The step of controlling the sequential movement of each response label displayed on the touchscreen according to the tangential velocity includes: The tangential velocity is used as the moving speed to control the various response labels displayed on the touch screen to move sequentially at a uniform speed.

5. The method according to claim 1, wherein, The step of controlling the sequential movement of each response label displayed on the touchscreen according to the tangential velocity includes: Obtain the rotation direction of the touch point, and determine the movement direction of each response label displayed on the touch screen based on the rotation direction; Based on the tangential speed and the direction of movement, the various response labels displayed on the touch screen are controlled to move sequentially.

6. The method according to claim 1, wherein, The response tags are arranged sequentially along the vertical axis; or, The response tags are arranged sequentially along the horizontal axis; or, The various response labels are arranged and displayed around the virtual knob.

7. A device for synchronizing tactile and visual feedback, wherein, include: A speed acquisition unit is used to acquire the tangential speed of the touch point rotation when a change in the angle of the touch point within the coverage area of ​​the virtual knob is detected. The touch point is generated by the user performing a rotational touch operation within the coverage area of ​​the virtual knob displayed on the touch screen, and the touch operation is accompanied by haptic feedback. The virtual knob is circular. The virtual knob is marked with various rotation angles, and the preset unit angle is obtained by dividing the maximum angle value of the virtual knob equally. A control unit is configured to control the sequential movement of each response label displayed on the touchscreen according to the tangential speed, so that the haptic feedback and the visual feedback formed by the movement of each response label are synchronized. As the touch point rotates, the virtual knob also rotates accordingly. The step size of each response label's movement corresponds to a preset unit angle, and the number of movements of each response label is determined based on the number of preset unit angles included in the rotation angle of the virtual knob. The control unit also determines the visual feedback time for the target response label to move to a reference position based on the tangential speed, wherein the target response label is the response displayed at the reference position before the sequential movement of each response label. The labels and the number of times each response label moves are determined; the target response label is the response label selected by the user after rotating the virtual knob, corresponding to the virtual knob after that rotation; when the visual feedback time is less than or equal to the time threshold, the content of each response label displayed on the touch screen is updated, and the switching of the response label does not involve displacement; when the visual feedback time is greater than the time threshold, according to the tangential speed, the response labels displayed on the touch screen are controlled to move sequentially, wherein the target response label is controlled to move to the reference position, and the switching of the response label involves displacement, so that the visual content of the response label is the same as the process of physical change in the real world.

8. A device for synchronizing tactile and visual feedback, wherein, The device includes a processor and a memory for storing a program executable by the processor, and the processor for reading the program in the memory and executing the steps of the method according to any one of claims 1 to 6.

9. A computer storage medium having a computer program stored thereon, wherein, When the program is executed by the processor, it implements the steps of the method as described in any one of claims 1 to 6.

Citation Information

Patent Citations

  • Mode-based graphical user interfaces for touch sensitive input devices

    US20060026535A1

  • Systems and Methods for a Graphical User Interface of a Controller for an Energy-Consuming System Having Spatially Related Discrete Display Elements

    US20130345883A1

  • Item selection apparatus and item selection method

    US20160124591A1

  • Content-based tactile outputs

    US20200341553A1