Tactile feedback generation method and device

Abstract

The invention provides a haptic feedback generation method, a haptic feedback generation device and apparatus, a computer readable storage medium, and a vehicle-mounted display system integrated with the haptic feedback generation device. The tactile feedback generation method includes: detecting a touch input of a user; determining an operation type of the user based on the detected touch input; generating a vibration control signal for controlling at least one vibration unit in the one or more vibration units at least according to the operation type; and controlling at least one of the one or more vibration units to generate vibration feedback corresponding to the touch input based on the vibration control signal.

Description

Technical Field

[0001] The present disclosure relates to the field of display technologies, and more particularly to a method and apparatus for generating haptic feedback. Background Art

[0002] Nowadays, touch screens have been widely used in electronic devices such as smart phones, tablet devices, wearable devices, gaming devices, in-vehicle display devices, etc. Users can perform touch operations on the touch screen such as clicking, swiping, zooming, rotating, etc., and the electronic device responds to the touch operation by adjusting the display screen. In some specific scenarios, such as in virtual reality devices, gaming devices, in-vehicle display devices, etc., it may be desirable to provide users with a more intuitive interaction experience in addition to the display screen adjustment, and thus the haptic feedback technology has emerged. The haptic feedback technology can reproduce or simulate the sense of touch for users in the form of forces, vibrations, etc., which can improve the interaction experience with virtual scenes and objects, electronic display devices, etc., and has broad application prospects in the fields of electronic devices, gaming entertainment, automobiles, aviation, and even medicine. How to achieve accurate, efficient, and good-interaction haptic feedback is an issue worthy of attention. Summary of the Invention

[0003] The present disclosure provides a method for generating haptic feedback, an apparatus and device for generating haptic feedback, a computer-readable storage medium, and an in-vehicle display system integrated with the apparatus for generating haptic feedback.

[0004] According to one aspect of the embodiments of the present disclosure, there is provided a method for generating haptic feedback, including: detecting a touch input of a user; determining an operation type of the user based on the detected touch input; generating at least a vibration control signal for controlling at least one of one or more vibration units at least according to the operation type; and controlling the at least one of the one or more vibration units to generate a vibration feedback corresponding to the touch input based on the vibration control signal.

[0005] According to an example of the embodiments of the present disclosure, determining the operation type of the user based on the detected touch input includes: determining the number of touch points based on the detected touch input; when the number of touch points is greater than one, determining that the operation type is one of a zoom operation or a rotation operation; and when the number of touch points is equal to one, determining that the operation type is one of a click operation, a swipe operation, or a drag-and-drop operation.

[0006] According to an example of the embodiments of the present disclosure, the method further includes determining a touch area based on the detected touch input, and the larger the touch area, the higher the vibration frequency and / or intensity of the vibration feedback generated based on the vibration control signal.

[0007] According to an example of an embodiment of the present disclosure, generating a vibration control signal for controlling at least one of one or more vibration units at least according to the operation type includes: determining an operation direction of the operation type; generating a vibration control signal for controlling at least one of the one or more vibration units according to the operation direction of the operation type.

[0008] According to an example of an embodiment of the present disclosure, generating a vibration control signal for controlling at least one of one or more vibration units according to the operation direction of the operation type includes: for different operation directions of the operation type, generating a vibration control signal for controlling vibration units located at different positions among the one or more vibration units, wherein vibration feedbacks located at different positions are generated based on the vibration control signal.

[0009] According to an example of an embodiment of the present disclosure, generating a vibration control signal for controlling at least one of one or more vibration units according to the operation direction of the operation type includes: for different operation directions of the operation type, generating a vibration control signal for controlling different numbers of vibration units among the one or more vibration units, wherein vibration feedbacks with different vibration intensities are generated based on the vibration control signal.

[0010] According to an example of an embodiment of the present disclosure, generating a vibration control signal for controlling at least one of one or more vibration units according to the operation direction of the operation type includes: for different operation directions of the operation type, generating a vibration control signal for controlling the at least one vibration unit to generate vibration feedback whose vibration frequency and / or intensity increases or decreases along the operation direction.

[0011] According to an example of an embodiment of the present disclosure, when the number of touch points is greater than one, determining that the operation type is one of a zoom operation or a rotation operation includes: when the number of touch points is greater than one and the touch electrical signals corresponding to the touch input are a pair of continuous signals that increase or decrease in two opposite linear directions, determining that the operation type is a zoom operation.

[0012] According to an example of an embodiment of the present disclosure, when the number of touch points is greater than one, determining that the operation type is one of a zoom operation or a rotation operation includes: when the number of touch points is greater than one and the touch electrical signals corresponding to the touch input are a pair of continuous signals in the counterclockwise or clockwise direction, determining that the operation type is a rotation operation.

[0013] According to an example of an embodiment of the present disclosure, when the number of touch points is equal to one, determining that the operation type is one of a click operation, a swipe operation, or a drag-and-drop operation includes: when the number of touch points is equal to one and the touch electrical signal corresponding to the touch input is a short pulse signal, determining that the operation type is a click operation.

[0014] According to an example of an embodiment of the present disclosure, when the number of touch points is equal to one, determining that the operation type is one of a click operation, a swipe operation, or a drag-and-drop operation includes: when the number of touch points is equal to one and the touch electrical signal corresponding to the touch input is a continuous signal in one direction, determining that the operation type is a swipe operation.

[0015] According to an example of an embodiment of the present disclosure, when the number of touch points is equal to one, determining that the operation type is one of a click operation, a swipe operation, or a drag-and-drop operation includes: when the number of touch points is equal to one, the initial position of the touch point is in a specific area, and the touch electrical signal corresponding to the touch input is a continuous signal in one direction with an initial amplitude greater than a specific threshold, determining that the operation type is a drag-and-drop operation.

[0016] According to another aspect of an embodiment of the present disclosure, there is provided a haptic feedback generation device, including: a display unit configured to receive a touch input from a user; a touch sensing unit configured to detect the touch input by collecting a touch electrical signal corresponding to the touch input; a control unit configured to, when the touch electrical signal is greater than a touch threshold, determine an operation type of the user based on the detected touch input, and generate at least a vibration control signal for controlling at least one of the one or more vibration units and a display control signal for controlling the display unit at least according to the operation type; and one or more vibration units, at least one of the one or more vibration units being configured to generate a vibration feedback corresponding to the touch input under the control of the vibration control signal, and wherein the display unit adjusts a current display screen according to the operation type under the action of the display control signal.

[0017] According to an example of an embodiment of the present disclosure, the control unit is further configured to: determine the number of touch points based on the detected touch input; when the number of touch points is greater than one, determine that the operation type is one of a zoom operation or a rotation operation; and when the number of touch points is equal to one, determine that the operation type is one of a click operation, a swipe operation, or a drag-and-drop operation.

[0018] According to an example of an embodiment of the present disclosure, the control unit is further configured to determine a touch area based on a detected touch input, and the larger the touch area, the higher the vibration frequency and / or intensity of the vibration feedback generated by the at least one vibration unit controlled by the vibration control signal generated by the control unit.

[0019] According to an example of an embodiment of the present disclosure, the control unit is further configured to: determine an operation direction of the operation type; generate a vibration control signal for controlling at least one of the one or more vibration units according to the operation direction of the operation type.

[0020] According to an example of an embodiment of the present disclosure, the control unit is further configured to: for different operation directions of the operation type, generate a vibration control signal for controlling vibration units located at different positions among the one or more vibration units, wherein vibration feedbacks located at different positions are generated based on the vibration control signal.

[0021] According to an example of an embodiment of the present disclosure, the control unit is further configured to: for different operation directions of the operation type, generate a vibration control signal for controlling different numbers of the one or more vibration units, wherein vibration feedbacks with different vibration intensities are generated based on the vibration control signal.

[0022] According to an example of an embodiment of the present disclosure, the control unit is further configured to: for different operation directions of the operation type, generate a vibration control signal for controlling the at least one vibration unit to generate vibration feedback with a vibration frequency and / or intensity increasing or decreasing along the operation direction.

[0023] According to an example of an embodiment of the present disclosure, the control unit is further configured to: when the number of touch points is greater than one and the touch electrical signal corresponding to the touch input is a pair of continuous signals increasing or decreasing in two opposite directions, determine that the operation type is a zoom operation.

[0024] According to an example of an embodiment of the present disclosure, the control unit is further configured to: when the number of touch points is greater than one and the touch electrical signal corresponding to the touch input is a pair of continuous signals increasing or decreasing in the counterclockwise or clockwise direction, determine that the operation type is a rotation operation.

[0025] According to an example of an embodiment of the present disclosure, the control unit is further configured to: when the number of touch points is equal to one and the touch electrical signal corresponding to the touch input is a short pulse signal, determine that the operation type is a click operation.

[0026] According to an example of an embodiment of the present disclosure, the control unit is further configured to: when the number of touch points is equal to one and the touch electrical signal corresponding to the touch input is a continuous signal in one direction, determine that the operation type is a swipe operation.

[0027] According to an example of an embodiment of the present disclosure, the control unit is further configured to: when the number of touch points is equal to one, the initial position of the touch point is located in a specific area, and the touch electrical signal corresponding to the touch input is a continuous signal in one direction with an initial amplitude greater than a specific threshold, determine that the operation type is a drag-and-drop operation.

[0028] According to another aspect of an embodiment of the present disclosure, there is provided a haptic feedback generation device, including: one or more processors; and one or more memories, wherein computer-readable instructions are stored in the memories, and when the computer-readable instructions are run by the one or more processors, the one or more processors are caused to execute the haptic feedback generation method described in each of the above aspects.

[0029] According to another aspect of an embodiment of the present disclosure, there is provided a computer-readable storage medium, on which computer-readable instructions are stored, and when the computer-readable instructions are executed by a processor, the processor is caused to execute the haptic feedback generation method described in each of the above aspects of the present disclosure.

[0030] According to another aspect of an embodiment of the present disclosure, there is provided an in-vehicle display system, which includes the haptic feedback generation device described in each of the above aspects of the present disclosure.

[0031] By using the haptic feedback generation method, haptic feedback generation device and equipment, and computer-readable storage medium according to an embodiment of the present disclosure, by determining the operation type of the user based on the detected touch input, and controlling at least one vibration unit to generate vibration feedback at different positions, with different intensities, or with different change characteristics according to different operation directions of the operation type, the user can confirm the specific operation type achieved only based on the position, intensity, or change characteristics of the felt vibration feedback, thereby simplifying the operation procedure and improving the user's interaction experience. Description of the Drawings

[0032] By describing the embodiments of the present disclosure in more detail in conjunction with the drawings, the above and other objects, features, and advantages of the embodiments of the present disclosure will become more obvious. The drawings are used to provide a further understanding of the embodiments of the present disclosure, and constitute a part of the specification. Together with the embodiments of the present disclosure, they are used to explain the present disclosure, and do not constitute a limitation to the present disclosure. In the drawings, the same reference numerals generally represent the same components or steps.

[0033] Figure 1Shows a flowchart of a haptic feedback generation method according to an embodiment of the present disclosure.

[0034] Figures 2A to 2E Shows an example of a zoom operation according to an embodiment of the present disclosure.

[0035] Figures 3A to 3D Shows an example of a rotation operation according to an embodiment of the present disclosure.

[0036] Figures 4A to 4D Shows an example of a swipe operation according to an embodiment of the present disclosure.

[0037] Figures 5A to 5D Shows an example of a drag-and-drop operation according to an embodiment of the present disclosure.

[0038] Figure 6 Shows a schematic structural diagram of a haptic feedback generation device according to an embodiment of the present disclosure.

[0039] Figure 7 Shows a system flowchart for generating vibration feedback according to an example of an embodiment of the present disclosure. Detailed implementation manners

[0040] Next, the technical solutions in the embodiments of the present disclosure will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only a part of the embodiments of the present disclosure, rather than all the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present disclosure.

[0041] Unless otherwise defined, the technical terms or scientific terms used in the present disclosure shall have the ordinary meaning understood by those of ordinary skill in the art to which the present disclosure pertains. The "first", "second" and similar terms used in the present disclosure do not denote any order, quantity or importance, but are only used to distinguish different components. Similarly, the terms such as "a", "one" or "the" do not denote a quantity limitation, but mean that there is at least one. The terms such as "comprising" or "including" mean that the elements or objects appearing before this word cover the elements or objects listed after this word and their equivalents, without excluding other elements or objects. The terms such as "connected" or "coupled" are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. The terms such as "upper", "lower", "left" and "right" are only used to represent relative positional relationships, and when the absolute position of the object being described changes, the relative positional relationship may also change accordingly.

[0042] Flowcharts are used in the present disclosure to illustrate the operations performed by the methods and apparatuses according to the embodiments of the present disclosure. It should be understood that the operations before or after do not necessarily have to be executed precisely in order. Instead, various steps can be processed in reverse order or simultaneously as needed. At the same time, other operations can also be added to these processes, or one or more steps can be removed from these processes.

[0043] Haptic feedback technology can reproduce or simulate tactile sensations for users in the form of forces, vibrations, etc., and can provide an important feedback mechanism for special groups (such as those with visual or auditory impairments) or in specific scenarios such as medical treatment, virtual reality games, and automobile driving to help users quickly obtain feedback information. For example, in an in-vehicle display system, a haptic feedback component can be set in the central control area. When the driver performs a touch operation on the central control area, haptic feedback for the touch operation is provided to the driver in the form of vibration, thereby avoiding distraction caused by the driver's long-term gaze at the display screen, improving the driver's operation control of the central control area, and enhancing driving safety.

[0044] Vibratory haptic feedback is the most common type of haptic feedback at present. For example, some smartphones can provide a simple vibration function for confirmation and reminder. Commonly used vibratory haptic actuators mainly include an eccentric rotary mass (EPM), a linear resonant actuator (LRA), and a piezoelectric ceramic (Piezo). Among them, the EPM is simple to drive and has a low cost, but has a slow response speed, a weak vibration intensity, and high power consumption; the LRA has a fast response speed, a large vibration intensity, and low power consumption, but a slight deviation in the resonant frequency will cause a significant decrease in the vibration intensity, thereby weakening the vibration effect; the piezoelectric ceramic has a faster response speed, a wide driving frequency band, a large vibration intensity, low power consumption, and low acoustic noise, so its comprehensive performance is better.

[0045] Piezoelectric materials have the direct piezoelectric effect and the inverse piezoelectric effect. If pressure is applied to a piezoelectric material, electric polarization will occur inside it and a potential difference will be generated, which is called the direct piezoelectric effect. At this time, if the applied pressure is a high-frequency vibration, the piezoelectric material will generate a high-frequency current. Conversely, if a voltage is applied to the piezoelectric material, it will generate mechanical stress, which is called the inverse piezoelectric effect. At this time, if the applied voltage is a high-frequency voltage signal, the piezoelectric material will generate mechanical vibration. This characteristic of piezoelectric materials enables them to achieve both touch operations and haptic feedback at the same time. For example, the direct piezoelectric effect can be used to achieve touch operations on a touch screen, while the inverse piezoelectric effect can be used to generate vibratory haptic feedback, so it is particularly suitable for the function realization of various intelligent terminal devices.

[0046] In the following description of various embodiments of the present disclosure, a piezoelectric ceramic is often used as an example of a vibration unit for illustration. However, those skilled in the art can understand that this is only an example rather than a limitation. According to the methods, apparatuses, and devices of the embodiments of the present disclosure, other vibration components other than piezoelectric ceramics can also be used, such as eccentric rotor motors, linear resonant actuators, and other commonly used or future-appearing applicable vibration components.

[0047] The following refers to Figure 1 Describe a tactile feedback generation method according to an embodiment of the present disclosure. Figure 1 FIG. shows a flowchart of a tactile feedback generation method 100 according to an embodiment of the present disclosure. The tactile feedback generation method 100 can be executed by various devices equipped with a tactile feedback generation device, such as a smart phone, a tablet device, a wearable device, a game device, an in-vehicle display device, etc. The embodiments of the present disclosure do not make specific limitations thereto.

[0048] In step S110, a touch input of a user is detected. The touch input can be, for example, an operation of the user on a display unit such as a touch screen, such as a click operation, a swipe operation, a drag-and-drop operation, a zoom operation, a rotation operation, etc. The touch input can be detected by using a touch sensing element to collect a touch electrical signal corresponding to the touch input, where the touch electrical signal can be, for example, a voltage signal, a current signal, etc. For example, a resistive sensing element, a capacitive sensing element, an infrared sensing element, a surface acoustic wave sensing element, etc. can be used to detect the touch input of the user. Also, for example, a piezoelectric ceramic can be used to collect a piezoelectric change signal generated by the touch operation of the user, so as to detect the touch input of the user. The embodiments of the present disclosure do not make specific limitations on the specific method for detecting the touch input of the user.

[0049] In step S120, the operation type of the user is determined based on the detected touch input. Specifically, the operation type of the user can be determined when the touch electrical signal corresponding to the touch input is greater than the touch threshold, and then corresponding vibration feedback can be generated in subsequent steps. Otherwise, if the touch electrical signal is less than the touch threshold, the touch input can be recognized as a misoperation and the touch input can be ignored. According to an example of an embodiment of the present disclosure, the number of touch points can be determined based on the detected touch input. For example, the number of touch points can be determined based on the touch electrical signal collected by the touch sensing element corresponding to the touch input. Generally, different touch operations on the touch screen have different numbers of touch points. For example, for operations such as clicking, swiping, and dragging and dropping, although their touch areas are different, it can be considered that the number of their touch points is 1. For operations such as zooming and rotating (specifically, for example, the rotation operation of a virtual knob), at least two touch points are required. Therefore, when the number of touch points is greater than one, the operation type can be determined as one of the zoom operation or the rotation operation, and when the number of touch points is equal to one, the operation type can be determined as one of the click operation, the swipe operation, or the drag and drop operation, as will be further described in detail below.

[0050] It should be noted that the above method for determining the operation type is only an example and not a limitation. For example, other operation types other than zooming, rotating, clicking, swiping, and dragging and dropping can also be determined. The embodiments of the present disclosure do not make specific limitations thereto. In addition, the rotation operation mentioned here is, for example, the rotation operation of a virtual knob, which requires at least two touch points. For the operation of pressing a virtual object on the touch screen with a single finger and rotating it clockwise or counterclockwise, in essence, it can be similar to a swipe or drag and drop operation with a single touch point.

[0051] After determining the type of user operation, in step S130, at least a vibration control signal for controlling at least one of one or more vibration units is generated according to the operation type. In step S140, the vibration control signal controls the at least one vibration unit to vibrate to generate a vibration feedback corresponding to the user's touch input. To achieve haptic feedback, one or more vibration units may be arranged in a display unit such as a touch screen. Specifically, according to the number of vibration units, the haptic feedback device can be divided into single-drive and multi-drive. Among them, single-drive uses only one vibration unit arranged at the center of the display unit, while multi-drive arranges multiple vibration units in multiple areas of the display unit to achieve a better vibration effect. The one or more vibration units may be arranged, for example, on the back of the display unit or in a non-display area on the front of the display unit, such as within the border around the display screen. In the example of the embodiment of the present disclosure, the vibration unit may be implemented using piezoelectric ceramics, but the embodiment of the present disclosure is not limited thereto, and other applicable vibration components such as eccentric rotor motors, linear resonant actuators, and other commonly used or future-emerging ones may also be used. In the example where the vibration unit is implemented using piezoelectric ceramics, the vibration control signal may be, for example, a voltage signal for driving the corresponding vibration unit to vibrate, or the vibration control signal may control another voltage generation device to generate a voltage signal for driving the vibration unit. The embodiment of the present disclosure does not make specific limitations on this.

[0052] Specifically, the operation direction of the current operation type can be determined, and then a vibration control signal for controlling at least one of one or more vibration units is generated according to the operation direction of the current operation type. According to the example of the embodiment of the present disclosure, for different operation directions of the determined operation type, vibration control signals for controlling vibration units located at different positions among one or more vibration units can be generated, and further, vibration feedbacks located at different positions are generated based on the vibration control signals. In this way, after the user performs a touch input, the user can judge the specific operation type achieved according to the position of the felt vibration feedback. For example, whether a zoom-in operation or a zoom-out operation, a clockwise rotation operation or a counterclockwise rotation operation, a left-right sliding operation or an up-down sliding operation, a left-right drag-and-drop operation or an up-down drag-and-drop operation, etc. are achieved.

[0053] According to another example of the embodiments of the present disclosure, for different operation directions of the determined operation type, vibration control signals for controlling different numbers of vibration units among one or more vibration units can be generated, and then vibration feedbacks with different vibration intensities can be generated based on the vibration control signals. In this way, after the user performs a touch input, the user can determine the specific operation type achieved according to the vibration intensity of the felt vibration feedback. For example, whether a zoom-in operation or a zoom-out operation is achieved, a clockwise rotation operation or a counterclockwise rotation operation, a left-right swipe operation or an up-down swipe operation, a left-right drag-and-drop operation or an up-down drag-and-drop operation, etc. In this example, for different operation directions of the operation type, after determining the number of vibration units to be driven, the vibration control signal can cause any such number of vibration units among one or more vibration units to vibrate. Alternatively, after determining the number of vibration units to be driven, the positions of the determined number of vibration units to be driven can be further determined, and vibration control signals for controlling these vibration units can be generated.

[0054] According to another example of the embodiments of the present disclosure, after determining the operation direction of the current operation type, a linearly or non-linearly varying vibration control signal can be generated, and the vibration control signal controls at least one vibration unit to generate vibration feedback whose vibration frequency and / or intensity increases or decreases along the operation direction. Specifically, for different operation directions of the determined operation type, vibration control signals for controlling at least one vibration unit to generate vibration feedback whose vibration frequency and / or intensity increases or decreases along the operation direction can be generated. In this way, after the user performs a touch input, the user can determine the specific operation type achieved according to the change characteristics of the felt vibration feedback (for example, whether the vibration frequency and / or intensity increases or decreases along a certain operation direction). For example, whether a zoom-in operation or a zoom-out operation is achieved, a clockwise rotation operation or a counterclockwise rotation operation, a left-right swipe operation or an up-down swipe operation, a left-right drag-and-drop operation or an up-down drag-and-drop operation, etc. For example, the vibration control signal can drive the vibration units arranged along the operation direction in sequence with different frequencies and / or intensities, so that as the user's finger moves, the position of the vibration feedback moves accordingly and the frequency and intensity of the vibration feedback also increase or decrease, thereby providing the user with a richer tactile experience.

[0055] In addition, the tactile feedback generation method 100 according to the embodiments of the present disclosure may further include determining the area of the touch point based on the detected touch input. For example, the touch area can be determined based on the magnitude of the touch electrical signal collected by the touch sensing element. A vibration control signal can be generated in positive correlation with the touch area, that is, the larger the touch area, the higher the vibration frequency and / or intensity of the vibration feedback generated based on the vibration control signal, and correspondingly, the stronger the vibration felt by the user.

[0056] Refer to the followingFigures 2A to 5D Specific examples in

[0057] <First example>

[0058] After determining the number of touch points based on the detected touch input, if the number of touch points is greater than one, it is possible to further determine that the user's operation type is one of a zoom operation or a rotation operation.

[0059] Generally, the user needs to use two fingers (such as the thumb and index finger) to perform a zoom operation on the touch screen, and at this time the number of touch points is two. Figures 2A to 2E An example of a zoom operation according to an embodiment of the present disclosure is shown. As Figures 2A to 2E shown, when performing a zoom operation, the user's two fingers generally slide or approximately slide along a straight line in two opposite directions. For example, when performing a zoom-in operation, the two fingers slide away from each other in opposite directions, and the sliding force gradually weakens; while when performing a zoom-out operation, the two fingers slide closer from opposite directions, and the sliding force gradually increases. Based on this operation characteristic, when it is determined that the number of touch points is greater than one and the touch electrical signals corresponding to the touch input are a pair of continuous signals that increase or decrease in two opposite directions, the operation type can be determined as a zoom operation. Specifically, when it is determined that the number of touch points is greater than one and the touch electrical signals corresponding to the touch input are a pair of continuous signals that increase in two opposite directions, the current operation type can be determined as a zoom-out operation; and when it is determined that the number of touch points is greater than one and the touch electrical signals corresponding to the touch input are a pair of continuous signals that decrease in two opposite directions, the current operation type can be determined as a zoom-in operation.

[0060] In response to determining that the operation type is a zoom-in operation or a zoom-out operation, the vibration control signal can drive the vibration units at different positions to vibrate to generate vibration feedback. Figures 2A to 2B And Figures 2C to 2D Examples of two vibration units and four vibration units are shown respectively, where the two vibration units can be arranged on the left and right sides of the display unit respectively, and the four vibration units can be arranged on the upper side, lower side, left side and right side of the display unit respectively. It can be understood that Figures 2A to 2D The number and arrangement manner of the vibration units shown are only examples rather than limitations. According to actual design requirements, more or fewer vibration units can be arranged, and the vibration units can also be arranged at other appropriate positions of the display unit.

[0061] For example, in the case of the two vibration units shown in Figures 2A to 2B , when it is determined that the operation type is a zoom-in operation, the vibration control signal can drive the vibration unit on the left side to vibrate, as shown in Figure 2Aas shown; and when it is determined that the operation type is a zoom-out operation, the vibration control signal can drive the vibration unit on the right side to vibrate, as Figure 2B shown. For another example, in the case of the four vibration units shown in Figures 2C to 2D , when it is determined that the operation type is a zoom-in operation, the vibration control signal can drive the vibration units on the left and right sides to vibrate, as Figure 2C shown; and when it is determined that the operation type is a zoom-out operation, the vibration control signal can drive the vibration units on the upper and lower sides to vibrate, as Figure 2D shown. In this way, for the zoom-in operation and the zoom-out operation, vibration feedback at different positions can be provided to the user, so that the user can determine whether the zoom-in operation or the zoom-out operation is achieved only based on the vibration position. It should be noted that, in this example, the corresponding vibration units driven for the zoom-in or zoom-out operation are only examples rather than limitations. In the case of two driving units, the vibration unit on the right side can also be driven for the zoom-in operation and the vibration unit on the left side can be driven for the zoom-out operation; and in the case of four driving units, the vibration units on the upper and lower sides or other combinations of vibration units can also be driven for the zoom-in operation, and the vibration units on the left and right sides or other combinations of vibration units can be driven for the zoom-out operation. For the sake of brevity, the detailed description of various other embodiments is omitted in the embodiments of the present disclosure.

[0062] Alternatively, in response to determining that the operation type is a zoom-in operation or a zoom-out operation, the vibration control signal can drive different numbers of vibration units to vibrate to generate vibration feedback. For example, in the case of the two vibration units shown in Figures 2A to 2B , when it is determined that the operation type is a zoom-in operation, only one vibration unit can be driven to vibrate, and when it is determined that the operation type is a zoom-out operation, two vibration units can be driven to vibrate simultaneously. For another example, in the case of the two vibration units shown in Figures 2C to 2D , when it is determined that the operation type is a zoom-in operation, only two vibration units can be driven to vibrate, and when it is determined that the operation type is a zoom-out operation, four vibration units can be driven to vibrate simultaneously. In this way, for the zoom-out operation and the zoom-in operation, vibration feedback of different intensities can be provided to the user, so that the user can determine whether the zoom-in operation or the zoom-out operation is achieved only based on the vibration intensity. It should be noted that, in this example, the number of vibration units driven for the zoom-in or zoom-out operation is only an example rather than a limitation. In the case of two driving units, two vibration units can also be driven for the zoom-in operation and one vibration unit can be driven for the zoom-out operation; and in the case of four driving units, four vibration units or other numbers of vibration units can also be driven for the zoom-in operation, and two vibration units or other numbers of vibration units can be driven for the zoom-out operation. For the sake of brevity, the detailed description of various other embodiments is omitted in the embodiments of the present disclosure.

[0063] Alternatively, in response to determining that the operation type is a zoom operation, the vibration control signal can also drive at least one of the one or more vibration units to generate continuous vibration feedback with the vibration frequency or intensity increasing or decreasing in two opposite directions, as Figure 2E shown. For example, when determining that the operation type is a shrink operation, the vibration control signal can drive at least one vibration unit to generate continuous vibration feedback that increases (or decreases) in two opposite directions; and when determining that the operation type is a magnify operation, the vibration control signal can drive at least one vibration unit to generate continuous vibration feedback that decreases (or increases) in two opposite directions. The continuous vibration feedback of increasing or decreasing can be achieved, for example, by driving the corresponding vibration unit in turn with increasing or decreasing vibration frequency or intensity in these two opposite directions. In this way, for the magnify operation and the shrink operation, vibration feedback with different change characteristics can be provided to the user, so that the user can determine whether the shrink operation or the magnify operation is achieved only based on whether the vibration intensity increases or decreases along the operation direction.

[0064] <Second Example>

[0065] After determining the number of touch points based on the detected touch input, if the number of touch points is greater than one, it can be further determined that the operation type of the user is one of a zoom operation or a rotation operation.

[0066] Generally, when performing a rotation operation on a virtual object such as a virtual knob on a touch screen, the user needs to use two fingers (such as the thumb and index finger), and at this time the number of touch points is two. Figures 3A to 3D An example of a rotation operation according to an embodiment of the present disclosure is shown. As Figures 3A to 3D shown, when performing a rotation operation, the two fingers of the user generally rotate in the clockwise or counterclockwise direction. For example, when performing a clockwise rotation operation, the two fingers rotate clockwise respectively; and when performing a counterclockwise rotation operation, the two fingers rotate counterclockwise respectively. Then based on this operation characteristic, when it is determined that the number of touch points is greater than one and the touch electrical signals corresponding to the touch input are a pair of continuous signals in the clockwise or counterclockwise direction, it can be determined that the operation type is a rotation operation. Specifically, when it is determined that the number of touch points is greater than one and the touch electrical signals corresponding to the touch input are a pair of continuous signals in the clockwise direction, it can be determined that the current operation type is a clockwise rotation operation; and when it is determined that the number of touch points is greater than one and the touch electrical signals corresponding to the touch input are a pair of continuous signals in the counterclockwise direction, it can be determined that the current operation type is a counterclockwise rotation operation.

[0067] In response to determining that the operation type is a clockwise or counterclockwise rotation operation, the vibration control signal can drive the vibration units at different positions to vibrate to generate vibration feedback. Figures 3A to 3B AndFigures 3C to 3D Examples of two vibration units and four vibration units are respectively shown, where the two vibration units can be respectively arranged on the left and right sides of the display unit, and the four vibration units can be respectively arranged on the upper, lower, left, and right sides of the display unit. It can be understood that Figures 3A to 3D The number and arrangement of the shown vibration units are only examples rather than limitations. According to actual design requirements, more or fewer vibration units can be arranged, and the vibration units can also be arranged at other appropriate positions of the display unit.

[0068] For example, in Figures 3A to 3B the case of the two vibration units shown, when it is determined that the operation type is a clockwise rotation operation, the vibration control signal can drive the vibration unit on the left side to vibrate, as Figure 3A shown; and when it is determined that the operation type is a counterclockwise rotation operation, the vibration control signal can drive the vibration unit on the right side to vibrate, as Figure 3B shown. Again, for example, in Figures 3C to 3D the case of the four vibration units shown, when it is determined that the operation type is a clockwise rotation operation, the vibration control signal can drive the vibration units on the left and right sides to vibrate, as Figure 3C shown; and when it is determined that the operation type is a counterclockwise rotation operation, the vibration control signal can drive the vibration units on the upper and lower sides to vibrate, as Figure 3D shown. In this way, for clockwise rotation operations and counterclockwise rotation operations, vibration feedback at different positions can be provided to the user, so that the user can judge whether a clockwise rotation operation or a counterclockwise rotation operation is achieved only based on the vibration position. It should be noted that in this example, the corresponding vibration units driven for clockwise or counterclockwise rotation operations are only examples rather than limitations. In the case of two drive units, the vibration unit on the right side can also be driven for clockwise rotation operations and the vibration unit on the left side can be driven for counterclockwise rotation operations; and in the case of four drive units, the vibration units on the upper and lower sides or other combinations of vibration units can also be driven for clockwise rotation operations, and the vibration units on the left and right sides or other combinations of vibration units can be driven for counterclockwise rotation operations. For the sake of brevity, the detailed description of various other embodiments is omitted in the embodiments of the present disclosure.

[0069] Alternatively, in response to determining that the operation type is a clockwise or counterclockwise rotation operation, the vibration control signal can drive different numbers of vibration units to vibrate to generate vibration feedback. For example, in Figures 3A to 3B the case of the two vibration units shown, when it is determined that the operation type is a clockwise rotation operation, only one vibration unit can be driven to vibrate, and when it is determined that the operation type is a counterclockwise rotation operation, two vibration units can be driven to vibrate simultaneously. Again, for example, in Figures 3C to 3DIn the case of the two vibration units shown, when it is determined that the operation type is a clockwise rotation operation, only the two vibration units can be driven to vibrate, and when it is determined that the operation type is a counterclockwise rotation operation, the four vibration units can be driven to vibrate simultaneously. In this way, different intensities of vibration feedback can be provided for the clockwise and counterclockwise rotation operations, so that the user can determine whether a clockwise rotation operation or a counterclockwise rotation operation is achieved only based on the vibration intensity. It should be noted that in this example, the number of vibration units driven for the clockwise and counterclockwise rotation operations is only an example rather than a limitation. In the case of two drive units, two vibration units can also be driven for the clockwise rotation operation and one vibration unit for the counterclockwise rotation operation; and in the case of four drive units, four vibration units or other numbers of vibration units can also be driven for the clockwise rotation operation, and two vibration units or other numbers of vibration units can be driven for the counterclockwise rotation operation. For the sake of brevity, the embodiments of the present disclosure omit the detailed description of various other embodiments.

[0070] Alternatively, in response to determining that the operation type is a rotation operation, the vibration control signal can also drive at least one of the one or more vibration units to generate continuous vibration feedback with the vibration frequency or intensity increasing or decreasing in the clockwise or counterclockwise direction. For example, when it is determined that the operation type is a clockwise rotation operation, the vibration control signal can drive at least one vibration unit to generate continuous vibration feedback increasing (or decreasing) in the clockwise direction; and when it is determined that the operation type is a counterclockwise rotation operation, the vibration control signal can drive at least one vibration unit to generate continuous vibration feedback decreasing (or increasing) in the counterclockwise direction. The continuous vibration feedback of increasing or decreasing can be achieved, for example, by driving the corresponding vibration unit in sequence with increasing or decreasing vibration frequency or intensity in the clockwise or counterclockwise direction. In this way, different changing characteristics of vibration feedback can be provided for the clockwise and counterclockwise rotation operations, so that the user can determine whether a clockwise rotation operation or a counterclockwise rotation operation is achieved only based on whether the vibration intensity increases or decreases along the operation direction.

[0071] <Third Example>

[0072] After determining the number of touch points based on the detected touch input, if the number of touch points is equal to one, it can be further determined that the user's operation type is one of a click operation, a swipe operation, or a drag-and-drop operation.

[0073] Generally, the user needs to use one finger (such as the index finger) to perform a swipe operation on the touch screen. At this time, the number of touch points is one, and the swipe operation usually occurs along a certain direction. Figures 4A to 4D An example of a swipe operation according to an embodiment of the present disclosure is shown. As Figures 4A to 4DAs shown, the user can slide left and right or up and down on the touch screen with the index finger. Based on this operation characteristic, when it is determined that the number of touch points is equal to one and the touch electrical signal corresponding to the touch input is a continuous signal in one direction, the operation type can be determined as a sliding operation. Specifically, for example, when it is determined that the number of touch points is equal to one and the touch electrical signal corresponding to the touch input is a continuous signal in the horizontal direction, the current operation type can be determined as a left - right sliding operation; and when it is determined that the number of touch points is equal to one and the touch electrical signal corresponding to the touch input is a continuous signal in the vertical direction, the current operation type can be determined as an up - down sliding operation.

[0074] In response to determining that the operation type is a left - right sliding operation or an up - down sliding operation, the vibration control signal can drive the vibration units at different positions to vibrate to generate vibration feedback. Figures 4A to 4B And Figures 4C to 4D Examples of two vibration units and four vibration units are respectively shown, where the two vibration units can be respectively arranged on the left and right sides of the display unit, and the four vibration units can be respectively arranged on the upper side, lower side, left side and right side of the display unit. It can be understood that Figures 4A to 4D The number and arrangement of the shown vibration units are only examples rather than limitations. According to actual design requirements, more or fewer vibration units can be arranged, and the vibration units can also be arranged at other appropriate positions of the display unit.

[0075] For example, in Figures 4A to 4B the case of the two vibration units shown, when it is determined that the operation type is a left - right sliding operation, the vibration control signal can drive the left - hand vibration unit to vibrate, as Figure 4A shown, and when it is determined that the operation type is an up - down sliding operation, the vibration control signal can drive the right - hand vibration unit to vibrate, as Figure 4B shown. Another example, in Figures 4C to 4D the case of the four vibration units shown, when it is determined that the operation type is a left - right sliding operation, the vibration control signal can drive the left - hand or right - hand vibration unit to vibrate, as Figure 4C shown, and when it is determined that the operation type is an up - down sliding operation, the vibration control signal can drive the upper - hand or lower - hand vibration unit to vibrate, as Figure 4DAs shown. In this way, for left - right sliding operations and up - down sliding operations, vibration feedback at different positions can be provided to the user, enabling the user to determine whether a left - right sliding operation or an up - down sliding operation has been achieved based solely on the vibration position. It should be noted that in this example, the corresponding vibration units driven for left - right sliding or up - down sliding operations are merely examples and not limitations. In the case of two driving units, it is also possible to drive the right - hand vibration unit for left - right sliding operations and the left - hand vibration unit for up - down sliding operations; and in the case of four driving units, for example, it is also possible to drive the left - hand, right - hand, upper - hand, and lower - hand vibration units for left, right, up, and down sliding operations respectively. For the sake of brevity, the detailed description of various other embodiments is omitted in the embodiments of the present disclosure.

[0076] Alternatively, in response to determining that the operation type is a left - right sliding operation or an up - down sliding operation, the vibration control signal can drive different numbers of vibration units to vibrate to generate vibration feedback. For example, in Figures 4A to 4B the case of the two vibration units shown, when it is determined that the operation type is a left - right sliding operation, only one vibration unit can be driven to vibrate, and when it is determined that the operation type is an up - down sliding operation, two vibration units can be driven to vibrate simultaneously. Again, for example, in Figures 4C to 4D the case of the two vibration units shown, when it is determined that the operation type is a left - right sliding operation, two vibration units can be driven to vibrate, and when it is determined that the operation type is an up - down sliding operation, four vibration units can be driven to vibrate simultaneously. In this way, for left - right sliding operations and up - down sliding operations, vibration feedback of different intensities can be provided to the user, enabling the user to determine whether a left - right sliding operation or an up - down sliding operation has been achieved based solely on the vibration intensity. It should be noted that in this example, the number of vibration units driven for left - right sliding or up - down sliding operations is merely an example and not a limitation. In the case of two driving units, it is also possible to drive two vibration units for left - right sliding operations and one vibration unit for up - down sliding operations; and in the case of four driving units, for example, it is also possible to drive one, two, three, and four vibration units for left, right, up, and down sliding operations respectively. For the sake of brevity, the detailed description of various other embodiments is omitted in the embodiments of the present disclosure.

[0077] Alternatively, in response to determining that the operation type is a swipe operation, the vibration control signal can also drive at least one of the one or more vibration units to generate continuous vibration feedback with an increasing or decreasing vibration frequency or intensity in the swipe direction. For example, when it is determined that the operation type is a left swipe operation, the vibration control signal can drive at least one vibration unit to generate continuous vibration feedback that decreases in the horizontal direction; when it is determined that the operation type is a right swipe operation, the vibration control signal can drive at least one vibration unit to generate continuous vibration feedback that increases in the horizontal direction; when it is determined that the operation type is a down swipe operation, the vibration control signal can drive at least one vibration unit to generate continuous vibration feedback that decreases in the vertical direction; and when it is determined that the operation type is an up swipe operation, the vibration control signal can drive at least one vibration unit to generate continuous vibration feedback that increases in the vertical direction. The increasing or decreasing continuous vibration feedback can be achieved, for example, by driving the corresponding vibration unit in sequence with an increasing or decreasing vibration frequency or intensity in the swipe direction. In this way, for left, right, down, and up swipe operations, vibration feedback with different change characteristics can be provided to the user, enabling the user to determine whether a left, right, down, or up swipe operation has been performed based solely on whether the vibration intensity decreases horizontally, increases horizontally, decreases vertically, or increases vertically.

[0078] <Fourth Example>

[0079] After determining the number of touch points based on the detected touch input, if the number of touch points is equal to one, it can be further determined that the user's operation type is one of a click operation, a swipe operation, or a drag-and-drop operation.

[0080] Generally, the user needs to use one finger (e.g., the index finger) or multiple fingers held together (e.g., the index finger and the middle finger held together) to perform a drag-and-drop operation on a virtual object in the touch screen. At this time, the number of touch points is one, and the drag-and-drop operation is usually along a certain direction. Additionally, the drag-and-drop operation is usually performed on a virtual object (e.g., an application icon) located in a specific known area of the touch screen, and a slightly greater pressure needs to be applied before the drag-and-drop to select the touch object to be dragged. Figures 5A to 5D Shows an example of a drag-and-drop operation according to an embodiment of the present disclosure. As Figures 5A to 5DAs shown, the user can perform a left - right drag - and - drop operation on the touch screen with the index finger and middle finger together. Based on the characteristics of the drag - and - drop operation, when it is determined that the number of touch points is equal to one, the initial position of the touch point is located in a specific area, and the touch electrical signal corresponding to the touch input is a continuous signal in one direction with an initial amplitude greater than a specific threshold, the operation type can be determined as a drag - and - drop operation, and further whether the drag - and - drop operation is a left - right drag - and - drop operation or an up - down drag - and - drop operation can be determined. For example, when it is determined that the touch electrical signal is a continuous signal in the horizontal direction, the current operation type can be determined as a left - right drag - and - drop operation; and when it is determined that the touch electrical signal is a continuous signal in the vertical direction, the current operation type can be determined as an up - down drag - and - drop operation.

[0081] In response to determining that the operation type is a left - right drag - and - drop operation or an up - down drag - and - drop operation, the vibration control signal can drive the vibration units at different positions to vibrate to generate vibration feedback. Figures 5A to 5B And Figures 5C to 5D Examples of two vibration units and four vibration units are respectively shown, where the two vibration units can be respectively arranged on the left and right sides of the display unit, and the four vibration units can be respectively arranged on the upper side, lower side, left side, and right side of the display unit. It can be understood that Figures 5A to 5D The number and arrangement of the shown vibration units are only examples rather than limitations. According to actual design requirements, more or fewer vibration units can be arranged, and the vibration units can also be arranged at other appropriate positions of the display unit.

[0082] For example, in Figures 5A to 5B the case of the two vibration units shown, when it is determined that the operation type is a left - right drag - and - drop operation, the vibration control signal can drive the left - hand vibration unit to vibrate, as Figure 5A shown; and when it is determined that the operation type is an up - down drag - and - drop operation, the vibration control signal can drive the right - hand vibration unit to vibrate, as Figure 5B shown. Also, for example, in Figures 5C to 5D the case of the four vibration units shown, when it is determined that the operation type is a left - right drag - and - drop operation, the vibration control signal can drive the left - hand or right - hand vibration unit to vibrate, as Figure 5C shown; and when it is determined that the operation type is an up - down drag - and - drop operation, the vibration control signal can drive the upper - hand or lower - hand vibration unit to vibrate, as Figure 5DAs shown. In this way, for left - right and up - down drag - and - drop operations, vibration feedback at different positions can be provided to the user, enabling the user to determine whether a left - right or up - down drag - and - drop operation has been achieved based solely on the vibration position. It should be noted that in this example, the corresponding vibration units driven for left - right or up - down drag - and - drop operations are merely examples and not limitations. In the case of two drive units, it is also possible to drive the right - hand vibration unit for left - right drag - and - drop operations and the left - hand vibration unit for up - down drag - and - drop operations; and in the case of four drive units, for example, it is also possible to drive the left - hand, right - hand, upper - hand, and lower - hand vibration units for left, right, up, and down drag - and - drop operations respectively. For the sake of brevity, the detailed description of various other embodiments is omitted in the embodiments of the present disclosure.

[0083] Alternatively, in response to determining that the operation type is a left - right or up - down drag - and - drop operation, the vibration control signal can drive different numbers of vibration units to vibrate to generate vibration feedback. For example, in Figures 5A to 5B the case of the two vibration units shown, when it is determined that the operation type is a left - right drag - and - drop operation, only one vibration unit can be driven to vibrate, and when it is determined that the operation type is an up - down drag - and - drop operation, two vibration units can be driven to vibrate simultaneously. Again, for example, in Figures 5C to 5D the case of the two vibration units shown, when it is determined that the operation type is a left - right drag - and - drop operation, two vibration units can be driven to vibrate, and when it is determined that the operation type is an up - down drag - and - drop operation, four vibration units can be driven to vibrate simultaneously. In this way, for left - right and up - down drag - and - drop operations, different intensities of vibration feedback can be provided to the user, enabling the user to determine whether a left - right or up - down drag - and - drop operation has been achieved based solely on the vibration intensity. It should be noted that in this example, the number of vibration units driven for left - right or up - down drag - and - drop operations is merely an example and not a limitation. In the case of two drive units, it is also possible to drive two vibration units for left - right drag - and - drop operations and one vibration unit for up - down drag - and - drop operations; and in the case of four drive units, for example, it is also possible to drive one, two, three, and four vibration units for left, right, up, and down drag - and - drop operations respectively. For the sake of brevity, the detailed description of various other embodiments is omitted in the embodiments of the present disclosure.

[0084] Alternatively, in response to determining that the operation type is a drag-and-drop operation, the vibration control signal can also drive at least one of the one or more vibration units to generate continuous vibration feedback with a vibration frequency or intensity that increases or decreases in the drag-and-drop direction. For example, when it is determined that the operation type is a left drag-and-drop operation, the vibration control signal can drive at least one vibration unit to generate continuous vibration feedback that decreases in the horizontal direction; when it is determined that the operation type is a right drag-and-drop operation, the vibration control signal can drive at least one vibration unit to generate continuous vibration feedback that increases in the horizontal direction; when it is determined that the operation type is a down drag-and-drop operation, the vibration control signal can drive at least one vibration unit to generate continuous vibration feedback that decreases in the vertical direction; and when it is determined that the operation type is an up drag-and-drop operation, the vibration control signal can drive at least one vibration unit to generate continuous vibration feedback that increases in the vertical direction. The continuous vibration feedback with increasing or decreasing can be achieved, for example, by driving the corresponding vibration unit in sequence with an increasing or decreasing vibration frequency or intensity in the sliding direction. In this way, for left, right, down, and up drag-and-drop operations, vibration feedback with different variation characteristics can be provided to the user, so that the user can determine whether a left, right, down, or up drag-and-drop operation has been achieved only based on whether the vibration intensity decreases horizontally, increases horizontally, decreases vertically, or increases vertically.

[0085] <Fifth Example>

[0086] After determining the number of touch points based on the detected touch input, if the number of touch points is equal to one, it can be further determined that the user's operation type is one of a click operation, a swipe operation, or a drag-and-drop operation.

[0087] Generally, the user needs to use one finger (e.g., the index finger) or multiple fingers held together (e.g., the index finger and the middle finger held together) to perform a click operation on a virtual object in the touch screen. At this time, the number of touch points is one, and the click operation is usually single and fast. Based on the characteristics of the click operation, when the number of touch points is equal to one and the touch electrical signal corresponding to the touch input is a short pulse signal, it can be determined that the operation type is a click operation. In response to determining that the operation type is a click operation, the vibration control signal can control at least one of the one or more vibration units to generate single-shot short-term vibration feedback. In addition, different intensities of vibration feedback can also be generated according to the touch area or click force of the click operation. For example, different intensities of vibration feedback can be generated by driving different numbers of vibration units, or by driving a certain vibration unit with different vibration frequencies and / or intensities.

[0088] The method for determining the operation type of a user and generating a vibration control signal for driving a vibration unit according to the operation type in accordance with embodiments of the present disclosure has been described with reference to specific examples. It is readily understood by those skilled in the art that the above five examples are not exhaustive, but merely list some implementation examples of the haptic feedback generation method according to embodiments of the present disclosure, and the number of elements, arrangement manners, specific operation manners, etc. in these examples do not constitute a limitation to the method of the present disclosure.

[0089] By using the haptic feedback generation method according to embodiments of the present disclosure, the operation type of the user is determined based on the detected touch input, and at least one vibration unit is controlled to generate vibration feedback at different positions, with different intensities, or with different variation characteristics according to different operation directions of the operation type, so that the user can confirm the specific operation type achieved only according to the position, intensity, or variation characteristics of the felt vibration feedback, thereby simplifying the operation procedure and improving the user's interaction experience.

[0090] The following refers to Figure 6 Describe a haptic feedback generation device according to embodiments of the present disclosure. Figure 6 FIG. shows a schematic structural diagram of a haptic feedback generation device 600 according to embodiments of the present disclosure. As Figure 6 shown, the haptic feedback device 600 may include a display unit 610, a touch sensing unit 620, a control unit 630, and one or more vibration units 640. In addition to these four components, the touch feedback device may further include more other components, such as a voltage generation device, connection wires, etc., but since these components are not relevant to the main inventive concept of the present disclosure, the detailed description thereof is omitted here. Additionally, since the functions of the respective components of the haptic feedback generation device 600 are similar to the details of the method described above with reference to Figure 1 therefore, the repeated description of some content is omitted here. The display unit 610, the touch sensing unit 620, the control unit 630, one or more vibration units 640, and possible other components may be electrically connected to each other, or may be connected to a common bus, and the present disclosure embodiment does not make specific limitations on the connection manners of the respective components. The haptic feedback generation device 600 according to embodiments of the present disclosure may be implemented, for example, in terminals such as smart phones, tablet devices, wearable devices, gaming devices, in-vehicle display devices, etc., and the present disclosure embodiment does not make specific limitations thereon.

[0091] The display unit 610 is configured to receive a touch input from a user, which may be, for example, a touch screen or other device capable of receiving a touch input from a user. The user performs operations such as clicking, swiping, dragging, zooming, rotating, etc. on the display unit 610 to perform a touch input. For example, the user can click on a certain application icon on the display unit 610 to start the application. Also, for example, the user can swipe left or right with a single finger on the display unit 610 to switch the display interface.

[0092] The touch sensing unit 620 is configured to detect a touch input from a user by collecting a touch electrical signal corresponding to the touch input, where the touch electrical signal may be, for example, a voltage signal, a current signal, etc. For example, the touch sensing unit 620 can use a resistive sensing element, a capacitive sensing element, an infrared sensing element, a surface acoustic wave sensing element, etc. to detect a touch input from a user. Also, for example, the touch sensing unit 620 can also use a piezoelectric ceramic to collect a piezoelectric change signal generated by a touch operation of the user, thereby detecting a touch input from a user. The embodiments of the present disclosure do not specifically limit the specific method for detecting a touch input from a user. The touch sensing unit 620 can be disposed, for example, on the upper side, the lower side, or any other appropriate position of the display unit 610, and the embodiments of the present disclosure do not specifically limit this.

[0093] The control unit 630 is configured to determine the operation type of the user based on the detected touch input when the touch electrical signal is greater than a touch threshold. Specifically, the control unit 630 can determine the operation type of the user when the touch electrical signal corresponding to the touch input is greater than the touch threshold, and then control the vibration unit to generate a corresponding vibration feedback in subsequent steps. Otherwise, if the touch electrical signal is less than the touch threshold, the touch input can be recognized as a misoperation and the touch input can be ignored. According to an example of the embodiments of the present disclosure, the control unit 630 can determine the number of touch points based on the detected touch input, for example, determine the number of touch points based on the touch electrical signal corresponding to the touch input collected by the touch sensing unit 620. Generally, different touch operations on a touch screen have different numbers of touch points. For example, for operations such as clicking, swiping, dragging, etc., although their touch areas are different, it can be considered that the number of touch points is 1 for all of them, while for operations such as zooming, rotating (specifically, for example, rotating a virtual knob), etc., at least two touch points are required. Thus, when the number of touch points is greater than one, the operation type can be determined as one of the zoom operation or the rotation operation, and when the number of touch points is equal to one, the operation type can be determined as one of the click operation, the swipe operation, or the drag operation, as specifically described above with reference to Figures 2A to 5D as detailed.

[0094] It should be noted that the above method for determining the operation type is only an example and not a limitation. For example, the control unit 630 can also determine other operation types in addition to zooming, rotating, clicking, swiping, and dragging. The embodiments of the present disclosure do not make specific limitations in this regard. In addition, the rotation operation mentioned here refers to, for example, the rotation operation of a virtual knob, which requires at least two touch points. For the operation of rotating a virtual object on the touch screen clockwise or counterclockwise with a single finger press, it can actually be analogized to a swipe or drag operation with a single touch point.

[0095] After determining the operation type of the user, the control unit 630 generates at least a vibration control signal for controlling at least one of the one or more vibration units 640 according to the operation type. The vibration control signal controls the at least one vibration unit to vibrate to generate a vibration feedback corresponding to the user's touch input. In order to achieve haptic feedback, one or more vibration units 640 can be arranged in a display unit 610 such as a touch screen. Specifically, according to the number of vibration units, the haptic feedback device can be divided into single-drive and multi-drive. Among them, single-drive uses only one vibration unit arranged at the center of the display unit, while multi-drive arranges multiple vibration units in multiple areas of the display unit to achieve a better vibration effect. The one or more vibration units 640 can be arranged, for example, on the back of the display unit 610, or in a non-display area on the front of the display unit 610, such as within the border around the display screen. In the example of the embodiments of the present disclosure, the vibration unit 640 can be implemented using piezoelectric ceramics, but the embodiments of the present disclosure are not limited thereto, and other commonly used or future-appearing applicable vibration components such as eccentric rotor motors, linear resonant actuators can also be used. In the example where the vibration unit 640 is implemented using piezoelectric ceramics, the vibration control signal can be, for example, a voltage signal for driving the corresponding vibration unit to vibrate, or the vibration control signal can control another voltage generating device to generate a voltage signal for driving the vibration unit. The embodiments of the present disclosure do not make specific limitations in this regard.

[0096] Specifically, the control unit 630 may determine the operation direction of the current operation type, and then generate a vibration control signal for controlling at least one of the one or more vibration units according to the operation direction of the current operation type. According to an example of an embodiment of the present disclosure, for different operation directions of the determined operation type, the control unit 630 may generate a vibration control signal for controlling vibration units located at different positions among the one or more vibration units, and further control at least one vibration unit 640 to generate vibration feedbacks located at different positions based on the vibration control signal. In this way, after the user performs a touch input, the user can determine the specific operation type achieved according to the position of the felt vibration feedback. For example, whether a zoom-in operation or a zoom-out operation is achieved, a clockwise rotation operation or a counterclockwise rotation operation, a left-right sliding operation or an up-down sliding operation, a left-right drag-and-drop operation or an up-down drag-and-drop operation, etc.

[0097] According to another example of an embodiment of the present disclosure, for different operation directions of the determined operation type, the control unit 630 may generate a vibration control signal for controlling different numbers of vibration units among the one or more vibration units, and further control at least one vibration unit 640 to generate vibration feedbacks with different vibration intensities based on the vibration control signal. In this way, after the user performs a touch input, the user can determine the specific operation type achieved according to the vibration intensity of the felt vibration feedback. For example, whether a zoom-in operation or a zoom-out operation is achieved, a clockwise rotation operation or a counterclockwise rotation operation, a left-right sliding operation or an up-down sliding operation, a left-right drag-and-drop operation or an up-down drag-and-drop operation, etc. In this example, for different operation directions of the operation type, after determining the number of vibration units to be driven, the vibration control signal may cause any such number of vibration units among the one or more vibration units to vibrate. Alternatively, after determining the number of vibration units to be driven, the control unit 630 may further determine the positions of the number of vibration units to be driven and generate a vibration control signal for controlling these vibration units.

[0098] According to another example of the embodiments of the present disclosure, after determining the operation direction of the current operation type, the control unit 630 may generate a vibration control signal that changes linearly or non-linearly, and the vibration control signal controls at least one vibration unit 640 to generate vibration feedback whose vibration frequency and / or intensity increases or decreases along the operation direction. Specifically, for different operation directions of the determined operation type, the control unit 630 may generate a vibration control signal for controlling at least one vibration unit to generate vibration feedback whose vibration frequency and / or intensity increases or decreases along the operation direction. In this way, after the user performs a touch input, according to the change characteristics of the felt vibration feedback (for example, whether the vibration frequency and / or intensity increases or decreases along the operation direction), the user can determine the specific operation type achieved, for example, whether it is a zoom-in operation or a zoom-out operation, a clockwise rotation operation or a counterclockwise rotation operation, a left-right swipe operation or an up-down swipe operation, a left-right drag-and-drop operation or an up-down drag-and-drop operation, and so on. For example, the vibration control signal may drive the vibration units arranged along the operation direction in sequence with different frequencies and / or intensities, so that as the user's finger moves, the position of the vibration feedback moves accordingly and the frequency and intensity of the vibration feedback also increase or decrease, thereby providing the user with a richer tactile experience.

[0099] On the other hand, the control unit 630 is further configured to generate a display control signal for controlling the display unit 610 in response to the user's operation type, and the display control signal controls the display unit 610 to adjust the current display screen according to the operation type. For example, when determining that the user's current operation type is a zoom-in operation, the control unit 630 may generate a vibration control signal to control at least one vibration unit 640 to generate vibration feedback located on the left side of the display unit, and generate a display control signal to control the display unit 610 to adjust the current display screen to the zoom-in state. Similarly, for example, when determining that the user's current operation type is a zoom-out operation, the control unit 630 may generate a vibration control signal to control at least one vibration unit 640 to generate vibration feedback located on the right side of the display unit, and generate a display control signal to control the display unit 610 to adjust the current display screen to the zoom-out state.

[0100] In addition, the control unit 630 according to the embodiments of the present disclosure may further include determining the area of the touch point based on the detected touch input, for example, determining the touch area based on the magnitude of the touch electrical signal collected by the touch sensing element. The control unit 630 may generate a vibration control signal that is positively correlated with the touch area, that is, the larger the touch area, the higher the vibration frequency and / or intensity of the vibration feedback generated based on the vibration control signal, and correspondingly, the stronger the vibration felt by the user.

[0101] By using the haptic feedback generation device according to an embodiment of the present disclosure, the operation type of the user is determined based on the detected touch input, and at least one vibration unit is controlled according to different operation directions of the operation type to generate vibration feedback at different positions, with different intensities, or with different change characteristics, so that the user can confirm the specific operation type achieved only according to the position, intensity, or change characteristics of the felt vibration feedback, thereby simplifying the operation procedure and improving the user's interaction experience.

[0102] By using an electronic device that implements the haptic feedback generation method or haptic feedback generation device according to an embodiment of the present disclosure, convenient and efficient vibration haptic feedback can be provided to the user. For example, for a system equipped with a haptic feedback device (such as an in-vehicle display system), when the user performs a touch operation on any application in the system, the haptic feedback device can generate vibration feedback in response to the touch operation according to the above haptic feedback generation method. The following refers to Figure 7 Describe the system flowchart for generating vibration feedback according to an example of an embodiment of the present disclosure.

[0103] Figure 7 Shows a system flowchart 700 for generating vibration feedback according to an example of an embodiment of the present disclosure. As Figure 7 shown, in step S710, any application 702 in a system 701 such as an in-vehicle display system may request to obtain the in-vehicle haptic feedback device capabilities. For example, the application 702 may issue a request in response to the user starting the application 702. The system 701 forwards the request to the haptic feedback device 703 to request to obtain the haptic feedback device capabilities. In response to receiving the request, in step S720, the haptic feedback device 703 returns the haptic feedback device capabilities result to the system 701, and the system 701 returns it to the application 702. The haptic feedback device capabilities may include, for example, the number of vibration units, the positions of the vibration units, vibration parameters such as vibration acceleration, and so on. After receiving the haptic feedback device capabilities result, in step S730, the application 702 may establish the correspondence between the user operation and the vibration units, vibration special effects, etc., or alternatively, the system 701 may establish the correspondence and provide it to the application 702.

[0104] In step S740, the application 702 receives a touch input from the user. The touch input can be, for example, operations such as clicking, swiping, zooming, swiping, rotating, etc. on the application 702 by the user. For example, when the application 702 is a volume control application, the user can slide the volume control application to the left or right to decrease or increase the volume. In step S750, in response to receiving the touch input from the user, the application 702 can generate a vibration description file and send it to the system 701. The vibration description file can include, for example, vibration unit identification, vibration start time, vibration duration, vibration intensity, vibration frequency, vibration effect curve, and so on. In step S760, the system 701 generates a vibration special effect execution file based on the received vibration description file, and then in step S770, calls the haptic feedback device 703 to generate a corresponding vibration special effect.

[0105] For example, when the application 702 is a volume control application, when the user swipes the volume control application to the left to attempt to decrease the volume, the haptic feedback device 703 can drive the vibration units in the swiping direction to generate vibrations with different vibration intensities in sequence, so that the user feels a gradually weakening vibration feedback extending to the left, thereby confirming that they have successfully achieved the volume decrease operation. On the other hand, when the user swipes the volume control application to the right to attempt to increase the volume, the haptic feedback device 703 can drive the vibration units in the swiping direction to generate vibrations with different vibration intensities in sequence, so that the user feels a gradually strengthening vibration feedback extending to the right, thereby confirming that they have successfully achieved the volume increase operation.

[0106] An embodiment of the present disclosure also provides a haptic feedback generation device, which includes one or more processors and one or more memories. The memories store computer-readable instructions that, when run by the one or more processors, cause the one or more processors to execute the haptic feedback generation method according to the above embodiments of the present disclosure or implement the haptic feedback generation device according to the above embodiments of the present disclosure.

[0107] An embodiment of the present disclosure also provides a computer-readable storage medium. For example, the computer-readable storage medium is used to non-temporarily store computer-readable instructions that, when executed by a computer (including a processor), can execute the haptic feedback generation method according to the above embodiments of the present disclosure or implement the haptic feedback generation device according to the above embodiments of the present disclosure.

[0108] For example, the storage medium may be any combination of one or more computer-readable storage media. For example, one computer-readable storage medium contains computer-readable program code for detecting user touch input, and another computer-readable storage medium contains computer-readable program code for generating vibrotactile feedback. For example, when the program code is read by a computer, the computer may execute the program code stored in the computer storage medium to perform the tactile feedback generation method according to the foregoing embodiments of the present disclosure or implement the tactile feedback generation device according to the foregoing embodiments of the present disclosure.

[0109] For example, the storage medium may include a memory card of a smart phone, a storage component of a tablet computer, a hard disk of a personal computer, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a portable compact disc read-only memory (CD-ROM), a flash memory, or any combination of the above storage media, and may also be other applicable storage media.

[0110] In addition, an embodiment of the present disclosure further provides a vehicle-mounted display system, which can implement the tactile feedback generation method according to the foregoing embodiments of the present disclosure or include the tactile feedback generation device according to the foregoing embodiments of the present disclosure. For example, the tactile feedback generation device according to the embodiment of the present disclosure may be disposed in the central control area of the vehicle-mounted display system. When the driver performs a touch operation on the central control area, the tactile feedback generation device can provide the driver with tactile feedback for the touch operation in the form of vibration, thereby avoiding the distraction of the driver's attention caused by long-term viewing of the display screen, improving the driver's operation and control of the central control area, and improving driving safety.

[0111] The program part in the technology can be regarded as a "product" or "article" in the form of executable code and / or related data, which is participated in or implemented by a computer-readable medium. Tangible, permanent storage media can include any memory or storage used by a computer, processor, or similar device or related module. For example, various semiconductor memories, tape drives, disk drives, or any similar device capable of providing storage functions for software.

[0112] All software, or portions thereof, may sometimes communicate over a network, such as the Internet or other communications network. Such communications can load the software from one computer device or processor to another. Accordingly, another medium that can transport the software elements can also be used as a physical connection between local devices, such as light waves, radio waves, electromagnetic waves, etc., which can be propagated through cables, optical fibers, or air. Physical media used to carry the wave, such as cables, wireless connections, or optical fibers and the like, can also be considered a medium carrying the software. As used herein, unless restricted to tangible "storage" media, other terms representing a computer or machine "readable medium" represent a medium involved in the execution of any instructions by a processor.

[0113] This application uses specific terms to describe embodiments of the application. For example, "the first / second embodiment", "an embodiment", and / or "some embodiments" mean a certain feature, structure, or characteristic related to at least one embodiment of the application. Therefore, it should be emphasized and noted that the "an embodiment" or "one embodiment" or "an alternative embodiment" mentioned twice or more at different positions in this specification does not necessarily refer to the same embodiment. In addition, certain features, structures, or characteristics in one or more embodiments of the application can be combined appropriately.

[0114] In addition, those skilled in the art can understand that various aspects of the application can be illustrated and described by several patentable types or situations, including any new and useful process, machine, product, or composition of matter, or any new and useful improvement thereof. Accordingly, various aspects of the application can be executed entirely by hardware, entirely by software (including firmware, resident software, microcode, etc.), or by a combination of hardware and software. The above hardware or software can all be referred to as "data blocks", "modules", "engines", "units", "components", or "systems". In addition, various aspects of the application may be embodied as a computer product located in one or more computer-readable media, which includes computer-readable program code.

[0115] Unless otherwise defined, all terms used herein (including technical and scientific terms) have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. It should also be understood that terms such as those defined in a commonly used dictionary should be interpreted as having a meaning consistent with their meaning in the context of the relevant art, and should not be interpreted in an idealized or overly formal sense, unless explicitly defined as such herein.

[0116] The foregoing is a description of the present invention and should not be construed as limiting thereof. Although several exemplary embodiments of the present invention have been described, those skilled in the art will readily appreciate that many modifications can be made to the exemplary embodiments without departing from the novel teachings and advantages of the present invention. Accordingly, all such modifications are intended to be included within the scope of the present invention as defined by the claims. It should be understood that the foregoing is a description of the present invention and should not be considered limited to the specific embodiments disclosed, and modifications to the disclosed embodiments as well as other embodiments are intended to be included within the scope of the appended claims. The present invention is defined by the claims and their equivalents.

Claims

1. A method for generating haptic feedback, comprising: Detecting a touch input of a user; Determining an operation type of the user based on the detected touch input; Generating at least a vibration control signal for controlling at least one of one or more vibration units at least according to the operation type; And Based on the vibration control signal, controlling the at least one of the one or more vibration units to generate a vibration feedback corresponding to the touch input.

2. The method according to claim 1, wherein, Determining the operation type of the user based on the detected touch input includes: Determining the number of touch points based on the detected touch input; When the number of touch points is greater than one, determining the operation type as one of a zoom operation or a rotation operation; and When the number of touch points is equal to one, determining the operation type as one of a click operation, a slide operation, or a drag-and-drop operation.

3. The method according to claim 1, wherein, The method further includes determining a touch area based on the detected touch input, and the larger the touch area is, the higher the vibration frequency and / or intensity of the vibration feedback generated based on the vibration control signal is.

4. The method according to claim 1, wherein Generating at least a vibration control signal for controlling at least one of one or more vibration units at least according to the operation type includes: Determining an operation direction of the operation type; Generating a vibration control signal for controlling at least one of the one or more vibration units according to the operation direction of the operation type.

5. The method according to claim 4, wherein, Generating a vibration control signal for controlling at least one of the one or more vibration units according to the operation direction of the operation type includes: For different operation directions of the operation type, generating vibration control signals for controlling vibration units located at different positions among the one or more vibration units, wherein, vibration feedbacks located at different positions are generated based on the vibration control signal.

6. The method according to claim 4, wherein, Generating a vibration control signal for controlling at least one of the one or more vibration units according to the operation direction of the operation type includes: For different operation directions of the operation type, generating vibration control signals for controlling different numbers of vibration units among the one or more vibration units, wherein, vibration feedbacks with different vibration intensities are generated based on the vibration control signal.

7. The method according to claim 4, wherein, Generating a vibration control signal for controlling at least one of the one or more vibration units according to the operation direction of the operation type includes: For different operation directions of the operation type, generating a vibration control signal for controlling the at least one vibration unit to generate a vibration feedback whose vibration frequency and / or intensity increases or decreases along the operation direction.

8. The method according to claim 2, wherein When the number of touch points is greater than one, determining the operation type as one of a zoom operation or a rotation operation includes: When the number of touch points is greater than one and the touch electrical signals corresponding to the touch input are a pair of continuous signals that increase or decrease in two opposite linear directions, determining the operation type as a zoom operation.

9. The method according to claim 2, wherein, When the number of touch points is greater than one, determining the operation type as one of a zoom operation or a rotation operation includes: When the number of the touch points is greater than one and the touch electrical signals corresponding to the touch input are a pair of consecutive signals in the counterclockwise or clockwise direction, determine that the operation type is a rotation operation.

10. The method according to claim 2, wherein, When the number of the touch points is equal to one, determining that the operation type is one of a click operation, a slide operation, or a drag-and-drop operation includes: When the number of the touch points is equal to one and the touch electrical signal corresponding to the touch input is a short pulse signal, determine that the operation type is a click operation.

11. The method according to claim 2, wherein, When the number of the touch points is equal to one, determining that the operation type is one of a click operation, a slide operation, or a drag-and-drop operation includes: When the number of the touch points is equal to one and the touch electrical signal corresponding to the touch input is a continuous signal in one direction, determine that the operation type is a slide operation.

12. The method according to claim 2, wherein, When the number of the touch points is equal to one, determining that the operation type is one of a click operation, a slide operation, or a drag-and-drop operation includes: When the number of the touch points is equal to one, the initial position of the touch point is located in a specific area, and the touch electrical signal corresponding to the touch input is a continuous signal in one direction with an initial amplitude greater than a specific threshold, determine that the operation type is a drag-and-drop operation.

13. A haptic feedback generation device, comprising: A display unit configured to receive a touch input from a user; A touch sensing unit configured to detect the touch input by collecting touch electrical signals corresponding to the touch input; A control unit configured to, when the touch electrical signal is greater than a touch threshold, determine an operation type of the user based on the detected touch input, and generate at least a vibration control signal for controlling at least one of the one or more vibration units and a display control signal for controlling the display unit according to the operation type; And One or more vibration units, at least one of the one or more vibration units being configured to generate a vibration feedback corresponding to the touch input under the control of the vibration control signal, and wherein the display unit adjusts a current display screen according to the operation type under the action of the display control signal.

14. The device according to claim 13, wherein, The control unit is further configured to: Determine the number of touch points based on the detected touch input; When the number of the touch points is greater than one, determine that the operation type is one of a zoom operation or a rotation operation; And When the number of the touch points is equal to one, determine that the operation type is one of a click operation, a slide operation, or a drag-and-drop operation.

15. The apparatus according to claim 13, wherein, The control unit is further configured to determine a touch area based on the detected touch input, and the larger the touch area is, the higher the vibration frequency and / or intensity of the vibration feedback generated by the at least one vibration unit controlled by the vibration control signal generated by the control unit is.

16. The device according to claim 13, wherein The control unit is further configured to: Determine an operation direction of the operation type; Generate a vibration control signal for controlling at least one of the one or more vibration units according to the operation direction of the operation type.

17. The apparatus according to claim 16, wherein, The control unit is further configured to: For different operation directions of the operation type, generate vibration control signals for controlling vibration units at different positions in the one or more vibration units. Wherein, generate vibration feedbacks at different positions based on the vibration control signals.

18. The apparatus according to claim 16, wherein, The control unit is further configured to: For different operation directions of the operation type, generate vibration control signals for controlling different numbers of vibration units in the one or more vibration units. Wherein, generate vibration feedbacks with different vibration intensities based on the vibration control signals.

19. The device according to claim 16, wherein The control unit is further configured to: For different operation directions of the operation type, generate vibration control signals for controlling the at least one vibration unit to generate vibration feedbacks with vibration frequencies and / or intensities increasing or decreasing along the operation direction.

20. The apparatus according to claim 14, wherein The control unit is further configured to: When the number of touch points is greater than one and the touch electrical signals corresponding to the touch input are a pair of continuous signals increasing or decreasing in two opposite directions, determine that the operation type is a zoom operation.

21. The apparatus according to claim 14, wherein The control unit is further configured to: When the number of touch points is greater than one and the touch electrical signals corresponding to the touch input are a pair of continuous signals increasing or decreasing in the counterclockwise or clockwise direction, determine that the operation type is a rotation operation.

22. The apparatus according to claim 14, wherein, The control unit is further configured to: When the number of touch points is equal to one and the touch electrical signals corresponding to the touch input are short pulse signals, determine that the operation type is a click operation.

23. The apparatus according to claim 14, wherein, The control unit is further configured to: When the number of touch points is equal to one and the touch electrical signals corresponding to the touch input are continuous signals in one direction, determine that the operation type is a swipe operation.

24. The apparatus according to claim 14, wherein The control unit is further configured to: When the number of touch points is equal to one, the initial position of the touch point is located in a specific area, and the touch electrical signals corresponding to the touch input are continuous signals in one direction with an initial amplitude greater than a specific threshold, determine that the operation type is a drag-and-drop operation.

25. A tactile feedback generation device, comprising: One or more processors; And One or more memories, wherein computer-readable instructions are stored in the memories, and when the computer-readable instructions are run by the one or more processors, cause the one or more processors to execute the method according to any one of claims 1-12.

Images