Interaction method, display touch equipment and storage medium
By detecting and updating touch parameter information in the graphical user interface, tactile signals are generated to drive the tactile feedback device, solving the problem of limited tactile perception effects, achieving rich tactile feedback and effective operation guidance, and improving the user experience.
Patent Information
- Application Number
- CN202310580180.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-05-22
- Publication Date
- 2024-11-22
AI Technical Summary
In existing technologies, the tactile perception effect in human-computer interaction is limited, resulting in a poor user experience.
By detecting touch parameter information of touch operations in the graphical user interface, haptic signals are generated and updated to drive the haptic feedback device to produce rich haptic feedback effects, including changes in parameters such as touch position, touch pressure, number of touch points, touch area, touch duration, and touch sequence.
It enhances the user's interactive experience, enriches the haptic feedback effect, and effectively guides the user's operation.
Smart Images

Figure CN119002719A_ABST
Abstract
Description
Technical Field
[0001] This article relates to but is not limited to the field of display technology, and in particular to an interaction method, a display touch device and a storage medium. Background Art
[0002] Touch screen (Touch Panel), also known as touch screen or touch panel, is an inductive display device that can receive input signals such as contacts. Commercial touch screen technologies have been formed, including: resistive technology touch screen, capacitive technology touch screen, infrared technology touch screen, surface acoustic wave technology touch screen, etc., and have been widely used in mobile phones, tablet computers, retail, public information query, multimedia information systems, medical equipment, industrial automation control, entertainment and catering industries, automatic ticketing systems, education systems and many other fields. Summary of the invention
[0003] The following is a summary of the subject matter described in detail herein. This summary is not intended to limit the scope of the claims.
[0004] Embodiments of the present disclosure provide an interaction method, a display touch device, and a storage medium.
[0005] On the one hand, an embodiment of the present disclosure provides an interaction method, including: determining a touch operation on a target object in a graphical user interface, and determining touch parameter information of the touch operation; generating a tactile signal according to the touch parameter information of the touch operation; when a change in the touch parameter information of the touch operation is detected, updating the tactile signal according to the updated touch parameter information. The tactile signal is configured to drive a tactile feedback device to generate a corresponding tactile feedback effect. The touch parameter information includes at least one of the following: touch position, touch pressure, number of touch points, touch area, touch duration, and touch sequence.
[0006] In some exemplary embodiments, the haptic signal is characterized by at least one of the following parameters: waveform type, waveform amplitude, and waveform frequency.
[0007] In some exemplary embodiments, generating a tactile signal based on touch parameter information of the touch operation includes: determining a correspondence between the touch parameter information and parameters of the tactile signal based on the type of the target object and the type of touch operation on the target object; generating the tactile signal based on the touch parameter information and the correspondence between the touch parameter information and parameters of the tactile signal.
[0008] In some exemplary embodiments, determining the correspondence between touch parameter information and parameters of the tactile signal based on the type of the target object and the type of touch operation on the target object includes at least one of the following: when the target object includes a control bar control and the touch operation on the target object is a sliding operation, determining that the waveform frequency of the tactile signal depends on the touch position of the touch operation; when the target object includes a button control and the touch operation on the target object is a click operation, determining that the waveform amplitude of the tactile signal depends on the touch pressure of the touch operation; when the target object includes a multi-touch area and the touch operation on the target object is a click operation, determining that the waveform type of the tactile signal depends on the number of touch points of the touch operation.
[0009] In some exemplary embodiments, the control bar control is divided into a plurality of first sub-areas along the length direction of the control bar control, and the waveform frequencies of the tactile signals corresponding to the plurality of first sub-areas vary along the length direction of the control bar control. When the target object includes the control bar control, and the touch operation on the target object is a sliding operation, generating the tactile signal according to the touch parameter information and the correspondence between the touch parameter information and the parameters of the touch signal includes: determining, according to the touch position of the touch point of the sliding operation, the first sub-area where the touch point is located in the control bar control; and generating the tactile signal according to the waveform frequency corresponding to the first sub-area.
[0010] In some exemplary embodiments, updating the tactile signal according to the updated touch parameter information includes: determining a first sub-region where the touch point is located in the control bar control according to the updated touch position of the touch point of the sliding operation; and updating the tactile signal according to a waveform frequency corresponding to the first sub-region.
[0011] In some exemplary embodiments, the button control corresponds to multiple touch pressure ranges, and the waveform amplitudes of the tactile signals corresponding to the multiple touch pressure ranges vary with the numerical values of the multiple touch pressure ranges. When the target object includes a button control, and the touch operation on the target object is a click operation, the generating of the tactile signal according to the touch parameter information and the correspondence between the touch parameter information and the parameters of the touch signal includes: determining the touch pressure range to which the touch pressure of the click operation belongs according to the touch pressure of the click operation; and generating the tactile signal according to the waveform amplitude corresponding to the determined touch pressure range.
[0012] In some exemplary embodiments, updating the tactile signal according to the updated touch parameter information includes: determining a touch pressure range to which the updated touch pressure belongs according to the updated touch pressure of the click operation; and updating the tactile signal according to a waveform amplitude corresponding to the updated touch pressure range.
[0013] In some exemplary embodiments, the multi-touch area corresponds to multiple touch point ranges, and the waveform types corresponding to the multiple touch point ranges are different. When the target object includes a multi-touch area, and the touch operation on the target object is a click operation, the generating the tactile signal according to the touch parameter information and the correspondence between the touch parameter information and the parameters of the touch signal includes: determining the touch point range to which the touch point number belongs according to the touch point number of the click operation; and generating the tactile signal according to the waveform type corresponding to the determined touch point range.
[0014] In some exemplary embodiments, updating the tactile signal according to the updated touch parameter information includes: determining the touch point range to which the updated touch point number belongs according to the updated touch point number of the click operation; and updating the tactile signal according to the waveform type corresponding to the updated touch point range.
[0015] In some exemplary embodiments, the haptic feedback effect includes a haptic feedback effect generated based on a squeeze film effect.
[0016] In some exemplary embodiments, determining a touch operation on a target object in a graphical user interface includes: when a touch position of the touch operation is located in an area where the target object is located and a type of the target object matches a type of the touch operation, determining that the touch operation is a touch operation on the target object.
[0017] On the other hand, an embodiment of the present disclosure provides a display touch device, comprising: a display touch panel, a processor, and a tactile feedback device, wherein the processor is connected to the display touch panel and the tactile feedback device. The display touch panel is configured to obtain touch parameter information of a touch operation in a graphical user interface. The processor is configured to determine a touch operation on a target object in a graphical user interface; generate a tactile signal according to the touch parameter information of the touch operation, and update the tactile signal according to the updated touch parameter information when a change in the touch parameter information of the touch operation is detected. The touch parameter information includes at least one of the following: touch position, touch pressure, number of touch points, touch area, touch duration, and touch sequence. The tactile feedback device is configured to generate a corresponding tactile feedback effect according to the tactile signal.
[0018] In some exemplary embodiments, the haptic signal is characterized by at least one of the following parameters: waveform type, waveform amplitude, and waveform frequency.
[0019] In some exemplary embodiments, the processor is configured to generate a tactile signal based on touch parameter information of the touch operation in the following manner: determining a correspondence between the touch parameter information and parameters of the tactile signal based on a type of the target object and a type of touch operation on the target object; and generating the tactile signal based on the touch parameter information and the correspondence between the touch parameter information and parameters of the tactile signal.
[0020] In some exemplary embodiments, the processor is configured to determine the correspondence between touch parameter information and parameters of the tactile signal according to the type of the target object and the type of touch operation on the target object in at least one of the following ways: when the target object includes a control bar control and the touch operation on the target object is a sliding operation, determining that the waveform frequency of the tactile signal depends on the touch position of the touch operation; when the target object includes a button control and the touch operation on the target object is a click operation, determining that the waveform amplitude of the tactile signal depends on the touch pressure of the touch operation; when the target object includes a multi-touch area and the touch operation on the target object is a click operation, determining that the waveform type of the tactile signal depends on the number of touch points of the touch operation.
[0021] In some exemplary embodiments, the control bar control is divided into multiple first sub-areas along the length direction of the control bar control, and the waveform frequency of the tactile signal corresponding to the multiple first sub-areas varies along the length direction of the control bar control; when the target object includes the control bar control, and the touch operation on the target object is a sliding operation, the processor is configured to generate the tactile signal according to the touch parameter information and the correspondence between the touch parameter information and the parameters of the touch signal in the following manner: determining the first sub-area where the touch point is located in the control bar control according to the touch position of the contact point of the sliding operation; and generating the tactile signal according to the waveform frequency corresponding to the first sub-area.
[0022] In some exemplary embodiments, the button control corresponds to multiple touch pressure ranges, and the waveform amplitude of the tactile signal corresponding to the multiple touch pressure ranges varies with the numerical values of the multiple touch pressure ranges. When the target object includes a button control, and the touch operation on the target object is a click operation, the processor is configured to generate the tactile signal according to the touch parameter information and the correspondence between the touch parameter information and the parameters of the touch signal in the following manner: determine the touch pressure range to which the touch pressure of the click operation belongs according to the touch pressure of the click operation; generate the tactile signal according to the waveform amplitude corresponding to the determined touch pressure range.
[0023] In some exemplary embodiments, the multi-touch area corresponds to multiple touch point ranges, and the waveform types corresponding to the multiple touch point ranges are different. When the target object includes a multi-touch area, and the touch operation on the target object is a click operation, the processor is configured to generate the tactile signal according to the touch parameter information and the correspondence between the touch parameter information and the parameters of the touch signal in the following manner: according to the number of touch points of the click operation, determine the touch point range to which the touch point number belongs; and generate the tactile signal according to the waveform type corresponding to the determined touch point range.
[0024] In some exemplary embodiments, the tactile feedback device includes at least a piezoelectric ceramic sheet.
[0025] On the other hand, an embodiment of the present disclosure provides a non-transitory computer-readable storage medium storing a computer program, which implements the steps of the interaction method described above when executed.
[0026] Other aspects will be apparent upon reading and understanding the drawings and detailed description. BRIEF DESCRIPTION OF THE DRAWINGS
[0027] The accompanying drawings are used to provide a further understanding of the technical solution of the present disclosure and constitute a part of the specification. Together with the embodiments of the present disclosure, they are used to explain the technical solution of the present disclosure and do not constitute a limitation on the technical solution of the present disclosure. The shape and size of one or more components in the accompanying drawings do not reflect the actual proportions and are only intended to illustrate the contents of the present disclosure.
[0028] Figure 1 A flowchart of an interactive method according to at least one embodiment of the present disclosure;
[0029] Figure 2 A schematic diagram of a display touch device according to at least one embodiment of the present disclosure;
[0030] Figure 3 is a plan view of a tactile feedback device according to at least one embodiment of the present disclosure;
[0031] Figure 4 is an example flow chart of an interactive method according to at least one embodiment of the present disclosure;
[0032] Figure 5 A schematic diagram of a control bar control according to at least one embodiment of the present disclosure;
[0033] Fig. 6A and Figure 6B An operation example diagram of at least one embodiment of the present disclosure;
[0034] Figure 7 is a schematic diagram of a knob control according to at least one embodiment of the present disclosure;
[0035] Figure 8 Another exemplary flow chart of the interaction method according to at least one embodiment of the present disclosure;
[0036] Fig. 9A and Fig. 9B An operation example diagram of at least one embodiment of the present disclosure;
[0037] Fig.10 is another flow chart of the interaction method of at least one embodiment of the present disclosure;
[0038] Fig.11A and Fig. 11B This is an operational example diagram of at least one embodiment of the present disclosure. DETAILED DESCRIPTION
[0039] The embodiments of the present disclosure will be described in detail below in conjunction with the accompanying drawings. The embodiments can be implemented in a plurality of different forms. A person skilled in the art can easily understand the fact that the method and content can be transformed into other forms without departing from the purpose and scope of the present disclosure. Therefore, the present disclosure should not be interpreted as being limited to the contents described in the following embodiments. In the absence of conflict, the embodiments in the present disclosure and the features in the embodiments can be arbitrarily combined with each other.
[0040] In the drawings, the size of one or more components, the thickness of a layer, or an area is sometimes exaggerated for the sake of clarity. Therefore, one embodiment of the present disclosure is not necessarily limited to the size, and the shape and size of one or more components in the drawings do not reflect the true proportion. In addition, the drawings schematically show ideal examples, and one embodiment of the present disclosure is not limited to the shapes or values shown in the drawings.
[0041] The ordinal numbers such as "first", "second", and "third" in this specification are provided to avoid confusion of constituent elements, and are not intended to limit the quantity. The "plurality" in this disclosure means two or more.
[0042] In this specification, for the sake of convenience, the words and phrases indicating the orientation or positional relationship such as "middle", "upper", "lower", "front", "back", "vertical", "horizontal", "top", "bottom", "inside", "outside" and the like are used to illustrate the positional relationship of the constituent elements with reference to the drawings. This is only for the convenience of describing this specification and simplifying the description, and does not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operate in a specific orientation, and therefore cannot be understood as a limitation of the present disclosure. The positional relationship of the constituent elements is appropriately changed according to the orientation of the constituent elements being described. Therefore, it is not limited to the words and phrases described in the specification, and can be appropriately replaced according to the circumstances.
[0043] In this specification, unless otherwise clearly specified and limited, the terms "installed", "connected" and "connected" should be understood in a broad sense. For example, it can be a fixed connection, or a detachable connection, or an integral connection; it can be a mechanical connection, or a connection; it can be a direct connection, or an indirect connection through an intermediate, or the internal connection of two elements. For ordinary technicians in this field, the meanings of the above terms in this disclosure can be understood according to the circumstances. In this specification, "electrical connection" includes the situation where constituent elements are connected together through an element with some electrical function. There is no special restriction on "elements with some electrical function" as long as they can transmit electrical signals between connected constituent elements. Examples of "elements with some electrical function" include not only electrodes and wirings, but also switching elements such as transistors, resistors, inductors, capacitors, and other elements with multiple functions.
[0044] With the development of technology, people have an urgent need for tactile perception and tactile reproduction in the process of human-computer interaction. However, the tactile perception effect in the process of human-computer interaction is relatively simple, which easily causes the user's tactile feeling to be monotonous, resulting in poor user experience.
[0045] The present embodiment provides an interaction method, a display touch device, and a storage medium, which can improve the situation where the user experience is affected by the single tactile perception effect during the human-computer interaction process.
[0046] Figure 1 Schematic diagram of the flow of the interactive method of at least one embodiment of the present disclosure. Figure 1 As shown, the interaction method provided in this embodiment may include the following steps.
[0047] Step 101: Determine a touch operation on a target object in a graphical user interface (GUI), and determine touch parameter information of the touch operation.
[0048] Step 102: Generate a tactile signal according to the touch parameter information, wherein the tactile signal is configured to drive a tactile feedback device to generate a corresponding tactile feedback effect.
[0049] Step 103: When it is detected that the touch parameter information of the touch operation has changed, the tactile signal is updated according to the updated touch parameter information.
[0050] In some examples, corresponding tactile feedback can be generated for a user's touch operation on a target object. For example, a GUI can display a GUI control (e.g., including a button control, a control bar control, a knob control, etc.), and a user can perform a touch operation on the GUI control (e.g., including a click operation, a slide operation, etc.). For the user's touch operation on the GUI control, a tactile feedback effect corresponding to the GUI control and the touch operation can be generated through a tactile feedback device. Moreover, during the change of the touch parameters of the touch operation on the GUI control, the corresponding tactile feedback effect can be adjusted according to the change of the touch parameters, so that the user can feel a rich tactile feedback effect, thereby enhancing the user experience.
[0051] In the interaction method of this embodiment, the tactile signal can be determined by the touch parameter information of the touch operation on the target object, and the tactile signal can change with the change of the touch parameter information of the touch operation, thereby generating a rich tactile feedback effect. In this way, not only can the user's interaction experience be enriched, but also the user's touch operation can be effectively guided based on different tactile feedback effects, for example, the user's blind operation can be prompted and guided.
[0052] In some examples, when it is detected that the touch parameter information of the touch operation on the target object has not changed, the tactile signal can be kept unchanged to produce a tactile feedback effect consistent with the previous one. When it is detected that the touch operation on the target object ends, the tactile signal can be stopped from being output, and the tactile feedback can be performed again after the next touch operation on the target object is detected.
[0053] In some examples, after a touch operation on a target object is detected, the touch parameter information of the touch operation can be detected and acquired in real time, and whether the touch parameter information has changed can be determined based on the continuously acquired touch parameter information, so as to change the tactile signal according to the change of the touch parameter information. In other examples, after a touch operation on a target object is detected, the touch parameter information of the touch operation can be periodically detected and acquired, and whether the touch parameter information has changed can be determined based on the periodically acquired touch parameter information, so as to change the tactile signal according to the change of the touch parameter information. This embodiment is not limited to this.
[0054] In some examples, the interaction method of this embodiment can be applied to a display touch device. The display touch device can be an electronic device with a display function and a touch function. For example, the display touch device can include: a mobile phone, a tablet computer, a wearable device, a vehicle-mounted device, a central control device, etc. Among them, the display touch device can receive the user's touch operation, and generate a corresponding tactile feedback effect for the touch operation of the target object through a tactile feedback device. However, this embodiment is not limited to this.
[0055] In some examples, the application scenarios of the interaction method of this embodiment may include, but are not limited to, smart home, smart wear, smart transportation, smart finance and other scenarios.
[0056] In some examples, the touch parameter information of the touch operation may include at least one of the following: touch position, touch pressure, number of touch points, touch area, touch duration, and touch sequence. The touch parameter information of this example may be parameter information that characterizes the attribute characteristics of the touch operation. For example, the touch parameter information of the touch operation may include: touch position, touch pressure, number of touch points, touch area, touch duration, or touch sequence; for another example, the touch parameter information may include: touch position and touch pressure, or touch position and touch area, or touch position and touch duration, or touch pressure and touch duration. This embodiment does not limit the combination of touch parameters included in the touch parameter information.
[0057] In some examples, the touch position may characterize the location of the touch operation on the touch surface of the display touch device. For example, if the touch operation is a click operation, the touch position may include the coordinate information of the touch point of the click operation on the touch surface of the display touch device. For example, if the touch operation is a sliding operation, the touch position of the sliding operation collected at a certain moment may include the coordinate information of the touch point of the sliding operation on the touch surface of the display touch device at that moment. For the sliding operation, the touch displacement of the sliding operation can be determined based on the change of the touch position. In some examples, the display touch device may include a capacitive touch panel to identify the position of the touch point on the touch surface. This embodiment is not limited to this.
[0058] In some examples, the touch pressure may refer to the force applied by the user's finger on the touch surface of the display touch device when performing a touch operation. For example, the touch operation is a click operation, and the touch pressure may be the magnitude of the force applied by the click operation on the touch surface of the display touch device. For example, the display touch device may include a pressure detection sensor (e.g., a piezoelectric ceramic sheet), and the pressure detection sensor may detect the touch pressure of the touch operation on the touch surface.
[0059] In some examples, the number of touch points may refer to the number of touch points applied by a user's finger on a touch surface of a display touch device when performing a touch operation. For a display touch panel that supports multi-touch, the number of touch points of a touch operation may be collected. For example, the display touch device may include a capacitive touch panel to collect the number of touch points on the touch surface.
[0060] In some examples, the touch area may refer to the contact area between the user's finger and the touch surface of the display touch device when performing a touch operation. For example, if the touch operation is a click operation and there is only one touch point, the touch area may be the contact area of the single touch point of the click operation. For another example, if the touch operation is a click operation and includes multiple touch points, the touch area may be the sum of the contact areas of all the touch points of the click operation.
[0061] In some examples, the touch duration may refer to the length of time that a user stays on the touch surface of a display touch device when performing a touch operation. For example, if the touch operation is a click operation and there is only one touch point, the touch duration may refer to the length of time that a single touch point of the click operation stays on the touch surface. For another example, if the touch operation is a click operation and includes multiple touch points, the touch duration may refer to the maximum length of time that all touch points of the click operation stay on the touch surface. For another example, if the touch operation is a sliding operation, the touch duration may refer to the length of time that the touch point is in contact with the touch surface during the sliding operation.
[0062] In some examples, the touch sequence may refer to the direction in which the user moves the touch surface of the touch display device when performing a touch operation. For example, if the touch operation is a sliding operation, the touch sequence may refer to the direction in which the touch point of the sliding operation moves on the touch surface.
[0063] In some examples, the haptic signal may be characterized by at least one of the following parameters: waveform type, waveform amplitude, and waveform frequency. For example, by adjusting at least one of the waveform type, waveform amplitude, and waveform frequency, different haptic signals may be generated, thereby driving different haptic feedback effects.
[0064] In some examples, the feedback strength of the tactile signal can be adjusted by setting at least one parameter of the tactile signal. For example, when the waveform type and the waveform amplitude are the same, the higher the waveform frequency of the tactile signal, the greater the feedback strength; the lower the waveform frequency of the tactile signal, the smaller the feedback strength. For another example, when the waveform type and the waveform frequency are the same, the greater the waveform amplitude of the tactile signal, the greater the feedback strength, and the smaller the waveform amplitude of the tactile signal, the smaller the feedback strength.
[0065] In some examples, the waveform frequency of the tactile signal may be less than or equal to 200 Hz. The tactile signal of the waveform frequency of this example helps to generate a film pressing effect between the finger, thereby changing the surface friction coefficient and providing a rich tactile feedback effect.
[0066] In some examples, the waveform type may include at least one of the following: a pulse wave, a square wave, a triangle wave, a sine function wave, and a sawtooth wave. Among them, when the waveform amplitude and the waveform frequency are equal, the feedback intensity of the square wave and the rectangular wave is relatively small, and the feedback intensity of the pulse wave, the triangle wave, and the sawtooth wave is relatively large. In some examples, a high-frequency pulse wave can be set as a tactile signal to achieve a tactile feedback effect with a relatively large feedback intensity; by setting a low-frequency square wave as a tactile signal, a tactile feedback effect with a relatively small feedback intensity can be achieved. This embodiment does not limit the waveform type of the tactile signal. In some examples, the above waveforms can be combined or converted to generate a desired waveform.
[0067] In some examples, in step 11, determining the touch operation of the graphical user interface on the target object may include: when the touch position of the touch operation is located in the area where the target object is located, and the type of the target object matches the type of the touch operation, then determining that the touch operation is a touch operation on the target object. For example, after the touch operation is detected, it can be determined whether the touch operation is performed in the area where the target object is located based on the touch position of the touch operation and the position of the area where the target object is located; when the touch position of the touch operation is located in the area where the target object is located, and the type of the target object matches the type of the touch operation, it can be determined that the detected touch operation is a touch operation on the target object. When the touch position of the detected touch operation is not in the area where the target object is located, or the type of the target object does not match the type of the touch operation, it can be determined that the detected touch operation is not a touch operation on the target object.
[0068] In some examples, the type of the target object may include at least one of the following: a GUI control, a set multi-touch area. The GUI control may include a button control, a control bar control, and a knob control. This embodiment is not limited to this.
[0069] In some examples, the types of touch operations may include at least: a click operation and a slide operation.
[0070] In some examples, the matching relationship between the type of the target object and the type of the touch operation can be preset. After determining the type of the target object and the type of the touch operation, whether the two match is determined according to the preset matching relationship. For example, the matching relationship between the type of the target object and the type of the touch operation may include at least one of the following: a button control matches a click operation, a control bar control matches a slide operation, a knob control matches a slide operation, and a multi-touch area matches a click operation. In some examples, a slide operation on a button control is not considered to be a touch operation to start the button control, and cannot trigger the interaction method of this example; a click operation on a control bar control is not considered to be a touch operation to start the control bar control, and cannot trigger the interaction method of this example; a click operation on a knob control is not considered to be a touch operation to start the knob control, and cannot trigger the interaction method of this example.
[0071] In some examples, step 12 may include: determining the correspondence between the touch parameter information and the parameters of the tactile signal according to the type of the target object and the type of the touch operation for the target object; generating the tactile signal according to the touch parameter information and the correspondence between the touch parameter signal and the parameters of the tactile signal. For example, for a target object and a touch operation with a matching relationship in type, the correspondence between the touch parameter information of the touch operation and the parameters of the tactile signal may be preset. After the type of the target object and the type of the touch operation are determined to match, the correspondence between the touch parameter information of the touch operation and the parameters of the tactile signal may be determined, so as to generate a corresponding tactile signal according to the touch parameter information, thereby driving the generation of a corresponding tactile feedback effect.
[0072] In some examples, when the target object includes a control bar control, and the touch operation on the target object is a sliding operation, it can be determined that the waveform frequency of the tactile signal depends on the touch position of the touch operation. In this example, for the sliding operation of the control bar control, the waveform frequency of the tactile signal can be changed according to the position change of the contact point during the sliding operation, so that different tactile feedback results can be given during the sliding operation of the sliding operation to enrich the user's tactile experience.
[0073] In some examples, when the target object includes a button control, and the touch operation on the target object is a click operation, it can be determined that the waveform amplitude of the tactile signal depends on the touch pressure of the touch operation. In this example, for the click operation of the button control, the waveform amplitude of the tactile signal can be changed according to the change of the touch pressure applied during the click operation, thereby providing different tactile feedback results to enrich the user's tactile experience.
[0074] In some examples, when the target object includes a multi-touch area and the touch operation on the target object is a click operation, it can be determined that the waveform type of the tactile signal depends on the number of touch points in the touch operation. In this example, for the click operation on the multi-touch area, the waveform type of the tactile signal can be changed according to the change in the number of touch points in the click operation, thereby giving different tactile feedback results to enrich the user's tactile experience.
[0075] The solution of this embodiment is described below by means of some examples.
[0076] Figure 2 is a schematic diagram of a display touch device according to at least one embodiment of the present disclosure. Figure 2 As shown, the display touch control device of this embodiment may include: a display touch control panel 21 , a tactile feedback device 22 and a processor 23 . The processor 23 is connected to the display touch control panel 21 and the tactile feedback device 22 .
[0077] In some examples, the processor 23 may be a microcontroller unit (MCU), a central processing unit (CPU), a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, transistor logic devices, or any combination of the above structures. For example, the processor may be a combination that implements a computing function, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, etc.
[0078] In some examples, the display touch panel 21 may include a display panel and a touch panel. The touch panel can collect the user's touch operation on it (for example, the user uses the finger to operate on the touch panel), and implement the corresponding operation according to a pre-set program. For example, the user clicks the operation of the shortcut logo of the function module, etc. The touch panel can be implemented using various types such as resistive, capacitive, infrared and surface acoustic waves. The capacitive touch panel works on the principle that the size of the capacitor changes with the size of the finger pressure. The resistive touch panel works on the principle that the resistance value of the piezoresistor changes with the size of the finger pressure. For example, the touch panel can be a capacitive touch panel. In some examples, the touch panel can be configured to collect touch parameter information of the touch operation, such as collecting the touch position, touch duration, touch area, touch points, and touch order of the touch operation. In other examples, the display touch panel can integrate a pressure sensor (for example, an optical fiber or a piezoelectric ceramic) to collect the touch pressure of the touch operation.
[0079] In some examples, the touch panel can cover the display panel, and when the touch panel detects a touch operation thereon, it is transmitted to the processor to determine the type of touch event, and then the processor provides a corresponding interface output on the display panel according to the type of touch event. The touch panel and the display panel can be used as two independent components to implement the input and output functions of the mobile terminal. In some examples, the touch panel and the display panel can be integrated to implement the input and output functions. For example, the display touch panel 21 may include: a substrate (such as a glass substrate), and a display structure and a touch structure sequentially arranged on the substrate.
[0080] In some examples, the tactile feedback device 22 may include: a piezoelectric structure (for example, a piezoelectric ceramic sheet or a piezoelectric film) and a driving circuit. The piezoelectric structure is electrically connected to the driving circuit. The driving circuit may receive a tactile signal from the processor 23, and drive the piezoelectric structure according to the tactile signal to produce a tactile feedback effect. For example, the tactile feedback device 22 may be located on a side of the substrate of the display touch panel 21 away from the touch structure; or, the tactile feedback device 22 may be located on a side of the touch structure close to the substrate. In some examples, the piezoelectric structure of the tactile feedback device may also serve as a pressure sensor to collect the touch pressure of the touch operation. This embodiment is not limited to this. In other examples, the display touch device may be provided with a separate pressure transmitter to collect the touch pressure.
[0081] In some examples, the tactile feedback effect generated by the tactile feedback device may include a tactile feedback effect generated based on the squeeze film effect. Among them, an air squeeze film can be formed between the surface of the user's finger and the touch surface (such as a horizontal plane) of the display touch device. The air squeeze film has a high-pressure characteristic and a certain squeezing force. The squeezing force can change the positive pressure of the finger touch, thereby changing the relative friction coefficient between the finger and the touch surface, thereby generating a squeeze film effect. The squeeze film effect generated based on different tactile signals can present different touch sensations. This example uses the squeeze film effect to give a tactile feedback effect, which can provide users with a more realistic touch feeling, optimize the user experience, and avoid excessively strong or stimulating tactile feedback effects that affect the user experience.
[0082] Figure 3 is a plan view of a tactile feedback device according to at least one embodiment of the present disclosure. Figure 3 As shown, the piezoelectric structure of the tactile feedback device 22 may include: a plurality of piezoelectric ceramic sheets 221 arranged in an array. Under the drive of the driving circuit, the piezoelectric ceramic sheets 221 at the corresponding positions may vibrate, causing the touch surface to deform in-plane and out-of-plane, so that the user's fingers can feel the tactile feedback effect.
[0083] In some examples, the setting area of the piezoelectric ceramic sheet array can correspond to the touch area of the display touch device. The piezoelectric ceramic sheet array of this example can also be used as a pressure sensor for the display touch device. For example, multiple piezoelectric ceramic sheets within the range of the contact point of the touch operation can collect the touch pressure of the touch operation, and the touch pressure collected by the multiple piezoelectric ceramic sheets can be processed to determine the touch pressure of the contact point. For another example, one or more piezoelectric ceramic sheets within the range of the contact point of the touch operation can generate vibrations under the drive of the driving circuit to achieve tactile feedback for the touch operation. However, this embodiment is not limited to this. In other examples, the multiple piezoelectric ceramic sheets included in the tactile feedback device can be set in the peripheral area of the display touch device, and the piezoelectric ceramic sheets can generate vibrations under the drive of the driving circuit to achieve tactile feedback for the touch operation.
[0084] Figure 4 The present invention is an example flowchart of an interaction method according to at least one embodiment of the present invention. Figure 5 A schematic diagram of a control bar control according to at least one embodiment of the present disclosure. Fig. 6A and Figure 6B FIG. 1 is an operation example diagram of at least one embodiment of the present disclosure. In this example, the target object is a control bar control, and the touch operation matching the control bar control is a sliding operation.
[0085] In some examples, such as Figure 4 As shown, the interactive method of this example may include the following steps.
[0086] Step 101: Detect whether there is a touch operation on the graphical user interface. In some examples, the display touch panel can detect whether there is a touch operation on the graphical user interface in real time or periodically.
[0087] In some examples, when the display touch panel detects a touch operation, step 102 can be executed; when no touch operation is detected, the process can return to step 101 to continue detecting whether there is a touch operation, for example, whether a touch operation occurs can be detected in real time.
[0088] Step 102, obtaining touch parameter information of the touch operation. In some examples, the display touch panel can obtain touch parameter information of the touch operation after detecting the touch operation. For example, the display touch panel can detect at least one of the touch position, touch area, number of touch points, touch duration, and touch sequence of the touch operation through a capacitive touch panel with a function of identifying the contact point position; for another example, the display touch panel can integrate a pressure sensor and use the pressure sensor to detect the touch pressure of the touch operation. In this example, the touch parameter information of the touch operation includes: the touch position as an example for explanation.
[0089] Step 103: Determine whether the touch operation is a touch operation for the target object. In some examples, when it is determined that the touch operation is a touch operation for the target object, steps 104 and 105 may be performed; when it is determined that the touch operation is not a touch operation for the target object, no feedback may be given for the touch operation, for example, the touch operation is considered to be an erroneous operation, and the process returns to step 101.
[0090] In some examples, the display touch panel can transmit the touch parameter information of the touch operation collected in real time or periodically to the processor. The processor can determine the type of touch operation and whether the touch operation is located in the area where the target object is located according to the touch parameter information of the collected touch operation (for example, including the touch position), and combine the preset matching relationship between the type of the target object and the type of the touch operation to determine whether the type of the detected touch operation matches the type of the target object. For example, if it is identified that the detected touch operation is located in the area where the target object is located, and the type of the detected touch operation matches the type of the target object, it can be determined that the detected touch operation is a touch operation for the target object. When it is identified that the touch operation is not located in the area where the target object is located, or the type of the detected touch operation does not match the type of the target object, it can be determined that the detected touch operation is not a touch operation of the target object. In this example, when it is identified that the detected touch operation is located in the area where the control bar control is located, and the detected touch operation is a sliding operation, it can be determined that the detected touch operation is a touch operation for the control bar control.
[0091] Step 104: Generate a tactile signal based on the touch parameter information of the touch operation. In some examples, the processor can determine the correspondence between the touch parameter information and the parameters of the tactile signal based on the type of the target object and the type of the touch operation, and generate a corresponding tactile signal based on the touch parameter information and the correspondence between the touch parameter information and the parameters of the tactile signal. The processor can send the generated tactile signal to the tactile feedback device, and the tactile feedback device can generate a corresponding tactile feedback effect based on the tactile signal. This example takes the change of the touch position of the touch operation to adjust the waveform frequency of the tactile signal as an example.
[0092] In some examples, such as Figure 5 As shown, a control bar control 31 of a strip structure extending along a first direction X is used as an example for illustration. The second direction Y intersects the first direction X, for example, the first direction X is perpendicular to the second direction Y. The plane where the first direction X and the second direction Y are located can be, for example, parallel to the plane where the touch surface of the display touch panel is located. The control bar control 31 can be configured to be used for adjusting functions, such as adjusting the volume, adjusting the brightness, adjusting the temperature, etc. The control bar control 31 can have a strip adjustment area, and a slider 32 is arranged on the strip adjustment area. The slider 32 can move in the strip adjustment area to indicate the corresponding adjustment value. The user can implement the setting operation in the strip adjustment area by dragging the slider 32. For example, the user drags the slider 32 to move in the strip adjustment area along the first direction X, and the volume can be adjusted to gradually increase, or the brightness can be adjusted to gradually increase; the user drags the slider 32 to move in the strip adjustment area in the opposite direction of the first direction X, and the volume or brightness can be adjusted to gradually decrease. In some examples, the slider 32 can be a rounded rectangular block. This embodiment does not limit the shape of the slider. For example, the slider 32 can be a circular block, an elliptical block, or an arrow-shaped structure located in the strip adjustment area. In some other examples, the slider 32 may be hidden and then displayed when a touch operation on the control bar is detected.
[0093] In some examples, such as Figure 5 As shown, the control bar control 31 can be divided into a plurality of continuous first sub-areas 310 along the length direction of the control bar control 31. The areas of the plurality of first sub-areas 310 can be substantially the same. This embodiment is not limited to this. For example, the areas of the plurality of first sub-areas can be partially the same. For another example, the areas of the plurality of first sub-areas can be different, for example, they can increase or decrease along the first direction.
[0094] In some examples, such as Figure 5As shown, the waveform frequency of the tactile signal corresponding to the multiple first sub-areas 310 of the control bar control 31 can change along the length direction of the control bar control 31. For example, the waveform frequency of the tactile signal corresponding to the multiple first sub-areas 310 arranged along the first direction X can increase or decrease in sequence. When the waveform type and waveform amplitude of the tactile signal are the same, the feedback intensity of the tactile feedback effect can be changed by changing the waveform frequency. For example, the greater the waveform frequency, the greater the feedback intensity, and the smaller the waveform frequency, the smaller the feedback intensity. The waveform frequencies corresponding to the multiple first sub-areas 310 of the control bar control 31 of this example are different, which can make the feedback intensity of the tactile feedback effect for the touch operation of different first sub-areas different, so that the user can feel the tactile feedback effect with different feedback intensity in different first sub-areas of the control bar control.
[0095] In some examples, such as Figure 5 As shown, taking the case where the adjustment value of the control bar control 31 along the first direction X gradually increases as an example, the waveform frequencies corresponding to the multiple first sub-areas 310 of the control bar control 31 along the first direction X can be increased in sequence. In this way, the user can feel the tactile feedback effects of different feedback strengths in the sliding operation of dragging the slider 32 along the first direction X, for example, feel the increase of the feedback strength along the first direction X. For example, sliding the slider along the first direction X on the control bar control can increase the volume, and sliding the slider along the opposite direction of the first direction X on the control bar control can reduce the volume. By setting the waveform frequencies corresponding to the multiple consecutive first sub-areas 310 along the first direction X to increase in sequence, the feedback strength corresponding to the multiple consecutive first sub-areas 310 along the first direction X can be gradually increased. In the sliding operation of the user dragging the slider along the first direction X, the user can feel the gradually increased feedback effect, and in the sliding operation of the user dragging the slider along the opposite direction of the first direction X, the user can feel the gradually weakened feedback effect.
[0096] In some examples, the processor may generate a tactile signal f1(x1, y1) based on the touch position of the sliding operation on the control bar control, for example, including the starting position coordinates P1(x1, y1). Wherein, x1 is the horizontal coordinate of the starting position, y1 is the vertical coordinate of the starting position, and f1 is the waveform function. The waveform function corresponds to the waveform type, and the waveform functions of different waveform types are different. The waveform function of this example may be a sine function, thereby generating a sine function wave. The waveform type and waveform amplitude of the tactile signal may adopt preset values.
[0097] In some examples, after the processor determines a sliding operation on a control bar control, the tactile signal generated according to the touch position of the sliding operation can be as follows: Fig. 6A As shown. Fig. 6AAs shown, the starting point position coordinates of the sliding operation are located in the first sub-region close to the left end of the control bar control, and the waveform frequency of the corresponding tactile signal generated is relatively small.
[0098] In some examples, the processor may transmit the generated tactile signal to the tactile feedback device so as to drive the tactile feedback device to generate a corresponding tactile feedback effect. For example, the tactile feedback device may drive the piezoelectric ceramic sheet corresponding to the touch position to generate a vibration displacement that matches the feedback strength of the tactile signal according to the tactile signal f1(x1, y1), so that the user feels the vibration or friction of the touch surface.
[0099] Step 105: Determine whether the touch position of the touch operation has changed. In some examples, the processor can determine whether the touch parameter information of the touch operation on the target object has changed based on the touch parameter information of the touch operation collected in real time or periodically by the display touch panel. When it is detected that the touch parameter information of the touch operation on the target object has changed, step 106 can be executed; when it is detected that the touch parameter information of the touch operation on the target object has not changed, the tactile signal generated by step 104 is kept output, and the touch operation is continued to be detected to detect whether the touch operation on the target object has ended.
[0100] In some examples, for the sliding operation of the control bar control, the coordinate position of the touch point during the sliding operation can be collected, for example, the coordinate position of the middle point of the sliding operation P2 (x2, y2). According to the coordinate position of the middle point of the sliding operation, the updated tactile signal can be obtained as f2 (x2, y2), where x2 is the horizontal coordinate of the middle point position, y2 is the vertical coordinate of the middle point position, and f2 is a waveform function, such as a sine function.
[0101] In some examples, the tactile signal generated by the processor according to the updated touch position of the sliding operation can be as follows: Figure 6B As shown. Figure 6B As shown, the coordinates of the middle point position of the sliding operation can be located in the first sub-area of the middle part of the control bar control, and the waveform frequency of the corresponding tactile signal can be relatively large. The waveform functions f1 and f2 can be the same waveform function, and the waveform frequency corresponding to the waveform function f2 is greater than the waveform frequency of the waveform function f1.
[0102] In some examples, the processor may transmit the updated tactile signal to the tactile feedback device so as to drive the tactile feedback device to update the corresponding tactile feedback effect. For example, the tactile feedback device may drive the piezoelectric ceramic piece corresponding to the updated touch position to generate a vibration displacement that matches the feedback strength of the tactile signal according to the tactile signal f2 (x2, y2), so that the user feels the vibration of the touch surface. Compared with the tactile feedback felt at the starting point of the sliding operation, the user can feel the tactile feedback with gradually increasing feedback strength along the direction of the sliding operation.
[0103] In some examples, the tactile feedback device may include: a plurality of tactile feedback units (e.g., piezoelectric ceramic sheets), and the plurality of tactile feedback units may be arranged in an array. After receiving the tactile signal, the tactile feedback device may drive the tactile feedback unit corresponding to the touch position of the touch operation to produce a tactile feedback effect. For example, the tactile feedback unit corresponding to the touch position or the tactile feedback unit adjacent to the touch position is driven to produce a vibration effect, so that the user's fingers can feel the tactile feedback.
[0104] In some examples, the processor can determine in real time or periodically whether the touch position of the touch operation on the target object has changed, thereby achieving real-time or periodic updates of the tactile signal. In this example, when a change in the touch position of the sliding operation on the control bar control is detected, a tactile signal matching the feedback strength corresponding to the first sub-area where the touch position is located can be updated and output, so that the tactile feedback effect can change with the change in the touch position of the sliding operation, thereby making the tactile feedback effect richer and helping to enhance the user experience.
[0105] In other examples, the target object is a control bar control, and the tactile signal can be determined according to the touch position and touch order of the sliding operation. For example, the control bar control can correspond to a first order (e.g., an order of adjusting the numerical value from large to small) and a second order (e.g., an order of adjusting the numerical value from small to large), and the waveform amplitudes of the tactile signals corresponding to the first order and the second order can be different, for example, the waveform amplitude of the tactile signal corresponding to the first order can be smaller than the waveform amplitude of the tactile signal corresponding to the second order. After detecting a sliding operation on the control bar control, the waveform frequency of the tactile signal can be determined according to the touch position of the sliding operation, and the waveform amplitude of the touch signal can be determined according to the touch order of the sliding operation to generate a corresponding tactile signal. After detecting that at least one of the touch position and the touch order of the sliding operation on the control bar control has changed, the waveform frequency can be updated according to the updated touch position, or the waveform amplitude can be updated according to the updated touch order, or the waveform frequency can be updated according to the updated touch position, and the waveform amplitude can be updated according to the updated touch order. In this way, during the sliding operation of the control bar control, the user can feel different tactile feedback effects as the sliding operation changes, which can not only enhance the user experience but also help guide the user's operation.
[0106] Figure 7 Schematic diagram of a knob control of at least one embodiment of the present disclosure. In some examples, such as Figure 7 As shown, the shape of the knob control 41 can be circular. This embodiment is not limited to this. For example, the shape of the knob control can be a rounded rectangle or an ellipse.
[0107] In some examples, such as Figure 7As shown, the knob control 41 can be configured to adjust functions, such as adjusting temperature, adjusting volume, etc. The touch operation matched with the knob control 41 can be a sliding operation. The knob control 41 can be divided into a plurality of continuous second sub-areas 410 in the circumferential direction. The user can implement function adjustment (for example, adjusting volume change, or adjusting temperature change) by sliding operations in the plurality of second sub-areas 410 of the knob control 41, and generate a corresponding tactile signal according to the second sub-area 410 where the touch position of the sliding operation is located. The waveform frequencies of the tactile signals corresponding to the plurality of second sub-areas 410 may be different. For example, the waveform frequencies of the tactile signals corresponding to the plurality of second sub-areas 410 arranged in a clockwise direction may increase or decrease in sequence. In this example, the user can feel the tactile feedback effects of different feedback intensities in the sliding operation of the knob control. For example, sliding the knob control in a clockwise direction can increase the volume, while sliding the knob control in a counterclockwise direction can decrease the volume. By setting the waveform frequencies corresponding to the multiple second sub-areas connected in a clockwise direction to increase sequentially, the feedback intensity corresponding to the multiple second sub-areas connected in a clockwise direction can be gradually increased or decreased. During the user's sliding operation, the user can feel the gradually increasing feedback effect in the clockwise direction and the gradually weakening feedback effect in the counterclockwise direction.
[0108] Regarding the interaction method for the knob control, reference can be made to the description of the aforementioned embodiment, so it will not be repeated here.
[0109] Figure 8 Another example flow chart of the interaction method according to at least one embodiment of the present disclosure. Fig. 9A and Fig. 9B FIG. 1 is an operation example diagram of at least one embodiment of the present disclosure. In this example, the target object is a button control, and the touch operation matched with the button control is a click operation.
[0110] In some examples, such as Figure 8 As shown, the interactive method of this example may include the following steps.
[0111] Step 201: Detect whether there is a touch operation on the graphical user interface. In some examples, the display touch panel can detect whether there is a touch operation on the graphical user interface in real time or periodically.
[0112] Step 202: Acquire touch parameter information of the touch operation. In some examples, the display touch panel may acquire touch parameter information of the touch operation after detecting the touch operation. In this example, the touch parameter information of the touch operation may include: touch position and touch pressure. For example, the display touch panel may acquire the touch position through a capacitive touch panel and acquire the touch pressure through a piezoelectric ceramic sheet.
[0113] Step 203: Determine whether the touch operation is a touch operation for the target object. In some examples, when it is determined that the touch operation is a touch operation for the target object, steps 204 and 205 may be performed; when it is determined that the touch operation is not a touch operation for the target object, no feedback may be given for the touch operation, for example, the touch operation is considered to be an erroneous operation, and the process returns to step 201.
[0114] Step 204: Generate a tactile signal according to the touch parameter information of the touch operation. This example takes the change of the touch pressure of the touch operation to adjust the waveform amplitude of the tactile signal as an example.
[0115] In some examples, such as Fig. 9A and Fig. 9B As shown, the button control 51 can be configured to realize the start, close or select function. The shape of the button control 51 can be an ellipse. However, this embodiment is not limited to this. For example, the shape of the button control 51 can be a circle, a rectangle, or a rounded rectangle.
[0116] In some examples, a button control may be preset to correspond to multiple touch pressure ranges. For example, the multiple touch pressure ranges may include a light tap pressure range, a light press pressure range, and a heavy press pressure range, the pressure value of the light tap pressure range is smaller than the pressure value of the light press pressure range, and the pressure value of the light press pressure range is smaller than the pressure value of the heavy press pressure range. The waveform amplitude of the tactile signal corresponding to the multiple touch pressure ranges changes with the numerical values of the multiple touch pressure ranges. For example, the waveform amplitudes corresponding to the light tap pressure range, the light press pressure range, and the heavy press pressure range may increase in sequence. This embodiment does not limit the division of the touch pressure ranges corresponding to the button controls. In other examples, different button controls may be set to correspond to different touch pressure ranges. For example, one button control may correspond to three touch pressure ranges, and another button control may correspond to four or two touch pressure ranges.
[0117] In some examples, the processor may generate a tactile signal based on the touch pressure of a click operation on a button control. Fig. 9A As shown, the touch pressure of the click operation for the button control belongs to the light press pressure range, and a tactile signal can be generated according to the waveform amplitude corresponding to the light press pressure range. Among them, the waveform type and waveform frequency of the tactile signal can adopt preset values. For example, the tactile feedback device can generate a waveform signal with a weak amplitude to achieve a weak tactile feedback effect. In some examples, when a user gently presses a button control in a graphical user interface, the user can feel a weak vibration.
[0118] Step 205: Determine whether the touch pressure of the touch operation has changed. In some examples, when the processor detects that the touch pressure of the click operation on the button control has changed, step 206 may be executed; when it is detected that the touch pressure of the click operation on the button control has not changed, the tactile signal generated in step 204 is output, and the click operation is continued to be detected to detect whether the click operation on the button control has ended.
[0119] In some examples, the processor may update the tactile signal according to the change of the touch pressure of the click operation on the button control. Fig. 9B As shown, when the touch pressure of the click operation on the button control is updated to the re-press pressure range, the tactile signal can be updated according to the waveform amplitude corresponding to the re-press pressure range. For example, the tactile feedback device can generate a waveform signal with a stronger amplitude to achieve a stronger tactile feedback effect. In some examples, when the user presses the button control hard, the user can feel a stronger vibration.
[0120] The detailed description of the remaining steps of the interactive method of this example can be referred to the description of the aforementioned embodiment, so it will not be repeated here.
[0121] In this example, piezoelectric ceramic sheets can be arranged in an array on a display touch panel and can be used as pressure sensors during the acquisition process to convert touch pressure signals into voltage signals to achieve the acquisition of touch pressure. They can also generate vibrations corresponding to tactile signals under the drive of a driving circuit during tactile feedback to achieve tactile feedback.
[0122] In some examples, such as Fig. 9A and Fig. 9B As shown, in the process of the user's click operation on the button control changing from small to large touch pressure, the tactile feedback device can give a vibration from small to large, so that the user can feel the change of the tactile feedback effect due to the different touch pressure when pressing the same position, which is more in line with the user experience in the human-computer interaction process. Moreover, the feedback intensity of the vibration feedback given by the tactile feedback device is related to the touch pressure of the click operation, and the user can be given an operation prompt, such as prompting the user to use too much force or too little force.
[0123] In some examples, the button control may be a control button for a video playback application. By tapping the button control, you can start or pause video playback; by tapping the button control, you can fast forward the video; by pressing the button control again, you can rewind the video. When the user clicks the button control, different functions can be realized by controlling the applied touch pressure, and different tactile feedback effects can be driven according to different touch pressures. The user can feel rich tactile feedback effects during the clicking operation, and according to the tactile feedback effects, the touch pressure can be adjusted as needed to realize the desired function.
[0124] In other examples, the target object is a button control, and the tactile signal can be determined according to the touch pressure and touch duration of the click operation. For example, the click operation of the button control can correspond to multiple touch duration ranges, wherein the multiple touch duration ranges can be different. For example, the multiple touch duration ranges may include a first duration range, a second duration range, and a third duration range, wherein the first duration range is less than the first duration, the second duration range is greater than or equal to the first duration and less than the second duration, and the third duration range is greater than or equal to the second duration. Among them, the first duration may be less than the second duration, and both are greater than zero. The waveform frequencies of the tactile signals corresponding to the first duration range, the second duration range, and the third duration range may be different. For example, the waveform frequency corresponding to the first duration range may be less than the waveform frequency corresponding to the second duration range, and the waveform frequency corresponding to the second duration range may be less than the waveform frequency corresponding to the third duration range. After detecting the click operation on the button control, the waveform amplitude of the tactile signal may be determined according to the touch pressure of the click operation, and the waveform frequency of the tactile signal may be determined according to the touch duration of the click operation to generate the corresponding tactile signal. After detecting that at least one of the touch pressure and the touch duration of the click operation on the button control has changed, the waveform amplitude can be updated according to the updated touch pressure, or the waveform frequency can be updated according to the updated touch duration, or the waveform amplitude can be updated according to the updated touch pressure and the waveform frequency can be updated according to the updated touch duration. In this way, during the user's click operation on the button control, different tactile feedback effects can be felt as the click operation changes, which can not only enhance the user experience, but also help guide the user's operation to achieve the function the user wants to achieve.
[0125] In other examples, the target object is a button control, and the tactile signal can be determined based on the touch duration of the click operation. For example, the click operation of the button control can correspond to multiple touch duration ranges, wherein the multiple touch duration ranges can be different. The waveform frequencies corresponding to the multiple touch duration ranges can be different. After detecting a click operation on the button control, the waveform frequency of the tactile signal can be determined based on the touch duration of the click operation to generate a corresponding tactile signal. After detecting that the touch duration of the click operation on the button control has changed, the waveform frequency can be updated according to the updated touch duration.
[0126] In other examples, the target object is a button control, and the touch signal can be determined based on the touch area of the click operation. For example, the click operation of the button control can correspond to multiple touch area ranges, wherein the multiple touch area ranges can be different, and the waveform frequencies or waveform amplitudes corresponding to the multiple touch area ranges can be different. After detecting a click operation on the button control, the waveform frequency or waveform amplitude of the tactile signal can be determined based on the touch area of the click operation to generate a corresponding tactile signal. After detecting that the touch area of the click operation on the button control has changed, the waveform frequency or waveform amplitude can be updated according to the updated touch area.
[0127] Fig.10 Another flowchart of the interaction method of at least one embodiment of the present disclosure. Fig.11A and Fig. 11B FIG. 1 is an operation example diagram of at least one embodiment of the present disclosure. In this example, the target object is a multi-touch area, and the touch operation matching the multi-touch area is a click operation.
[0128] In some examples, such as Fig.10 As shown, the interaction method of this example may include the following steps:
[0129] Step 301: Detect whether there is a touch operation on the graphical user interface. In some examples, the display touch panel can detect whether there is a touch operation on the graphical interactive interface in real time or periodically.
[0130] Step 302: Acquire touch parameter information of the touch operation. In some examples, the display touch panel may acquire touch parameter information of the touch operation after detecting the touch operation. In this example, the touch parameter information of the touch operation may include: touch position and touch point number. For example, the display touch panel may acquire the touch position and touch point number through a capacitive touch panel.
[0131] Step 303: Determine whether the touch operation is a touch operation for the target object. In some examples, when it is determined that the touch operation is a touch operation for the target object, steps 304 and 305 may be executed; when it is determined that the touch operation is not a touch operation for the target object, no feedback may be given for the touch operation, for example, the touch operation is considered to be an erroneous operation, and the process returns to step 301.
[0132] Step 304: Generate a tactile signal according to the touch parameter information of the touch operation. This example takes the change of the touch point number of the click operation to adjust the waveform type of the tactile signal as an example.
[0133] In some examples, such as Fig.11A and Fig. 11B As shown, the set multi-touch area of the graphical user interface can be used as the target object. For example, the target object can be a blank area displayed in the graphical user interface.
[0134] In some examples, a multi-touch area may be preset to correspond to multiple touch ranges. For example, the multiple touch ranges may include: a first touch range, a second touch range, and a third touch range. The first touch range may be less than or equal to the first number, the second touch range may be greater than the first number and less than or equal to the second number, and the third touch range may be greater than the second number, wherein the second number may be greater than the first number. This embodiment does not limit the division of the touch ranges corresponding to the multi-touch areas. In other examples, different multi-touch areas may be set to correspond to different touch ranges. For example, one multi-touch area may correspond to three touch ranges, and another multi-touch area may correspond to two or four touch ranges.
[0135] In some examples, the processor can generate a tactile signal based on the number of touch points in a click operation on a multi-touch area. Fig.11A As shown, the number of touch points for the click operation in the multi-touch area is one, for example, belonging to the first touch point range, and a tactile signal can be generated according to the waveform type corresponding to the first touch point range. For example, the first touch point range corresponds to a sine function wave, and the waveform frequency and waveform amplitude of the tactile signal can adopt preset values.
[0136] In some examples, such as Fig.11AAs shown, the click operation on the multi-touch area is a single-touch operation with one touch point, and the coordinate position of the touch point is Q1 (x3, y3). The processor can generate a tactile signal g1 (x3, y3), where x3 is the horizontal coordinate of the touch point, y3 is the vertical coordinate of the touch point, and g1 is a waveform function. In this example, the waveform type corresponding to the first contact range is a sine function wave, and the waveform function g1 is a sine function. For example, the driving circuit of the tactile feedback device can drive the piezoelectric ceramic sheet corresponding to the position of the touch point to generate vibration feedback corresponding to the feedback intensity of the tactile signal. In some examples, when the user single-point touches the target object, it can be achieved to enter the next level page.
[0137] Step 305: Determine whether the number of touch points of the touch operation has changed. In some examples, when the processor detects that the number of touch points of the click operation on the multi-touch area has changed, step 306 may be executed; when it is detected that the number of touch points of the click operation on the multi-touch area has not changed, the tactile signal generated in step 304 is kept output, and the click operation is continued to be detected to detect whether the click operation on the multi-touch area has ended.
[0138] In some examples, the processor may update the tactile signal according to the change in the number of touch points of the click operation on the multi-touch area. Fig. 11B As shown, when the number of touch points for the click operation on the multi-touch area is two, for example, belonging to the second touch point range, a tactile signal can be generated according to the waveform type corresponding to the second touch point range. For example, the second touch point range corresponds to a rectangular wave, and the waveform frequency and waveform amplitude of the tactile signal can adopt preset values.
[0139] In some examples, such as Fig. 11B As shown, the click operation on the multi-touch area is a multi-touch operation with two touch points, and the coordinate positions of the two touch points are Q1 (x3, y3) and Q2 (x4, y4). The processor can generate tactile signals g2 (x3, y3) and g2 (x4, y4), where g2 is a rectangular wave function. For example, the driving circuit of the tactile feedback device can drive the piezoelectric ceramic sheet corresponding to the position of the two touch points to generate vibration feedback corresponding to the feedback intensity of the tactile signal. In some examples, when the user multi-touches the target object, it can be realized to return to the previous page.
[0140] The detailed description of the remaining steps of the interactive method of this example can be referred to the description of the aforementioned embodiment, so it will not be repeated here.
[0141] In this example, if Fig.11A and Fig. 11BAs shown, when the number of touch points of the user's click operation on the multi-touch area switches from a single point to two points, the processor can generate tactile signals of different waveform types, so that the tactile feedback device can give tactile feedback effects of different intensities. When the user performs a click operation on the same area, the user can feel the change in the tactile feedback effect by changing the number of touch points, which is more in line with the user experience in the human-computer interaction process. Moreover, the feedback intensity of the vibration feedback given by the tactile feedback device is related to the number of touch points of the click operation, and the user can be given an operation prompt.
[0142] In other examples, the target object may be a multi-touch area, and the touch signal is determined according to the number of touch points and the touch area of the click operation. The touch area collected at a certain moment in this example may refer to the sum of the touch areas of all touch points of the click operation at that moment. For example, the click operation of the multi-touch area may correspond to multiple touch area ranges, wherein the multiple touch area ranges may be different, and the waveform frequencies or waveform amplitudes corresponding to the multiple touch area ranges may be different. After detecting the click operation on the multi-touch area, the waveform type of the tactile signal may be determined according to the number of touch points of the click operation, and the waveform frequency may be determined according to the touch area to generate a corresponding tactile signal. After detecting that at least one of the number of touch points and the touch area of the click operation has changed, the waveform type may be updated according to the updated number of touch points, or the waveform frequency may be updated according to the updated touch area, or the waveform type may be updated according to the updated number of touch points, and the waveform frequency may be updated according to the updated touch area. In this way, when the user clicks on the multi-touch area, different tactile feedback effects can be felt as the click operation changes, which not only enhances the user experience but also helps guide the user's operation to achieve the desired function.
[0143] In other examples, the target object may include: application icons, display images, file icons, etc. For example, a click operation on a display image may realize the image zooming in or out function, and a corresponding tactile signal may be generated according to the touch parameter information of the click operation to realize a rich tactile feedback effect. For another example, a drag operation on a file icon may realize functions such as file opening, file deletion, or file sending, and a corresponding tactile signal may be generated according to the touch parameter information of the drag operation to realize tactile feedback. This embodiment is not limited to this.
[0144] In other examples, the correspondence between the touch parameter information of the touch operation on the target object and the parameters of the tactile signal can be adjusted or matched according to the actual application scenario to meet the actual use requirements. This embodiment is not limited to this.
[0145] The interactive method provided in this embodiment can detect the touch parameter information of the touch operation on the graphical user interface, and drive the feedback of different tactile feedback effects based on the changes in the touch parameter information, thereby generating rich tactile feedback effects. This example can not only increase the diversified experience of interaction, but also effectively guide the user's touch operation.
[0146] This embodiment also provides a display touch device, including: a display touch panel, a processor and a tactile feedback device, wherein the processor is connected to the display touch panel and the tactile feedback device. The display touch panel is configured to obtain touch parameter information of a touch operation in a graphical user interface. The processor is configured to determine a touch operation on a target object in a graphical user interface; generate a tactile signal according to the touch parameter information of the touch operation, and update the tactile signal according to the updated touch parameter information when a change in the touch parameter information of the touch operation is detected. The touch parameter information includes at least one of the following: touch position, touch pressure, number of touch points, touch area, touch duration, and touch sequence. The tactile feedback device is configured to generate a corresponding tactile feedback effect according to the tactile signal.
[0147] In some exemplary embodiments, the haptic signal is characterized by at least one of the following parameters: waveform type, waveform amplitude, and waveform frequency.
[0148] In some exemplary embodiments, the processor is configured to generate a tactile signal based on touch parameter information of the touch operation in the following manner: determining a correspondence between the touch parameter information and parameters of the tactile signal based on a type of the target object and a type of touch operation on the target object; and generating the tactile signal based on the touch parameter information and the correspondence between the touch parameter information and parameters of the tactile signal.
[0149] In some exemplary embodiments, the processor is configured to determine the correspondence between touch parameter information and parameters of the tactile signal according to the type of the target object and the type of touch operation on the target object in at least one of the following ways: when the target object includes a control bar control and the touch operation on the target object is a sliding operation, determining that the waveform frequency of the tactile signal depends on the touch position of the touch operation; when the target object includes a button control and the touch operation on the target object is a click operation, determining that the waveform amplitude of the tactile signal depends on the touch pressure of the touch operation; when the target object includes a multi-touch area and the touch operation on the target object is a click operation, determining that the waveform type of the tactile signal depends on the number of touch points of the touch operation.
[0150] In some exemplary embodiments, the control bar control is divided into multiple first sub-areas along the length direction of the control bar control, and the waveform frequency of the tactile signal corresponding to the multiple first sub-areas varies along the length direction of the control bar control; when the target object includes the control bar control, and the touch operation on the target object is a sliding operation, the processor is configured to generate the tactile signal according to the touch parameter information and the correspondence between the touch parameter information and the parameters of the touch signal in the following manner: determining the first sub-area where the touch point is located in the control bar control according to the touch position of the contact point of the sliding operation; and generating the tactile signal according to the waveform frequency corresponding to the first sub-area.
[0151] In some exemplary embodiments, the button control corresponds to multiple touch pressure ranges, and the waveform amplitude of the tactile signal corresponding to the multiple touch pressure ranges varies with the numerical values of the multiple touch pressure ranges. When the target object includes a button control, and the touch operation on the target object is a click operation, the processor is configured to generate the tactile signal according to the touch parameter information and the correspondence between the touch parameter information and the parameters of the touch signal in the following manner: determine the touch pressure range to which the touch pressure of the click operation belongs according to the touch pressure of the click operation; generate the tactile signal according to the waveform amplitude corresponding to the determined touch pressure range.
[0152] In some exemplary embodiments, the multi-touch area corresponds to multiple touch point ranges, and the waveform types corresponding to the multiple touch point ranges are different. When the target object includes a multi-touch area, and the touch operation on the target object is a click operation, the processor is configured to generate the tactile signal according to the touch parameter information and the correspondence between the touch parameter information and the parameters of the touch signal in the following manner: according to the number of touch points of the click operation, determine the touch point range to which the touch point number belongs; and generate the tactile signal according to the waveform type corresponding to the determined touch point range.
[0153] In some exemplary embodiments, the tactile feedback device includes at least a piezoelectric ceramic sheet.
[0154] The description of the display touch device of this embodiment can refer to the description of the aforementioned embodiment, so it will not be repeated here.
[0155] In addition, at least one embodiment of the present disclosure further provides a non-transitory computer-readable storage medium storing a computer program, which implements the steps of the above-mentioned interaction method when executed.
[0156] It will be appreciated by those skilled in the art that all or some of the steps, systems, and functional modules / units in the methods disclosed above may be implemented as software, firmware, hardware, and appropriate combinations thereof. In hardware implementations, the division between the functional modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed by several physical components in cooperation. Some or all components may be implemented as software executed by a processor, such as a digital signal processor or a microprocessor, or implemented as hardware, or implemented as an integrated circuit, such as an application-specific integrated circuit. Such software may be distributed on a computer-readable medium, which may include a computer storage medium (or non-transitory medium) and a communication medium (or temporary medium). As known to those skilled in the art, the term computer storage medium includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tapes, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and can be accessed by a computer. In addition, it is well known to those of ordinary skill in the art that communication media typically contain computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media.
[0157] The above shows and describes the basic principles, main features and advantages of the present disclosure. The present disclosure is not limited by the above embodiments. The above embodiments and descriptions are only for explaining the principles of the present disclosure. Without departing from the spirit and scope of the present disclosure, the present disclosure may have various changes and improvements, which all fall within the scope of the present disclosure to be protected.
Claims
1. An interactive method, characterized in that: include: Determine a touch operation on a target object in a graphical user interface, and determine touch parameter information of the touch operation; the touch parameter information includes at least one of the following: touch position, touch pressure, touch point number, touch area, touch duration, and touch sequence; generating a tactile signal according to the touch parameter information of the touch operation, wherein the tactile signal is configured to drive a tactile feedback device to generate a corresponding tactile feedback effect; When it is detected that the touch parameter information of the touch operation changes, the tactile signal is updated according to the updated touch parameter information.
2. The method according to claim 1, characterized in that The tactile signal is characterized by at least one of the following parameters: waveform type, waveform amplitude, and waveform frequency.
3. The method according to claim 2, characterized in that The step of generating a tactile signal according to the touch parameter information of the touch operation includes: Determining a correspondence between touch parameter information and parameters of a tactile signal according to the type of the target object and the type of the touch operation on the target object; The tactile signal is generated according to the touch parameter information and the corresponding relationship between the touch parameter information and the parameters of the tactile signal.
4. The method according to claim 3, characterized in that The determining, according to the type of the target object and the type of the touch operation on the target object, the correspondence between the touch parameter information and the parameters of the tactile signal includes at least one of the following: When the target object includes a control bar control, and the touch operation on the target object is a sliding operation, determining the waveform frequency of the tactile signal depends on the touch position of the touch operation; When the target object includes a button control, and the touch operation on the target object is a click operation, determining that the waveform amplitude of the tactile signal depends on the touch pressure of the touch operation; When the target object includes a multi-touch area, and the touch operation on the target object is a click operation, determining the waveform type of the tactile signal depends on the number of touch points of the touch operation.
5. The method according to claim 4, characterized in that The control bar control is divided into a plurality of first sub-areas along a length direction of the control bar control, and the waveform frequencies of the haptic signals corresponding to the plurality of first sub-areas vary along the length direction of the control bar control; When the target object includes a control bar control, and the touch operation on the target object is a sliding operation, generating the tactile signal according to the touch parameter information and the correspondence between the touch parameter information and the parameters of the touch signal includes: According to the touch position of the touch point of the sliding operation, a first sub-region where the touch point is located in the control bar control is determined; and according to the waveform frequency corresponding to the first sub-region, the tactile signal is generated.
6. The method according to claim 5, characterized in that The updating of the tactile signal according to the updated touch parameter information comprises: According to the updated touch position of the contact point of the sliding operation, a first sub-region where the contact point is located in the control bar control is determined; and according to the waveform frequency corresponding to the first sub-region, the tactile signal is updated.
7. The method according to claim 4, characterized in that The button control corresponds to a plurality of touch pressure ranges, and the waveform amplitudes of the tactile signals corresponding to the plurality of touch pressure ranges vary with the numerical values of the plurality of touch pressure ranges; When the target object includes a button control, and the touch operation on the target object is a click operation, generating the tactile signal according to the touch parameter information and the correspondence between the touch parameter information and the parameters of the touch signal includes: According to the touch pressure of the click operation, the touch pressure range to which the touch pressure of the click operation belongs is determined; and according to the waveform amplitude corresponding to the determined touch pressure range, the tactile signal is generated.
8. The method according to claim 7, characterized in that The updating of the tactile signal according to the updated touch parameter information comprises: According to the updated touch pressure of the click operation, the touch pressure range to which the updated touch pressure belongs is determined; and according to the waveform amplitude corresponding to the updated touch pressure range, the tactile signal is updated.
9. The method according to claim 4, characterized in that The multi-touch area corresponds to a plurality of touch point ranges, and the plurality of touch point ranges correspond to different waveform types; When the target object includes a multi-touch area, and the touch operation on the target object is a click operation, generating the tactile signal according to the touch parameter information and the correspondence between the touch parameter information and the parameters of the touch signal includes: According to the number of touch points of the click operation, the touch point range to which the touch points belong is determined; and according to the waveform type corresponding to the determined touch point range, the tactile signal is generated.
10. The method according to claim 9, characterized in that The updating of the tactile signal according to the updated touch parameter information includes: According to the updated number of touch points of the click operation, the touch point range to which the updated number of touch points belongs is determined; and according to the waveform type corresponding to the updated touch point range, the tactile signal is updated.
11. The method according to any one of claims 1 to 10, characterized in that The tactile feedback effect includes a tactile feedback effect generated based on a squeeze film effect.
12. The method according to claim 1, characterized in that The step of determining a touch operation on a target object in a graphical user interface includes: When the touch position of the touch operation is located in the area where the target object is located, and the type of the target object matches the type of the touch operation, it is determined that the touch operation is a touch operation for the target object.
13. A display touch device, characterized in that: include: A display touch panel, a processor and a tactile feedback device, wherein the processor is connected to the display touch panel and the tactile feedback device; The display touch panel is configured to obtain touch parameter information of a touch operation in a graphical user interface; the touch parameter information includes at least one of the following: touch position, touch pressure, touch point number, touch area, touch duration, and touch sequence; The processor is configured to determine a touch operation on a target object in a graphical user interface; generate a tactile signal according to touch parameter information of the touch operation; and update the tactile signal according to the updated touch parameter information when a change in the touch parameter information of the touch operation is detected; The tactile feedback device is configured to generate a corresponding tactile feedback effect according to the tactile signal.
14. The display touch device according to claim 13, characterized in that: The tactile signal is characterized by at least one of the following parameters: waveform type, waveform amplitude, and waveform frequency.
15. The display touch device according to claim 14, characterized in that: The processor is configured to generate a tactile signal according to the touch parameter information of the touch operation in the following manner: Determining a correspondence between touch parameter information and parameters of a tactile signal according to the type of the target object and the type of the touch operation on the target object; The tactile signal is generated according to the touch parameter information and the corresponding relationship between the touch parameter information and the parameters of the tactile signal.
16. The display touch device according to claim 15, characterized in that: The processor is configured to determine a correspondence between the touch parameter information and the parameters of the tactile signal according to the type of the target object and the type of the touch operation on the target object in at least one of the following ways: When the target object includes a control bar control, and the touch operation on the target object is a sliding operation, determining the waveform frequency of the tactile signal depends on the touch position of the touch operation; When the target object includes a button control, and the touch operation on the target object is a click operation, determining that the waveform amplitude of the tactile signal depends on the touch pressure of the touch operation; When the target object includes a multi-touch area, and the touch operation on the target object is a click operation, determining the waveform type of the tactile signal depends on the number of touch points of the touch operation.
17. The display touch device according to claim 16, characterized in that: The control bar control is divided into a plurality of first sub-areas along a length direction of the control bar control, and the waveform frequencies of the haptic signals corresponding to the plurality of first sub-areas vary along the length direction of the control bar control; When the target object includes a control bar control, and the touch operation on the target object is a sliding operation, the processor is configured to generate the tactile signal according to the touch parameter information and the corresponding relationship between the touch parameter information and the parameters of the touch signal in the following manner: According to the touch position of the touch point of the sliding operation, a first sub-region where the touch point is located in the control bar control is determined; and according to the waveform frequency corresponding to the first sub-region, the tactile signal is generated.
18. The display touch device according to claim 16, characterized in that: The button control corresponds to a plurality of touch pressure ranges, and the waveform amplitudes of the tactile signals corresponding to the plurality of touch pressure ranges vary with the numerical values of the plurality of touch pressure ranges; When the target object includes a button control, and the touch operation on the target object is a click operation, the processor is configured to generate the tactile signal according to the touch parameter information and the correspondence between the touch parameter information and the parameters of the touch signal in the following manner: According to the touch pressure of the click operation, the touch pressure range to which the touch pressure of the click operation belongs is determined; and according to the waveform amplitude corresponding to the determined touch pressure range, the tactile signal is generated.
19. The display touch device according to claim 16, characterized in that: The multi-touch area corresponds to a plurality of touch point ranges, and the plurality of touch point ranges correspond to different waveform types; When the target object includes a multi-touch area, and the touch operation on the target object is a click operation, the processor is configured to generate the tactile signal according to the touch parameter information and the correspondence between the touch parameter information and the parameters of the touch signal in the following manner: According to the number of touch points of the click operation, the touch point range to which the touch points belong is determined; and according to the waveform type corresponding to the determined touch point range, the tactile signal is generated.
20. The display touch device according to claim 13, characterized in that: The tactile feedback device at least includes: a piezoelectric ceramic sheet.
21. A non-transitory computer-readable storage medium, characterized in that A computer program is stored, and when the computer program is executed, the steps of the interactive method according to any one of claims 1 to 12 are implemented.
Citation Information
Cited By
Touch vibration feedback method, vibration feedback system, computer equipment and storage medium
CN120848754A
