Multi-element tactile feedback method and system for touch screen

By constructing a model of multivariate haptic driving signal parameters, combining the three-dimensional feature information of elements on the touch screen, multiple tactile feedback driving signals are generated, which solves the problem of pilots lacking natural feedback in touch operations, and realizes intuitive and real three-dimensional tactile feedback. Improves operational efficiency.

CN119473021AInactive Publication Date: 2025-02-18SHENYANG AIRCRAFT DESIGN INST AVIATION IND CORP OF CHINA

Patent Information

Application Number
CN202510054147.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-01-14
Publication Date
2025-02-18
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

When pilots perform touch operations, they lack natural feedback, which leads to inability to judge the real-time interaction state, low interaction efficiency, and easy operational errors.

Method used

By constructing a tactile perception model of multivariate haptic driving signal parameters, combining the three-dimensional characteristic information of elements on the touch screen, a multivariate haptic feedback driving signal is generated, which drives electrostatic force, air pressure film and mechanical vibration trigger source to provide three-dimensional tactile feedback.

Benefits of technology

It realizes intuitive and real three-dimensional haptic feedback, reduces the dependence of visual feedback, improves operation efficiency, and reduces the possibility of operation errors.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119473021A_ABST
    Figure CN119473021A_ABST
Patent Text Reader

Abstract

The invention belongs to the technical field of touch screen tactile feedback design, and particularly relates to a touch screen multi-element tactile feedback method and a touch screen multi-element tactile feedback system, and the touch screen multi-element tactile feedback method comprises the following steps: 1, constructing a tactile perception model of multi-element tactile driving signal parameters; 2, constructing a touch sensing model of the three-dimensional feature information of the elements on the touch screen; 3, constructing a multi-element tactile feedback driving signal parameter model of the element three-dimensional feature information based on the tactile perception model of the element three-dimensional feature information on the touch screen and the tactile perception model of the multi-element tactile driving signal parameters; and step 4, sensing a touch position on the touch screen so as to obtain three-dimensional feature information of a touch position element and a multivariate tactile feedback driving signal parameter model based on the element three-dimensional feature information, so that a multivariate tactile feedback driving signal parameter is obtained, a corresponding multivariate tactile feedback driving signal is generated, and a multivariate tactile generation source is driven. The method acts on the touch screen.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application belongs to the technical field of touch screen tactile feedback design, and specifically relates to a touch screen multi-element tactile feedback method and system thereof. Background Art

[0002] With the development of technology, industrial products are showing a trend of moving from physical button operation to touch display interaction. Touch screens are widely used as operation input devices on airplanes, replacing traditional keyboards or physical buttons for operation.

[0003] In the cockpit of an aircraft, pilots mainly use large-size touch screens to obtain situational awareness, flight status and other data, and perform touch operations to control the aircraft. The effectiveness of touch operations judged by pilots mainly depends on visual feedback. However, with the increase in mission complexity, the pilots' visual guidance has gradually overflowed. When there is no perception of smooth clicks on the touch screen and a lack of natural feedback, it is impossible to judge the real-time interaction status and interaction efficiency, resulting in frequent operational errors.

[0004] This application is proposed in view of the above-mentioned technical defects. Summary of the invention

[0005] The purpose of the present application is to provide a touch screen multi-tactile feedback method and system thereof to overcome or alleviate at least one of the known technical defects.

[0006] The technical solution of this application is: A touch screen multi-tactile feedback method, comprising: Step 1: construct a tactile perception model of multiple tactile driving signal parameters; Step 2: construct a tactile perception model of three-dimensional feature information of elements on the touch screen; Step 3: construct a multivariate tactile feedback driving signal parameter model of the three-dimensional feature information of the element based on the tactile perception model of the three-dimensional feature information of the element on the touch screen and the tactile perception model of the multivariate tactile driving signal parameters; Step 4: sense the touch position on the touch screen, and then obtain the three-dimensional feature information of the touch position element, obtain the multi-dimensional tactile feedback driving signal parameter model based on the element's three-dimensional feature information, generate the corresponding multi-dimensional tactile feedback driving signal, drive the multi-dimensional tactile source, and act on the touch screen.

[0007] Optionally, in the above touch screen multi-tactile feedback method, step 1 is specifically as follows: Through subjective scoring, a tactile perception model of electrostatic force, air pressure film, and mechanical vibration driving signal parameters is constructed.

[0008] Optionally, in the above-mentioned touch screen multi-dimensional tactile feedback method, in step two, a tactile perception model of three-dimensional feature information of elements on the touch screen is constructed, specifically including constructing a tactile perception model of gradient information about electrostatic force and air pressure film, and constructing a tactile perception model of depth information about mechanical vibration.

[0009] Optionally, in the above touch screen multi-tactile feedback method, step three specifically includes: Based on the tactile perception model of electrostatic force and air pressure film of the element gradient information on the touch screen, and the tactile perception model of the electrostatic force and air pressure film driving signal parameters, the electrostatic force and air pressure film feedback driving signal parameter model of the gradient information is constructed; Based on the tactile perception model of mechanical vibration of the element depth information on the touch screen and the tactile perception model of the mechanical vibration driving signal parameters, a mechanical vibration feedback driving signal parameter model of the depth information is constructed.

[0010] Optionally, in the above touch screen multi-tactile feedback method, step 4 is specifically as follows: Sense the touch position on the touch screen, obtain the gradient information and depth information of the touch position element, obtain the electrostatic force and air pressure film feedback driving signal parameters based on the electrostatic force and air pressure film feedback driving signal parameter models based on the gradient information, and obtain the mechanical vibration feedback driving signal parameters based on the mechanical vibration feedback driving signal parameter model based on the depth information, generate corresponding electrostatic force, air pressure film, and mechanical vibration feedback driving signals, drive the electrostatic force, air pressure film, and mechanical vibration trigger sources, and act on the touch screen.

[0011] A touch screen multi-tactile feedback system, comprising a touch position sensing unit, a multi-tactile feedback driving signal parameter generating unit, a multi-tactile feedback driving control unit, and a multi-tactile feedback interaction unit; The touch position sensing unit is used to sense the touch position on the touch screen; The multivariate tactile feedback driving signal parameter generating unit acquires the three-dimensional feature information of the touch position element, and generates the multivariate tactile feedback driving signal parameter based on the multivariate tactile feedback driving signal parameter model of the element's three-dimensional feature information, specifically: acquiring the gradient information and depth information of the touch position element, and generating the electrostatic force and air film pressure feedback driving signal parameters based on the electrostatic force and air film pressure feedback driving signal parameter model of the gradient information, and generating the mechanical vibration feedback driving signal parameters based on the mechanical vibration feedback driving signal parameter model of the depth information; The multi-tactile feedback driving control unit generates a corresponding multi-tactile feedback driving signal according to the multi-tactile feedback driving signal parameters, specifically: generating a corresponding electrostatic force, air pressure film, and mechanical vibration feedback driving signal according to the electrostatic force, air pressure film, and mechanical vibration feedback driving signal parameters; The multi-tactile feedback interaction unit includes a multi-tactile source, which is driven by a multi-tactile feedback driving signal and acts on the touch screen, wherein the multi-tactile source includes an electrostatic force, an air pressure film, and a mechanical vibration trigger source, which is driven by an electrostatic force, an air pressure film, and a mechanical vibration feedback driving signal and acts on the touch screen.

[0012] This application has at least the following beneficial technical effects: Provided is a touch screen multi-tactile feedback method and system thereof. According to the gradient and depth three-dimensional feature information of tactile perception, a mapping relationship with electrostatic force, air pressure film and mechanical vibration feedback drive signal parameters is constructed, the electrostatic force, air pressure film and mechanical vibration trigger sources are driven, and the electrostatic force, air pressure film and mechanical vibration are integrated to perform multi-tactile feedback, so that the horizontal interaction space of the touch screen is expanded to the depth direction, and intuitive and real three-dimensional tactile feedback can be provided, so that the operator does not need to judge the operation through visual feedback, but can perceive the operation more directly through real three-dimensional tactile interaction, perform touch operation efficiently, and reduce the possibility of operation errors. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 is a schematic diagram of a touch screen multi-tactile feedback method provided by an embodiment of the present application; Figure 2 Schematic diagram of a touch screen multi-tactile feedback system provided in an embodiment of the present application.

[0014] In order to better illustrate the present embodiment, some parts of the drawings may be omitted, enlarged or reduced, and do not represent the size of the actual product. In addition, the drawings are only used for illustrative purposes and should not be construed as limitations on the present application. DETAILED DESCRIPTION

[0015] In order to make the technical solution and advantages of the present application clearer, the technical solution of the present application will be described in further detail in detail and in detail with reference to the accompanying drawings. It can be understood that the specific embodiments described here are only partial embodiments of the present application, which are only used to explain the present application, not to limit the present application. It should be noted that, for the convenience of description, only the parts related to the present application are shown in the accompanying drawings, and other related parts can refer to the general design.

[0016] In addition, unless otherwise defined, the technical terms or scientific terms used in the description of this application shall have the usual meanings understood by those of ordinary skill in the art to which this application belongs. The words used in the description of this application to indicate orientation are only used to indicate relative directions or positional relationships. When the absolute position of the described object changes, its relative positional relationship may also change accordingly. The word "include" used in the description of this application indicates that the elements or objects appearing before the word include the elements or objects listed after the word and their equivalents, but does not exclude other elements or objects.

[0017] In addition, it should be noted that, unless otherwise clearly specified and limited, the words "installation", "connection" and similar terms used in the description of this application should be understood in a broad sense. For example, the connection can be a fixed connection or a detachable connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium. Technical personnel in the field can understand its specific meaning in this application according to the specific circumstances.

[0018] The three-dimensional feature information of the elements on the touch screen includes gradient information and depth information. The gradient information indicates how fast the edge of the three-dimensional protrusion changes, which can be characterized by the magnitude of the tangential feedback force; the depth information indicates the height change trend of the three-dimensional protrusion, which can be characterized by the magnitude of the vibration.

[0019] Electrostatic force and air pressure film can provide tangential feedback force, and mechanical vibration can provide vibration normal force.

[0020] Based on the above, the present application provides a touch screen multi-tactile feedback method, such as Figure 1 shown.

[0021] Step 1: Construct a tactile perception model of multiple tactile driving signal parameters.

[0022] The multi-dimensional tactile driving signal may include an electrostatic force driving signal, an air pressure film driving signal, and a mechanical vibration driving signal. Therefore, a tactile perception model of the multi-dimensional tactile driving signal parameters is constructed, specifically including constructing a tactile perception model of the electrostatic force, air pressure film, and mechanical vibration driving signal parameters.

[0023] The tactile perception models of electrostatic force, air pressure film, and mechanical vibration driving signal parameters can be constructed respectively through subjective scoring, which can further include a tactile perception intensity model regarding amplitude, and a tactile perception roughness model regarding frequency.

[0024] Step 2: Construct a tactile perception model of the three-dimensional feature information of elements on the touch screen.

[0025] The three-dimensional feature information of the elements on the touch screen includes gradient information and depth information.

[0026] The gradient information can be characterized by the tangential feedback force provided by the electrostatic force and the air pressure film, and the depth information can be characterized by the vibration provided by the mechanical vibration. Therefore, constructing a tactile perception model of the three-dimensional feature information of the elements on the touch screen can specifically include constructing a tactile perception model of the gradient information about the electrostatic force and the air pressure film, and constructing a tactile perception model of the depth information about the mechanical vibration.

[0027] Step three: construct a multivariate tactile feedback driving signal parameter model of the three-dimensional feature information of the element based on the tactile perception model of the three-dimensional feature information of the element on the touch screen and the tactile perception model of the multivariate tactile driving signal parameters.

[0028] Based on the tactile perception model of electrostatic force and air pressure film of the element gradient information on the touch screen, and the tactile perception model of the electrostatic force and air pressure film driving signal parameters, the electrostatic force and air pressure film feedback driving signal parameter model of the gradient information is constructed; Based on the tactile perception model of mechanical vibration of the element depth information on the touch screen and the tactile perception model of the mechanical vibration driving signal parameters, a mechanical vibration feedback driving signal parameter model of the depth information is constructed.

[0029] Step 4: sense the touch position on the touch screen, that is, the position interaction information of the finger sliding on the touch screen, and then obtain the three-dimensional feature information of the touch position element, obtain the multivariate tactile feedback drive signal parameter model based on the element's three-dimensional feature information, generate the corresponding multivariate tactile feedback drive signal, drive the multivariate tactile source, and act on the touch screen.

[0030] The multiple tactile sources include electrostatic force, air pressure film, and mechanical vibration trigger source.

[0031] Sense the touch position on the touch screen, obtain the gradient information and depth information of the touch position element, obtain the electrostatic force and air pressure film feedback driving signal parameters based on the electrostatic force and air pressure film feedback driving signal parameter models based on the gradient information, and obtain the mechanical vibration feedback driving signal parameters based on the mechanical vibration feedback driving signal parameter model based on the depth information, generate corresponding electrostatic force, air pressure film, and mechanical vibration feedback driving signals, drive the electrostatic force, air pressure film, and mechanical vibration trigger sources, and act on the touch screen, so as to generate corresponding tactile feedback for the operator.

[0032] The touch screen multi-tactile feedback method disclosed in the above embodiment constructs a mapping relationship with the electrostatic force, air pressure film and mechanical vibration feedback drive signal parameters based on the gradient and depth three-dimensional feature information of tactile perception, drives the electrostatic force, air pressure film and mechanical vibration trigger sources, integrates the electrostatic force, air pressure film and mechanical vibration for multi-tactile feedback, expands the horizontal interaction space of the touch screen to the depth direction, and can provide intuitive and real three-dimensional tactile feedback, so that the operator no longer needs to judge the operation through visual feedback, and can perceive the operation more directly through real three-dimensional tactile interaction, efficiently perform touch operations, and reduce the possibility of operational errors.

[0033] A touch screen multi-tactile feedback system, such as Figure 2 As shown, it includes a touch position sensing unit, a multi-dimensional tactile feedback driving signal parameter generating unit, a multi-dimensional tactile feedback driving control unit, and a multi-dimensional tactile feedback interaction unit.

[0034] The touch position sensing unit is used to sense the touch position on the touch screen.

[0035] The multi-element tactile feedback driving signal parameter generating unit obtains the three-dimensional feature information of the touch position element, and generates the multi-element tactile feedback driving signal parameter based on the multi-element tactile feedback driving signal parameter model of the three-dimensional feature information of the element, specifically: The gradient information and depth information of the touch position element are obtained, and the electrostatic force and air pressure film feedback driving signal parameter models based on the gradient information are used to generate the electrostatic force and air pressure film feedback driving signal parameters, and the mechanical vibration feedback driving signal parameter model based on the depth information is used to generate the mechanical vibration feedback driving signal parameters.

[0036] The multi-tactile feedback driving control unit generates a corresponding multi-tactile feedback driving signal according to the multi-tactile feedback driving signal parameters. The signal generator generates a corresponding multi-tactile feedback driving signal according to the multi-tactile feedback driving signal parameters and outputs it through an amplifier, specifically: According to the electrostatic force, air pressure film, and mechanical vibration feedback driving signal parameters, corresponding electrostatic force, air pressure film, and mechanical vibration feedback driving signals are generated.

[0037] The multi-tactile feedback interaction unit includes a multi-tactile generating source, which is driven by a multi-tactile feedback driving signal and acts on the touch screen.

[0038] The multiple tactile sources include electrostatic force, air pressure film, and mechanical vibration trigger sources, which are driven by electrostatic force, air pressure film, and mechanical vibration feedback drive signals and act on the touch screen, thereby generating corresponding tactile feedback for the operator.

[0039] The touch screen multi-tactile feedback system disclosed in the above embodiment is used to implement the touch screen multi-tactile feedback method disclosed in the above embodiment. The description is relatively simple. For specific related matters, please refer to the relevant description of the touch screen multi-tactile feedback method part. Its technical effects can also refer to the technical effects of the relevant part of the touch screen multi-tactile feedback method, which will not be repeated here.

[0040] In addition, technicians in the field should also be able to realize that the various units of the touch screen multi-tactile feedback system disclosed in the embodiments of the present application can be implemented by electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, this application generally describes them according to their functions. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Technicians in the field can choose to adopt different methods to implement the described functions for each specific application and its actual constraints, but such implementation should not be considered to be beyond the scope of this application.

[0041] So far, the technical solution of the present application has been described in conjunction with the preferred embodiments shown in the accompanying drawings. Those skilled in the art should understand that the scope of protection of the present application is obviously not limited to these specific embodiments. Without departing from the principles of the present application, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will fall within the scope of protection of the present application.

Claims

1. A touch screen multi-tactile feedback method, characterized in that: include: Step 1: construct a tactile perception model of multiple tactile driving signal parameters; Step 2: construct a tactile perception model of three-dimensional feature information of elements on the touch screen; Step 3: construct a multivariate tactile feedback driving signal parameter model of the three-dimensional feature information of the element based on the tactile perception model of the three-dimensional feature information of the element on the touch screen and the tactile perception model of the multivariate tactile driving signal parameters; Step 4: sense the touch position on the touch screen, and then obtain the three-dimensional feature information of the touch position element, obtain the multi-dimensional tactile feedback driving signal parameter model based on the element's three-dimensional feature information, generate the corresponding multi-dimensional tactile feedback driving signal, drive the multi-dimensional tactile source, and act on the touch screen.

2. The touch screen multi-tactile feedback method according to claim 1, characterized in that: Step 1 is as follows: Through subjective scoring, a tactile perception model of electrostatic force, air pressure film, and mechanical vibration driving signal parameters is constructed.

3. The touch screen multi-tactile feedback method according to claim 2, characterized in that: In step 2, a tactile perception model of three-dimensional feature information of elements on the touch screen is constructed, specifically including constructing a tactile perception model of gradient information about electrostatic force and air pressure film, and constructing a tactile perception model of depth information about mechanical vibration.

4. The touch screen multi-tactile feedback method according to claim 3, characterized in that: Step three specifically includes: Based on the tactile perception model of electrostatic force and air pressure film of the element gradient information on the touch screen, and the tactile perception model of the electrostatic force and air pressure film driving signal parameters, the electrostatic force and air pressure film feedback driving signal parameter model of the gradient information is constructed; Based on the tactile perception model of mechanical vibration of the element depth information on the touch screen and the tactile perception model of the mechanical vibration driving signal parameters, a mechanical vibration feedback driving signal parameter model of the depth information is constructed.

5. The touch screen multi-tactile feedback method according to claim 4, characterized in that: Step 4 is as follows: Sense the touch position on the touch screen, obtain the gradient information and depth information of the touch position element, obtain the electrostatic force and air pressure film feedback driving signal parameters based on the electrostatic force and air pressure film feedback driving signal parameter models based on the gradient information, and obtain the mechanical vibration feedback driving signal parameters based on the mechanical vibration feedback driving signal parameter model based on the depth information, generate corresponding electrostatic force, air pressure film, and mechanical vibration feedback driving signals, drive the electrostatic force, air pressure film, and mechanical vibration trigger sources, and act on the touch screen.

6. A touch screen multi-tactile feedback system, characterized in that: It includes a touch position sensing unit, a multi-tactile feedback driving signal parameter generating unit, a multi-tactile feedback driving control unit, and a multi-tactile feedback interaction unit; The touch position sensing unit is used to sense the touch position on the touch screen; The multivariate tactile feedback driving signal parameter generating unit acquires the three-dimensional feature information of the touch position element, and generates the multivariate tactile feedback driving signal parameter based on the multivariate tactile feedback driving signal parameter model of the element's three-dimensional feature information, specifically: acquiring the gradient information and depth information of the touch position element, and generating the electrostatic force and air film pressure feedback driving signal parameters based on the electrostatic force and air film pressure feedback driving signal parameter model of the gradient information, and generating the mechanical vibration feedback driving signal parameters based on the mechanical vibration feedback driving signal parameter model of the depth information; The multi-tactile feedback driving control unit generates a corresponding multi-tactile feedback driving signal according to the multi-tactile feedback driving signal parameters, specifically: generating a corresponding electrostatic force, air pressure film, and mechanical vibration feedback driving signal according to the electrostatic force, air pressure film, and mechanical vibration feedback driving signal parameters; The multi-tactile feedback interaction unit includes a multi-tactile source, which is driven by a multi-tactile feedback driving signal and acts on the touch screen, wherein the multi-tactile source includes an electrostatic force, an air pressure film, and a mechanical vibration trigger source, which is driven by an electrostatic force, an air pressure film, and a mechanical vibration feedback driving signal and acts on the touch screen.

Citation Information

Patent Citations

  • Method and apparatus for tactile reproduction incorporating electrostatic force, pneumatic film and mechanical vibration

    CN109101111A

  • Image rendering method applied to haptic representation device integrating electrostatic force and air pressure film

    CN111338471A

  • Texture surface identification method based on multi-dimensional friction tactile signals

    CN118626924A

Cited By

  • Touch screen tactile feedback control method and system and touch screen

    CN121560185A