Tactile feedback method and device based on image texture, equipment and storage medium

Abstract

The invention provides a tactile feedback method and device based on image texture, equipment and a storage medium. The specific implementation scheme is as follows: obtaining object feature information of an image object according to texture feature parameters of the image texture in a target display image; acquiring a global relative vibration parameter corresponding to the target display image according to the object feature information; when a touch operation event relative to the image object is detected, acquiring a local relative vibration parameter corresponding to a touch operation occurrence position according to the global relative vibration parameter; and mapping actual vibration parameters of the tactile feedback actuator based on the local relative vibration parameters, and generating a vibration control signal corresponding to the touch operation occurrence position according to the actual vibration parameters so as to control the tactile feedback actuator to execute corresponding vibration operation. A tactile feedback mechanism is provided for the touch operation applied to the image object in the equipment display image, the application range of tactile feedback is expanded, and the interestingness of tactile feedback application is improved.

Description

[Technical field]

[0001] The present application relates to the field of electronic technology and can be applied to tactile feedback scenarios of electronic devices. Specifically, the present application relates to a tactile feedback method, device, equipment and storage medium based on image texture. [Background technology]

[0002] With the continuous development of science and technology, the functions of electronic devices are becoming more and more diversified. Electronic devices can provide users with a variety of human-computer interaction functions. Tactile feedback, as a typical human-computer interaction function, can significantly enhance the user's control experience of electronic devices.

[0003] At present, the tactile feedback technologies provided by related technologies for electronic devices are limited to the following types: providing vibration feedback in response to the user's virtual key operation, and providing vibration feedback in response to specific game operation events during the game. That is, the diversity and interest of the tactile feedback technologies provided in related technologies are still relatively limited.

[0004] It is worth noting that the related technologies described in this section are not necessarily technologies that have been previously conceived or adopted. Unless otherwise specified, it should not be assumed that any related technologies described in this section are considered to be prior art simply because they are included in this section. Similarly, unless otherwise specified, the issues mentioned in this section should not be considered to have been recognized in any prior art. [Summary of the invention]

[0005] The present application provides a tactile feedback method, apparatus, device and storage medium based on image texture, aiming to solve one of the problems in the related art at least to a certain extent.

[0006] In order to solve the above technical problems, the first aspect of the present application provides a tactile feedback method based on image texture, comprising:

[0007] Obtaining object feature information of an image object according to texture feature parameters of an image texture in a target display image;

[0008] Acquiring a global relative vibration parameter corresponding to the image object according to the object feature information;

[0009] When a touch operation event relative to the image object is detected, obtaining a local relative vibration parameter corresponding to a location where the touch operation occurs according to the global relative vibration parameter;

[0010] Mapping actual vibration parameters of the tactile feedback actuator based on the local relative vibration parameters, and generating a vibration control signal corresponding to the location where the touch operation occurs according to the actual vibration parameters;

[0011] The vibration control signal is sent to the tactile feedback actuator to control the tactile feedback actuator to perform a corresponding vibration operation for the location where the touch operation occurs.

[0012] A second aspect of the present application provides a tactile feedback device based on image texture, comprising:

[0013] An information acquisition module, used for acquiring object feature information of an image object according to texture feature parameters of an image texture in a target display image;

[0014] A first parameter acquisition module, used for acquiring a global relative vibration parameter corresponding to the image object according to the object feature information;

[0015] A second parameter acquisition module is used to acquire a local relative vibration parameter corresponding to a location where the touch operation occurs according to the global relative vibration parameter when a touch operation event relative to the image object is detected;

[0016] A signal generating module, configured to map an actual vibration parameter of a tactile feedback actuator based on the local relative vibration parameter, and generate a vibration control signal corresponding to a location where the touch operation occurs according to the actual vibration parameter;

[0017] The vibration control module is used to send the vibration control signal to the tactile feedback actuator to control the tactile feedback actuator to perform a corresponding vibration operation according to the location where the touch operation occurs.

[0018] The third aspect of the present application provides an electronic device, comprising: a memory and a processor, wherein the processor is used to execute a computer program stored in the memory; when the processor executes the computer program, the steps of the image texture-based tactile feedback method provided in the first aspect of the present application are implemented.

[0019] The fourth aspect of the present application provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps of the image texture-based tactile feedback method provided in the first aspect of the present application are implemented.

[0020] As can be seen from the above, according to the tactile feedback method, device, equipment and storage medium based on image texture provided by the present application, the object feature information of the image object is obtained according to the texture feature parameters of the image texture in the target display image; the global relative vibration parameters corresponding to the image object are obtained according to the object feature information; when a touch operation event relative to the image object is detected, the local relative vibration parameters corresponding to the position where the touch operation occurs are obtained according to the global relative vibration parameters; the actual vibration parameters of the tactile feedback actuator are mapped based on the local relative vibration parameters, and a vibration control signal corresponding to the position where the touch operation occurs is generated according to the actual vibration parameters; the vibration control signal is sent to the tactile feedback actuator to control the tactile feedback actuator to perform a corresponding vibration operation for the position where the touch operation occurs. Through the implementation of the present application, a tactile feedback mechanism is provided for the touch operation applied to the image object in the image displayed by the electronic device, which can restore the authenticity of the touch behavior of the image object, expand the application scope of tactile feedback, and improve the interest of tactile feedback application.

[0021] It should be understood that the content described in this section is not intended to identify the key or important features of the present application, nor is it intended to limit the scope of the present application. Other features of the present application will become easily understood through the following description.

Brief Description of the Drawings

[0022] The accompanying drawings exemplarily illustrate the embodiments and constitute a part of the specification, and together with the text description of the specification, are used to explain the exemplary implementation of the embodiments. The drawings shown are for illustrative purposes only and do not limit the scope of the claims. In all drawings, the same reference numerals refer to similar but not necessarily identical elements.

[0023] Figure 1 A schematic diagram of a basic flow chart of a tactile feedback method based on image texture provided in an embodiment of the present application;

[0024] Figure 2 A schematic diagram of relative vibration intensity at a pixel level provided in an embodiment of the present application;

[0025] Figure 3 A schematic diagram of relative vibration frequency at a pixel level provided in an embodiment of the present application;

[0026] Figure 4 A schematic diagram of a touch operation event provided by an embodiment of the present application;

[0027] Figure 5 A schematic diagram of a vibration envelope of a tactile feedback actuator provided in one embodiment of the present application;

[0028] Figure 6A schematic diagram of a detailed process of a tactile feedback method based on image texture provided in an embodiment of the present application;

[0029] Figure 7 A schematic diagram of functional modules of a tactile feedback device based on image texture provided in one embodiment of the present application;

[0030] Figure 8 A schematic diagram of the hardware structure of an electronic device provided in one embodiment of the present application. [Specific implementation method]

[0031] In order to make the purpose, features, and advantages of the invention of this application more obvious and easy to understand, the technical solutions in the embodiments of this application will be clearly and completely described below in conjunction with the drawings in the embodiments of this application. Obviously, the described embodiments are only part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of this application.

[0032] In the description of the embodiments of the present application, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features; the term "multiple" means two or more, unless otherwise clearly and specifically defined; the term "including" indicates the presence of the described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or their collections; the term "and / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B may include the existence of A alone, the existence of A and B at the same time, and the existence of B alone. The character " / " generally indicates that the previously associated objects belong to the "or" relationship.

[0033] In order to solve the problem that the diversity and interest of the tactile feedback technology provided in the relevant technology are still relatively limited, an embodiment of the present application provides a tactile feedback method based on image texture, which can be applied to electronic devices (such as mobile phones, tablet computers, etc.) equipped with tactile feedback actuators, and can also be applied to human-computer interaction systems including a first electronic device (such as mobile phones, tablet computers, etc.) and a second electronic device (such as VR devices equipped with tactile feedback actuators, finger-worn tactile feedback devices, etc.).

[0034] like Figure 1 The basic flow chart of the tactile feedback method based on image texture provided in this embodiment includes the following steps:

[0035] Step 101: Obtain object feature information of an image object according to texture feature parameters of an image texture in a target display image.

[0036] In practical applications, electronic devices can display images or videos (i.e., including multiple frames of images), and images include imaging information of objects. The object feature information of this embodiment includes the roughness and / or hardness of the image object. Image texture refers to the visual texture effect presented in the image, and generally includes the texture of the surface of the object. It should be noted that this embodiment can first pre-process the original input image or video to optimize the quality of the image or video and reduce the amount of data, and then obtain the target display image.

[0037] In an optional implementation of this embodiment, if the object feature information is roughness, the target display image is first converted into a grayscale image; then the first texture feature parameters of the grayscale image are extracted based on the grayscale co-occurrence matrix; finally, the roughness of the image object is calculated based on the functional relationship between the preset first texture feature parameters and the roughness.

[0038] This embodiment converts the target display image into a grayscale image, and uses rotation, homomorphic filtering or other image processing methods to eliminate the influence of environmental factors (such as angle, lighting, etc.), and the first texture feature parameter includes at least one of the following: texture entropy, texture moment of inertia, texture contrast, texture correlation, texture uniformity. In addition, the functional relationship between the above-mentioned first texture feature parameter and roughness can be understood as a mapping relationship between different first texture feature parameters and roughness.

[0039] In an optional implementation manner of the present embodiment, if the object feature information is hardness, first obtain N frames of displayed images that are before the target display image in the currently displayed video; then, based on the target display image and the N frames of displayed images, count the second texture feature information of the image texture in the target display image; finally, calculate the hardness of the image object based on the functional relationship between the preset second texture feature parameters and the hardness.

[0040] It is worth mentioning that the value of N is a positive integer greater than 0, and the second texture feature information includes deformation information.

[0041] In an optional implementation manner of this embodiment, the tactile feedback method also includes: querying whether there is a hardness corresponding to the image object in a preset object prior information library; if the query has no result, executing the step of obtaining N frames of displayed images before the target displayed image in the currently displayed video.

[0042] In practical applications, the hardness prior information of a known object can be obtained in advance, and then an object prior information library can be established based on the correspondence between the object and its hardness prior information. In the tactile feedback application scenario of this embodiment, the object prior information library can be queried based on the image object. If the image object is a known object in the object prior information library, the hardness queried in the object prior information library can be used as the hardness of the image object, thereby efficiently obtaining the hardness of the image object. On the contrary, if the image object is an object not covered by the object prior information library, it is necessary to estimate the hardness of the image object by counting the object deformation of the image displayed in the current frame in accordance with the aforementioned recording method.

[0043] Step 102: Acquire global relative vibration parameters corresponding to the image object according to the object feature information.

[0044] When a user interacts with an image displayed on a device, if a touch operation is performed on an image object, the touch area is only a local area on the image object. In order to achieve tactile feedback in the local area of ​​the image object, this embodiment pre-analyzes relative vibration parameters of the image object at the pixel level.

[0045] In an optional implementation manner of this embodiment, the specific implementation manner of acquiring the global relative vibration parameters corresponding to the image object according to the object feature information includes but is not limited to the following two aspects:

[0046] On the one hand, the global relative vibration intensity corresponding to the image object is obtained according to the roughness of the image object; on the other hand, the global relative vibration frequency corresponding to the image object is obtained according to the hardness of the image object.

[0047] That is, in this embodiment, the corresponding relative vibration intensity can be mapped based on the roughness feature of the image object, and the corresponding relative vibration frequency can be mapped based on the hardness of the image object. It should be noted that this embodiment is pre-configured with a mapping function of roughness and relative vibration intensity. For the image object, the mapping function can be called to obtain the corresponding relative vibration intensity based on the roughness of each pixel, and then the global relative vibration intensity of the image object can be obtained based on the relative vibration intensity of all pixels, such as Figure 2 FIG. 1 is a schematic diagram of a relative vibration intensity at a pixel level provided in this embodiment, showing a mapping relationship between the roughness of an image object and the relative vibration intensity. Figure 2 The horizontal and vertical axes of the coordinate system diagram on the left represent the x-axis and y-axis of the pixel points respectively, and the bar diagram on the right is a relative vibration intensity mapping diagram based on color representation. Figure 2The color of each pixel in can be mapped to the corresponding relative vibration intensity in the bar graph on the right. It is worth mentioning that the above mapping function can be expressed as I=f1(R), and I∈[0,1], where f1() represents the mapping function from roughness R to relative vibration intensity I.

[0048] In addition, the present embodiment also pre-configures a mapping function between hardness and relative vibration frequency. Similarly, for an image object, the corresponding relative vibration frequency can be obtained pixel by pixel based on the hardness, and then the global relative vibration frequency of the image object can be obtained based on the relative vibration frequencies of all pixels, such as Figure 3 FIG. 1 is a schematic diagram of a relative vibration frequency at a pixel level provided in this embodiment, showing a mapping relationship between the hardness of an image object and the relative vibration frequency. Figure 3 The horizontal and vertical axes of the coordinate system diagram on the left represent the x-axis and y-axis of the pixel points respectively, and the bar diagram on the right is a relative vibration frequency mapping diagram based on color representation. Figure 3 The color of each pixel in the image can be mapped to the corresponding relative vibration frequency in the bar graph on the right. It is worth mentioning that the above mapping function can be expressed as F=f2(H), and F∈[0,100], where f2() represents the mapping function from hardness H to relative vibration frequency F.

[0049] Step 103: when a touch operation event relative to the image object is detected, a local relative vibration parameter corresponding to the location where the touch operation occurs is obtained according to the global relative vibration parameter.

[0050] In actual applications, electronic devices display images through touch screens. When a user performs a touch operation on an image object on the touch screen, if the touch screen is a capacitive screen, the electronic device can identify the touch operation event based on the detected capacitance value. The identified touch operation event includes but is not limited to the touch operation location, touch operation pressure, and touch operation speed. It is worth mentioning that the touch operation speed known in this embodiment is usually for sliding touch operations. When a user applies a sliding touch operation to an image, the finger has a moving path on the image, such as Figure 4 The figure shows a schematic diagram of a touch operation event provided by the present embodiment, which shows the movement path of the finger in the image. It should also be noted that, since the user touches a local area of ​​an image object when performing a touch operation, and different areas of the object have different physical properties, the human body will have different tactile perceptions when touching different areas of the object, so the present embodiment needs to obtain the corresponding local relative vibration parameters according to the location where the touch operation occurs.

[0051] Step 104 : Mapping actual vibration parameters of the tactile feedback actuator based on the local relative vibration parameters, and generating a vibration control signal corresponding to the location where the touch operation occurs according to the actual vibration parameters.

[0052] The tactile feedback actuator of this embodiment can be understood as an actuator, which can be a linear motor. After acquiring the local relative vibration parameters based on the image object, this embodiment further maps the local relative vibration parameters to the parameters at the tactile feedback actuator level, that is, the actual vibration parameters, and then generates a vibration control signal executable by the tactile feedback actuator based on the actual vibration parameters. It is worth mentioning that in actual applications, this embodiment can construct the above-mentioned vibration control signal based on a preset mathematical function (such as a polynomial function such as a sine wave, a square wave, a triangle wave, etc.).

[0053] In an optional implementation manner of the present embodiment, the types of the above-mentioned relative vibration parameters include relative vibration intensity and relative vibration frequency. Accordingly, the above-mentioned mapping of the actual vibration parameters of the tactile feedback actuator based on the local relative vibration parameters includes: weighting the local relative vibration intensity based on the touch operation pressure, and weighting the local relative vibration frequency based on the touch operation speed; mapping the weighted local relative vibration intensity to the actual vibration intensity of the tactile feedback actuator, and mapping the weighted local relative vibration frequency to the actual vibration frequency of the tactile feedback actuator.

[0054] In this embodiment, corresponding weighted functions are constructed for relative vibration intensity and relative vibration frequency respectively. In the basic implementation, the two weighted functions are both directly proportional functions, that is, the greater the touch operation pressure, the greater the relative vibration intensity, and the faster the touch operation speed, the greater the relative vibration frequency. Therefore, based on the weighted local relative vibration parameters, the user's perception of vibration feedback can be enhanced.

[0055] In an optional implementation manner of the present embodiment, the mapping of the weighted local relative vibration intensity to the actual vibration intensity of the tactile feedback actuator, and the mapping of the weighted local relative vibration frequency to the actual vibration frequency of the tactile feedback actuator, include: acquiring a rated voltage and a rated frequency response range of the tactile feedback actuator; mapping the weighted local relative vibration intensity to the actual vibration intensity of the tactile feedback actuator based on the rated voltage, and mapping the weighted local relative vibration frequency to the actual vibration frequency of the tactile feedback actuator based on the rated frequency response range.

[0056] In practical applications, the maximum intensity of the tactile feedback actuator shall not exceed its rated voltage, and the actual frequency shall be within its rated frequency response range. Based on this, the present embodiment may determine the corresponding rated indicators (i.e., rated voltage and rated frequency response range) according to the type of the tactile feedback actuator, and then when mapping the local relative vibration parameters, the rated indicators of the tactile feedback actuator are combined to map the local relative vibration parameters to the actual vibration parameters of the tactile feedback actuator (i.e., actual vibration intensity and actual vibration frequency).

[0057] Step 105: Send the vibration control signal to the tactile feedback actuator to control the tactile feedback actuator to perform a corresponding vibration operation according to the position where the touch operation occurs.

[0058] like Figure 5 The figure shows a vibration envelope diagram of a tactile feedback actuator provided by the present embodiment. The corresponding touch operation event is a finger uniform movement event within 3 seconds. After the present embodiment generates a corresponding vibration control signal for the position where the touch operation occurs, the tactile feedback actuator can be controlled to output a vibration signal corresponding to the texture of the image object at the position where the touch operation occurs, so as to simulate the tactile feeling of the user touching the real object, so as to help the user understand the object and improve the interest of human-computer interaction.

[0059] In order to better illustrate the embodiment of the present application, an embodiment of the present application also provides a refined tactile feedback method based on image texture, such as Figure 6 FIG. 1 is a schematic diagram of a detailed process of a tactile feedback method based on image texture provided in an embodiment of the present application. The tactile feedback method based on image texture specifically includes the following process:

[0060] Step 601, obtaining the roughness and hardness of the image object according to the image texture feature parameters of the target display image;

[0061] Step 602: acquiring a global relative vibration intensity corresponding to the image object according to the roughness of the image object, and acquiring a global relative vibration frequency corresponding to the image object according to the hardness of the image object;

[0062] Step 603: when a touch operation event relative to the image object is detected, the local relative vibration intensity and the local relative vibration frequency corresponding to the location where the touch operation occurs are obtained according to the global relative vibration intensity and the global relative vibration frequency respectively;

[0063] Step 604: weighting the local relative vibration intensity based on the touch operation pressure, and weighting the local relative vibration frequency based on the touch operation speed;

[0064] Step 605: obtaining the rated voltage and rated frequency response range of the tactile feedback actuator;

[0065] Step 606: Mapping the weighted local relative vibration intensity to the actual vibration intensity of the tactile feedback actuator based on the rated voltage, and mapping the weighted local relative vibration frequency to the actual vibration frequency of the tactile feedback actuator based on the rated frequency response range;

[0066] Step 607: Generate a vibration control signal corresponding to the location where the touch operation occurs based on the actual vibration intensity and the actual vibration frequency;

[0067] Step 608: Send the vibration control signal to the tactile feedback actuator to control the tactile feedback actuator to perform a corresponding vibration operation according to the location where the touch operation occurs.

[0068] It should be understood that the size of the serial number of each step in this embodiment does not mean the order of execution of the steps. The execution order of each step should be determined by its function and internal logic, and should not constitute a sole limitation on the implementation process of the embodiment of this application.

[0069] Figure 7 A tactile feedback device based on image texture is provided in one embodiment of the present application. The tactile feedback device based on image texture can be used to implement the tactile feedback method based on image texture in the above-mentioned embodiment, and mainly includes:

[0070] The information acquisition module 701 is used to acquire object feature information of the image object according to the texture feature parameters of the image texture in the target display image;

[0071] A first parameter acquisition module 702 is used to acquire a global relative vibration parameter corresponding to the image object according to the object feature information;

[0072] A second parameter acquisition module 703 is used to acquire a local relative vibration parameter corresponding to a location where the touch operation occurs according to the global relative vibration parameter when a touch operation event relative to the image object is detected;

[0073] A signal generating module 704, configured to map the actual vibration parameters of the tactile feedback actuator based on the local relative vibration parameters, and to generate a vibration control signal corresponding to the location where the touch operation occurs according to the actual vibration parameters;

[0074] The vibration control module 705 is used to send a vibration control signal to the tactile feedback actuator to control the tactile feedback actuator to perform a corresponding vibration operation according to the location where the touch operation occurs.

[0075] It should be noted that the image texture-based tactile feedback methods in the aforementioned method embodiments can all be implemented based on the image texture-based tactile feedback device provided in this embodiment. Ordinary technicians in the relevant field can clearly understand that for the convenience and conciseness of description, the specific working process of the image texture-based tactile feedback device described in this embodiment can be implemented by referring to the corresponding working process in the aforementioned method embodiments, and will not be repeated here.

[0076] Based on the technical solution of the embodiment of the present application, the object feature information of the image object is obtained according to the texture feature parameters of the image texture in the target display image; the global relative vibration parameters corresponding to the image object are obtained according to the object feature information; when a touch operation event relative to the image object is detected, the local relative vibration parameters corresponding to the position where the touch operation occurs are obtained according to the global relative vibration parameters; the actual vibration parameters of the tactile feedback actuator are mapped based on the local relative vibration parameters, and a vibration control signal corresponding to the position where the touch operation occurs is generated according to the actual vibration parameters; the vibration control signal is sent to the tactile feedback actuator to control the tactile feedback actuator to perform a corresponding vibration operation for the position where the touch operation occurs. Through the implementation of the present application, a tactile feedback mechanism is provided for the touch operation applied to the image object in the image displayed by the electronic device, which can restore the authenticity of the touch behavior of the image object, expand the application scope of tactile feedback, and improve the interest of tactile feedback application.

[0077] See also Figure 8 , Figure 8 An electronic device is provided in one embodiment of the present application. The electronic device can be used to implement the tactile feedback method based on image texture in the above-mentioned embodiment. Figure 8 As shown, the electronic device mainly includes:

[0078] Memory 801, processor 802 and bus 803, memory 801 and processor 802 are connected via bus 803. Memory 801 stores a computer program that can be run on processor 802, and when processor 802 executes the computer program, the tactile feedback method based on image texture in the above embodiment is implemented. The number of processors can be one or more.

[0079] The memory 801 may be a high-speed random access memory (RAM) memory, or a non-volatile memory, such as a disk memory. The memory 801 is used to store executable program codes, and the processor 802 is coupled to the memory 801 .

[0080] Furthermore, the present application also provides a computer-readable storage medium, which may be provided in the electronic device in the above embodiments. Figure 8 Memory in the illustrated embodiment.

[0081] The computer readable storage medium stores a computer program, and when the program is executed by the processor, the tactile feedback method based on image texture in the aforementioned embodiment is implemented. Furthermore, the computer storable medium can also be a U disk, a mobile hard disk, a read-only memory (ROM), a RAM, a magnetic disk or an optical disk, and other media that can store program codes.

[0082] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules is only a logical function division, and there may be other division methods in actual implementation, such as multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or modules, which can be electrical, mechanical or other forms.

[0083] The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical modules, that is, they may be located in one place or distributed on multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0084] In addition, each functional module in each embodiment of the present application can be integrated into a processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The above integrated modules can be implemented in the form of hardware or software functional modules.

[0085] If the integrated module is implemented in the form of a software function module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, which is stored in a readable storage medium, including several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the various embodiments of the present application. The aforementioned readable storage medium includes: various media that can store program codes, such as USB flash drives, mobile hard drives, ROM, RAM, magnetic disks, or optical disks.

[0086] It should be noted that, for the above-mentioned method embodiments, for the sake of simplicity of description, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described action sequence, because according to the present application, certain steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

[0087] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0088] The above is a description of the image texture-based tactile feedback method, device, equipment and storage medium provided in the present application. For technicians in this field, according to the ideas of the embodiments of the present application, there may be changes in the specific implementation methods and application scopes. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A tactile feedback method based on image texture, characterized in that: include: Obtaining object feature information of an image object according to texture feature parameters of an image texture in a target display image; Acquiring a global relative vibration parameter corresponding to the image object according to the object feature information; When a touch operation event relative to the image object is detected, obtaining a local relative vibration parameter corresponding to a location where the touch operation occurs according to the global relative vibration parameter; Mapping actual vibration parameters of the tactile feedback actuator based on the local relative vibration parameters, and generating a vibration control signal corresponding to the location where the touch operation occurs according to the actual vibration parameters; The vibration control signal is sent to the tactile feedback actuator to control the tactile feedback actuator to perform a corresponding vibration operation for the location where the touch operation occurs.

2. The tactile feedback method according to claim 1, characterized in that: The acquiring of the global relative vibration parameter corresponding to the image object according to the object feature information comprises: A global relative vibration intensity corresponding to the image object is obtained according to the roughness of the image object, and / or a global relative vibration frequency corresponding to the image object is obtained according to the hardness of the image object.

3. The tactile feedback method according to claim 2, characterized in that: The object feature information is the roughness, and the step of acquiring the object feature information of the image object according to the texture feature parameter of the image texture in the target display image includes: Converting the target display image into a grayscale image; Extracting a first texture feature parameter of the grayscale image based on a gray level co-occurrence matrix; wherein the first texture feature parameter includes at least one of the following: texture entropy, texture moment of inertia, texture contrast, texture correlation, and texture uniformity; The roughness of the image object is calculated based on a preset functional relationship between the first texture feature parameter and the roughness.

4. The tactile feedback method according to claim 2, characterized in that: The object feature information is the hardness, and the step of acquiring the object feature information of the image object according to the texture feature parameter of the image texture in the target display image includes: Obtain N frames of displayed images before the target displayed image in the currently displayed video; wherein the value of N is a positive integer greater than 0; According to the target display image and the N frames of displayed images, second texture feature information of the image texture in the target display image is counted; wherein the second texture feature information includes deformation information; The hardness of the image object is calculated based on a preset functional relationship between the second texture feature parameter and the hardness.

5. The tactile feedback method according to claim 4, characterized in that: The method further comprises: Querying a preset object prior information database to determine whether there is a hardness corresponding to the object in the image; If the query yields no result, the step of obtaining N frames of displayed images before the target displayed image in the currently displayed video is performed.

6. The tactile feedback method according to claim 1, characterized in that: The types of the relative vibration parameters include relative vibration intensity and relative vibration frequency, and the mapping of the actual vibration parameters of the tactile feedback actuator based on the local relative vibration parameters includes: weighting the local relative vibration intensity based on the touch operation pressure, and weighting the local relative vibration frequency based on the touch operation speed; The weighted local relative vibration intensity is mapped to the actual vibration intensity of the haptic feedback actuator, and the weighted local relative vibration frequency is mapped to the actual vibration frequency of the haptic feedback actuator.

7. The tactile feedback method according to claim 6, characterized in that: The step of mapping the weighted local relative vibration intensity to the actual vibration intensity of the tactile feedback actuator, and mapping the weighted local relative vibration frequency to the actual vibration frequency of the tactile feedback actuator, comprises: Get the rated voltage and rated frequency response range of the tactile feedback actuator; The weighted local relative vibration intensity is mapped to the actual vibration intensity of the haptic feedback actuator based on the rated voltage, and the weighted local relative vibration frequency is mapped to the actual vibration frequency of the haptic feedback actuator based on the rated frequency response range.

8. A tactile feedback device based on image texture, characterized in that: include: An information acquisition module, used for acquiring object feature information of an image object according to texture feature parameters of an image texture in a target display image; A first parameter acquisition module, used for acquiring a global relative vibration parameter corresponding to the image object according to the object feature information; A second parameter acquisition module is used to acquire a local relative vibration parameter corresponding to a location where the touch operation occurs according to the global relative vibration parameter when a touch operation event relative to the image object is detected; A signal generating module, configured to map an actual vibration parameter of a tactile feedback actuator based on the local relative vibration parameter, and generate a vibration control signal corresponding to a location where the touch operation occurs according to the actual vibration parameter; The vibration control module is used to send the vibration control signal to the tactile feedback actuator to control the tactile feedback actuator to perform a corresponding vibration operation for the location where the touch operation occurs.

9. An electronic device, characterized in that: include: Memory and processor; The processor is used to execute the computer program stored in the memory; When the processor executes the computer program, the steps in the image texture-based tactile feedback method according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps in the image texture-based tactile feedback method according to any one of claims 1 to 7 are implemented.

Images