Image texture-based haptic feedback method and apparatus, device, and storage medium

Abstract

The present application provides an image texture-based haptic feedback method and apparatus, a device, and a storage medium. The specific implementation solution comprises: acquiring object feature information of an image object on the basis of a texture feature parameter of an image texture in a target display image; on the basis of the object feature information, acquiring a global relative vibration parameter corresponding to the target display image; upon detecting a touch operation event relative to the image object, on the basis of the global relative vibration parameter, acquiring a local relative vibration parameter corresponding to the position where a touch operation occurs; and mapping an actual vibration parameter of a haptic feedback actuator on the basis of the local relative vibration parameter, and on the basis of the actual vibration parameter, generating a vibration control signal corresponding to the position where the touch operation occurs, so as to control the haptic feedback actuator to perform a corresponding vibration operation. The present application provides a haptic feedback mechanism for a touch operation applied to an image object in an image displayed by a device, expands the application scope of haptic feedback, and enhances the interestingness of haptic feedback applications.

Description

Image texture-based tactile feedback methods, devices, equipment, and storage media Technical Field

[0001] This application relates to the field of electronic technology and can be applied to tactile feedback scenarios in electronic devices. Specifically, this application relates to a tactile feedback method, apparatus, device, and storage medium based on image texture. Background Technology

[0002] With the continuous development of technology, electronic devices are becoming more and more diverse in function. Electronic devices can provide users with a variety of human-computer interaction functions. Haptic feedback, as a typical human-computer interaction function, can significantly improve the user's control experience of electronic devices.

[0003] Currently, the haptic feedback technologies provided for electronic devices are limited to the following: providing vibration feedback in response to the user's virtual button operations, and providing vibration feedback in response to specific game operation events during game operation. In other words, the diversity and fun of the haptic feedback technologies provided in these technologies are still relatively limited.

[0004] It is important to note that the related technologies described in this section are not necessarily technologies that had been previously conceived or adopted. Unless otherwise specified, no related technology described in this section should be assumed to be prior art simply because it is included in this section. Similarly, unless otherwise specified, the issues mentioned in this section should not be considered to be recognized in any prior art. Technical issues

[0005] This application provides a tactile feedback method, apparatus, device, and storage medium based on image texture, aiming to at least partially solve one of the problems in related technologies. Technical solutions

[0006] To address the aforementioned technical problems, the first aspect of this application provides a haptic feedback method based on image texture, comprising:

[0007] Obtain object feature information of the image object based on the texture feature parameters of the image texture in the target displayed image;

[0008] The global relative vibration parameters corresponding to the object in the image are obtained based on the object feature information;

[0009] When a touch operation event relative to the image object is detected, local relative vibration parameters corresponding to the location where the touch operation occurs are obtained based on the global relative vibration parameters;

[0010] The actual vibration parameters of the haptic feedback actuator are mapped based on the local relative vibration parameters, and a vibration control signal corresponding to the location where the touch operation occurs is generated according to the actual vibration parameters.

[0011] The vibration control signal is sent to the tactile feedback actuator to control the tactile feedback actuator to perform a corresponding vibration operation at the location where the touch operation occurs.

[0012] A second aspect of this application provides a haptic feedback device based on image texture, comprising:

[0013] The information acquisition module is used to obtain the object feature information of the image object based on the texture feature parameters of the image texture in the target display image;

[0014] The first parameter acquisition module is used to acquire global relative vibration parameters corresponding to the image object based on the object feature information;

[0015] The second parameter acquisition module is used to acquire local relative vibration parameters corresponding to the location where the touch operation occurs based on the global relative vibration parameters when a touch operation event relative to the image object is detected.

[0016] The signal generation module is used to map the actual vibration parameters of the haptic feedback actuator based on the local relative vibration parameters, and generate a vibration control signal corresponding to the location where the touch operation occurs based on the actual vibration parameters.

[0017] The vibration control module is used to send the vibration control signal to the tactile feedback actuator to control the tactile feedback actuator to perform a corresponding vibration operation at the location where the touch operation occurs.

[0018] A third aspect of this application provides an electronic device, including a memory and a processor, wherein the processor is configured to execute a computer program stored in the memory; when the processor executes the computer program, it implements the steps of the image texture-based haptic feedback method provided in the first aspect of this application.

[0019] The fourth aspect of this application provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the image texture-based haptic feedback method provided in the first aspect of this application. Beneficial effects

[0020] As can be seen from the above, according to the image texture-based haptic feedback method, apparatus, device, and storage medium provided in this application, object feature information of an image object is obtained based on the texture feature parameters of the image texture in the target displayed image; global relative vibration parameters corresponding to the image object are obtained based on the object feature information; when a touch operation event relative to the image object is detected, local relative vibration parameters corresponding to the touch operation location are obtained based on the global relative vibration parameters; the actual vibration parameters of the haptic feedback actuator are mapped based on the local relative vibration parameters, and a vibration control signal corresponding to the touch operation location is generated based on the actual vibration parameters; the vibration control signal is sent to the haptic feedback actuator to control the haptic feedback actuator to perform a corresponding vibration operation at the touch operation location. Through the implementation of this application, a haptic feedback mechanism is provided for touch operations applied to image objects in an image displayed on an electronic device, which can restore the realism of the touch behavior of the image object, expand the application scope of haptic feedback, and improve the fun of haptic feedback applications.

[0021] It should be understood that the description in this section is not intended to identify key or important features of this application, nor is it intended to limit the scope of this application. Other features of this application will become readily apparent from the following description. Attached Figure Description

[0022] The accompanying drawings exemplify embodiments and form part of the specification, working together with the textual description to explain exemplary implementations of the embodiments. The drawings shown are for illustrative purposes only and do not limit the scope of the claims. Throughout the drawings, the same reference numerals refer to similar but not necessarily identical elements.

[0023] Figure 1 is a schematic diagram of the basic process of a tactile feedback method based on image texture provided in an embodiment of this application;

[0024] Figure 2 is a schematic diagram of relative vibration intensity at the pixel level provided in an embodiment of this application;

[0025] Figure 3 is a schematic diagram of a pixel-level relative vibration frequency provided in an embodiment of this application;

[0026] Figure 4 is a schematic diagram of a touch operation event provided in an embodiment of this application;

[0027] Figure 5 is a schematic diagram of the vibration envelope of a haptic feedback actuator according to an embodiment of this application;

[0028] Figure 6 is a detailed flowchart of a haptic feedback method based on image texture provided in an embodiment of this application;

[0029] Figure 7 is a schematic diagram of the functional modules of a haptic feedback device based on image texture provided in an embodiment of this application;

[0030] Figure 8 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application. Embodiments of the present invention

[0031] To make the inventive objectives, features, and advantages of this application more apparent and understandable, the technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0032] In the description of the embodiments of this application, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. The term "multiple" means two or more, unless otherwise explicitly specified. The term "comprising" indicates the presence of the described feature, whole, step, operation, element, and / or component, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components, and / or sets thereof. The term "and / or" describes the relationship between related objects, indicating that three relationships may exist. For example, A and / or B may include three cases: A existing alone, A and B existing simultaneously, and B existing alone. The character " / " generally indicates that the preceding and following related objects belong to an "or" relationship.

[0033] To address the limitation in the diversity and appeal of haptic feedback technologies in related fields, one embodiment of this application provides a haptic feedback method based on image texture. This method can be applied to electronic devices (such as mobile phones, tablets, etc.) equipped with haptic feedback actuators, as well as to human-computer interaction systems that include a first electronic device (such as a mobile phone, tablet, etc.) and a second electronic device (such as a VR device or a finger-worn haptic feedback device equipped with haptic feedback actuators).

[0034] Figure 1 is a basic flowchart of the image texture-based haptic feedback method provided in this embodiment. The image texture-based haptic feedback method includes the following steps:

[0035] Step 101: Obtain the object feature information of the image object based on the texture feature parameters of the image texture in the target display image.

[0036] In practical applications, electronic devices can display images or videos (i.e., multiple frames of images). Images include imaging information of objects. In this embodiment, the object feature information includes the roughness and / or hardness of the image object. Image texture refers to the visual texture effect presented in the image, which generally includes the texture of the object's surface. It should be noted that in this embodiment, the original input image or video can be preprocessed to optimize the image or video quality and reduce the data volume before obtaining the target display image.

[0037] In an optional implementation of this embodiment, if the object feature information is roughness, the target display image is first converted into a grayscale image; then, the first texture feature parameter of the grayscale image is extracted based on the grayscale co-occurrence matrix; finally, the roughness of the image object is calculated based on the preset functional relationship between the first texture feature parameter and roughness.

[0038] In this embodiment, the target display image is converted into a grayscale image, and rotation, homomorphic filtering or other image processing methods are used to eliminate the influence of environmental factors (such as angle, illumination, etc.). The first texture feature parameters include at least one of the following: texture entropy, texture inertia moment, texture contrast, texture correlation, texture uniformity. In addition, the functional relationship between the above first texture feature parameters and roughness can be understood as the mapping relationship between different first texture feature parameters and roughness.

[0039] In an optional implementation of this embodiment, if the object feature information is hardness, then first obtain the N frames of already displayed images in the currently displayed video that are before the target displayed image; then, based on the target displayed image and the N frames of already displayed images, statistically analyze the second texture feature information of the image texture in the target displayed image; finally, calculate the hardness of the image object based on the preset functional relationship between the second texture feature parameters and hardness.

[0040] It is worth mentioning that N is a positive integer greater than 0, and the second texture feature information includes deformation information.

[0041] In an optional embodiment of this example, the tactile feedback method further includes: querying a preset object prior information database to see if there is a hardness corresponding to the image object; if no result is found, then performing the step of obtaining N frames of already displayed images in the currently displayed video that precede the target displayed image.

[0042] In practical applications, prior information about the hardness of a known object can be obtained in advance. Then, an object prior information database can be established based on the correspondence between the object and its hardness prior information. In the haptic feedback application scenario of this embodiment, the object prior information database can be queried based on the image object. If the image object is a known object in the object prior information database, then the hardness obtained from the object prior information database can be used as the hardness of the image object, thus efficiently obtaining the hardness of the image object. Conversely, if the image object is an object not covered by the object prior information database, then the hardness of the image object needs to be estimated by statistically analyzing the object deformation of the current frame displayed in the aforementioned manner.

[0043] Step 102: Obtain the global relative vibration parameters corresponding to the object in the image based on the object feature information.

[0044] When a user interacts with an image displayed on a device, if a touch operation is performed on an image object, the touch area is only a local area on the image object. In order to achieve tactile feedback in a local area of ​​the image object, this embodiment performs pixel-level relative vibration parameter analysis on the entire image object in advance.

[0045] In an optional implementation of this embodiment, the specific implementation of obtaining the global relative vibration parameters corresponding to the image object based on object feature information includes, but is not limited to, the following two aspects:

[0046] Firstly, the global relative vibration intensity corresponding to the image object is obtained based on the roughness of the image object; secondly, the global relative vibration frequency corresponding to the image object is obtained based on the hardness of the image object.

[0047] That is, in this embodiment, the relative vibration intensity can be mapped based on the roughness features of the image object, and the relative vibration frequency can be mapped based on the hardness of the image object. It should be noted that this embodiment has a pre-configured mapping function between roughness and relative vibration intensity. For the image object, this mapping function can be called to obtain the corresponding relative vibration intensity pixel by pixel based on roughness, and then obtain the global relative vibration intensity of the image object based on the relative vibration intensity of all pixels. Figure 2 shows a pixel-level relative vibration intensity diagram provided by this embodiment, which shows the mapping relationship between the roughness of the image object and the relative vibration intensity. In the coordinate system diagram on the left of Figure 2, the horizontal axis and vertical axis represent the x-axis and y-axis of the pixel, respectively. The bar chart on the right is a relative vibration intensity mapping diagram based on color representation. Based on the color of each pixel in Figure 2, the corresponding relative vibration intensity can be mapped in the bar chart on the right. It is worth mentioning that the above mapping function can be expressed as I=f1(R), and I∈[0,1], where f1() represents the mapping function from roughness R to relative vibration intensity I.

[0048] In addition, this embodiment also pre-configures a mapping function between hardness and relative vibration frequency. Similarly, for an image object, the corresponding relative vibration frequency can be obtained pixel by pixel based on hardness, and then the global relative vibration frequency of the image object can be obtained based on the relative vibration frequencies of all pixels. Figure 3 shows a pixel-level relative vibration frequency diagram provided by this embodiment, illustrating the mapping relationship between the hardness and relative vibration frequency of the image object. In the coordinate system diagram on the left of Figure 3, the horizontal and vertical axes represent the x-axis and y-axis of the pixel, respectively. The bar chart on the right is a relative vibration frequency mapping diagram based on color representation. Based on the color of each pixel in Figure 3, the corresponding relative vibration frequency can be mapped in the bar chart on the right. It is worth mentioning that the above mapping function can be expressed as F=f2(H), and F∈[0,100], where f2() represents the mapping function from hardness H to relative vibration frequency F.

[0049] Step 103: When a touch operation event relative to an image object is detected, obtain the local relative vibration parameters corresponding to the location where the touch operation occurs based on the global relative vibration parameters.

[0050] In practical applications, electronic devices display images via touchscreens. When a user touches an object on the touchscreen, if the touchscreen is capacitive, the electronic device can identify the touch event based on the detected capacitance value. The identified touch event includes, but is not limited to, the touch location, touch pressure, and touch speed. It is worth noting that the touch speed described in this embodiment typically refers to swipe-type touch operations. When a user applies a swipe-type touch to an image, the finger moves along a path on the image. Figure 4 shows a schematic diagram of a touch event provided in this embodiment, illustrating the finger's movement path in the image. It should also be noted that since the user touches a local area of ​​an image object, and different areas of the object have different physical properties, the human body will have different tactile perceptions when touching different areas. Therefore, this embodiment needs to obtain the corresponding local relative vibration parameters based on the touch location.

[0051] Step 104: Map the actual vibration parameters of the haptic feedback actuator based on the local relative vibration parameters, and generate a vibration control signal corresponding to the location where the touch operation occurs based on the actual vibration parameters.

[0052] The haptic feedback actuator in this embodiment can be understood as an actuator, specifically a linear motor. After obtaining local relative vibration parameters based on an image object, this embodiment further maps these local relative vibration parameters to parameters at the haptic feedback actuator level, i.e., actual vibration parameters. Next, a vibration control signal executable by the haptic feedback actuator is generated based on these actual vibration parameters. It is worth noting that in practical applications, this embodiment can construct the aforementioned vibration control signal based on a preset mathematical function (e.g., a polynomial function such as a sine wave, square wave, or triangular wave).

[0053] In an optional embodiment of this example, the types of the aforementioned relative vibration parameters include relative vibration intensity and relative vibration frequency. Correspondingly, the mapping of the actual vibration parameters of the haptic feedback actuator based on local relative vibration parameters includes: weighting the local relative vibration intensity based on touch operation pressure, and weighting the local relative vibration frequency based on touch operation speed; mapping the weighted local relative vibration intensity to the actual vibration intensity of the haptic feedback actuator, and mapping the weighted local relative vibration frequency to the actual vibration frequency of the haptic feedback actuator.

[0054] In this embodiment, corresponding weighting functions are constructed for relative vibration intensity and relative vibration frequency. In the basic implementation, both weighting functions are direct proportional functions, that is, the greater the touch operation pressure, the greater the relative vibration intensity, and the faster the touch operation speed, the greater the relative vibration frequency. Thus, based on the weighted local relative vibration parameters, the user's ability to perceive vibration feedback can be enhanced.

[0055] In an optional embodiment of this example, the above-mentioned mapping of the weighted local relative vibration intensity to the actual vibration intensity of the haptic feedback actuator, and mapping of the weighted local relative vibration frequency to the actual vibration frequency of the haptic feedback actuator, includes: obtaining the rated voltage and rated frequency response range of the haptic feedback actuator; mapping the weighted local relative vibration intensity to the actual vibration intensity of the haptic feedback actuator based on the rated voltage, and mapping the weighted local relative vibration frequency to the actual vibration frequency of the haptic feedback actuator based on the rated frequency response range.

[0056] In practical applications, the maximum intensity of the haptic feedback actuator must not exceed its rated voltage, and the actual frequency must be within its rated frequency response range. Based on this, this embodiment can determine the corresponding rated parameters (i.e., rated voltage and rated frequency response range) according to the type of the haptic feedback actuator. Then, when mapping the local relative vibration parameters, the rated parameters of the haptic feedback actuator are combined to map the local relative vibration parameters to the actual vibration parameters (i.e., actual vibration intensity and actual vibration frequency) of the haptic feedback actuator.

[0057] Step 105: Send the vibration control signal to the haptic feedback actuator to control the haptic feedback actuator to perform the corresponding vibration operation at the location where the touch operation occurs.

[0058] Figure 5 shows a schematic diagram of the vibration envelope of a haptic feedback actuator provided in this embodiment. The corresponding touch operation event is a finger moving at a constant speed within 3 seconds. After generating a corresponding vibration control signal for the location where the touch operation occurs, this embodiment can control the haptic feedback actuator to output a vibration signal corresponding to the texture of the image object at the location where the touch operation occurs, so as to simulate the tactile feeling of the user touching a real object, thereby helping the user understand the object and improving the fun of human-computer interaction.

[0059] To better illustrate the embodiments of this application, one embodiment of this application also provides a refined haptic feedback method based on image texture. Figure 6 shows a detailed flowchart of the haptic feedback method based on image texture provided in one embodiment of this application. The haptic feedback method based on image texture specifically includes the following steps:

[0060] Step 601: Obtain the roughness and hardness of the image object based on the image texture feature parameters of the target displayed image;

[0061] Step 602: Obtain the global relative vibration intensity corresponding to the image object based on the roughness of the image object, and obtain the global relative vibration frequency corresponding to the image object based on the hardness of the image object.

[0062] Step 603: When a touch operation event relative to an image object is detected, the local relative vibration intensity and local relative vibration frequency corresponding to the location where the touch operation occurs are obtained according to the global relative vibration intensity and the global relative vibration frequency, respectively.

[0063] Step 604: Weight the local relative vibration intensity based on the touch operation pressure, and weight the local relative vibration frequency based on the touch operation speed;

[0064] Step 605: Obtain the rated voltage and rated frequency response range of the haptic feedback actuator;

[0065] Step 606: Map the weighted local relative vibration intensity to the actual vibration intensity of the tactile feedback actuator based on the rated voltage, and map the weighted local relative vibration frequency to the actual vibration frequency of the tactile feedback actuator based on the rated frequency response range;

[0066] Step 607: Generate a vibration control signal corresponding to the location where the touch operation occurs based on the actual vibration intensity and actual vibration frequency;

[0067] Step 608: Send the vibration control signal to the haptic feedback actuator to control the haptic feedback actuator to perform the corresponding vibration operation at the location where the touch operation occurs.

[0068] It should be understood that the sequence number of each step in this embodiment does not imply the order in which the steps are executed. The execution order of each step should be determined by its function and internal logic, and should not constitute a unique limitation on the implementation process of this application embodiment.

[0069] Figure 7 illustrates a tactile feedback device based on image texture according to an embodiment of this application. This tactile feedback device can be used to implement the tactile feedback method based on image texture in the aforementioned embodiments, and mainly includes:

[0070] The information acquisition module 701 is used to acquire object feature information of the image object based on the texture feature parameters of the image texture in the target display image;

[0071] The first parameter acquisition module 702 is used to acquire global relative vibration parameters corresponding to the object in the image based on the object feature information;

[0072] The second parameter acquisition module 703 is used to acquire local relative vibration parameters corresponding to the location where the touch operation occurs based on global relative vibration parameters when a touch operation event relative to an image object is detected.

[0073] The signal generation module 704 is used to map the actual vibration parameters of the haptic feedback actuator based on the local relative vibration parameters, and generate a vibration control signal corresponding to the location where the touch operation occurs based on the actual vibration parameters.

[0074] The vibration control module 705 is used to send vibration control signals to the haptic feedback actuator to control the haptic feedback actuator to perform corresponding vibration operations at the location where the touch operation occurs.

[0075] It should be noted that the image texture-based haptic feedback methods in the foregoing method embodiments can all be implemented based on the image texture-based haptic feedback device provided in this embodiment. Those skilled in the art can clearly understand that, for the sake of convenience and brevity, the specific working process of the image texture-based haptic feedback device described in this embodiment can be implemented by referring to the corresponding working process in the foregoing method embodiments, and will not be repeated here.

[0076] Based on the technical solution of the embodiments of this application described above, object feature information of an image object is obtained according to the texture feature parameters of the image texture in the target display image; global relative vibration parameters corresponding to the image object are obtained according to the object feature information; when a touch operation event relative to the image object is detected, local relative vibration parameters corresponding to the touch operation location are obtained according to the global relative vibration parameters; the actual vibration parameters of the haptic feedback actuator are mapped based on the local relative vibration parameters, and a vibration control signal corresponding to the touch operation location is generated according to the actual vibration parameters; the vibration control signal is sent to the haptic feedback actuator to control the haptic feedback actuator to perform a corresponding vibration operation at the touch operation location. Through the implementation of this application, a haptic feedback mechanism is provided for touch operations applied to image objects in an image displayed on an electronic device, which can restore the realism of the touch behavior of the image object, expand the application scope of haptic feedback, and improve the fun of haptic feedback applications.

[0077] Please refer to Figure 8, which illustrates an electronic device according to an embodiment of this application. This electronic device can be used to implement the image texture-based haptic feedback method described in the foregoing embodiments. As shown in Figure 8, the electronic device mainly includes:

[0078] The system includes a memory 801, a processor 802, and a bus 803, with the memory 801 and processor 802 connected via the bus 803. The memory 801 stores a computer program that can run on the processor 802. When the processor 802 executes the computer program, it implements the image texture-based haptic feedback method described in the preceding embodiments. The number of processors can be one or more.

[0079] The memory 801 can be a high-speed random access memory (RAM) or a non-volatile memory, such as a disk storage device. The memory 801 is used to store executable program code, and the processor 802 is coupled to the memory 801.

[0080] Furthermore, embodiments of this application also provide a computer-readable storage medium, which may be disposed in the electronic device in the above embodiments, and the computer-readable storage medium may be the memory in the embodiment shown in FIG8 above.

[0081] The computer-readable storage medium stores a computer program that, when executed by a processor, implements the image texture-based haptic feedback method described in the foregoing embodiments. Furthermore, the computer-readable storage medium can also be a USB flash drive, external hard drive, read-only memory (ROM), RAM, magnetic disk, or optical disk, or any other medium capable of storing program code.

[0082] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple modules or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or modules may be electrical, mechanical, or other forms.

[0083] The modules described as separate components may or may not be physically separate. Similarly, the components shown as modules may or may not be physical modules; they may be located in one place or distributed across multiple network modules. Some or all of the modules can be selected to achieve the purpose of this embodiment, depending on actual needs.

[0084] Furthermore, the functional modules in the various embodiments of this application can be integrated into one processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The integrated modules described above can be implemented in hardware or as software functional modules.

[0085] If the integrated module is implemented as a software functional module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a readable storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned readable storage medium includes various media capable of storing program code, such as USB flash drives, external hard drives, ROM, RAM, magnetic disks, or optical disks.

[0086] It should be noted that, for the sake of simplicity, the foregoing method embodiments are all described as a series of actions. However, those skilled in the art should understand that this application is not limited to the described order of actions, as some steps may be performed in other orders or simultaneously according to this application. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions and modules involved are not necessarily essential to this application.

[0087] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions in other embodiments.

[0088] The above is a description of the image texture-based haptic feedback method, apparatus, device, and storage medium provided in this application. For those skilled in the art, based on the ideas of the embodiments of this application, there will be changes in the specific implementation methods and application scope. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. A haptic feedback method based on image texture, characterized in that, include: Obtain object feature information of the image object based on the texture feature parameters of the image texture in the target displayed image; The global relative vibration parameters corresponding to the object in the image are obtained based on the object feature information; When a touch operation event relative to the image object is detected, local relative vibration parameters corresponding to the location where the touch operation occurs are obtained based on the global relative vibration parameters; The actual vibration parameters of the haptic feedback actuator are mapped based on the local relative vibration parameters, and a vibration control signal corresponding to the location where the touch operation occurs is generated according to the actual vibration parameters. The vibration control signal is sent to the tactile feedback actuator to control the tactile feedback actuator to perform a corresponding vibration operation at the location where the touch operation occurs.

2. The tactile feedback method according to claim 1, characterized in that, The step of obtaining the global relative vibration parameters corresponding to the image object based on the object feature information includes: The global relative vibration intensity corresponding to the image object is obtained based on the roughness of the image object, and / or the global relative vibration frequency corresponding to the image object is obtained based on the hardness of the image object.

3. The tactile feedback method according to claim 2, characterized in that, The object feature information is the roughness, and the step of obtaining the object feature information of the image object based on the texture feature parameters of the image texture in the target display image includes: Convert the target display image into a grayscale image; The first texture feature parameters of the grayscale image are extracted based on the grayscale co-occurrence matrix; wherein, the first texture feature parameters include at least one of the following: texture entropy, texture inertia moment, texture contrast, texture correlation, and texture uniformity; The roughness of the image object is calculated based on the preset functional relationship between the first texture feature parameter and roughness.

4. The tactile feedback method according to claim 2, characterized in that, The object feature information is the hardness, and the step of obtaining the object feature information of the image object based on the texture feature parameters of the image texture in the target display image includes: Obtain the N frames of already displayed images in the currently displayed video that precede the target displayed image; where N is a positive integer greater than 0; Based on the target display image and the N frames of already displayed images, statistically analyze the second texture feature information of the image texture in the target display image; wherein, the second texture feature information includes deformation information; The hardness of the image object is calculated based on the preset functional relationship between the second texture feature parameters and hardness.

5. The tactile feedback method according to claim 4, characterized in that, The method further includes: Check in the preset object prior information database whether there is a hardness corresponding to the object in the image; If no results are found in the query, then the step of obtaining the N frames of images that were displayed before the target image in the currently displayed video is executed.

6. The tactile feedback method according to claim 1, characterized in that, The types of relative vibration parameters include relative vibration intensity and relative vibration frequency. The mapping of the actual vibration parameters of the haptic feedback actuator based on the local relative vibration parameters includes: The local relative vibration intensity is weighted based on the touch operation pressure, and the local relative vibration frequency is weighted based on the touch operation speed; The weighted local relative vibration intensity is mapped to the actual vibration intensity of the tactile feedback actuator, and the weighted local relative vibration frequency is mapped to the actual vibration frequency of the tactile feedback actuator.

7. The tactile feedback method according to claim 6, characterized in that, The process of mapping the weighted local relative vibration intensity to the actual vibration intensity of the haptic feedback actuator, and mapping the weighted local relative vibration frequency to the actual vibration frequency of the haptic feedback actuator, includes: Obtain the rated voltage and rated frequency response range of the haptic feedback actuator; Based on the rated voltage, the weighted local relative vibration intensity is mapped to the actual vibration intensity of the tactile feedback actuator, and based on the rated frequency response range, the weighted local relative vibration frequency is mapped to the actual vibration frequency of the tactile feedback actuator.

8. A haptic feedback device based on image texture, characterized in that, include: The information acquisition module is used to obtain the object feature information of the image object based on the texture feature parameters of the image texture in the target display image; The first parameter acquisition module is used to acquire global relative vibration parameters corresponding to the image object based on the object feature information; The second parameter acquisition module is used to acquire local relative vibration parameters corresponding to the location where the touch operation occurs based on the global relative vibration parameters when a touch operation event relative to the image object is detected. The signal generation module is used to map the actual vibration parameters of the haptic feedback actuator based on the local relative vibration parameters, and generate a vibration control signal corresponding to the location where the touch operation occurs based on the actual vibration parameters. The vibration control module is used to send the vibration control signal to the tactile feedback actuator to control the tactile feedback actuator to perform a corresponding vibration operation at the location where the touch operation occurs.

9. An electronic device, characterized in that, include: Memory and processor; The processor is used to execute computer programs stored in the memory; When the processor executes the computer program, it implements the steps in the image texture-based haptic feedback method as described in any one of claims 1 to 7.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the steps in the image texture-based haptic feedback method as described in any one of claims 1 to 7.

Images