METHOD AND DEVICE FOR PROCEEDING HAPTIC FEEDBACK AND STORAGE MEDIUM

DE602021023145T2Active Publication Date: 2024-12-11BEIJING XIAOMI MOBILE SOFTWARE CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
DE602021023145
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-12-28
Filing Date
2021-06-23
Publication Date
2024-12-11
Estimated Expiration
2041-06-23

AI Technical Summary

Technical Problem

Current screen reading software for visually-impaired users provides the same vibration sense for all controls, making it difficult for users to distinguish between interface elements, especially in scenarios where voice activation is inconvenient.

Method used

A method and device for generating haptic feedback that determines the type of interface element touched and matches it with a specific haptic effect, allowing users to differentiate between various interface elements through distinct haptic feedbacks.

Benefits of technology

Enables visually-impaired users to accurately determine the interface element being touched by providing unique haptic feedbacks for different interface elements, enhancing user efficiency and accessibility.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of haptic feedback, and in particular to a method for generating a haptic feedback, a device for generating a haptic feedback, and a storage medium.BACKGROUND

[0002] With the development of accessibility technologies, more users, including those with disabilities, can use smart terminal device, particularly assistive devices.

[0003] Visually-impaired users may use a terminal with the help of a screen reading software. However, current screen reading software generally generates a voice and a single vibration sense corresponding to a touched item to help visually-impaired users use the terminal. For places where it is inconvenient to activate the voice function, the screen reading software cannot effectively help the visually-impaired users distinguish the control being touched because the screen reading software provides the same vibration sense to all controls in the application scenario. Related technologies are known from patent publication documents EP 2 733 576 A1, US 2012 / 268412 A1, US2019 / 121500 A1, and US 2017 / 358181 A1.SUMMARY

[0004] In view of the problems in related arts, the present disclosure provides a method and device for generating a haptic feedback, and a storage medium. The invention is defined by the appended independent claims. Further embodiments of the invention are defined by the dependent claims.

[0005] A first aspect of embodiments of the present disclosure provides a method for generating a haptic feedback. The method is applied to a terminal and includes: in response to an interface element on a display interface of the terminal being touched, determining a first interface element type corresponding to the interface element; determining, based on a matchup between interface element types and haptic effects, a first haptic effect corresponding to the first interface element type, where different interface element types correspond to different haptic effect; and generating a haptic feedback of the first haptic effect.

[0006] A second aspect of embodiments of the present disclosure provides a device for generating a haptic feedback. The device is applied to a terminal and includes: a processing unit, configured to: in response to an interface element on a display interface of the terminal being touched, determine a first interface element type corresponding to the interface element, and determine a first haptic effect corresponding to the first interface element type based on a matchup between interface element types and haptic effects, where different interface element types correspond to different haptic effects; and a haptic feedback unit, configured to generate a haptic feedback of the first haptic effect.

[0007] A third aspect of embodiments of the present disclosure provides a device for generating a haptic feedback, including: a processor; and a memory storing executable by the processor, where the processor is configured to call the instructions to execute the method for generating a haptic feedback according to the first aspect or any implement of the first aspect of the present disclosure.

[0008] A fourth aspect of embodiments of the present disclosure provides a non-transitory computer-readable storage medium, where instructions in the storage medium that, when executed by a processor of a mobile terminal, cause the mobile terminal to execute the method for generating a haptic feedback according to the first aspect or any implement of the first aspect of the present disclosure.

[0009] The solutions provided by embodiments of the present disclosure can achieve the following beneficial effect. According to the method for generating a haptic feedback provided by the present disclosure, the first interface element type corresponding to the interface element being touched on the display interface of the terminal is determined, and the first haptic effect corresponding to the first interface element type is determined based on the matchup between the interface element types and the haptic effects, so that the haptic feedback matching the first haptic effect is generated. Since different interface elements correspond to different haptic feedbacks, the user is ensured to determine the interface element being currently touched based on the haptic feedback.

[0010] It should be understood that the above general description and detailed description described hereinafter are only exemplary and explanatory, and not intended to limit the present disclosure.BRIEF DESCRIPTION OF THE DRAWINGS

[0011] The drawings herein are incorporated into the specification and constitute a part of the specification, show embodiments that conform to the disclosure, and together with the specification are used to explain the principle of the disclosure. FIG. 1 is a flowchart showing a method for generating a haptic feedback according to some embodiments. FIG. 2 is a flow chart of determining the correspondence between interface element types and haptic effects. FIG.3 is a schematic diagram illustrating an application scenario where the method for generating a touch feedback according to an embodiment of the present disclosure is applied. FIG.4 is a schematic diagram illustrating another application scenario where the method for generating a touch feedback according to an embodiment of the present disclosure is applied. FIG.5 is a schematic diagram illustrating another application scenario where the method for generating a touch feedback according to an embodiment of the present disclosure is applied. FIG.6 is a schematic diagram illustrating yet another application scenario where the method for generating a touch feedback according to an embodiment of the present disclosure is applied. FIG. 7 shows a flow chart of generating a haptic feedback matching a first haptic effect. FIG. 8 is a flowchart of another method for generating a haptic feedback according to some embodiments. FIG. 9 is a block diagram showing a device for generating a haptic feedback according to some embodiments. FIG. 10 is a block diagram showing a device for generating a haptic feedback according to some embodiments. DETAILED DESCRIPTION

[0012] The exemplary embodiments will be described in detail here, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings indicate same or similar elements. The implementation manners described in the following exemplary embodiments do not represent all implementation manners consistent with the present disclosure. On the contrary, they are merely examples of devices and methods consistent with some aspects of the present disclosure as recited in the appended claims.

[0013] In the drawings, same or similar reference numerals indicate same or similar elements or elements with same or similar functions. The described embodiments are a part of the embodiments of the present disclosure, but not all of the embodiments. The embodiments described below with reference to the drawings are exemplary, and are intended to explain the present disclosure, but should not be construed as limiting the present disclosure. All other embodiments that are obtained by those ordinary skilled in the art based on the embodiments in the present disclosure without paying creative work shall fall within the protection scope of the present disclosure. The embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. It should be noted that unless specifically stated otherwise, the relative arrangement of components, numerical expressions, and numerical values set forth in these embodiments do not limit the scope of the present disclosure.

[0014] With the constant development of terminal technology, a terminal is more and more popular, and the terminal is used by a user more frequently. Especially, terminals with a touch screen have become indispensable smart devices for users in their daily lives.

[0015] Further, with the constant development of accessibility technologies, every person, even the disabled, can easily use a smart terminal device.

[0016] For visually-impaired users, a screen reading software may be used to help them use the terminal. However, current screen reading software generally generates a voice and a single vibration sense corresponding to the touched item to help visually-impaired users use the terminal. For places where it is inconvenient to activate the voice function, the visually-impaired users cannot effectively distinguish the control being touched because the screen reading software provides the same vibration sense to all controls in the application scenario.

[0017] According to the method for generating a haptic feedback provided by the present disclosure, a haptic feedback matching an interface element being touched is generated by: determining an interface element type corresponding to the interface element being touched on a display interface of the terminal, and determining haptic effect corresponding to the interface element being touched based on a matchup between interface element types and haptic effects. Different interface elements correspond to different haptic feedbacks. Therefore, the user is ensured to determine the interface element being currently touched based on the haptic feedback.

[0018] The method for generating a haptic feedback provided by the embodiment of the present disclosure may be applied to a terminal. The terminal may have a touch screen. For example, the terminal may include a smart mobile terminal with a touch screen, and may also include a tablet computer with a touch screen. In the present disclosure, the terminal is not specifically limited.

[0019] FIG. 1 is a flowchart of a method for generating a haptic feedback according to some embodiments.

[0020] In some embodiments of the present disclosure, as shown in FIG. 1, the method for generating a haptic feedback includes the following steps.

[0021] In step S 11, in response to an interface element on a display interface of the terminal being touched, a first interface element type corresponding to the interface element is determined.

[0022] In an embodiment, when an interface element on the display interface of the terminal is touched, the interface element type corresponding to the touched interface element can be determined, which is referred to as the first interface element type hereinafter.

[0023] It should be understood that if the first interface element type corresponding to the interface element being touched is an interface element type preset with a specific haptic effect, the haptic effect corresponding to the interface element type can be generated when the interface element is touched.

[0024] The interface elements may include elements such as applications, buttons, switches, sliders, specific texts, etc. displayed on the display interface of the terminal.

[0025] In step S12, a first haptic effect corresponding to the first interface element type is determined based on a matchup between interface element types and haptic effects. Among them, different interface element types correspond to different haptic effects.

[0026] In an embodiment, different interface element types can be preset to correspond to different haptic effects. For example, an answer button interface element for a terminal incoming call may correspond to a haptic effect of a first vibration sense level. A hang-up button interface element for the terminal incoming call may correspond to a haptic effect of a second vibration sense level. During the application process, the first haptic effect corresponding to the first interface element type may be determined based on a preconfigured matchup between the interface element types and the haptic effects.

[0027] In step S13, a haptic feedback of the first haptic effect is generated.

[0028] In an embodiment, different haptic effects may correspond to different haptic feedbacks. The matchup between the haptic effects and the haptic feedbacks can be determined in advance. In an example, the interface element being touched on the current display interface of the terminal is an unread message list in a communication chat software, the haptic effect corresponding to the interface element being touched on the current display interface of the terminal is determined as a haptic effect of a third vibration sense level based on the matchup between the interface element types and the haptic effects. Further, when the unread message list in the communication chat software is touched, a haptic feedback matching the haptic effect of the third vibration level can be generated for the user.

[0029] According to the method for generating a haptic feedback provided by the present disclosure, the haptic feedback matching the first haptic effect is generated by: determining the first interface element type corresponding to the interface element being touched on the display interface of the terminal, and determining the first haptic effect corresponding to the first interface element type based on the matchup between the interface element types and the haptic effects. Since different interface elements correspond to different haptic feedbacks, the user is ensured to determine the interface element being currently touched based on the haptic feedback.

[0030] The manner for determining the matchup between the interface element types and the haptic effects will be illustrated through the following embodiments in the present disclosure.

[0031] FIG.2 is a flow chart of determining the matchup between interface element types and haptic effects.

[0032] In some embodiments of the present disclosure, as shown in FIG. 2, the matchup between the interface element types and the haptic effects is determined through step S21 and step S22. These steps will be described respectively below.

[0033] In step S21, an interface element control is determined among the interface elements, and the interface element type corresponding to the interface element control is determined, where different interface element types correspond to different interface element control types. It should be understood that the interface element control types include at least one of the following: a text list, a button, a switch, and a slider.

[0034] In an embodiment, the interface elements may include the interface element control. The interface element control may include one or more of a text list, a button, a switch, and a slider. In the application process, the interface element control can be determined among the interface elements, and the interface element types corresponding to the interface element controls can be determined, and different interface element types correspond to different interface element control types.

[0035] In step S22, for the interface element type, a haptic effect matching the interface element control type is created.

[0036] In an embodiment, the haptic effect matching the interface element control type may be pre-created based on the interface element type. Furthermore, a corresponding touch effect is generated for the user when the interface element control is touched, which is convenient for the user to determine what kind of interface element controls the interface element control is.

[0037] In an example, the interface element control may be an unread message list in a communication chat application, and the unread message list in the communication chat application corresponds to the first interface element type. In another example, the interface element control may be a read message list in the communication chat application, and the read message list in the communication chat application corresponds to the second interface element type. In the application process, a haptic effect matching the unread message list in the communication chat application can be created, based on the first interface element type, in advance. It is also possible to create, based on the second interface element type, a haptic effect matching the read message list in the communication chat application in advance.

[0038] In some embodiments of the present disclosure, the haptic effect matching the interface element control type can be created in the following manner.

[0039] In response to different control operation attributes included in the same interface element control type, different haptic effects are created for different control operation attributes.

[0040] The control operation attributes can represent different processing methods of the control operation. Taking the communication chat application control as an example, the message list in the communication chat application may be displayed as including an unread message list and a read message list. It should be understood that the unread message list and the read message list displayed in the message list are different control operation attributes of the communication chat application control. Further, corresponding haptic effects can be created for the unread message list and the read message list respectively. When the user touches the unread message list or the read message list, corresponding haptic feedback can be provided to the user to give a clue that the currently touched interface element control is the unread message list or the read message list.

[0041] In another embodiment, there may include two control operation attributes (that is, answering calls and rejecting calls) for a terminal incoming call. Further, corresponding haptic effects can be created for answering calls and rejecting calls respectively. When the user touches an interface element control for answering calls or an interface element control for rejecting calls, the corresponding haptic feedback can be provided to the user to give a clue that the interface element control currently touched is the interface element control for answering calls or the interface element control for rejecting calls.

[0042] The process of creating different haptic effects for different control operation attributes will be described through the following embodiments of the present disclosure.

[0043] In some embodiments of the present disclosure, different control operation attributes include emphasized control operations and normal control operations, and an emphasized haptic effect may be created for the emphasized control operation, and a normal haptic effect may be created for the normal control operation.

[0044] In the application process, there are generally more than two control operation attributes for the same interface element control type. Among the multiple control operation attributes, the terminal recommends a certain control operation attribute to be operated by the user. Such type of control operation attribute can be referred to as the emphasized control operation attribute. In an example, control operation attributes other than the emphasized control operation attributes may be referred to as normal control operation attributes.

[0045] In an embodiment, in the communication chat application control, the control operation attribute of the unread message list is the control operation attribute that is recommended by the terminal for the user to operate. Therefore, the control operation attribute of the unread message list can be used as the emphasized control operation attribute. Accordingly, the control operation attribute of the read message list can be used as the normal control operation attribute.

[0046] In another embodiment, in the terminal incoming call control, the control operation attribute for answering calls is the control operation attribute that the terminal recommends the user to operate. Therefore, the control operation attribute for answering calls can be used as the emphasized control operation attribute. Accordingly, the control operation attribute for rejecting calls can be regarded as the normal control operation attribute.

[0047] according to the claimed invention, it is possible to create an emphasized haptic effect for emphasized control operations, and create a normal haptic effect for normal control operations. According to the invention, the emphasized haptic effect corresponding to the emphasized control operation may be a vibration with a higher vibration level, and the normal haptic effect corresponding to the normal control operation may be a vibration with a weaker vibration level.

[0048] In order to further explain the method for generating a haptic feedback according to the embodiments of the present disclosure, scenarios where the method for generating a haptic feedback of the embodiments of the present disclosure is applied are described through the following embodiments.

[0049] It should be understood that the method for generating a haptic feedback described in the embodiments of the present disclosure can be applied to a scenario where a smart terminal is used by visually-impaired users. In an example, corresponding haptic effects can be set for the interface element controls commonly used by the visually-impaired users. In this way, when the voice screen reading software cannot be used, the visually-impaired users can directly determine, based on the haptic feedback generated by the terminal, what kind of interface element control is being currently touched.

[0050] FIG.3 is a schematic diagram illustrating an application scenario where the method for generating a touch feedback according to an embodiment of the present disclosure is applied.

[0051] In an embodiment of the present disclosure, as shown in FIG. 3, in the communication chat application control, the control operation attribute of the unread message list is the emphasized control operation attribute, and corresponds to the first emphasized haptic effect. If the first haptic feedback matching the first emphasized haptic effect is generated when the user touches the interface elements on the interface displayed by the terminal, it indicates that the interface element currently touched by the user is the unread message list control. In this case, the user can determine, based on his / her current environment, whether to listen to the unread messages displayed in the unread message list control. In the embodiment, once the user touches the unread message list control, the first haptic feedback corresponding to the unread message list control can be generated, thereby ensuring that the user is aware of information about the existence of unread messages in the communication chat software at earliest time possible. Therefore, the user's efficiency for the next operation is improved.

[0052] FIG.4 is a schematic diagram illustrating another application scenario where the method for generating a touch feedback according to an embodiment of the present disclosure is applied.

[0053] In an embodiment of the present disclosure, as shown in FIG. 4, in the music control, the control operation attribute for controlling the pause / play of the playing music, the control operation attribute for controlling the fast forward of the playing music, the control operation attribute for controlling the rewind of the playing music, and the control operation attribute for turning off playing music can correspond to different haptic effects respectively. In an example, the control operation attribute for turning off the playing music may correspond to the third haptic effect. If a third haptic feedback matching the third haptic effect is generated when the user touches the interface element on the display interface of the terminal, it indicates that the interface element currently touched by the user is the operation control that controls the playing music to be turned off. In this case, the user can determine, based on his / her current environment, whether to turn off the currently playing music.

[0054] FIG.5 is a schematic diagram illustrating another application scenario where the method for generating a touch feedback according to an embodiment of the present disclosure is applied.

[0055] In an embodiment of the present disclosure, as shown in FIG. 5, in the terminal incoming call control, the operation attribute for answering calls is the emphasized control operation attribute, and corresponds to the first emphasized haptic effect. If the first haptic feedback matching the first emphasized haptic effect is generated when the user touches the interface element on the display interface on the terminal, it indicates that the interface element currently touched by the user is the operation control for answering calls, and the user can determine, based on his / her current environment, whether to answer the call of the terminal. In another example, the operation attribute for rejecting calls is the normal control operation attribute, and corresponds to a second emphasized haptic effect. If the second haptic feedback matching the second emphasized haptic effect is generated when the user touches the interface element on the display interface on the terminal, it indicates that the interface element currently touched by the user is the operation control for rejecting calls, and the user can determine, based on his / her current environment, whether to reject the call of the terminal.

[0056] FIG.6 is a schematic diagram illustrating an application scenario where the method for generating a touch feedback according to an embodiment of the present disclosure is applied.

[0057] In an embodiment of the present disclosure, as shown in FIG. 6, in the shopping application controls, the operation attribute of the search box control, the operation attribute of the add-to-shopping cart control, and the operation attribute of the buy-now control can respectively correspond to different haptic effects. In an example, the operation attribute of the buy-now control may correspond to the first haptic effect. If the first haptic feedback matching the first haptic effect is generated when the user touches the interface element on the display interface of the terminal, it indicates that the interface element currently touched by the user is the buy-now operation control in the shopping application controls. The user can determine whether to buy the currently selected commodity according to his / her own needs.

[0058] As can be seen from the above embodiments, a haptic feedback corresponding to the interface element can be generated once the user touches the interface element. Therefore, in the case that the current interface elements cannot be read in voices, the user is ensured to know what kind of interface elements is currently touched at earliest time possible, thereby improving the operation efficiency of the user in the next step.

[0059] The process of generating a haptic feedback matching the first haptic effect will be described through the following embodiments of the present disclosure.

[0060] FIG.7 shows a flow chart of generating a haptic feedback matching the first haptic effect.

[0061] In some embodiments of the present disclosure, the terminal includes a signal actuator. In an example, the signal actuator may be a linear motor for generating vibration. As shown in FIG. 7, the process of generating a haptic feedback matching the first haptic effect includes step S31 and step S32, and each step will be introduced separately below.

[0062] In step S31, a first haptic effect signal corresponding to the first haptic effect is called, based on the first haptic effect, in a haptic effect signal database.

[0063] In step S32, the signal actuator is controlled, based on the first haptic effect signal, to generate a haptic feedback matching the first haptic effect.

[0064] In an embodiment, the haptic effect signal database includes a matchup table of haptic effects and haptic effect signals. Based on the haptic effect signal database, the first haptic effect signal corresponding to the first haptic effect can be determined and called.

[0065] Further, the signal actuator may be controlled based on the first haptic effect signal to generate a haptic feedback matching the first haptic effect at the terminal. The signal actuator can be a linear motor. It should be understood that different haptic effects correspond to different haptic effect signals. Different haptic effect signals can be used by the signal actuator to generate different haptic feedback at the terminal.

[0066] The process of another method for generating a haptic feedback will be described through the following embodiments of the present disclosure.

[0067] In some embodiments of the present disclosure, as shown in FIG. 8, the method for generating a haptic feedback may include steps S41 to S44, where steps S42 to S44 are the same as steps S11 to S13 described above. The specific steps and the beneficial effects of these steps will not be repeated in this embodiment, please refer to the preceding text for details. Step S41 will be described in detail below.

[0068] In step S41, it is determined that the terminal is in a first operation mode, and the first operation mode is an operation mode that is allowed to generate the haptic feedback.

[0069] In an embodiment, the first operation mode that is allowed to generate the haptic feedback may be a focus screen reading mode. It should be understood that the method for generating the haptic feedback can be applied to a scenario where the terminal is in the focus screen reading mode. In the focus screen reading mode, the touched item can be read by voice to help the user know what kind of control is currently touched. However, in the focus screen reading mode, the same vibration is generated for all the touched items, thus failing to help the user to determine what kind of control is currently touched through the touch feedback.

[0070] In order to enable the user to determine, based on the touch feedback, what kind of control is currently being touched, in response to determining that the interface element on the display interface of the terminal is being touched, the first interface element type corresponding to the interface element can be determined, the first haptic effect corresponding to the first interface element type is determined based on the matchup between the interface element types and the haptic effects, and the haptic feedback matching the first haptic effect is generated based on the first haptic effect. According to the embodiment, the user is ensured to determine which interface element is currently being touched based on the haptic feedback.

[0071] According to the above description, the method for generating a haptic feedback of the present disclosure determines the first interface element type corresponding to the touched interface element on the display interface of the terminal, and determines, based on the matchup between the interface element types and the haptic effects, the first haptic effect corresponding to the first interface element type, to generate the haptic feedback matching the first haptic effect. Since different interface elements correspond to different haptic feedbacks, the user is ensured to determine which interface element is currently being touched based on the haptic feedback.

[0072] Based on the same concept, the embodiments of the present disclosure further provide a device for generating a haptic feedback.

[0073] It can be understood that, in order to realize the above-mentioned functions, the device for generating a haptic feedback provided in the embodiments of the present disclosure includes corresponding hardware structures and / or software modules used for performing each function. In combination with the units and algorithm steps of the examples disclosed in the embodiments of the present disclosure, the embodiments of the present disclosure can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed by hardware or a combination of hardware and computer software depends on the specific application and design constraint conditions of the technical solution. Those skilled in the art can use different methods for each specific application to implement the described functions, but such implementation should not be considered as going beyond the scope of the technical solutions of the embodiments of the present disclosure.

[0074] FIG.9 is a block diagram showing a device for generating a haptic feedback according to some embodiments.

[0075] In some embodiments of the present disclosure, as shown in FIG.9, the device for generating a haptic feedback may include a processing unit 101 and a haptic feedback unit 102. Each module will be introduced separately below.

[0076] The processing unit 101 may be configured to: in response to an interface element on a display interface of the terminal being touched, determine a first interface element type corresponding to the interface element.

[0077] The processing unit 101 may be configured to: determine, based on a matchup between interface element types and haptic effects, a first haptic effect corresponding to the first interface element type, where different interface element types correspond to different haptic effects.

[0078] The haptic feedback unit 102 may be configured to: generate a haptic feedback of the first haptic effect.

[0079] In some embodiments of the present disclosure, the processing unit 101 may preconfigure the matchup between the interface element types and the haptic effects through the following methods: determining an interface element control among the interface elements, and determining the interface element type corresponding to the interface element control, where different interface element types correspond to different interface element control types, the interface element control types include at least one of a text list, a button, a switch, and a slider; for the interface element type, creating a haptic effect matching the interface element control type.

[0080] In some embodiments of the present disclosure, the processing unit 101 may use the following method to create the haptic effect matching the interface element control type: in response to determining that the same interface element control type includes different control operation attributes, creating different haptic effects for different control operation attributes.

[0081] In some embodiments of the present disclosure, the processing unit 101 may use the following method to create different haptic effects for different control operation attributes: different control operation attributes include emphasized control operations and normal control operations, and an emphasized haptic effect is created for the emphasized control operation, and a normal haptic effect is created for the normal control operation.

[0082] In some embodiments of the present disclosure, the terminal includes a signal actuator, and the haptic feedback unit 102 is configured to generate the haptic feedback matching the first haptic effect in the following manner: calling, based on the first haptic effect, a first haptic effect signal corresponding to the first haptic effect in a haptic effect signal database; controlling, based on the first haptic effect signal, the signal actuator to generate the haptic feedback matching the first haptic effect.

[0083] In some embodiments of the present disclosure, the processing unit 101 may further be configured to: determine that the terminal is in a first operation mode, where the first operation mode is an operation mode that is allowed to generate the haptic feedback.

[0084] As for the device provided in the foregoing embodiment, the specific manner in which each module performs the operation has been described in detail in the method embodiment, and detailed description will not be given here.

[0085] FIG. 10 is a block diagram showing a device for generating a haptic feedback 200 according to some embodiments. For example, the device 200 may be a mobile phone, a computer, a digital broadcasting terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0086] Referring to FIG. 10, the device for generating a haptic feedback 200 may include one or more of the following components: a processing component 202, a memory 204, a power component 206, a multimedia component 208, an audio component 210, an input / output (I / O) interface 212, a sensor component 214, and a communication component 216.

[0087] The processing component 202 is generally configured to control the overall operation of the device for generating a haptic feedback 200, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 202 may include one or more processors 220 to execute instructions to perform all or part of the steps of the above-mentioned method for generating a haptic feedback. In addition, the processing component 202 may also include one or more modules to facilitate the interaction between the processing component 202 and other components. For example, the processing component 202 may also include a multimedia module to facilitate the interaction between the multimedia component 208 and the processing component 202.

[0088] The memory 204 is configured to store various data to support operations of the device for generating a haptic feedback 200. Examples of the data includes instructions of any application or method that can be run on the device for generating a haptic feedback 200, contact data, phonebook data, messages, pictures and videos and the like. The memory 204 can be implemented by any type of volatile or non-volatile storage device or their combination, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable and Programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0089] The power component 206 may supply power to various components of the device for generating a haptic feedback 200. The power component 206 may also include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device for generating a haptic feedback 200.

[0090] The multimedia component 208 may include a screen that provides an output interface between the device for generating a haptic feedback 200 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). In some embodiments, an organic light-emitting diode (OLED) display can be employed. If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, sliding, and gestures on the touch panel. The touch sensor may not only sense the boundary of the touch or slide action, but also detect the duration and pressure related to the touch or slide operation. In some embodiments, the multimedia component 208 includes a front camera and / or a rear camera. When the device for generating a haptic feedback 200 is in an operation mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have focal length and optical zoom capabilities.

[0091] The audio component 210 is configured to output and / or input audio signals. For example, the audio component 210 includes a microphone (MIC), and when the device for generating a haptic feedback 200 is in an operation mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive external audio signals. The received audio signal may be further stored in the memory 204 or transmitted via the communication component 216. In some embodiments, the audio component 210 further includes a speaker for outputting audio signals.

[0092] The I / O interface 212 provides an interface between the processing component 202 and a peripheral interface module. The peripheral interface module may be a keyboard, a click wheel, a button, and the like. The button includes but not limits to a home button, a volume button, a start button and a lock button.

[0093] The sensor component 214 includes one or more sensors for providing the device for generating a haptic feedback 200 with state evaluation in various aspects. For example, the sensor component 214 can detect the on / off state of the device for generating a haptic feedback 200 and the relative positioning of the components, for example, the component is the display and the keypad of the device for generating a haptic feedback 200. The sensor component 214 can also detect the position change of the device for generating a haptic feedback 200 or a component of the device for generating a haptic feedback 200; detect whether the user contacts the device for generating a haptic feedback 200; detect the orientation or acceleration / deceleration of the device for generating a haptic feedback 200, and the temperature change of the device for generating a haptic feedback 200. The sensor component 214 may include a proximity sensor configured to detect the presence of nearby objects when there is no physical contact. The sensor component 214 may also include a light sensor used for imaging application, such as a complementary metal oxide semiconductor (CMOS) or a charge coupled device (CCD) image sensor. In some embodiments, the sensor component 214 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor or a temperature sensor.

[0094] The communication component 216 is configured to facilitate wired or wireless communication between the device for generating a haptic feedback 200 and other devices. The device for generating a haptic feedback 200 can access a wireless network based on a communication standard, such as Wi-Fi, 2G, or 3G, 4G, 5G, or a combination thereof. In some embodiments, the communication component 216 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In some embodiments, the communication component 216 further includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0095] In some embodiments, the device for generating a haptic feedback 200 may be implemented by one or more application specific integrated circuits (ASIC), digital signal processors (DSP), digital signal processing devices (DSPD), programmable logic devices (PLD), field programmable gate array (FPGA), a controller, a microcontroller, a microprocessor, or other electronic components, to execute the foregoing method.

[0096] In some embodiments, there is further provided a non-transitory computer-readable storage medium including instructions, such as a memory 204 including instructions, which may be executed by the processor 220 of the device for generating a haptic feedback 200 to complete the foregoing method. For example, the non-transitory computer-readable storage medium may be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0097] It can be understood that the terms "plurality" used herein can refer to two or more, and other quantifiers can refer to two or more similarly. The terms "and / or" describes the association relationship of associated objects, indicating that there can be three types of relationships, for example, A and / or B, which can mean: only A, only B, both A and B. The character " / " generally indicates that the former associated object and the latter associated object are in an "or" relationship. The singular forms "a", "said" and "the" are also intended to include plural forms, unless the context clearly indicates other meanings.

[0098] It can be further understood that the terms "first", "second", etc. can be used to describe various information, but the information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other, and do not indicate a specific order or degree of importance. In fact, expressions such as "first" and "second" can be used interchangeably. For example, without departing from the scope of the present disclosure, the first information may also be referred to as second information, and similarly, the second information may also be referred to as first information.

[0099] In the drawings, same or similar reference numerals indicate same or similar elements or elements with same or similar functions. The described embodiments are a part of the embodiments of the present disclosure, but not all of the embodiments. The embodiments described below with reference to the drawings are exemplary, and are intended to explain the present disclosure, but should not be construed as limiting the present disclosure. All other embodiments that are obtained by those ordinary skilled in the art based on the embodiments in the present disclosure without paying creative work shall fall within the protection scope of the present disclosure. The embodiments of the present disclosure have been described in detail with reference to the accompanying drawings.

[0100] It can be further understood that, unless otherwise specified, "connection" may include a direct connection between two components without other components being inserted, or an indirect connection between two components with other elements being inserted.

[0101] Further, it can be understand that although the operations in the embodiments of the present disclosure are described in a specific order in the drawings, they should not be understood as requiring these operations to be performed in the specific order shown or in a serial order, or requiring perform all the shown operations to get the desired result. In certain circumstances, multitasking and parallel processing may be advantageous.

[0102] Other embodiments of the present disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the present disclosure disclosed herein. The present application is intended to cover any variations, uses, or adaptations of the present disclosure, which are in accordance with the general principles of the present disclosure and include common general knowledge or conventional technical means in the art that are not disclosed in the present disclosure. The specification and embodiments are illustrative, and the real scope of the present disclosure is defined by the appended claims.

[0103] It should be understood that the present disclosure is not limited to the precise structures that have been described above and shown in the drawings, and various modifications and changes can be made without departing from the scope thereof. The invention is defined by the appended claims.

Claims

1. A method for generating a haptic feedback, applied to a terminal, the method comprising: in response to an interface element on a display interface of the terminal being touched, determining a first interface element type corresponding to the interface element (S11); determining, based on a matchup between interface element types and haptic effects, a first haptic effect corresponding to the first interface element type, wherein different interface element types correspond to different haptic effects (S12); and generating a haptic feedback matching the first haptic effect (S13), wherein the matchup between interface element types and haptic effects is preconfigured by: determining an interface element control among the interface elements, and determining the interface element type corresponding to the interface element control, wherein different interface element types correspond to different interface element control types, and the interface element control types comprise at least one of: a text list, a button, a switch, and a slider (S21); and creating, for the interface element type, a haptic effect matching the interface element control type (S22), characterized by in response to determining that a same interface element control type comprises different control operation attributes, creating different haptic effects for different control operation attributes by creating an emphasized haptic effect for an emphasized control operation, and creating a normal haptic effect for a normal control operation, wherein the emphasized haptic effect corresponding to the emphasized control operation is a vibration with a higher vibration level, and the normal haptic effect corresponding to the normal control operation is a vibration with a weaker vibration level, wherein the emphasized control operation is recommended by the terminal to be operated by a user.

2. The method according to claim 1, wherein the terminal comprises a signal actuator, and the generating a haptic feedback matching the first haptic effect comprises: calling, based on the first haptic effect, a first haptic effect signal corresponding to the first haptic effect in a haptic effect signal database (S31); and controlling, based on the first haptic effect signal, the signal actuator to generate the haptic feedback matching the first haptic effect (S32).

3. The method according to claim 1, wherein prior to the determining a first interface element type corresponding to the interface element, the method further comprises: determining that the terminal is in a first operation mode (S41), wherein the first operation mode is an operation mode that is allowed to generate the haptic feedback.

4. A device for generating a haptic feedback, applied to a terminal and comprising: a processing unit (101), configured to: in response to an interface element on a display interface of the terminal being touched, determine a first interface element type corresponding to the interface element, and determine a first haptic effect corresponding to the first interface element type based on a matchup between interface element types and haptic effects, where different interface element types correspond to different haptic effects; and a haptic feedback unit (102), configured to generate a haptic feedback of the first haptic effect, wherein the processing unit (101) is further configured to predetermine the matchup between interface element types and haptic effects by: determining an interface element control among the interface elements, and determining the interface element type corresponding to the interface element control, wherein different interface element types correspond to different interface element control types, and the interface element control types comprise at least one of: a text list, a button, a switch, and a slider; creating, for the interface element type, a haptic effect matching the interface element control type, characterized by: in response to determining that a same interface element control type comprises different control operation attributes, creating different haptic effects for different control operation attributes by creating an emphasized haptic effect for an emphasized control operation, and creating a normal haptic effect for a normal control operation, wherein the emphasized haptic effect corresponding to the emphasized control operation is a vibration with a higher vibration level, and the normal haptic effect corresponding to the normal control operation is a vibration with a weaker vibration level, wherein the emphasized control operation is recommended by the terminal to be operated by a user.

5. The device according to claim 4, wherein the terminal comprises a signal actuator, and the processing unit (101) is further configured to generate a haptic feedback matching the first haptic effect by: calling, based on the first haptic effect, a first haptic effect signal corresponding to the first haptic effect in a haptic effect signal database; controlling, based on the first haptic effect signal, the signal actuator to generate the haptic feedback matching the first haptic effect.

6. The device according to claim 4, wherein the processing unit (101) is further configured to: determine that the terminal is in a first operation mode, wherein the first operation mode is an operation mode that is allowed to generate the haptic feedback.

7. A non-transitory computer-readable storage medium, wherein instructions in the storage medium that, when executed by a processor of a mobile terminal, cause the mobile terminal to execute the method of any one of claims 1 to 3.