Tactile signal generation method and apparatus, electronic device, chip, and medium
By acquiring a variety of signal attenuation information and generating accurate tactile signals, the problem of lack of interaction standards in the prior art is solved and the accuracy of the tactile signal model is improved.
Patent Information
- Application Number
- PCT/CN2024/135028
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-11-30
- Filing Date
- 2024-11-27
- Publication Date
- 2025-06-05
AI Technical Summary
The lack of interaction standards related to tactile signal in the prior art makes it difficult to generate accurate tactile signal models.
Generate more accurate tactile signals by obtaining signal attenuation information related to distance, time, occlusion, body parts and pressure.
The accuracy of the constructed tactile signal model is improved, making it more able to simulate the presentation of tactile signal in a real environment.
Smart Images

Figure CN2024135028_05062025_PF_FP_ABST
Abstract
Description
Method, device, electronic device, chip and medium for generating tactile signal
[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on November 30, 2023, with application number 202311644251.9 and invention name “Method, device, electronic device, chip and medium for generating tactile signals”, the entire contents of which are incorporated by reference into this application. Technical Field
[0002] The present application belongs to the field of computer technology, and specifically relates to a method, device, electronic device, chip, and medium for generating tactile signals. Background Art
[0003] The Graphical Language Transmit Format (glTF) is an open standard for transferring and loading 3D models. glTF defines an extensible publishing format that simplifies authoring workflows and interactive services by enabling interoperable use of 3D content across the industry.
[0004] However, there is no interaction standard related to tactile signals in the related art. Therefore, how to generate tactile signals to ensure the accuracy of the constructed tactile signal model is an issue that needs to be solved urgently. Summary of the Invention
[0005] The embodiments of the present application provide a method, device, electronic device, chip, and medium for generating a tactile signal, which can ensure the accuracy of a constructed tactile signal model.
[0006] In a first aspect, a method for generating a tactile signal is provided, comprising:
[0007] obtaining signal attenuation information of a tactile signal;
[0008] generating the tactile signal according to signal attenuation information of the tactile signal;
[0009] The signal attenuation information of the tactile signal includes at least one of the following:
[0010] distance-related signal attenuation information;
[0011] Time-dependent signal attenuation information;
[0012] Signal attenuation information related to occluders;
[0013] Signal attenuation information related to body parts;
[0014] Information on pressure-related signal attenuation.
[0015] In a second aspect, a device for generating a tactile signal is provided, comprising:
[0016] an acquiring unit, configured to acquire signal attenuation information of a tactile signal;
[0017] a generating unit, configured to generate the tactile signal according to signal attenuation information of the tactile signal;
[0018] The signal attenuation information of the tactile signal includes at least one of the following:
[0019] distance-related signal attenuation information;
[0020] Time-dependent signal attenuation information;
[0021] Signal attenuation information related to obstructions;
[0022] Signal attenuation information related to body parts;
[0023] Information on pressure-related signal attenuation.
[0024] In a third aspect, an electronic device is provided, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.
[0025] In a fourth aspect, a readable storage medium is provided, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.
[0026] In a fifth aspect, a chip is provided, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is configured to run a program or instruction to implement the method described in the first aspect.
[0027] In a sixth aspect, a computer program / program product is provided, which is stored in a storage medium and is executed by at least one processor to implement the steps of the method for generating tactile signals as described in the first aspect.
[0028] In an embodiment of the present application, when generating a tactile signal, signal attenuation information related to at least one of distance, time, obstructions, body parts and pressure is taken into account. Therefore, the generated tactile signal can more accurately simulate the presentation form of the tactile signal in the real environment, thereby improving the accuracy of the constructed tactile signal model. BRIEF DESCRIPTION OF THE DRAWINGS
[0029] FIG1 is a schematic diagram of a system architecture applicable to an embodiment of the present application.
[0030] Figure 2 is a hierarchical structure diagram of a glTF object.
[0031] FIG3 is a schematic diagram of a method for generating a tactile signal provided in an embodiment of the present application.
[0032] FIG4 is a schematic diagram of an attenuation method of a tactile signal provided in an embodiment of the present application.
[0033] FIG5 is a schematic diagram of a device for generating a tactile signal provided in an embodiment of the present application.
[0034] FIG6 is a schematic diagram of an electronic device provided in an embodiment of the present application.
[0035] FIG7 is a schematic diagram of another electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0036] The following will be combined with the accompanying drawings in the embodiments of this application to clearly describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field are within the scope of protection of this application.
[0037] The terms "first", "second", etc. in this application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the terms used in this way are interchangeable where appropriate, so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first" and "second" are generally of the same type, and do not limit the number of objects, for example, the first object can be one or more. In addition, "or" in this application represents at least one of the connected objects. For example, "A or B" covers three options, namely, Option 1: including A but not including B; Option 2: including B but not including A; Option 3: including both A and B. The character " / " generally indicates that the objects associated before and after are in an "or" relationship.
[0038] FIG1 is a schematic diagram of an application scenario of a method for generating a tactile signal applicable to an embodiment of the present application. As shown in FIG1 , the method can be applied to a system architecture consisting of a terminal 110 and a server 120 , wherein the terminal 110 and the server 120 are connected via a network.
[0039] In one possible implementation, the terminal 110 may be any electronic product that can perform human-computer interaction with a user through one or more methods such as a keyboard, a touchpad, a touch screen, a remote controller, voice interaction, or a handwriting device.
[0040] Exemplarily, the terminal may include but is not limited to the above-mentioned mobile phones, tablet personal computers, laptop computers, notebook computers, personal digital assistants (PDAs), handheld computers, netbooks, ultra-mobile personal computers (UMPCs), mobile Internet devices (MIDs), augmented reality (AR), virtual reality (VR) devices, robots, wearable devices, flight vehicles, vehicle user equipment (VUE), shipborne equipment, pedestrian user equipment (PUE), smart homes (home appliances with wireless communication capabilities, such as refrigerators, televisions, washing machines or furniture, etc.), game consoles, personal computers (PCs), ATMs or self-service machines and other terminal-side devices. Wearable devices include: smart watches, smart bracelets, smart headphones, smart glasses, smart jewelry (smart bracelets, smart bracelets, smart rings, smart necklaces, smart anklets, smart anklets, etc.), smart wristbands, smart clothing, etc. Among them, vehicle-mounted equipment can also be called vehicle-mounted terminals, vehicle-mounted controllers, vehicle-mounted modules, vehicle-mounted components, vehicle-mounted chips, or vehicle-mounted units.
[0041] In one possible implementation, server 120 can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDNs), and big data and artificial intelligence platforms.
[0042] Exemplarily, the server may be an object storage service platform, or a network attached storage (NAS).
[0043] In some embodiments, the terminal 110 and the server 120 may be connected directly or indirectly via a wired or wireless manner, which is not limited in this application.
[0044] The method for generating a tactile signal according to the embodiment of the present application can be executed by the terminal 110, or by the server 120, or by both the server and the terminal. When executed by the terminal 110, it can be executed by a client installed on the terminal 110.
[0045] It should be understood that the above-mentioned terminal 110 and server 120 are only examples. Other existing or future possible implementations of terminals or servers, if applicable to this application, should also be included in the scope of protection of this application and included here by reference.
[0046] To facilitate understanding of the embodiments of the present application, the interactive extension technology related to the present application is described.
[0047] The Graphical Language Transmit Format (glTF) is an open standard for transmitting and loading 3D models. It aims to provide a lightweight, efficient, and scalable 3D model format for fast loading and rendering on platforms such as engines and mobile devices. The glTF format supports a variety of 3D model elements, including geometry, materials, textures, animations, and scenes. Due to its openness and efficiency, the glTF format has been widely adopted in engines and mobile devices, becoming a key standard for transmitting and loading 3D models.
[0048] Figure 2 shows a schematic diagram of the structure of a glTF file. As can be seen, the glTF file includes multiple object nodes.
[0049] For example, the scene is the entry point of the glTF file. A gltf file may store multiple scenes, each of which contains one or more nodes. The node points to the mesh, camera, and skin, and is used to describe the various deformations of the node. Mesh: represents the geometric objects in the scene. Camera: used to define the view configuration of the rendered scene; skin is bound to the animation. Accessor is used as an abstract source of data and can be accessed by mesh, skin, and animation, and provides geometric data, skin parameters, and animation values that change over time. Material is the appearance object when the geometric object is rendered, which is used to define the appearance parameters of the geometric object. Animation: used to define the changes of the node (such as rotation and translation); Texture: contains sampler and image, which together define how to map the texture to the model, among which images are used to locate the image resource; sampler: used to define the sampling and filtering method of the image. BufferView is used to get real data from the buffer.
[0050] In related technologies, the Moving Pictures Experts Group (MPEG) interactively extended glTF and designed relevant standards for interactivity.
[0051] Interactivity is defined based on behavior, which includes a trigger node and an action node. The trigger conditions for a trigger node include collision conditions, proximity conditions, and visibility conditions. Actions include tactile feedback actions (i.e., ACTION_SET_HAPTIC) and activation actions (ACTION_ACTIVATE).
[0052] However, there is no interaction standard related to tactile signals in the prior art. Therefore, how to describe tactile signals is an urgent problem to be solved.
[0053] The method for generating tactile signals provided by the embodiments of the present application will be described in detail below with reference to some embodiments and their application scenarios in conjunction with the accompanying drawings.
[0054] FIG3 is a schematic diagram of a method for generating a tactile signal according to an embodiment of the present application. As shown in FIG3 , the method 300 includes at least part of the following:
[0055] S310, obtaining signal attenuation information of a tactile signal;
[0056] S320: Generate the tactile signal according to the signal attenuation information of the tactile signal.
[0057] In some embodiments, signal attenuation information of a haptic signal is used to describe the interaction between a haptic source and an avatar (or an object executing the haptic signal). Therefore, a haptic signal can be generated based on the signal attenuation information of the haptic signal.
[0058] In some embodiments, the method may be executed by an electronic device, for example, by the terminal 110 in FIG. 1 , or by the server 120 in FIG. 1 , which is not limited in this application.
[0059] In some embodiments, the signal attenuation information of the haptic signal includes at least one of the following:
[0060] distance-related signal attenuation information;
[0061] Time-dependent signal attenuation information;
[0062] Signal attenuation information related to occluders;
[0063] Signal attenuation information related to body parts;
[0064] Information on pressure-related signal attenuation.
[0065] That is, in the embodiment of the present application, when constructing the tactile signal model, the signal attenuation related to at least one factor among distance, time, obstructions, body parts and pressure is taken into account, which is conducive to ensuring that the tactile signal model provided by the embodiment of the present application can more accurately simulate the presentation form of the tactile signal in the real environment, thereby improving the accuracy of the tactile signal model.
[0066] It should be understood that the present application does not limit the type of tactile signal. For example, the tactile signal may be triggered by vibration, heat, wind, rain, etc.
[0067] In some embodiments, the signal attenuation information of the tactile signal is carried in a first object. For example, the first object includes at least one of the following:
[0068] The tactile source object corresponding to the tactile signal, the avatar object corresponding to the tactile signal, the trigger node object corresponding to the tactile signal, the action node object (or trigger action object, i.e., HapticActionNode object) corresponding to the tactile signal, and the occlusion object corresponding to the tactile signal.
[0069] In some embodiments, signal attenuation information of the haptic signal may be carried in the attribute information of the first object.
[0070] It should be understood that the signal attenuation information of the haptic signal can be carried in the same object, or in multiple objects, and this application is not limited to this. For example, part of the signal attenuation information of the haptic signal can be carried in the haptic source object, and the remaining information can be carried in the action node object.
[0071] In some embodiments, the first object may be a glTF object.
[0072] In some embodiments, when the signal attenuation information of the tactile signal is carried in a trigger action node object, the signal attenuation information of the tactile signal can be carried in a child node of the trigger action node object, for example, carried in a trigger action media object (HapticActionMedia object), wherein the trigger action media object points to a tactile data file object, for example, the trigger action media object includes address information of the tactile data file.
[0073] In some embodiments of the present application, the S310 includes:
[0074] Get the first object;
[0075] The first object is analyzed to obtain signal attenuation information of the tactile signal.
[0076] In some embodiments, the first object can be obtained locally by the tactile signal generating device, or it can be obtained from other devices, such as from a server, which can be, for example, an object storage service platform, or a network attached storage (NAS).
[0077] In some embodiments of the present application, the S320 includes:
[0078] The haptic signal is rendered according to the signal attenuation information of the haptic signal.
[0079] In some embodiments, the haptic signal generating device may include a rendering engine (presentation engine), which may render the haptic signal according to signal attenuation information of the haptic signal.
[0080] In some embodiments, the first object is associated with one or more scenes. Rendering the haptic signal may include rendering the haptic signal in the scene associated with the first object.
[0081] For example, in the scene where the first object is located, the tactile source and the tactile signal execution object (i.e., the avatar) are rendered, the distance between the tactile source and the tactile signal execution object is determined, and whether there is an obstruction between the tactile source and the tactile signal execution object is determined, and then the tactile signal is rendered based on the signal attenuation information related to the distance and the signal attenuation information related to the obstruction.
[0082] For another example, in the scene where the first object is located, the haptic source and the haptic signal execution object (ie, the avatar) are rendered, and the haptic signal is rendered according to the triggering time of the haptic signal and the time-related signal attenuation information.
[0083] For another example, in the scene where the first object is located, the tactile source and the tactile signal execution object (ie, avatar) are rendered, and tactile signals of different body parts of the tactile signal execution object are rendered according to signal attenuation information related to the body parts.
[0084] For another example, in the scene where the first object is located, the tactile source and the tactile signal execution object (i.e., the avatar) are rendered, and the tactile signal felt by the tactile signal execution object is rendered based on the force with which the tactile signal execution object contacts or presses the tactile source and combined with the signal attenuation information related to pressure.
[0085] The following describes the specific implementations of the above-mentioned signal attenuation information in conjunction with specific embodiments.
[0086] Example 1: Distance-related signal attenuation information
[0087] In some embodiments, the distance-related signal attenuation information can be used to characterize the signal attenuation caused by distance factors. For example, the shock or heat energy caused by an explosion will attenuate as the distance from the explosion center increases.
[0088] In some embodiments, the distance-related signal attenuation information includes but is not limited to at least one of the following:
[0089] a signal attenuation parameter, used to determine an attenuation amount of the tactile signal;
[0090] an indication of a signal attenuation manner of the tactile signal;
[0091] an enable or disable indication, used to indicate whether to enable the distance-related signal attenuation information when generating the tactile signal;
[0092] The tactile signal type indication is used to indicate the type of the tactile signal to which the distance-related signal attenuation information is applicable.
[0093] Exemplarily, each information in the distance-related signal attenuation information may be carried in at least one of the following objects:
[0094] The tactile source object corresponding to the tactile signal, the avatar object corresponding to the tactile signal, the trigger node object corresponding to the tactile signal, and the action node object corresponding to the tactile signal (for example, carried in a child node of the action node object, such as a trigger action media object).
[0095] In some embodiments, the signal attenuation manner of the haptic signal is indicated to indicate at least one of the following manners:
[0096] Attenuation is performed by a fixed attenuation amount, attenuation is performed based on a preset signal attenuation method (for example, based on a preset signal attenuation formula), or attenuation is performed based on a user-defined signal attenuation method (for example, based on a user-defined signal attenuation formula).
[0097] In some embodiments, when there are multiple preset signal attenuation methods, the signal attenuation method indication of the tactile signal can also indicate a target preset signal attenuation method among the multiple preset signal attenuation methods, for example, indicating a target signal attenuation formula among multiple preset signal attenuation formulas.
[0098] In some embodiments, the plurality of preset signal attenuation modes include but are not limited to at least one of the following:
[0099] Inverse distance decay method, linear distance decay method, exponential distance decay method, inverse square decay method.
[0100] In some embodiments, for the inverse distance attenuation method, the following formula (also called the inverse distance attenuation formula) can be used to determine the feedback intensity ida(d,md,rf) of the tactile signal:
[0101] Where md is the maximum distance, rf is the roll factor, rd is the reference distance, and d is the distance for calculating range gain.
[0102] In some embodiments, for the linear distance attenuation method, the following formula (also called the linear distance attenuation formula) can be used to determine the feedback intensity lda(d,md,rf) of the tactile signal:
[0103] Where md is the maximum distance, rf is the roll factor, rd is the reference distance, and d is the distance for calculating range gain.
[0104] In some embodiments, for the exponential distance decay method, the following formula (also called the exponential distance decay formula) can be used to determine the feedback intensity eda(d,md,rf) of the tactile signal:
[0105] Where md is the maximum distance, rf is the roll factor, rd is the reference distance, and d is the distance for calculating range gain.
[0106] In some embodiments, the signal attenuation parameter may include one of the following parameters:
[0107] Attenuation coefficient α, initial tactile feedback strength F obtained from the tactile source max ;
[0108] The attenuation coefficient is inversely proportional to the square of the distance. For example, when the distance R from the tactile source is within the target range (e.g., D min <R≤D max ), the attenuation coefficient is inversely proportional to the square of the distance.
[0109] In some embodiments, the S320 may include:
[0110] determining a feedback intensity of the tactile signal according to the signal attenuation parameter;
[0111] The haptic signal is generated according to the feedback strength of the haptic signal.
[0112] For example, the feedback intensity F of the tactile signal is determined according to the following formula: F=αF max
[0113] Where α is the attenuation coefficient, F max Indicates the initial feedback strength obtained from the tactile source;
[0114] Among them, the change function of α can be expressed as:
[0115] Among them, α min is the minimum value of the attenuation coefficient, D min and D min is a predefined value.
[0116] That is, within a certain distance range, for example, less than D min Within the range, it can be considered that the feedback intensity of the tactile signal does not decay, that is, the attenuation coefficient α is set to 1. After exceeding a certain distance range, for example, greater than Dmax , the attenuation coefficient α is set to 0.
[0117] In some embodiments,
[0118] The relationship between the feedback strength of the tactile signal and the distance obtained by this function is shown in FIG4 , wherein the feedback strength of the tactile signal is a monotonically decreasing interval between the minimum and maximum distance values.
[0119] In some embodiments, the customized signal attenuation method may be a signal attenuation method customized by the device manufacturer, that is, not a signal attenuation method specified by the standard.
[0120] In some embodiments, the signal attenuation parameter includes a fixed attenuation amount.
[0121] For example, when using a fixed attenuation, a target attenuation for signal attenuation may be further indicated. For example, the fixed attenuation may be infinite, 0, or any other value. Alternatively, the target attenuation for signal attenuation may not be indicated. In this case, signal attenuation is performed based on a default attenuation, which may be predefined or user-set.
[0122] In some embodiments, when a preset signal attenuation method is adopted for attenuation, the signal attenuation parameter includes a parameter used to calculate the attenuation amount of the tactile signal based on a target preset signal attenuation method.
[0123] For example, when attenuation is performed based on a preset signal attenuation method, the signal attenuation parameter may be carried in a first object, such as a tactile source object or an action node object.
[0124] In some embodiments, when the inverse distance decay method, the linear distance decay method, or the exponential distance decay method is used, the signal attenuation parameter may include at least one of the following parameters:
[0125] md represents the maximum distance, rf represents the roll factor, rd represents the reference distance, and d represents the distance for calculating the range gain.
[0126] In some embodiments, when the inverse square attenuation method is adopted, the signal attenuation parameter may include at least one of the following parameters:
[0127] α, represents the attenuation coefficient that changes with distance R, D min 、D max .
[0128] Optionally, when there are multiple preset signal attenuation modes, the signal attenuation mode indication is used to indicate the target signal attenuation mode among the multiple preset signal attenuation modes and the signal attenuation parameters involved in the target signal attenuation mode. The signal attenuation mode indication and the signal attenuation parameters can both be carried in a first object, such as a tactile source object or an action node object.
[0129] In some embodiments, when based on a customized signal attenuation method, the signal attenuation information of the haptic signal may include a customized signal attenuation parameter.
[0130] In some embodiments, the enable or disable indication is used to indicate whether to enable the distance-related signal attenuation information (or, whether to enable the signal attenuation parameter and / or signal attenuation mode indication) when generating the tactile signal, or to determine whether to consider the signal attenuation caused by the distance factor when generating the tactile signal.
[0131] In some embodiments, when the enable or disable indication is used to indicate enabling of the distance-related signal attenuation information, the distance-related signal attenuation information is considered when generating the haptic signal. When the distance-related signal attenuation information is disabled, the distance-related signal attenuation information is not considered when generating the haptic signal.
[0132] In some embodiments, the tactile signal type indication is used to indicate the type of tactile signal to which the distance-related signal attenuation information applies.
[0133] In some embodiments, signal attenuation due to distance factors may only be effective for specific types of tactile signals (e.g., vibration, thermal energy), or in other words, only for specific types of trigger sources, such as vibration, thermal energy, etc. Therefore, when describing the signal attenuation information due to distance factors, the applicable tactile signal type can be added. In this way, for tactile signals of this tactile signal type, the signal attenuation information can be used to generate a tactile signal, which helps ensure the accuracy of the tactile signal model.
[0134] Example 2: Time-dependent signal attenuation information
[0135] In some embodiments, the time-related signal attenuation information can be used to characterize the signal attenuation caused by time factors. For example, the shock or temperature caused by an explosion will decay over time.
[0136] In some embodiments, the time-dependent signal attenuation information includes at least one of the following:
[0137] a signal attenuation parameter, used to determine an attenuation amount of the tactile signal;
[0138] an indication of a signal attenuation manner of the tactile signal;
[0139] an enable or disable indication, used to indicate whether to enable the time-related signal attenuation information when generating the tactile signal;
[0140] The tactile signal type indication is used to indicate the type of the tactile signal to which the time-related signal attenuation information is applicable.
[0141] Exemplarily, each information in the time-related signal attenuation information may be carried in at least one of the following objects:
[0142] The tactile source object corresponding to the tactile signal, the avatar object corresponding to the tactile signal, the trigger node object corresponding to the tactile signal, and the action node object corresponding to the tactile signal (for example, carried in a child node of the action node object, such as a trigger action media object).
[0143] In some embodiments, the signal attenuation manner of the haptic signal is indicated to indicate at least one of the following manners:
[0144] Attenuation is performed by a fixed attenuation amount, attenuation is performed based on a preset signal attenuation method (for example, based on a preset signal attenuation formula), or attenuation is performed based on a user-defined signal attenuation method (for example, based on a user-defined signal attenuation formula).
[0145] In some embodiments, when there are multiple preset signal attenuation methods, the signal attenuation method indication of the tactile signal can also indicate a target preset signal attenuation method among the multiple preset signal attenuation methods, for example, indicating a target signal attenuation formula among multiple preset signal attenuation formulas.
[0146] In some embodiments, the customized signal attenuation method may be a signal attenuation method customized by the device manufacturer, that is, not a signal attenuation method specified by the standard.
[0147] In some embodiments, the signal attenuation parameter includes a fixed attenuation amount.
[0148] For example, when using a fixed attenuation, a target attenuation for signal attenuation may be further indicated. For example, the fixed attenuation may be infinite, 0, or any other value. Alternatively, the target attenuation for signal attenuation may not be indicated. In this case, signal attenuation is performed based on a default attenuation, which may be predefined or user-set.
[0149] In some embodiments, when a preset signal attenuation method is adopted for attenuation, the signal attenuation parameter includes a parameter used to calculate the attenuation amount of the tactile signal based on a target preset signal attenuation method.
[0150] For example, when attenuation is performed based on a preset signal attenuation method, the signal attenuation parameter may be carried in a first object, such as a tactile source object or an action node object.
[0151] Optionally, when there are multiple preset signal attenuation modes, the signal attenuation mode indication is used to indicate the target signal attenuation mode among the multiple preset signal attenuation modes and the signal attenuation parameters involved in the target signal attenuation mode. The signal attenuation mode indication and the signal attenuation parameters can both be carried in a first object, such as a tactile source object or an action node object.
[0152] In some embodiments, when based on a customized signal attenuation method, the signal attenuation information of the haptic signal may include a customized signal attenuation parameter.
[0153] In some embodiments, the enable or disable indication is used to indicate whether to enable the time-related signal attenuation information (or, whether to enable the signal attenuation parameter and / or signal attenuation mode indication) when generating the tactile signal, or to determine whether to consider the signal attenuation caused by the time factor when generating the tactile signal.
[0154] In some embodiments, when the enable or disable indication indicates enabling of the time-dependent signal attenuation information, the time-dependent signal attenuation information is considered when generating the haptic signal. When the time-dependent signal attenuation information is disabled, the time-dependent signal attenuation information is not considered when generating the haptic signal.
[0155] In some embodiments, the haptic signal type indication is used to indicate the type of the haptic signal to which the time-related signal attenuation information applies.
[0156] In some embodiments, signal attenuation due to time factors may only be effective for specific types of haptic signals (e.g., vibration, thermal energy), or in other words, only for specific types of trigger sources, such as vibration, thermal energy, etc. Therefore, when describing the signal attenuation information due to time factors, the applicable haptic signal type can be added. In this way, for haptic signals of this haptic signal type, this signal attenuation information can be used to generate a haptic signal, which helps ensure the accuracy of the haptic signal model.
[0157] Example 3: Signal attenuation information related to obstructions
[0158] In some embodiments, the signal attenuation information related to the obstruction may be used to characterize the signal attenuation caused by the obstruction. For example, an obstruction such as a wall may block the vibration or heat energy caused by an explosion.
[0159] In some embodiments, the signal attenuation information related to the obstruction includes at least one of the following:
[0160] a signal attenuation parameter, used to determine an attenuation amount of the tactile signal;
[0161] an indication of a signal attenuation manner of the tactile signal;
[0162] an enable or disable indication, used to indicate whether to enable the signal attenuation information related to the obstruction when generating the tactile signal;
[0163] The tactile signal type indication is used to indicate the type of tactile signal to which the signal attenuation information related to the obstruction is applicable.
[0164] Exemplarily, each information in the signal attenuation information related to the obstruction may be carried in at least one of the following objects:
[0165] The tactile source object corresponding to the tactile signal, the avatar object corresponding to the tactile signal, the trigger node object corresponding to the tactile signal, the action node object corresponding to the tactile signal, and the occlusion object corresponding to the tactile signal (for example, carried in the child node of the action node object, such as the trigger action media object).
[0166] In some embodiments, the signal attenuation manner of the haptic signal is indicated to indicate at least one of the following manners:
[0167] Attenuation is performed by a fixed attenuation amount, attenuation is performed based on a preset signal attenuation method (for example, based on a preset signal attenuation formula), or attenuation is performed based on a user-defined signal attenuation method (for example, based on a user-defined signal attenuation formula).
[0168] In some embodiments, when there are multiple preset signal attenuation methods, the signal attenuation method indication of the tactile signal can also indicate a target preset signal attenuation method among the multiple preset signal attenuation methods, for example, indicating a target signal attenuation formula among multiple preset signal attenuation formulas.
[0169] In some embodiments, the customized signal attenuation method may be a signal attenuation method customized by the device manufacturer, that is, not a signal attenuation method specified by the standard.
[0170] In some embodiments, the signal attenuation parameter includes a fixed attenuation amount.
[0171] For example, when using a fixed attenuation, a target attenuation for signal attenuation may be further indicated. For example, the fixed attenuation may be infinite, 0, or any other value. Alternatively, the target attenuation for signal attenuation may not be indicated. In this case, signal attenuation is performed based on a default attenuation, which may be predefined or user-set.
[0172] In some embodiments, when a preset signal attenuation method is adopted for attenuation, the signal attenuation parameter includes a parameter used to calculate the attenuation amount of the tactile signal based on a target preset signal attenuation method.
[0173] For example, when attenuation is performed based on a preset signal attenuation method, the signal attenuation parameter may be carried in a first object, such as a tactile source object or an action node object.
[0174] Optionally, when there are multiple preset signal attenuation modes, the signal attenuation mode indication is used to indicate the target signal attenuation mode among the multiple preset signal attenuation modes and the signal attenuation parameters involved in the target signal attenuation mode. The signal attenuation mode indication and the signal attenuation parameters can both be carried in a first object, such as a tactile source object or an action node object.
[0175] In some embodiments, when based on a customized signal attenuation method, the signal attenuation information of the haptic signal may include a customized signal attenuation parameter.
[0176] In some embodiments, the enable or disable indication is used to indicate whether to enable the signal attenuation information related to the obstruction (or, whether to enable the signal attenuation parameter and / or signal attenuation mode indication) when generating the tactile signal, or to determine whether to consider the signal attenuation caused by the obstruction when generating the tactile signal.
[0177] In some embodiments, when the enable or disable indication indicates enabling of signal attenuation information related to an obstruction, the signal attenuation information related to the obstruction is considered when generating a haptic signal. When the signal attenuation information related to the obstruction is disabled, the signal attenuation information related to the obstruction is not considered when generating a haptic signal.
[0178] In some embodiments, the tactile signal type indication is used to indicate the type of tactile signal to which the signal attenuation information related to the obstruction is applicable.
[0179] In some embodiments, signal attenuation due to obstructions may only be effective for specific types of tactile signals (e.g., vibration, thermal energy), or in other words, only for specific types of trigger sources, such as vibration, thermal energy, etc. Therefore, when describing the signal attenuation information due to obstructions, the applicable tactile signal type can be added. In this way, for tactile signals of this tactile signal type, this signal attenuation information can be used to generate a tactile signal, which helps ensure the accuracy of the tactile signal model.
[0180] In some embodiments, the attribute information of the first object includes an occluder indication, where the occluder indication is used to indicate whether the first object is an occluder. For example, if the first object is an occluder, the haptic signal is generated based on the signal attenuation information related to the occluder. If the first object is not an occluder, the signal attenuation information related to the occluder is not considered when generating the haptic signal.
[0181] Example 4: Signal attenuation information related to body parts
[0182] In some embodiments, the body part-related signal attenuation information can be used to characterize the signal attenuation caused by the tactile sensitivity of different body parts. For example, different body parts have different tactile sensitivities, such as fingertips being more sensitive and the back of the hand being less sensitive. Therefore, the tactile signals perceived by different body parts are also different.
[0183] In some embodiments, the signal attenuation information related to the body part includes at least one of the following:
[0184] a signal attenuation parameter, used to determine an attenuation amount of the tactile signal;
[0185] an indication of a signal attenuation manner of the tactile signal;
[0186] an enable or disable indication, used to indicate whether to enable the signal attenuation information related to the body part when generating the tactile signal;
[0187] a tactile signal type indication, used to indicate the type of tactile signal to which the signal attenuation information related to the body part is applicable;
[0188] A body part identifier is used to indicate the body part used for the signal attenuation parameter or the signal attenuation mode indication.
[0189] Exemplarily, each piece of information in the signal attenuation information related to a body part may be carried in at least one of the following objects:
[0190] The tactile source object corresponding to the tactile signal, the avatar object corresponding to the tactile signal, the trigger node object corresponding to the tactile signal, and the action node object corresponding to the tactile signal (for example, carried in a child node of the action node object, such as a trigger action media object).
[0191] In some embodiments, the signal attenuation manner of the haptic signal is indicated to indicate at least one of the following manners:
[0192] Attenuation is performed by a fixed attenuation amount, attenuation is performed based on a preset signal attenuation method (for example, based on a preset signal attenuation formula), or attenuation is performed based on a user-defined signal attenuation method (for example, based on a user-defined signal attenuation formula).
[0193] In some embodiments, when there are multiple preset signal attenuation methods, the signal attenuation method indication of the tactile signal can also indicate a target preset signal attenuation method among the multiple preset signal attenuation methods, for example, indicating a target signal attenuation formula among multiple preset signal attenuation formulas.
[0194] In some embodiments, the customized signal attenuation method may be a signal attenuation method customized by the device manufacturer, that is, not a signal attenuation method specified by the standard.
[0195] In some embodiments, the signal attenuation parameter includes a fixed attenuation amount.
[0196] For example, when using a fixed attenuation, a target attenuation for signal attenuation may be further indicated. For example, the fixed attenuation may be infinite, 0, or any other value. Alternatively, the target attenuation for signal attenuation may not be indicated. In this case, signal attenuation is performed based on a default attenuation, which may be predefined or user-set.
[0197] In some embodiments, when a preset signal attenuation method is adopted for attenuation, the signal attenuation parameter includes a parameter used to calculate the attenuation amount of the tactile signal based on a target preset signal attenuation method.
[0198] For example, when attenuation is performed based on a preset signal attenuation method, the signal attenuation parameter may be carried in a first object, such as a tactile source object or an action node object.
[0199] Optionally, when there are multiple preset signal attenuation modes, the signal attenuation mode indication is used to indicate the target signal attenuation mode among the multiple preset signal attenuation modes and the signal attenuation parameters involved in the target signal attenuation mode. The signal attenuation mode indication and the signal attenuation parameters can both be carried in a first object, such as a tactile source object or an action node object.
[0200] In some embodiments, when based on a customized signal attenuation method, the signal attenuation information of the haptic signal may include a customized signal attenuation parameter.
[0201] In some embodiments, the enable or disable indication is used to indicate whether to enable the signal attenuation information related to the body part (or, whether to enable the signal attenuation parameter and / or signal attenuation mode indication) when generating the tactile signal, or to determine whether to consider the signal attenuation caused by the body part when generating the tactile signal.
[0202] In some embodiments, when the enable or disable indication is used to indicate enabling of the signal attenuation information related to the body part, the signal attenuation information related to the body part is considered when generating the haptic signal. When the signal attenuation information related to the body part is disabled, the signal attenuation information related to the body part is not considered when generating the haptic signal.
[0203] In some embodiments, the tactile signal type indication is used to indicate the type of tactile signal to which the signal attenuation information related to the body part is applicable.
[0204] In some embodiments, signal attenuation due to body part factors may only be effective for specific types of tactile signals (e.g., thermal energy), or in other words, only for specific types of trigger sources, such as thermal energy. Therefore, when describing the signal attenuation information due to body part factors, the applicable tactile signal type can be added. In this way, for tactile signals of this tactile signal type, this signal attenuation information can be used to generate a tactile signal, which helps ensure the accuracy of the tactile signal model.
[0205] In some embodiments, the body part identifier is used to indicate the body part used for the signal attenuation parameter and / or the signal attenuation mode indication. Optionally, the body part-related signal attenuation information may include at least one body part-related signal attenuation information.
[0206] For example, the sensitivity value S of each body part of the tactile signal execution object is set, for example, the value range is [0.0, 1.0], which is used to describe the ratio of the feedback strength of the tactile signal felt by this body part, and the final perceived feedback strength F of the tactile signal p =S*F, where F is the original feedback strength value.
[0207] Example 5: Signal attenuation information related to pressure
[0208] In some embodiments, different contact or pressure granularity may result in different signal attenuation or enhancement. The pressure-related signal attenuation information can be used to characterize the signal attenuation or enhancement caused by different pressures. For example, the greater the pressure (the degree of deformation), the stronger the tactile signal.
[0209] In some embodiments, the pressure-related signal attenuation information includes at least one of the following:
[0210] a signal attenuation parameter, used to determine an attenuation amount of the tactile signal;
[0211] an indication of a signal attenuation manner of the tactile signal;
[0212] an enable or disable indication, used to indicate whether to enable the pressure-related signal attenuation information when generating the tactile signal;
[0213] The tactile signal type indication is used to indicate the type of the tactile signal to which the pressure-related signal attenuation information is applicable.
[0214] Exemplarily, each piece of information in the signal attenuation information related to a body part may be carried in at least one of the following objects:
[0215] The tactile source object corresponding to the tactile signal, the avatar object corresponding to the tactile signal, the trigger node object corresponding to the tactile signal, and the action node object corresponding to the tactile signal (for example, carried in a child node of the action node object, such as a trigger action media object).
[0216] In some embodiments, the signal attenuation manner of the haptic signal is indicated to indicate at least one of the following manners:
[0217] Attenuation is performed by a fixed attenuation amount, attenuation is performed based on a preset signal attenuation method (for example, based on a preset signal attenuation formula), or attenuation is performed based on a user-defined signal attenuation method (for example, based on a user-defined signal attenuation formula).
[0218] In some embodiments, when there are multiple preset signal attenuation methods, the signal attenuation method indication of the tactile signal can also indicate a target preset signal attenuation method among the multiple preset signal attenuation methods, for example, indicating a target signal attenuation formula among multiple preset signal attenuation formulas.
[0219] In some embodiments, the customized signal attenuation method may be a signal attenuation method customized by the device manufacturer, that is, not a signal attenuation method specified by the standard.
[0220] In some embodiments, the signal attenuation parameter includes a fixed attenuation amount.
[0221] For example, when using a fixed attenuation, a target attenuation for signal attenuation may be further indicated. For example, the fixed attenuation may be infinite, 0, or any other value. Alternatively, the target attenuation for signal attenuation may not be indicated. In this case, signal attenuation is performed based on a default attenuation, which may be predefined or user-set.
[0222] In some embodiments, when a preset signal attenuation method is adopted for attenuation, the signal attenuation parameter includes a parameter used to calculate the attenuation amount of the tactile signal based on a target preset signal attenuation method.
[0223] For example, when attenuation is performed based on a preset signal attenuation method, the signal attenuation parameter may be carried in a first object, such as a tactile source object or an action node object.
[0224] Optionally, when there are multiple preset signal attenuation modes, the signal attenuation mode indication is used to indicate the target signal attenuation mode among the multiple preset signal attenuation modes and the signal attenuation parameters involved in the target signal attenuation mode. The signal attenuation mode indication and the signal attenuation parameters can both be carried in a first object, such as a tactile source object or an action node object.
[0225] In some embodiments, when based on a customized signal attenuation method, the signal attenuation information of the haptic signal may include a customized signal attenuation parameter.
[0226] In some embodiments, the enable or disable indication is used to indicate whether to enable the pressure-related signal attenuation information (or, whether to enable the signal attenuation parameter and / or signal attenuation mode indication) when generating the tactile signal, or to determine whether to consider the signal attenuation caused by pressure when generating the tactile signal.
[0227] In some embodiments, when the enable or disable indication is used to indicate enabling of pressure-related signal attenuation information, the pressure-related signal attenuation information is considered when generating a tactile signal. When the body part-related signal attenuation information is disabled, the pressure-related signal attenuation information is not considered when generating a tactile signal.
[0228] In some embodiments, the tactile signal type indication is used to indicate the type of the tactile signal to which the pressure-related signal attenuation information applies.
[0229] It should be understood that in the above embodiments 1-5, the signal attenuation type indications may be the same or different.
[0230] In some embodiments, the signal attenuation parameter is associated with at least one of the following: the type of the haptic signal; or the frequency of the haptic signal. For example, the signal attenuation parameter is valid only for a specific type of haptic signal. For another example, the signal attenuation parameter is valid only for haptic signals within a certain frequency range, or different signal attenuation parameters are associated with haptic signals within different frequency ranges.
[0231] For example, the association between the haptic signal type and the signal attenuation parameter can also be carried in the first object, such as in the haptic source object or the action node object, for example, in the form of a <haptic signal type, signal attenuation parameter> tuple.
[0232] For another example, the association between the frequency of the haptic signal and the signal attenuation parameter can also be carried in the first object, such as in the haptic source object or action node object, for example, in the form of a <haptic signal frequency, signal attenuation parameter> tuple.
[0233] In summary, in the embodiment of the present application, when generating a tactile signal, signal attenuation information related to at least one factor among distance, time, obstructions, body parts and pressure is taken into account. Therefore, the tactile signal generated by the embodiment of the present application can more accurately simulate the presentation form of the tactile signal in the real environment, thereby improving the accuracy of the constructed tactile signal model.
[0234] The above text, in combination with Figures 3 to 4, describes in detail the method embodiment of the present application. The following text, in combination with Figures 5 to 7, describes in detail the device embodiment of the present application. It should be understood that the device embodiment and the method embodiment correspond to each other, and similar descriptions can refer to the method embodiment.
[0235] The method for generating a tactile signal provided in the embodiment of the present application can be performed by a device for generating a tactile signal. In the embodiment of the present application, the device for generating a tactile signal performing the method for generating a tactile signal is used as an example to illustrate the device for generating a tactile signal provided in the embodiment of the present application.
[0236] FIG5 shows a schematic block diagram of an apparatus 500 for generating a tactile signal according to an embodiment of the present application. As shown in FIG5 , the apparatus 500 includes:
[0237] an acquiring unit 510, configured to acquire signal attenuation information of a tactile signal;
[0238] a generating unit 520, configured to generate the tactile signal according to the signal attenuation information of the tactile signal;
[0239] The signal attenuation information of the tactile signal includes at least one of the following:
[0240] distance-related signal attenuation information;
[0241] Time-dependent signal attenuation information;
[0242] Signal attenuation information related to obstructions;
[0243] Signal attenuation information related to body parts;
[0244] Information on pressure-related signal attenuation.
[0245] In some embodiments, the distance-related signal attenuation information includes at least one of the following:
[0246] a signal attenuation parameter, used to determine an attenuation amount of the tactile signal;
[0247] an indication of a signal attenuation manner of the tactile signal;
[0248] an enable or disable indication, used to indicate whether to enable the distance-related signal attenuation information when generating the tactile signal;
[0249] The tactile signal type indication is used to indicate the type of the tactile signal to which the distance-related signal attenuation information is applicable.
[0250] In some embodiments, the time-dependent signal attenuation information includes at least one of the following:
[0251] a signal attenuation parameter, used to determine an attenuation amount of the tactile signal;
[0252] an indication of a signal attenuation manner of the tactile signal;
[0253] an enable or disable indication, used to indicate whether to enable the time-related signal attenuation information when generating the tactile signal;
[0254] The tactile signal type indication is used to indicate the type of the tactile signal to which the time-related signal attenuation information is applicable.
[0255] In some embodiments, the signal attenuation information related to the obstruction includes at least one of the following:
[0256] a signal attenuation parameter, used to determine an attenuation amount of the tactile signal;
[0257] an indication of a signal attenuation manner of the tactile signal;
[0258] an enable or disable indication, used to indicate whether to enable the signal attenuation information related to the obstruction when generating the tactile signal;
[0259] The tactile signal type indication is used to indicate the type of the tactile signal to which the signal attenuation information related to the obstruction is applicable.
[0260] In some embodiments, the signal attenuation information related to the body part includes at least one of the following:
[0261] a signal attenuation parameter, used to determine an attenuation amount of the tactile signal;
[0262] an indication of a signal attenuation manner of the tactile signal;
[0263] an enable or disable indication, used to indicate whether to enable the signal attenuation information related to the body part when generating the tactile signal;
[0264] a tactile signal type indication, used to indicate the type of tactile signal to which the signal attenuation information related to the body part is applicable;
[0265] The body part identifier is used to indicate the body part to which the signal attenuation parameter or the signal attenuation mode indication is applicable.
[0266] In some embodiments, the pressure-related signal attenuation information includes at least one of the following:
[0267] a signal attenuation parameter, used to determine an attenuation amount of the tactile signal;
[0268] an indication of a signal attenuation manner of the tactile signal;
[0269] an enable or disable indication, used to indicate whether to enable the pressure-related signal attenuation information when generating the tactile signal;
[0270] The tactile signal type indication is used to indicate the type of the tactile signal to which the pressure-related signal attenuation information is applicable.
[0271] In some embodiments, the signal attenuation parameter includes a fixed attenuation amount; or
[0272] The signal attenuation parameter includes a parameter used to calculate the attenuation amount of the tactile signal based on a target preset signal attenuation mode; or
[0273] The signal attenuation information of the haptic signal includes user-defined parameters.
[0274] In some embodiments, the signal attenuation manner indication of the tactile signal is used to indicate at least one of the following attenuation manners:
[0275] Attenuation is performed by a fixed attenuation amount, attenuation is performed based on a preset signal attenuation method, or attenuation is performed based on a custom signal attenuation method. In some embodiments, when the signal attenuation parameter is a signal attenuation parameter in distance-related signal attenuation information, the target preset signal attenuation method includes at least one of the following:
[0276] Inverse distance decay method, linear distance decay method, exponential distance decay method, inverse square decay method.
[0277] In some embodiments, the signal attenuation parameter includes at least one of the following:
[0278] Attenuation coefficient, the initial feedback strength obtained from the tactile source;
[0279] The attenuation coefficient is inversely proportional to the square of the distance.
[0280] In some embodiments, the generating unit 520 is further configured to:
[0281] determining a feedback intensity of the tactile signal according to the signal attenuation parameter;
[0282] The haptic signal is generated according to the feedback strength of the haptic signal.
[0283] In some embodiments, the generating unit 520 is further configured to:
[0284] The feedback intensity F of the tactile signal is determined according to the following formula: F=αF max
[0285] Where α is the attenuation coefficient, F max Indicates the initial feedback strength obtained from the tactile source;
[0286] Among them, the change function of α can be expressed as:
[0287] Among them, α min is the minimum value of the attenuation coefficient, D min and D min is a predefined value.
[0288] In some embodiments, the signal attenuation parameter is associated with at least one of: a type of the haptic signal, a frequency of the haptic signal.
[0289] In some embodiments, the signal attenuation information of the tactile signal is carried in the first object, and the acquiring unit 510 is further configured to:
[0290] The first object is analyzed to obtain signal attenuation information of the tactile signal.
[0291] In some embodiments, the first object includes at least one of the following:
[0292] The tactile source object corresponding to the tactile signal, the avatar object corresponding to the tactile signal, the trigger node object corresponding to the tactile signal, the action node object corresponding to the tactile signal, and the occlusion object corresponding to the tactile signal.
[0293] In some embodiments, the attribute information of the first object includes an occluder indication, where the occluder indication is used to indicate whether the first object is an occluder.
[0294] In some embodiments, the generating unit 520 is further configured to:
[0295] In a case where the obstruction indication is used to indicate that the first object is an obstruction, the tactile signal is generated according to the signal attenuation information related to the obstruction.
[0296] In some embodiments, the generating unit 520 is further configured to:
[0297] The haptic signal is rendered according to the signal attenuation information of the haptic signal.
[0298] Optionally, in some embodiments, the acquisition unit or generation unit may be one or more processors.
[0299] It should be understood that the device 500 according to the embodiment of the present application may correspond to the tactile signal generating device in the method embodiment of the present application, and the above-mentioned and other operations and / or functions of each unit in the device 500 are respectively for realizing the corresponding processes of the tactile signal generating device in the method embodiment shown in Figures 3 to 4 and achieving the same technical effects. To avoid repetition, they will not be repeated here.
[0300] In some embodiments, the apparatus 500 in the embodiments of the present application may be an electronic device, such as an electronic device having an operating system, or a component in an electronic device, such as an integrated circuit or chip. The electronic device may be a terminal, or may be another device other than a terminal. For example, the terminal may include but is not limited to the types of terminal 11 listed above, and the other device may be a server, a network attached storage (NAS), etc., which is not specifically limited in the embodiments of the present application.
[0301] An embodiment of the present application further provides an electronic device 1000, as shown in FIG6 , including a processor 1001 and a memory 1002, wherein the memory 1002 stores programs or instructions that can be executed on the processor 1001. For example, when the communication device 1000 is a tactile signal generating device, the program or instructions, when executed by the processor 1001, implement the steps performed by the tactile signal generating device in the above-mentioned positioning method embodiment, and can achieve the same technical effect. To avoid repetition, they are not described here.
[0302] The present application also provides another electronic device, including a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is configured to execute a program or instruction to implement the steps of the method embodiments shown in Figures 3 and 4. For example, when the tactile signal generating device is an electronic device, the various implementation processes and implementation methods of the above method embodiments can be applied to the electronic device embodiment and can achieve the same technical effects.
[0303] Specifically, Figure 7 is a schematic diagram of the hardware structure of an electronic device implementing an embodiment of the present application. The electronic device 1100 includes, but is not limited to, at least some of the components of a radio frequency unit 1101, a network module 1102, an audio output unit 1103, an input unit 1104, a sensor 1105, a display unit 1106, a user input unit 1107, an interface unit 1108, a memory 1109, and a processor 1110.
[0304] Those skilled in the art will appreciate that the electronic device 1100 may further include a power source (e.g., a battery) to power various components. The power source may be logically connected to the processor 1110 via a power management system, thereby enabling the power management system to manage charging, discharging, and power consumption. The electronic device structure shown in FIG7 does not limit the electronic device. The electronic device may include more or fewer components than shown, or may combine certain components, or have different component arrangements, which will not be described in detail here.
[0305] It should be understood that in an embodiment of the present application, the input unit 1104 may include a graphics processing unit (GPU) 11041 and a microphone 11042, and the graphics processor 11041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 1106 may include a display panel 11061, and the display panel 11061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1107 includes a touch panel 11071 and at least one of other input devices 11072. The touch panel 11071 is also called a touch screen. The touch panel 11071 may include two parts: a touch detection device and a touch controller. Other input devices 11072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.
[0306] The memory 1109 can be used to store software programs or instructions and various data. The memory 1109 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, applications or instructions required for at least one function (such as a sound playback function, an image playback function, etc.). In addition, the memory 1109 may include a volatile memory or a non-volatile memory. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct RAM bus random access memory (DRRAM). The memory 1109 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.
[0307] Processor 1110 may include one or more processing units. Optionally, processor 1110 integrates an application processor and a modem processor. The application processor primarily handles operations related to the operating system, user interface, and application programs, while the modem processor primarily processes wireless communication signals, such as a baseband processor. It is understood that the modem processor may not be integrated into processor 1110.
[0308] In some embodiments, the processor 1110 is configured to obtain signal attenuation information of a tactile signal;
[0309] rendering the tactile signal according to signal attenuation information of the tactile signal;
[0310] The signal attenuation information of the tactile signal includes at least one of the following:
[0311] distance-related signal attenuation information;
[0312] Time-dependent signal attenuation information;
[0313] Signal attenuation information related to obstructions;
[0314] Signal attenuation information related to body parts;
[0315] Information on pressure-related signal attenuation.
[0316] It can be understood that the implementation process of each implementation method mentioned in this embodiment can refer to the relevant description of the method for generating tactile signals in the method embodiment, and achieve the same or corresponding technical effects. To avoid repetition, it will not be repeated here.
[0317] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned method embodiment for generating tactile signals are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0318] The processor is the processor in the device or electronic device for generating a tactile signal as described in the above embodiments. The readable storage medium includes a computer-readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk. In some examples, the readable storage medium may be a non-transitory readable storage medium.
[0319] The processors mentioned in the embodiments of the present application may include general-purpose processors, special-purpose processors, etc., such as a central processing unit (CPU), a microprocessor, a digital signal processor (DSP), an artificial intelligence (AI) processor, a graphics processing unit (GPU), an application-specific integrated circuit (ASIC), a network processor (NP), a field programmable gate array (FPGA), or other programmable logic devices, gate circuits, transistors, discrete hardware components, etc.
[0320] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned method embodiment for generating tactile signals, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0321] It should be understood that the chip mentioned in the embodiments of the present application may include a system-level chip (also referred to as a system chip, a chip system or a system-on-chip chip), and may also include an independent display chip, etc.
[0322] An embodiment of the present application further provides a computer program / program product, which is stored in a storage medium. The computer program / program product is executed by at least one processor to implement the various processes of the above-mentioned method embodiment for generating tactile signals, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0323] It should be understood that the processor of the embodiments of the present application may be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above method embodiment can be completed by hardware integrated logic circuits in the processor or software instructions. The above processor can be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. The various methods, steps, and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the method disclosed in the embodiments of the present application can be directly embodied as being executed by a hardware decoding processor, or can be executed by a combination of hardware and software modules in the decoding processor. The software module can be located in a storage medium mature in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, etc. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.
[0324] The memory in the embodiments of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct RAM bus random access memory (DR RAM). It should be noted that the memory of the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.
[0325] It should be noted that, in this article, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in the opposite order according to the functions involved. For example, the described method may be performed in an order different from that described, and various steps may also be added, omitted or combined. In addition, the features described with reference to certain examples may be combined in other examples.
[0326] Through the description of the above embodiments, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of a computer software product plus a necessary general-purpose hardware platform, or of course, by hardware. The computer software product is stored in a storage medium (such as ROM, RAM, magnetic disk, optical disk, etc.) and includes a number of instructions for enabling a terminal or network-side device to execute the methods described in each embodiment of the present application.
[0327] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of this application, ordinary technicians in this field can also make many forms of implementation methods without departing from the purpose of this application and the scope of protection of the claims. These implementation methods are all within the protection of this application.
Claims
1. A method for generating a tactile signal, wherein: include: Acquiring signal attenuation information of a tactile signal; generating the tactile signal according to signal attenuation information of the tactile signal; The signal attenuation information of the tactile signal includes at least one of the following: distance-dependent signal attenuation information; Time-dependent signal attenuation information; Signal attenuation information related to occluders; Signal attenuation information related to body parts; Information on pressure-related signal attenuation.
2. The method according to claim 1, wherein: The distance-related signal attenuation information includes at least one of the following: a signal attenuation parameter, used to determine the attenuation amount of the tactile signal; an indication of a signal attenuation mode of the tactile signal; an enable or disable indication, used to indicate whether to enable the signal attenuation information related to the distance when generating the tactile signal; The tactile signal type indication is used to indicate the type of the tactile signal to which the distance-related signal attenuation information is applicable.
3. The method according to claim 1 or 2, wherein: The time-dependent signal attenuation information includes at least one of the following: a signal attenuation parameter, used to determine the attenuation amount of the tactile signal; an indication of a signal attenuation mode of the tactile signal; an enable or disable indication, used to indicate whether to enable the time-related signal attenuation information when generating the tactile signal; The tactile signal type indication is used to indicate the type of the tactile signal to which the time-dependent signal attenuation information is applicable.
4. The method according to any one of claims 1 to 3, wherein: The signal attenuation information related to the obstruction includes at least one of the following: a signal attenuation parameter, used to determine the attenuation amount of the tactile signal; an indication of a signal attenuation mode of the tactile signal; an enable or disable indication, used to indicate whether to enable the signal attenuation information related to the occluder when generating the tactile signal; The tactile signal type indication is used to indicate the type of tactile signal to which the signal attenuation information related to the obstruction is applicable.
5. The method according to any one of claims 1 to 4, wherein: The signal attenuation information related to the body part includes at least one of the following: a signal attenuation parameter, used to determine the attenuation amount of the tactile signal; an indication of a signal attenuation mode of the tactile signal; an enable or disable indication, used to indicate whether to enable the signal attenuation information related to the body part when generating the tactile signal; a tactile signal type indication, used to indicate the type of tactile signal to which the signal attenuation information associated with the body part is applicable; The body part identifier is used to indicate the body part to which the signal attenuation parameter or the signal attenuation mode indication is applicable.
6. The method according to any one of claims 1 to 5, wherein: The pressure-related signal attenuation information includes at least one of the following: a signal attenuation parameter, used to determine the attenuation amount of the tactile signal; an indication of a signal attenuation mode of the tactile signal; an enable or disable indication, used to indicate whether to enable the pressure-related signal attenuation information when generating the tactile signal; The tactile signal type indication is used to indicate the type of the tactile signal to which the pressure-related signal attenuation information is applicable.
7. The method according to any one of claims 2 to 6, wherein: The signal attenuation parameter includes a fixed attenuation amount; or The signal attenuation parameter includes a parameter used to calculate the attenuation amount of the tactile signal based on a target preset signal attenuation mode; or The signal attenuation parameters include user-defined parameters.
8. The method according to claim 7, wherein: The signal attenuation mode indication of the tactile signal is used to indicate at least one of the following attenuation modes: Attenuate by fixed attenuation, attenuate based on preset signal attenuation method, attenuate based on custom signal attenuation method.
9. The method according to claim 7 or 8, wherein: In the case where the signal attenuation parameter is a signal attenuation parameter in the signal attenuation information related to the distance, the target preset signal attenuation mode includes at least one of the following: Inverse distance decay method, linear distance decay method, exponential distance decay method, inverse square decay method.
10. The method according to any one of claims 2 to 9, wherein: The signal attenuation parameter includes at least one of the following: Attenuation coefficient, the initial feedback strength obtained from the tactile source; The attenuation coefficient is inversely proportional to the square of the distance.
11. The method according to claim 10, wherein: The step of generating the tactile signal according to the signal attenuation information of the tactile signal comprises: determining the feedback strength of the tactile signal according to the signal attenuation parameter; The haptic signal is generated according to the feedback strength of the haptic signal.
12. The method according to claim 11, wherein: The step of determining the feedback strength of the tactile signal according to the signal attenuation parameter includes: The feedback strength F of the tactile signal is determined according to the following formula: F=αF max Where α is the attenuation coefficient, F max represents the initial feedback strength obtained from the tactile source; Among them, the change function of α can be expressed as: Among them, α min is the minimum value of the attenuation coefficient, D min and D min is a predefined value.
13. The method according to any one of claims 2 to 11, wherein: The signal attenuation parameter is associated with at least one of the following: a type of the haptic signal, a frequency of the haptic signal.
14. The method according to any one of claims 1 to 13, wherein: The signal attenuation information of the tactile signal is carried in the first object, and the acquiring the signal attenuation information of the tactile signal includes: The first object is analyzed and processed to obtain signal attenuation information of the tactile signal.
15. The method according to claim 14, wherein: The first object includes at least one of the following: The tactile source object corresponding to the tactile signal, the avatar object corresponding to the tactile signal, the trigger node object corresponding to the tactile signal, the action node object corresponding to the tactile signal, and the occlusion object corresponding to the tactile signal.
16. The method according to claim 15, wherein: The attribute information of the first object includes an occluder indication, where the occluder indication is used to indicate whether the first object is an occluder; The step of generating the tactile signal according to the signal attenuation information of the tactile signal includes: In a case where the obstruction indication is used to indicate that the first object is an obstruction, the tactile signal is generated according to the signal attenuation information related to the obstruction.
17. The method according to any one of claims 1 to 16, wherein: The step of generating the tactile signal according to the signal attenuation information of the tactile signal comprises: The haptic signal is rendered according to the signal attenuation information of the haptic signal.
18. A device for generating a tactile signal, wherein: include: an acquisition unit, used for acquiring signal attenuation information of a tactile signal; a generating unit, configured to generate the tactile signal according to the signal attenuation information of the tactile signal; The signal attenuation information of the tactile signal includes at least one of the following: distance-dependent signal attenuation information; Time-dependent signal attenuation information; Signal attenuation information related to occluders; Signal attenuation information related to body parts; Information on pressure-related signal attenuation.
19. The device according to claim 18, wherein: The distance-related signal attenuation information includes at least one of the following: a signal attenuation parameter, used to determine the attenuation amount of the tactile signal; an indication of a signal attenuation mode of the tactile signal; an enable or disable indication, used to indicate whether to enable the signal attenuation information related to the distance when generating the tactile signal; The tactile signal type indication is used to indicate the type of the tactile signal to which the distance-related signal attenuation information is applicable.
20. The device according to claim 18 or 19, wherein: The time-dependent signal attenuation information includes at least one of the following: a signal attenuation parameter, used to determine the attenuation amount of the tactile signal; an indication of a signal attenuation mode of the tactile signal; an enable or disable indication, used to indicate whether to enable the time-related signal attenuation information when generating the tactile signal; The tactile signal type indication is used to indicate the type of the tactile signal to which the time-dependent signal attenuation information is applicable.
21. The device according to any one of claims 18 to 20, wherein: The signal attenuation information related to the obstruction includes at least one of the following: a signal attenuation parameter, used to determine the attenuation amount of the tactile signal; an indication of a signal attenuation mode of the tactile signal; an enable or disable indication, used to indicate whether to enable the signal attenuation information related to the occluder when generating the tactile signal; The tactile signal type indication is used to indicate the type of tactile signal to which the signal attenuation information related to the obstruction is applicable.
22. The device according to any one of claims 18 to 21, wherein: The signal attenuation information related to the body part includes at least one of the following: a signal attenuation parameter, used to determine the attenuation amount of the tactile signal; an indication of a signal attenuation mode of the tactile signal; an enable or disable indication, used to indicate whether to enable the signal attenuation information related to the body part when generating the tactile signal; a tactile signal type indication, used to indicate the type of tactile signal to which the signal attenuation information associated with the body part is applicable; The body part identifier is used to indicate the body part to which the signal attenuation parameter or the signal attenuation mode indication is applicable.
23. An electronic device, wherein: The method comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the method for generating a tactile signal according to any one of claims 1 to 17 are implemented.
24. A chip, wherein: The chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is used to run a program or instructions to implement the steps of the method for generating a tactile signal as described in any one of claims 1 to 17.
25. A readable storage medium, wherein: The readable storage medium stores a program or an instruction, and when the program or the instruction is executed by a processor, the steps in the method according to any one of claims 1 to 17 are implemented.
Citation Information
Patent Citations
Systems and methods for pressure-based haptic effects
CN105556423A
Haptic driver with attenuation
CN107743640A
Spatialized haptic device force feedback
CN111819520A
Representation formats for haptic objects
CN116601587A
Location-based haptic signal compression
WO2023046899A1