Tactile data processing method and device and related equipment

Abstract

The invention discloses a tactile data processing method and device and related equipment, and belongs to the technical field of rendering, and the method comprises the steps: obtaining a plurality of paths of tactile signals corresponding to the same execution equipment group or the same action position group; preprocessing the multiple paths of tactile signals to obtain processed tactile signals; wherein the preprocessing comprises at least one of the following items: tactile signal discarding processing; and haptic signal processing priority reduction processing.

Description

Technical Field

[0001] This application belongs to the field of rendering technology, and particularly relates to a method, device, and related equipment for processing tactile data. Background Art

[0002] Based on the current 3D model file format standard, the rendering engine only supports signal compression processing for one-way tactile signals. When multiple tactile signals are triggered, if each tactile signal is independently compressed and encoded, the compression efficiency of the tactile signals is greatly restricted. However, when compressing and encoding multiple tactile signals simultaneously, due to the large amount of information corresponding to the multiple tactile signals, more processing resources are required to process them. Therefore, it is difficult for existing solutions to ensure both the compression efficiency of tactile signals and the occupancy rate of processing resources. Summary of the Invention

[0003] Embodiments of this application provide a method, device, and related equipment for processing tactile data, which can solve the problem that it is difficult for existing solutions to ensure both the compression efficiency of tactile signals and the occupancy rate of processing resources.

[0004] In a first aspect, a method for processing tactile data is provided, which is executed by an electronic device and includes:

[0005] Obtain multiple tactile signals corresponding to the same execution device group or the same action position group;

[0006] Preprocess the multiple tactile signals to obtain processed tactile signals; where the preprocessing includes at least one of the following:

[0007] Tactile signal discard processing;

[0008] Tactile signal processing priority reduction processing.

[0009] In a second aspect, a device for processing tactile data is provided, including:

[0010] An acquisition unit for obtaining multiple tactile signals corresponding to the same execution device group or the same action position group;

[0011] A processing unit for preprocessing the multiple tactile signals to obtain processed tactile signals; where the preprocessing includes at least one of the following:

[0012] Tactile signal discard processing;

[0013] Tactile signal processing priority reduction processing.

[0014] In a third aspect, an electronic device is provided, which includes a processor and a memory. The memory stores programs or instructions that can run on the processor. When the programs or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.

[0015] In a fourth aspect, an electronic device is provided, including a processor and a communication interface. The processor is configured to obtain multiple tactile signals corresponding to the same execution device group or the same action position group.

[0016] Preprocess the multiple tactile signals to obtain processed tactile signals. The preprocessing includes at least one of the following:

[0017] Tactile signal discarding process;

[0018] Tactile signal processing priority reduction process.

[0019] In a fifth aspect, a readable storage medium is provided. Programs or instructions are stored on the readable storage medium. When the programs or instructions are executed by a processor, the steps of the method described in the first aspect are implemented.

[0020] In a sixth aspect, a chip is provided. The chip includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is configured to run programs or instructions to implement the method described in the first aspect.

[0021] In a seventh aspect, a computer program / program product is provided. The computer program / program product is stored in a storage medium. The computer program / program product is executed by at least one processor to implement the steps of the method described in the first aspect.

[0022] In the embodiments of the present application, multiple tactile signals corresponding to the same execution device group or the same action position group are obtained; the multiple tactile signals are preprocessed to obtain processed tactile signals. The preprocessing includes at least one of the following: tactile signal discarding process; tactile signal processing priority reduction process. In the above solution, since the multiple tactile signals belong to the same execution device group or the same action position group, there may be an overlap in the signal content among the multiple tactile signals. Through the above preprocessing, the signal redundancy of the multiple tactile signals can be effectively reduced, thereby effectively reducing the processing resource occupancy of the multiple tactile signals. Thus, based on the preprocessed tactile signals, the compression efficiency can be effectively improved subsequently, and without affecting the signal content of the multiple tactile signals, the processing resource occupancy of the multiple tactile signals can be effectively reduced. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 It shows a schematic diagram of accessing tactile data in the embodiments of the present application;

[0024] Figure 2 A schematic flowchart showing the method for processing tactile data according to an embodiment of the present application;

[0025] Figure 3 A schematic diagram showing the modules of the tactile data processing device according to an embodiment of the present application;

[0026] Figure 4 A block diagram showing the structure of an electronic device according to an embodiment of the present application;

[0027] Figure 5 A block diagram showing the structure of a terminal according to an embodiment of the present application. Detailed implementation manners

[0028] Next, the technical solutions in the embodiments of the present application will be clearly described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are some, but not all, of the embodiments of the present application. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in the present application belong to the scope of protection of the present application.

[0029] The terms "first", "second", etc. in the present application are used to distinguish similar objects, rather than to describe a specific order or sequence. It should be understood that such terms can be interchanged under appropriate circumstances so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first" and "second" are generally of the same type, and do not limit the number of objects. For example, the first object can be one or more. In addition, "or" in the present application means at least one of the connected objects. For example, "A or B" covers three scenarios, namely, Scenario 1: including A and not including B; Scenario 2: including B and not including A; Scenario 3: including both A and B. The character " / " generally indicates an "or" relationship between the associated objects before and after.

[0030] The term "indication" in the present application can be either a direct indication (or an explicit indication) or an indirect indication (or an implicit indication). Among them, a direct indication can be understood as that the sender clearly informs the recipient of specific information, operations to be performed, or request results, etc. in the sent indication; an indirect indication can be understood as that the recipient determines the corresponding information according to the indication sent by the sender, or makes a judgment and determines the operations to be performed or request results, etc. according to the judgment result.

[0031] To enable those skilled in the art to better understand the embodiments of the present application, the following explanations are made first.

[0032] 1. The process of scene synthesis or rendering.

[0033] The rendering engine can synthesize a scene based on a glTF (3D model file format) file or render the scene based on the glTF file. Through the rendering of the haptic scene, the rendering engine can obtain the feedback haptic signals. After operations such as encoding / transmission / decoding, the haptic signals are played by a haptic signal actuator.

[0034] The ways for the engine to obtain the glTF file include: the server and the client interact to transfer the glTF file through the glTF status stream, or obtain the glTF file through the program files stored on the server and the client.

[0035] 2. The Moving Pictures Experts Group (MPEG) has made an extension (haptic extension) in haptic signal rendering for glTF (3D model file format);

[0036] MPEG_haptic extension provides a method for accessing haptic data. MPEG_haptic includes a set of haptic objects (hapticObjects), as shown in Table 1. As shown in Table 2, the accessor property in hapticObjects further points to the haptic data source.

[0037] Table 1

[0038]

[0039] Table 2

[0040]

[0041] The specific access method for haptic data is as Figure 1 shown. The hapticObjects in MPEG_haptic point to the accessor, and the accessor further points to the circular buffer object. The circular buffer object provides the data position information for accessing the circular buffer on the one hand, and on the other hand, reflects the property information of the haptic data rendering by referring to the MPEG_media object.

[0042] 3. MPEG has also made an extension related to haptic materials for glTF (MPEG_haptic_material extension);

[0043] The MPEG_haptic_material extension provides tactile properties for materials. MPEG_haptic_material contains the materials attributes. Among them, MPEG_haptic_material is shown in Table 3, and MPEG_haptic_material.material is shown in Table 4.

[0044] Table 3

[0045]

[0046] The materials attribute points to a group of material objects, and each material object points to the hapticObject in MPEG_haptic that provides the data source through the haptic attribute, and indicates the relevant material tactile properties (such as stiffness, friction, etc.) and texture coordinate related information.

[0047] Table 4

[0048]

[0049]

[0050] 4. The Interactivity extension in glTF (3D model file format);

[0051] glTF is used for engines and applications to efficiently transmit and load 3D scenes and models. glTF defines an extensible publishing format, which simplifies the creation workflow and interactive services by enabling the interoperable use of 3D content across the industry.

[0052] The Moving Picture Expert Group (MPEG) has extended glTF interactively and initially designed the relevant standards for interactivity. For haptic scenarios, the relevant standards for interactivity are mainly used to describe the interaction between the avatar and the haptic source, and based on this, trigger and generate haptic signals.

[0053] Interactivity is defined based on behavior, which includes trigger nodes (i.e., trigger node, which can also be described as the trigger object) and action nodes (i.e., action node, which can also be described as the action object). Among them, the trigger node includes collision condition, proximity condition, and visibility condition. Among them, the action node includes haptic feedback actions (i.e., ACTION_SET_HAPTIC), activation nodes (ACTION_ACTIVATE), etc. ACTION_SET_HAPTIC is implemented based on the HapticActionNode object or the HapticActionMedia object.

[0054] The hapticObject attribute in the HapticActionNode (as shown in Table 5) points to the hapticObject in MPEG_haptic, and the mediaIndex attribute in the HapticActionMedia (as shown in Table 6) further points to the accessor in the above hapticObject to access the haptic data.

[0055] Table 5

[0056]

[0057]

[0058] Table 6

[0059]

[0060] The Object in the embodiments of the present application includes at least one of the following: scene, node, mesh, material, vertices, face, primitive, etc.

[0061] Next, in conjunction with the accompanying drawings, through some embodiments and their application scenarios, the method for processing haptic data and related devices provided by the embodiments of the present application will be described in detail.

[0062] Such as Figure 2As shown in the figure, an embodiment of the present application provides a method for processing tactile data, which is executed by an electronic device. The electronic device may be at least one of a rendering engine, a rendering device, a scene composition device, a scene composition engine, a presentation engine, and a presentation device. The method includes:

[0063] Step 201: Obtain multiple tactile signals corresponding to the same execution device group or the same action position group.

[0064] The above-mentioned same execution device group includes at least one execution device, and the above-mentioned same action position group includes at least one action position.

[0065] Optionally, the multiple tactile signals corresponding to the same execution device group or the same action position group have spatial correlation.

[0066] Step 202: Preprocess the multiple tactile signals to obtain processed tactile signals; where the preprocessing includes at least one of the following:

[0067] Tactile signal discard processing;

[0068] Tactile signal processing priority reduction processing.

[0069] Here, through the tactile signal processing priority reduction processing, the processing priority of some tactile signals in the multiple tactile signals can be reduced, so that the priority of the above-mentioned processed tactile signals is higher than or equal to the preset priority, and then it is convenient to subsequently perform compression or rendering processing only on the tactile signals higher than or equal to the preset priority.

[0070] Optionally, the method of the embodiment of the present application further includes: performing compression processing or rendering processing on the processed tactile signals.

[0071] In the embodiment of the present application, multiple tactile signals corresponding to the same execution device group or the same action position group are obtained; the multiple tactile signals are preprocessed to obtain processed tactile signals; where the preprocessing includes at least one of the following: tactile signal discard processing; tactile signal processing priority reduction processing. In the above solution, since the multiple tactile signals belong to the same execution device group or the same action position group, there may be a situation where the signal content overlaps in the multiple tactile signals. Through the above preprocessing, the signal redundancy of the multiple tactile signals can be effectively reduced, and thus the processing resource occupancy of the multiple tactile signals can be effectively reduced. Therefore, based on the preprocessed tactile signals, the compression efficiency can be effectively improved subsequently, and the processing resource occupancy of the multiple tactile signals can be effectively reduced without affecting the signal content of the multiple tactile signals.

[0072] Optionally, the method according to an embodiment of the present application further includes:

[0073] Determine an execution device group or an action location group according to the object attribute information;

[0074] Or, determine an execution device group or an action location group according to the rules predetermined by the protocol.

[0075] In an embodiment of the present application, according to the object attribute information of (glTF) or the rules predetermined by the protocol, an execution device group or an action location group is determined, so as to facilitate subsequent preprocessing of multiple tactile signals corresponding to the same execution device group or the same action location group.

[0076] As an implementation manner, determining an execution device group or an action location group according to the object attribute information includes at least one of the following:

[0077] Item A1: Determine the execution devices corresponding to the body part mask or body part target indicated by the object attribute information as the same execution device group or the same action location group.

[0078] In an embodiment of the present application, if the object attribute information indicates a Body part mask or a body part target, it is determined that all the execution devices on the Body part mask or the body part target belong to the same execution device group or the same action location group.

[0079] Item A2: Determine the execution devices corresponding to a set of mesh vertices or faces indicated by the object attribute information as the same execution device group or the same action location group.

[0080] In an embodiment of the present application, if the object attribute information indicates a set of mesh vertices or faces, it is determined that all the execution devices on the set of mesh vertices or faces belong to the same execution device group or the same action location group.

[0081] Item A3: Determine the execution devices corresponding to a set of device identifiers indicated by the object attribute information as the same execution device group or the same action location group.

[0082] For example, if the object attribute information indicates a set of device identifiers (device ID), it is determined that the execution devices corresponding to the set of device identifiers belong to the same execution device group or the same action location group.

[0083] Item A4: Determine the set of body part masks indicated by the object attribute information and the execution devices corresponding to the actuator target as the same execution device group or the same action location group;

[0084] For example, if the object attribute information indicates a set of body part masks and an actuator target, then determine that all the execution devices on the set of body part masks and the actuator target belong to the same execution device group or the same action location group.

[0085] Item A5: Determine the set of actuators indicated by the object attribute information as the same execution device group or the same action location group.

[0086] Through the above method, the purpose of determining the execution device group or the action location group corresponding to the execution device based on the object attribute information is achieved.

[0087] As an implementation method, according to the rules predetermined by the protocol, determine the execution device group or the action location group, including at least one of the following:

[0088] Item B1: Determine the execution devices corresponding to at least one body part mask or body part target agreed upon by the protocol as the same execution device group or the same action location group.

[0089] For example, the protocol stipulates that all the execution devices on a certain or certain Body part mask / body part target belong to the same execution device group or the same action location group.

[0090] Item B2: Determine the execution devices corresponding to at least one mesh vertex or face agreed upon by the protocol as the same execution device group or the same action location group.

[0091] For example, the protocol stipulates that all the execution devices on certain mesh vertice(s) / face(s) belong to the same execution device group or the same action location group.

[0092] Item B3: Determine the execution devices corresponding to at least two adjacent vertices or faces of the avatar mesh agreed upon by the protocol as the same execution device group or the same action location group.

[0093] For example, determine that all the execution devices on M vertice(s) / face(s) with adjacent numbers of the avatar network agreed upon by the protocol belong to the same execution device group or the same action location group.

[0094] It should be noted that in the embodiments of the present application, the grouping information of the execution devices can be reported from the hardware device side to the rendering engine side, so that the manufacturer can report the grouping information of the execution devices according to the distribution of the execution devices on the hardware device.

[0095] Optionally, preprocessing the multiplexed tactile signals to obtain processed tactile signals, including:

[0096] Determining a main signal in the multiplexed tactile signals;

[0097] Preprocessing the secondary signals according to the main signal to obtain processed tactile signals, where the secondary signals are some or all of the tactile signals in the multiplexed tactile signals other than the main signal.

[0098] The above-mentioned processed tactile signals include the main signal and the preprocessed secondary signals.

[0099] In the embodiments of the present application, the main signal is first determined in the multiplexed tactile signals, and then at least one secondary signal is preprocessed (which can also be described as masking processing) based on this main signal, such as discarding the secondary signals that overlap with the main signal or discarding the secondary signals with smaller signal intensities, so as to effectively reduce the resource occupancy of the multiplexed tactile signals without affecting the signal content of the multiplexed tactile signals.

[0100] As an implementation, determining the main signal in the multiplexed tactile signals includes at least one of the following:

[0101] Item C1: Determining the main signal according to at least one tactile signal with the largest signal intensity in the multiplexed tactile signals.

[0102] For example, selecting the tactile signal with the largest signal intensity in the multiplexed tactile signals as the main signal.

[0103] Or, selecting one tactile signal as the main signal from the L tactile signals with the largest signal intensity in the multiplexed tactile signals, where L is a positive integer.

[0104] Here, determining the main signal based on the tactile signal with the largest channel intensity can effectively ensure the signal intensity of the main signal, that is, effectively ensure the signal quality of the main signal, and then subsequent discarded processing can be performed on the low-quality secondary signals based on the high-quality main signal.

[0105] Item C2: Determining the main signal according to at least one tactile signal with a signal intensity greater than a preset intensity in the multiplexed tactile signals.

[0106] When the number of tactile signals with a signal intensity greater than the preset intensity in the multiplexed tactile signals is greater than 1, any one of the multiple tactile signals with a signal intensity greater than the preset intensity can be selected as the main signal.

[0107] Here, determining the main signal based on at least one haptic signal with an intensity greater than a preset intensity can effectively ensure the signal intensity of the main signal, that is, effectively ensure the signal quality of the main signal. Subsequently, the secondary signal with low quality (signal intensity lower than the preset intensity) can be discarded based on the high-quality main signal.

[0108] Item C3: Determine the main signal among the multiple haptic signals according to the object attribute information corresponding to the multiple haptic signals.

[0109] For example, if the object attribute information of glTF indicates actuator information, then the signal corresponding to the actuator corresponding to the actuator information is used as the main signal.

[0110] Here, based on the object attribute information, the signal corresponding to a certain actuator can be flexibly used as the main signal.

[0111] Item C4: Determine the main signal among the multiple haptic signals according to the haptic signal corresponding to a preset execution device or a preset action position.

[0112] The above preset execution device or preset action position is agreed upon by the protocol. For example, for a finger, the signal corresponding to the fingertip joint is used as the main signal.

[0113] Here, the haptic signal corresponding to a certain execution device or action position can be flexibly set as the main signal.

[0114] Optionally, the main signal or the secondary signal is determined for the signal at one time-domain sampling point, or the main signal or the secondary signal is determined for the signals at the sampling points within a preset time period.

[0115] In the embodiments of the present application, the time dimension corresponding to the above main signal or secondary signal can be one time-domain sampling point or the sampling points of a preset time period.

[0116] Optionally, the time interval for each determination of the main signal or the secondary signal should be greater than or equal to a first preset time interval to avoid frequent determination of the main signal or the secondary signal. Or, the time interval for each determination of the main signal or the secondary signal should be less than or equal to a second preset time interval to ensure that when preprocessing the secondary signal based on the main signal, the signal content of the multiple haptic signals is not affected (such as avoiding content loss). Or, the main signal or the secondary signal is determined periodically. For example, within each time period, the main signal or the secondary signal is determined once.

[0117] As an implementation manner, the preprocessing the secondary signal according to the main signal to obtain a processed haptic signal includes:

[0118] Preprocess the secondary signal within the first time range according to the primary signal at the target moment, where the first time range includes at least one of a first time period and a second time period. The first time period includes a time period with a first preset duration before the target moment, and the second time period includes a time period with a second preset duration after the target moment;

[0119] Alternatively, perform target processing on the secondary signal within the second time range according to the primary signal corresponding to the preset time period. The second time range includes at least one of a third time period and a fourth time period. The third time period includes a time period with a third preset duration before the preset time period, and the fourth time period includes a time period with a fourth preset duration after the preset time period.

[0120] Through the above solution, the secondary signal can be fully compressed according to the hysteresis principle. The first preset duration, the second preset duration, the third preset duration, and the fourth preset duration are static or semi-static or dynamic values.

[0121] Optionally, the tactile signal discarding process is used to discard tactile signals with a signal strength less than or equal to the reference value, or to discard the N tactile signals with the lowest priority, where N is a positive integer;

[0122] The tactile signal processing priority reduction process is used to reduce the processing priority of tactile signals with a signal strength less than or equal to the reference value.

[0123] Here, by reducing the tactile signal processing priority, the tactile signals can be processed when the total information volume of multiple tactile signals is small, effectively ensuring the total information volume of multiple tactile signals.

[0124] Optionally, the method of the embodiment of the present application further includes:

[0125] Determine the priority of the tactile signal according to the object attribute information;

[0126] Alternatively, determine the priority of the tactile signal corresponding to the actuator according to the sorting of the actuator in the target object (glTF object).

[0127] The target object here is the virtual object corresponding to the actuator.

[0128] In the embodiment of the present application, the above object attribute information can explicitly indicate the priority identifier of the tactile signal corresponding to a certain action position or a certain actuator.

[0129] Optionally, the method of the embodiment of the present application further includes:

[0130] Determine at least one of the reference values according to the primary signal and at least one threshold.

[0131] Exemplarily, the above reference value is obtained based on the product of the signal strength of the primary signal and the threshold. For example, if the signal strength of the primary signal is A and the above threshold is 0.8, then the above reference value is 0.8*A.

[0132] Optionally, the method according to the embodiment of the present application further includes:

[0133] Determine the at least one threshold according to the object attribute information or protocol convention.

[0134] In the embodiment of the present application, different reference values are obtained based on the primary signal and different thresholds. For example, different secondary signals correspond to different reference values.

[0135] Exemplarily, the above object attribute information may indicate a threshold for the primary signal or multiple tactile signals, or may indicate a threshold for each of the multiple secondary signals of the primary signal.

[0136] Exemplarily, the protocol may agree on corresponding thresholds based on the signal action position information of the primary signal. For example, for the signal of the finger part, the agreed threshold is the first threshold, and for the signal of the chest, the agreed threshold is the second threshold.

[0137] Optionally, the method according to the embodiment of the present application further includes:

[0138] Determine the signal strength of each tactile signal according to the signal strength of the signal at one time domain sampling point;

[0139] Or determine the signal strength of each tactile signal according to the signal strength of the signal at the sampling points within a preset time period.

[0140] Optionally, the time unit for preprocessing the multiple tactile information is one time domain sampling point.

[0141] Optionally, determining the signal strength of each tactile signal according to the signal strength of the signal at the sampling points within a preset time period includes: processing the signal strength of the signal at the sampling points within the preset time period by a preset calculation method to obtain the signal strength of each tactile signal.

[0142] The above preset calculation methods include taking the average, weighted average (optionally, the weighting value can be obtained from a preset model), taking the maximum value or taking the minimum value, etc.

[0143] Optionally, the time unit for preprocessing the multiple tactile information is the preset time period.

[0144] Optionally, the method according to the embodiment of the present application further includes:

[0145] Determine the preset time period according to the time period indicated by the object attribute information, the time period agreed upon by the protocol, or the time period implemented by the rendering engine.

[0146] For example, the duration of the preset time period is not greater than the hysteresis time, and the specific time length can be determined by the protocol, optionally in the range of 0.3s to 0.5s, so as not to affect the user experience.

[0147] It should be noted that the main signal and threshold information can be reported from the hardware device side to the rendering engine side, so that the manufacturer can report the information according to the actuator distribution and actuator working parameters on the hardware device. However, it does not exclude that the rendering engine itself determines the main signal, threshold and other information.

[0148] Optionally, in the embodiments of the present application, it is also possible to determine whether to preprocess the multiplexed tactile signals according to the object attribute information.

[0149] In the embodiments of the present application, multiplexed tactile signals corresponding to the same execution device group or the same action position group are obtained; the multiplexed tactile signals are preprocessed to obtain processed tactile signals; wherein, the preprocessing includes at least one of the following: tactile signal discard processing; tactile signal processing priority reduction processing. In the above solution, since the multiplexed tactile signals belong to the same execution device group or the same action position group, there may be an overlap in the signal content in the multiplexed tactile signals. Through the above preprocessing, the signal redundancy of the multiplexed tactile signals can be effectively reduced, thereby effectively reducing the processing resource occupancy of the multiplexed tactile signals. Thus, based on the preprocessed tactile signals, the compression efficiency can be effectively improved subsequently, and the processing resource occupancy of the multiplexed tactile signals can be effectively reduced without affecting the signal content of the multiplexed tactile signals.

[0150] The execution subject of the tactile data processing method provided in the embodiments of the present application can be a tactile data processing device. In the embodiments of the present application, taking the tactile data processing device executing the tactile data processing method as an example, the tactile data processing device provided in the embodiments of the present application is described.

[0151] As Figure 3 shown, the embodiments of the present application also provide a tactile data processing device 300, including:

[0152] An acquisition unit 301, configured to acquire multiplexed tactile signals corresponding to the same execution device group or the same action position group;

[0153] A processing unit 302, configured to preprocess the multiplexed tactile signals to obtain processed tactile signals; wherein, the preprocessing includes at least one of the following:

[0154] Tactile signal discard processing;

[0155] Reduction processing of haptic signal processing priority.

[0156] Optionally, the device according to an embodiment of the present application further includes:

[0157] A first determination unit, configured to determine an execution device grouping or an action location grouping according to object attribute information;

[0158] Or, determine an execution device grouping or an action location grouping according to rules predefined by a protocol.

[0159] Optionally, the first determination unit is configured to perform at least one of the following:

[0160] Determine the execution devices corresponding to the body part mask or body part target indicated by the object attribute information as the same execution device grouping or the same action location grouping;

[0161] Determine the execution devices corresponding to a set of mesh vertices or faces indicated by the object attribute information as the same execution device grouping or the same action location grouping;

[0162] Determine the execution devices corresponding to a set of device identifiers indicated by the object attribute information as the same execution device grouping or the same action location grouping;

[0163] Determine the execution devices corresponding to a set of body part masks and actuator targets indicated by the object attribute information as the same execution device grouping or the same action location grouping;

[0164] Determine a set of actuators indicated by the object attribute information as the same execution device grouping or the same action location grouping.

[0165] Optionally, the first determination unit is configured to perform at least one of the following:

[0166] Determine the execution devices corresponding to at least one body part mask or body part target agreed by the protocol as the same execution device grouping or the same action location grouping;

[0167] Determine the execution devices corresponding to at least one mesh vertex or face agreed by the protocol as the same execution device grouping or the same action location grouping;

[0168] Determine the execution devices corresponding to at least two adjacent vertices or faces of the avatar mesh agreed by the protocol as the same execution device grouping or the same action location grouping.

[0169] Optionally, the processing unit includes:

[0170] A determination subunit, configured to determine a main signal in the multiplexed haptic signals;

[0171] A processing subunit, configured to preprocess a secondary signal according to the primary signal to obtain a processed tactile signal, where the secondary signal is part or all of the tactile signals in the multiplexed tactile signals except the primary signal.

[0172] Optionally, the primary signal or the secondary signal is determined for a signal at a time domain sampling point, or the primary signal or the secondary signal is determined for signals at sampling points within a preset time period.

[0173] Optionally, the processing subunit is configured to:

[0174] Preprocess the secondary signal within a first time range according to the primary signal at a target time, where the first time range includes at least one of a first time period and a second time period, the first time period includes a time period with a first preset duration before the target time, and the second time period includes a time period with a second preset duration after the target time;

[0175] Or, preprocess the secondary signal within a second time range according to the primary signal corresponding to a preset time period, where the second time range includes at least one of a third time period and a fourth time period, the third time period includes a time period with a third preset duration before the preset time period, and the fourth time period includes a time period with a fourth preset duration after the preset time period.

[0176] Optionally, the tactile signal discarding process is configured to discard tactile signals with a signal strength less than or equal to a reference value, or to discard the N tactile signals with the lowest priority, where N is a positive integer;

[0177] The tactile signal processing priority reduction process is configured to reduce the processing priority of tactile signals with a signal strength less than or equal to a reference value.

[0178] Optionally, the device according to the embodiment of the present application further includes:

[0179] A second determination unit, configured to determine at least one of the reference values according to the primary signal and at least one threshold.

[0180] Optionally, the device according to the embodiment of the present application further includes:

[0181] A third determination unit, configured to determine the at least one threshold according to object attribute information or protocol convention.

[0182] Optionally, the determination subunit is configured to perform at least one of the following:

[0183] Determine the primary signal according to at least one tactile signal with the maximum signal strength in the multiplexed tactile signals;

[0184] Determine a main signal according to at least one haptic signal in the multiple haptic signals whose signal strength is greater than a preset strength;

[0185] Determine a main signal in the multiple haptic signals according to the object attribute information corresponding to the multiple haptic signals;

[0186] Determine a main signal in the multiple haptic signals according to the haptic signal corresponding to a preset execution device or a preset action position.

[0187] Optionally, the device according to an embodiment of the present application further includes:

[0188] A fourth determination unit, configured to determine the signal strength of each haptic signal according to the signal strength of the signal at one time-domain sampling point;

[0189] Or, determine the signal strength of each haptic signal according to the signal strength of the signal at the sampling points within a preset time period.

[0190] Optionally, the device according to an embodiment of the present application further includes:

[0191] A fifth determination unit, configured to determine the preset time period according to the time period indicated by the object attribute information, the time period agreed upon by the protocol, or the time period implemented by the rendering engine.

[0192] Optionally, the device according to an embodiment of the present application further includes:

[0193] A sixth determination unit, configured to determine the priority of the haptic signal according to the object attribute information;

[0194] Or, determine the priority of the haptic signal corresponding to the actuator according to the sorting of the actuators in the target object.

[0195] In the above solution of the embodiment of the present application, multiple haptic signals corresponding to the same execution device group or the same action position group are obtained; the multiple haptic signals are preprocessed to obtain processed haptic signals; wherein, the preprocessing includes at least one of the following: haptic signal discard processing; haptic signal processing priority reduction processing. In the above solution, since the multiple haptic signals belong to the same execution device group or the same action position group, there may be an overlap in the signal content among the multiple haptic signals. Through the above preprocessing, the signal redundancy of the multiple haptic signals can be effectively reduced, thereby effectively reducing the processing resource occupancy of the multiple haptic signals. Thus, based on the preprocessed haptic signals, the compression efficiency can be effectively improved subsequently, and without affecting the signal content of the multiple haptic signals, the processing resource occupancy of the multiple haptic signals can be effectively reduced.

[0196] The haptic data processing device provided by the embodiment of the present application can achieveFigure 2 The various processes implemented by the method embodiments achieve the same technical effects. To avoid repetition, they will not be elaborated here.

[0197] Optionally, as Figure 4 shown, an embodiment of the present application further provides an electronic device 400, including a processor 401 and a memory 402. A program or instruction that can run on the processor 401 is stored on the memory 402. For example, when the electronic device 400 is a terminal, when the program or instruction is executed by the processor 401, it implements each step of the above method embodiment for processing tactile data and can achieve the same technical effects. To avoid repetition, they will not be elaborated here.

[0198] An embodiment of the present application further provides an electronic device, including a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run a program or instruction to implement the steps in the method embodiment as Figure 2 shown. This device embodiment corresponds to the above method embodiment. Each implementation process and implementation manner of the above method embodiment can be applied to this electronic device embodiment and can achieve the same technical effects.

[0199] The above electronic device can be a terminal or other devices other than a terminal, such as a server, a Network Attached Storage (NAS), etc.

[0200] Among them, the terminal can be a mobile phone, a tablet personal computer, a laptop computer, a notebook computer, a personal digital assistant (PDA), a handheld computer, a netbook, an ultra-mobile personal computer (UMPC), a mobile internet device (MID), an augmented reality (AR) device, a virtual reality (VR) device, a mixed reality (MR) device, a robot, a wearable device, a flight vehicle, a vehicle user equipment (VUE), a shipborne device, a pedestrian user equipment (PUE), a smart home (home devices with wireless communication functions, such as refrigerators, TVs, washing machines, or furniture, etc.), a game console, a personal computer (PC), a teller machine, or a self-service machine, etc., which are terminal-side devices. Wearable devices include: smart watches, smart bracelets, smart earphones, smart glasses, smart jewelry (such as smart bracelets, smart bracelets, smart rings, smart necklaces, smart anklets, smart ankle chains, etc.), smart wristbands, smart clothing, etc. Among them, vehicle user equipment can also be referred to as vehicle terminal, vehicle controller, vehicle module, vehicle component, vehicle chip, or vehicle unit, etc. It should be noted that the specific type of the terminal is not limited in the embodiments of the present application.

[0201] The server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server. The cloud server can provide cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery network (CDN), or cloud computing services based on big data and artificial intelligence platforms, etc.

[0202] Taking an electronic device as an example of the terminal, Figure 5 It is a schematic diagram of the hardware structure of a terminal to implement an embodiment of the present application.

[0203] The terminal 500 includes, but is not limited to, at least some components such as a radio frequency unit 501, a network module 502, an audio output unit 503, an input unit 504, a sensor 505, a display unit 506, a user input unit 507, an interface unit 508, a memory 509, and a processor 510.

[0204] Those skilled in the art can understand that the terminal 500 may further include a power source (such as a battery) for supplying power to each component. The power source can be logically connected to the processor 510 through a power management system, so as to implement functions such as management of charging, discharging, and power consumption management through the power management system. Figure 5 The terminal structure shown does not limit the terminal. The terminal may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.

[0205] It should be understood that in the embodiments of the present application, the input unit 504 may include a graphics processing unit (GPU) 5041 and a microphone 5042. The graphics processor 5041 processes the image data of static pictures or videos obtained by an image acquisition device (such as a camera) in a video acquisition mode or an image acquisition mode, or may process the obtained point cloud data. The display unit 506 may include a display panel 5061, and the display panel 5061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 507 includes at least one of a touch panel 5071 and other input devices 5072. The touch panel 5071 is also called a touch screen. The touch panel 5071 may include two parts: a touch detection device and a touch controller. The other input devices 5072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be elaborated here.

[0206] In the embodiments of the present application, after the radio frequency unit 501 receives downlink data from a network-side device, it can be transmitted to the processor 510 for processing; in addition, the radio frequency unit 501 can send uplink data to the network-side device. Generally, the radio frequency unit 501 includes, but is not limited to, an antenna, an amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, etc.

[0207] The memory 509 can be used to store software programs or instructions as well as various data. The memory 509 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data. Among them, the first storage area may store an operating system, application programs or instructions required for at least one function (such as a sound playback function, an image playback function, etc.). In addition, the memory 509 may include volatile memory or non-volatile memory. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDR SDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM), and a direct rambus random access memory (DRRAM). The memory 509 in the embodiments of the present application includes but is not limited to these and any other suitable types of memory.

[0208] The processor 510 may include one or more processing units; optionally, the processor 510 integrates an application processor and a modem processor. Among them, the application processor mainly processes operations related to the operating system, user interface, and application programs, etc., and the modem processor mainly processes wireless communication signals, such as a baseband processor. It can be understood that the above modem processor may not be integrated into the processor 510 either.

[0209] Among them, the processor 510 is configured to obtain multiple tactile signals corresponding to the same execution device group or the same action location group;

[0210] preprocess the multiple tactile signals to obtain processed tactile signals; wherein, the preprocessing includes at least one of the following:

[0211] Tactile signal discard processing;

[0212] Tactile signal processing priority reduction processing.

[0213] Optionally, the processor 510 is further configured to:

[0214] Determine an execution device grouping or an action location grouping according to the object attribute information;

[0215] Alternatively, determine an execution device grouping or an action location grouping according to the rules predefined in the protocol.

[0216] Optionally, the processor 510 is further configured to perform at least one of the following:

[0217] Determine the execution devices corresponding to the body part mask or body part target indicated by the object attribute information as the same execution device grouping or the same action location grouping;

[0218] Determine the execution devices corresponding to a group of mesh vertices or faces indicated by the object attribute information as the same execution device grouping or the same action location grouping;

[0219] Determine the execution devices corresponding to a group of device identifiers indicated by the object attribute information as the same execution device grouping or the same action location grouping;

[0220] Determine the execution devices corresponding to a group of body part masks and actuator targets indicated by the object attribute information as the same execution device grouping or the same action location grouping;

[0221] Determine a group of actuators indicated by the object attribute information as the same execution device grouping or the same action location grouping.

[0222] Optionally, the processor 510 is further configured to perform at least one of the following:

[0223] Determine the execution devices corresponding to at least one body part mask or body part target agreed upon in the protocol as the same execution device grouping or the same action location grouping;

[0224] Determine the execution devices corresponding to at least one mesh vertex or face agreed upon in the protocol as the same execution device grouping or the same action location grouping;

[0225] Determine the execution devices corresponding to at least two adjacent vertices or faces of the avatar mesh agreed upon in the protocol as the same execution device grouping or the same action location grouping.

[0226] Optionally, the processor 510 is further configured to:

[0227] Determine a primary signal in the multiplexed haptic signals;

[0228] Preprocess the secondary signal according to the primary signal to obtain a processed tactile signal, where the secondary signal is part or all of the tactile signals among the multiple tactile signals other than the primary signal.

[0229] Optionally, the primary signal or the secondary signal is determined for the signal at one time-domain sampling point, or the primary signal or the secondary signal is determined for the signals at the sampling points within a preset time period.

[0230] Optionally, the processor 510 is further configured to:

[0231] Preprocess the secondary signal within the first time range according to the primary signal at the target moment, where the first time range includes at least one of a first time period and a second time period. The first time period includes a time period with a first preset duration before the target moment, and the second time period includes a time period with a second preset duration after the target moment;

[0232] Or, preprocess the secondary signal within the second time range according to the primary signal corresponding to the preset time period, where the second time range includes at least one of a third time period and a fourth time period. The third time period includes a time period with a third preset duration before the preset time period, and the fourth time period includes a time period with a fourth preset duration after the preset time period.

[0233] Optionally, the tactile signal discarding process is used to discard the tactile signals with signal strength less than or equal to the reference value, or to discard the N tactile signals with the lowest priority, where N is a positive integer;

[0234] The tactile signal processing priority reduction process is used to reduce the processing priority of the tactile signals with signal strength less than or equal to the reference value.

[0235] Optionally, the processor 510 is further configured to:

[0236] Determine at least one of the reference values according to the primary signal and at least one threshold.

[0237] Optionally, the processor 510 is further configured to:

[0238] Determine the at least one threshold according to the object attribute information or protocol convention.

[0239] Optionally, the processor 510 is further configured to perform at least one of the following:

[0240] Determine the primary signal according to at least one of the tactile signals with the maximum signal strength among the multiple tactile signals;

[0241] Determine a main signal according to at least one haptic signal among the multiple haptic signals whose signal strength is greater than a preset strength;

[0242] Determine a main signal among the multiple haptic signals according to the object attribute information corresponding to the multiple haptic signals;

[0243] Determine a main signal among the multiple haptic signals according to the haptic signal corresponding to a preset execution device or a preset action position.

[0244] Optionally, the processor 510 is further configured to:

[0245] Determine the signal strength of each haptic signal according to the signal strength of the signal at a time-domain sampling point;

[0246] Alternatively, determine the signal strength of each haptic signal according to the signal strength of the signals at the sampling points within a preset time period.

[0247] Optionally, the processor 510 is further configured to:

[0248] Determine the preset time period according to the time period indicated by the object attribute information, the time period agreed upon by the protocol, or the time period implemented by the rendering engine.

[0249] Optionally, the processor 510 is further configured to:

[0250] Determine the priority of the haptic signal according to the object attribute information;

[0251] Alternatively, determine the priority of the haptic signal corresponding to the actuator according to the sorting of the actuators in the target object.

[0252] In the embodiments of the present application, obtain multiple haptic signals corresponding to the same execution device group or the same action position group; perform preprocessing on the multiple haptic signals to obtain processed haptic signals; wherein, the preprocessing includes at least one of the following: haptic signal discard processing; haptic signal processing priority reduction processing. In the above solution, since the multiple haptic signals belong to the same execution device group or the same action position group, there may be an overlap in the signal content among the multiple haptic signals. Through the above preprocessing, the signal redundancy of the multiple haptic signals can be effectively reduced, thereby effectively reducing the processing resource occupancy of the multiple haptic signals. Thus, based on the preprocessed haptic signals, the compression efficiency can be effectively improved subsequently, and without affecting the signal content of the multiple haptic signals, the processing resource occupancy of the multiple haptic signals can be effectively reduced.

[0253] It can be understood that the implementation processes of the various implementation manners mentioned in this embodiment can refer to the relevant descriptions of the haptic data processing method in the method embodiments and achieve the same or corresponding technical effects. To avoid repetition, they will not be elaborated here.

[0254] The embodiment of the present application further provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, it implements each process of the above-mentioned embodiment of the method for processing tactile data and can achieve the same technical effect. To avoid repetition, it will not be elaborated here.

[0255] Among them, the processor is the processor in the terminal described in the above embodiment. The readable storage medium includes computer-readable storage media such as computer read-only memory ROM, random access memory RAM, magnetic disk or optical disc, etc. In some examples, the readable storage medium may be a non-transitory readable storage medium.

[0256] The embodiment of the present application further provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run a program or instruction to implement each process of the above-mentioned embodiment of the method for processing tactile data and can achieve the same technical effect. To avoid repetition, it will not be elaborated here.

[0257] It should be understood that the chip mentioned in the embodiment of the present application may include a system-on-chip (also referred to as a system chip, chip system or system-on-chip), or may also include an independent display chip, etc.

[0258] The embodiment of the present application further provides a computer program / program product, which is stored in a storage medium. The computer program / program product is executed by at least one processor to implement each process of the above-mentioned embodiment of the method for processing tactile data and can achieve the same technical effect. To avoid repetition, it will not be elaborated here.

[0259] It should be noted that in this article, the term "comprising", "including" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed, or further includes elements inherent to such process, method, article or device. Without more limitations, the element defined by the statement "including one..." does not exclude the existence of additional identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in a reverse order according to the functions involved. For example, the described method may be executed in a different order from that described, and various steps may be added, omitted or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0260] Through the description of the above embodiments, those skilled in the art can clearly understand that the above-described example methods can be implemented by means of computer software products plus the necessary general hardware platforms, and of course, they can also be implemented by hardware. The computer software products are stored in storage media (such as ROM, RAM, magnetic disks, optical disks, etc.) and include several instructions for enabling a terminal or a network-side device to execute the methods described in various embodiments of the present application.

[0261] The embodiments of the present application have been described above in conjunction with the accompanying drawings. However, the present application is not limited to the above specific embodiments. The above specific embodiments are merely illustrative and not restrictive. Under the inspiration of the present application, those of ordinary skill in the art can also make many forms of embodiments without departing from the purpose of the present application and the scope protected by the claims. These embodiments are all within the protection scope of the present application.

Claims

1. A method for processing tactile data, which is executed by an electronic device, characterized in that Including: Obtaining multiple tactile signals corresponding to the same execution device group or the same action position group; Preprocessing the multiple tactile signals to obtain processed tactile signals; wherein, the preprocessing includes at least one of the following: Discarding processing of tactile signals; Reducing the processing priority of tactile signals.

2. The method according to claim 1, wherein Further including: Determining an execution device group or an action position group according to object attribute information; Or, determining an execution device group or an action position group according to rules predefined in the protocol.

3. The method according to claim 2, wherein Determining an execution device group or an action position group according to object attribute information includes at least one of the following: Determining the execution devices corresponding to the body part mask or body part target indicated by the object attribute information as the same execution device group or the same action position group; Determining the execution devices corresponding to a group of mesh vertices or faces indicated by the object attribute information as the same execution device group or the same action position group; Determining the execution devices corresponding to a group of device identifiers indicated by the object attribute information as the same execution device group or the same action position group; Determining the execution devices corresponding to a group of body part masks and actuator targets indicated by the object attribute information as the same execution device group or the same action position group; Determining a group of actuators indicated by the object attribute information as the same execution device group or the same action position group.

4. The method according to claim 2, wherein Determining an execution device group or an action position group according to rules predefined in the protocol includes at least one of the following: Determining the execution devices corresponding to at least one body part mask or body part target agreed in the protocol as the same execution device group or the same action position group; Determining the execution devices corresponding to at least one mesh vertex or face agreed in the protocol as the same execution device group or the same action position group; Determining the execution devices corresponding to at least two adjacent vertices or faces of the avatar mesh agreed in the protocol as the same execution device group or the same action position group.

5. The method according to any one of claims 1 to 4, characterized in that, The preprocessing the multiple tactile signals to obtain processed tactile signals includes: Determining a main signal in the multiple tactile signals; Preprocessing secondary signals according to the main signal to obtain processed tactile signals, where the secondary signals are part or all of the tactile signals other than the main signal in the multiple tactile signals.

6. The method according to claim 5, wherein The main signal or the secondary signal is determined for a signal at a time domain sampling point, or the main signal or the secondary signal is determined for signals at sampling points within a preset time period.

7. The method according to claim 5 or 6, characterized in that, The preprocessing the secondary signals according to the main signal to obtain processed tactile signals includes: Preprocessing the secondary signals within a first time range according to the main signal at a target moment, where the first time range includes at least one of a first time period and a second time period, the first time period includes a time period with a first preset duration before the target moment, and the second time period includes a time period with a second preset duration after the target moment; Alternatively, preprocess the secondary signals within the second time range according to the primary signal corresponding to the preset time period. The second time range includes at least one of a third time period and a fourth time period. The third time period includes a time period with a third preset duration before the preset time period, and the fourth time period includes a time period with a fourth preset duration after the preset time period.

8. The method according to any one of claims 5 to 7, characterized in that The tactile signal discarding process is used to discard tactile signals with a signal intensity less than or equal to a reference value, or to discard the N tactile signals with the lowest priority, where N is a positive integer. The tactile signal processing priority reduction process is used to reduce the processing priority of tactile signals with a signal intensity less than or equal to a reference value.

9. The method according to claim 8, wherein It further includes: Determine at least one of the reference values according to the primary signal and at least one threshold.

10. The method according to claim 9, wherein It further includes: Determine the at least one threshold according to the object attribute information or protocol convention.

11. The method according to any one of claims 5 to 9, characterized in that Determining the primary signal among the multiple tactile signals includes at least one of the following: Determine the primary signal according to at least one tactile signal with the maximum signal intensity among the multiple tactile signals. Determine the primary signal according to at least one tactile signal with a signal intensity greater than a preset intensity among the multiple tactile signals. Determine the primary signal among the multiple tactile signals according to the object attribute information corresponding to the multiple tactile signals. Determine the primary signal among the multiple tactile signals according to the tactile signal corresponding to the preset execution device or preset action position.

12. The method according to claim 11, wherein It further includes: Determine the signal intensity of each tactile signal according to the signal intensity of the signal at one time domain sampling point. Alternatively, determine the signal intensity of each tactile signal according to the signal intensity of the signals at the sampling points within the preset time period.

13. The method according to claim 12, wherein It further includes: Determine the preset time period according to the time period indicated by the object attribute information, the time period agreed upon by the protocol, or the time period implemented by the rendering engine.

14. The method according to claim 8, wherein It further includes: Determine the priority of the tactile signal according to the object attribute information. Alternatively, determine the priority of the tactile signal corresponding to the actuator according to the sorting of the actuators in the target object.

15. A processing device for tactile data, characterized in that, It includes: An acquisition unit for acquiring multiple tactile signals corresponding to the same execution device group or the same action position group. A processing unit for preprocessing the multiple tactile signals to obtain processed tactile signals. Among them, the preprocessing includes at least one of the following: Tactile signal discarding process; Tactile signal processing priority reduction process.

16. The device according to claim 15, characterized in that, It further includes: A first determination unit for determining the execution device group or the action position group according to the object attribute information. Alternatively, determine the execution device group or the action position group according to the rules predetermined by the protocol.

17. The device according to claim 16, characterized in that, The first determination unit is used to execute at least one of the following: Determine the execution devices corresponding to the body part mask or body part target indicated by the object attribute information as the same execution device group or the same action position group. Determine the execution devices corresponding to a group of mesh vertices or faces indicated by the object attribute information as the same execution device group or the same action position group. Determine the execution devices corresponding to a group of device identifiers indicated by the object attribute information as the same execution device group or the same action position group. Determine a set of body part masks indicated by object attribute information and the execution device corresponding to the actuator target as the same execution device group or the same action position group; Determine a set of actuators indicated by object attribute information as the same execution device group or the same action position group.

18. The device according to claim 16, characterized in that, The first determination unit is used to perform at least one of the following: Determine the execution devices corresponding to at least one body part mask or body part target agreed upon by the protocol as the same execution device group or the same action position group; Determine the execution devices corresponding to at least one mesh vertex or face agreed upon by the protocol as the same execution device group or the same action position group; Determine the execution devices corresponding to at least two adjacent vertices or faces of the avatar mesh agreed upon by the protocol as the same execution device group or the same action position group.

19. The device according to any one of claims 15 to 18, characterized in that, The processing unit includes: A determination subunit, configured to determine a main signal from the multiplexed tactile signals; A processing subunit, configured to preprocess the secondary signals according to the main signal to obtain processed tactile signals, where the secondary signals are part or all of the tactile signals other than the main signal in the multiplexed tactile signals.

20. The device according to claim 19, characterized in that, The main signal or the secondary signal is determined for the signal at one time domain sampling point, or the main signal or the secondary signal is determined for the signals at the sampling points within a preset time period.

21. The device according to claim 19 or 20, characterized in that, The processing subunit is used for: Preprocessing the secondary signals within a first time range according to the main signal at the target moment, where the first time range includes at least one of a first time period and a second time period, the first time period includes a time period with a first preset duration before the target moment, and the second time period includes a time period with a second preset duration after the target moment; Alternatively, preprocessing the secondary signals within a second time range according to the main signal corresponding to a preset time period, where the second time range includes at least one of a third time period and a fourth time period, the third time period includes a time period with a third preset duration before the preset time period, and the fourth time period includes a time period with a fourth preset duration after the preset time period.

22. The device according to any one of claims 19 to 21, characterized in that, The tactile signal discarding process is used to discard tactile signals with a signal strength less than or equal to a reference value, or to discard the N lowest-priority tactile signals, where N is a positive integer; The tactile signal processing priority reduction process is used to reduce the processing priority of tactile signals with a signal strength less than or equal to a reference value.

23. The device according to claim 22, characterized in that, It further includes: A second determination unit, configured to determine at least one of the reference values according to the main signal and at least one threshold.

24. The device according to claim 23, characterized in that, It further includes: A third determination unit, configured to determine the at least one threshold according to object attribute information or protocol agreement.

25. The device according to any one of claims 19 to 23, characterized in that The determination subunit is used to perform at least one of the following: Determine the main signal according to at least one tactile signal with the maximum signal strength in the multiplexed tactile signals; Determine the main signal according to at least one tactile signal with a signal strength greater than a preset strength in the multiplexed tactile signals; Determine the main signal in the multiplexed tactile signals according to the object attribute information corresponding to the multiplexed tactile signals; Determine a main signal from the multiple tactile signals according to a tactile signal corresponding to a preset execution device or a preset action position.

26. The device according to claim 25, wherein It further includes: A fourth determination unit, configured to determine the signal strength of each tactile signal according to the signal strength of the signal at a time-domain sampling point; Alternatively, determine the signal strength of each tactile signal according to the signal strength of the signal at the sampling points within a preset time period.

27. The device according to claim 26, wherein, It further includes: A fifth determination unit, configured to determine the preset time period according to a time period indicated by object attribute information, a time period agreed upon by a protocol, or a time period implemented by a rendering engine.

28. The device according to claim 22, characterized in that, It further includes: A sixth determination unit, configured to determine the priority of a tactile signal according to object attribute information; Alternatively, determine the priority of the tactile signal corresponding to the actuator according to the sorting of the actuators in the target object.

29. An electronic device, characterized in that, It includes a processor and a memory. The memory stores a program or instruction that can run on the processor. When the program or instruction is executed by the processor, the steps of the method for processing tactile data described in any one of claims 1 to 14 are implemented.

30. A readable storage medium, characterized in that, A program or instruction is stored on the readable storage medium. When the program or instruction is executed by a processor, the steps of the method for processing tactile data described in any one of claims 1 to 14 are implemented.

31. A chip, characterized in that, The chip includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is configured to run a program or instruction to implement the steps of the method for processing tactile data described in any one of claims 1 to 14.

Images