Tactile data processing method and apparatus and related device

Abstract

The present application belongs to the technical field of rendering and discloses a tactile data processing method and apparatus and a related device. The method in the embodiments of the present application comprises: acquiring multiple tactile signals corresponding to the same execution device group or the same action position group; and preprocessing the multiple tactile signals to obtain processed tactile signals, wherein the preprocessing comprises at least one of the following: tactile signal discarding processing, and tactile signal processing priority lowering processing.

Description

Tactile data processing method, device and related equipment

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to Chinese Patent Application No. 202410047370.4 filed in China on January 11, 2024, the entire contents of which are incorporated herein by reference. Technical Field

[0003] The present application belongs to the field of rendering technology, and specifically relates to a method, apparatus, and related equipment for processing tactile data. Background Art

[0004] Based on the current 3D model file format standard, the rendering engine only supports signal compression processing for one haptic signal. When multiple haptic signals are triggered, independently compressing and encoding each signal significantly limits the haptic signal compression efficiency. However, when simultaneously compressing and encoding multiple haptic signals, the large amount of information corresponding to these signals requires significant processing resources. Therefore, it is difficult to simultaneously achieve both haptic signal compression efficiency and processing resource utilization in the related art. Summary of the Invention

[0005] The embodiments of the present application provide a method, apparatus, and related equipment for processing tactile data, which can solve the problem in related technologies that it is difficult to simultaneously ensure the compression efficiency and processing resource occupancy of tactile signals.

[0006] In a first aspect, a method for processing tactile data is provided, which is executed by an electronic device and includes:

[0007] Acquire multiple tactile signals corresponding to the same execution device group or the same action position group;

[0008] Preprocessing the multiple tactile signals to obtain processed tactile signals; wherein the preprocessing includes at least one of the following:

[0009] Tactile signal discarding processing;

[0010] Tactile signal processing is prioritized.

[0011] In a second aspect, a tactile data processing device is provided, comprising:

[0012] An acquisition unit, configured to acquire multiple tactile signals corresponding to the same execution device group or the same action position group;

[0013] A processing unit is configured to pre-process the multiple tactile signals to obtain processed tactile signals; wherein the pre-processing includes at least one of the following:

[0014] Tactile signal discarding processing;

[0015] Tactile signal processing is prioritized.

[0016] In a third aspect, an electronic device is provided, comprising a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.

[0017] In a fourth aspect, an electronic device is provided, comprising a processor and a communication interface, wherein the processor is configured to obtain multiple tactile signals corresponding to the same execution device group or the same action position group;

[0018] Preprocessing the multiple tactile signals to obtain processed tactile signals; wherein the preprocessing includes at least one of the following:

[0019] Tactile signal discarding processing;

[0020] Tactile signal processing is prioritized.

[0021] In a fifth aspect, a readable storage medium is provided, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0022] In a sixth aspect, a chip is provided, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is configured to run a program or instruction to implement the method described in the first aspect.

[0023] In a seventh aspect, a computer program / program product is provided, wherein the computer program / program product is stored in a storage medium and is executed by at least one processor to implement the steps of the method described in the first aspect.

[0024] In an embodiment of the present application, multiple tactile signals corresponding to the same execution device group or the same action position group are obtained; the multiple tactile signals are preprocessed to obtain processed tactile signals; wherein the preprocessing includes at least one of the following: tactile signal discarding processing; tactile signal processing priority reduction processing. In the above scheme, since the multiple tactile signals belong to the same execution device group or the same action position group, there may be overlapping signal content in the multiple tactile signals. The above preprocessing can effectively reduce the signal redundancy of the multiple tactile signals, thereby effectively reducing the processing resource usage of the multiple tactile signals. Therefore, the subsequent compression efficiency based on the preprocessed tactile signals can be effectively improved, and the processing resource usage of the multiple tactile signals can be effectively reduced without affecting the signal content of the multiple tactile signals. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] FIG1 is a schematic diagram showing access to tactile data in an embodiment of the present application;

[0026] FIG2 is a schematic flow chart showing a method for processing tactile data according to an embodiment of the present application;

[0027] FIG3 is a schematic diagram showing a module of a device for processing tactile data according to an embodiment of the present application;

[0028] FIG4 is a block diagram showing the structure of an electronic device according to an embodiment of the present application;

[0029] FIG5 shows a structural block diagram of a terminal according to an embodiment of the present application. DETAILED DESCRIPTION

[0030] The following will be combined with the accompanying drawings in the embodiments of this application to clearly describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field are within the scope of protection of this application.

[0031] The terms "first", "second", etc. in this application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the terms used in this way are interchangeable where appropriate, so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first" and "second" are generally of the same type, and do not limit the number of objects, for example, the first object can be one or more. In addition, "or" in this application represents at least one of the connected objects. For example, "A or B" covers three options, namely, Option 1: including A but not including B; Option 2: including B but not including A; Option 3: including both A and B. The character " / " generally indicates that the objects associated before and after are in an "or" relationship.

[0032] The term "indication" in this application can be either a direct indication (or explicit indication) or an indirect indication (or implicit indication). A direct indication can be understood as the sender explicitly informing the receiver of specific information, the operation to be performed, or the requested result, etc. in the instruction sent; an indirect indication can be understood as the receiver determining the corresponding information based on the instruction sent by the sender, or making a judgment and determining the operation to be performed or the requested result, etc. based on the judgment result.

[0033] In order to enable those skilled in the art to better understand the embodiments of the present application, the following description is first given.

[0034] 1. Scene synthesis or rendering process.

[0035] The rendering engine can synthesize scenes based on glTF (3D model file format) files, or it can render the scenes based on glTF files. By rendering the tactile scene, the rendering engine can obtain tactile feedback signals. These tactile signals are then encoded, transmitted, and decoded before being played by the tactile signal actuator.

[0036] The engine obtains glTF files in two ways: the server and client exchange glTF files through the glTF state stream, or obtain glTF files through program files stored on the server and client.

[0037] 2. The Moving Pictures Experts Group (MPEG) has made a haptic extension to glTF (a 3D model file format);

[0038] The MPEG_haptic extension provides access methods for haptic data. MPEG_haptic includes a set of haptic objects (hapticObjects), as shown in Table 1. As shown in Table 2, the accessor properties in hapticObjects point to the haptic data source.

[0039] Table 1

[0040] Table 2

[0041] Figure 1 shows how haptic data is accessed. The hapticObjects in MPEG_haptic point to the accessor, which in turn points to the circular buffer object. The circular buffer object provides access to the circular buffer's data location information and reflects the rendering attributes of the haptic data by referencing the MPEG_media object.

[0042] 3. MPEG also made haptic material-related extensions to glTF (MPEG_haptic_material extension);

[0043] The MPEG_haptic_material extension provides haptic properties for materials. MPEG_haptic_material contains material properties. MPEG_haptic_material is shown in Table 3, and MPEG_haptic_material.material is shown in Table 4.

[0044] Table 3

[0045] The materials property points to a set of material objects. Each material object points to the hapticObject in MPEG_haptic that provides the data source through the haptic property, and indicates the relevant material tactile properties (such as stiffness, friction, etc.) and texture coordinate information.

[0046] Table 4

[0047] 4. Interactivity extension in glTF (3D model file format);

[0048] glTF is used for efficient transmission and loading of 3D scenes and models by engines and applications. glTF defines an extensible publishing format that simplifies authoring workflows and interactive services by enabling interoperable use of 3D content across the industry.

[0049] The Moving Picture Experts Group (MPEG) has extended glTF and initially designed standards for interactivity. For haptic scenarios, these standards primarily describe the interaction between avatars and haptic sources, triggering and generating haptic signals based on this interaction.

[0050] Interactivity is defined based on behavior. Behavior includes trigger condition nodes (i.e., trigger nodes, which can also be described as trigger objects) and action nodes (i.e., action nodes, which can also be described as action objects). The trigger node includes collision conditions, proximity conditions, and visibility conditions. The action node includes tactile feedback actions (i.e., ACTION_SET_HAPTIC), activation nodes (ACTION_ACTIVATE), etc. ACTION_SET_HAPTIC is implemented based on tactile action node objects (HapticActionNode objects) or tactile action media objects (HapticActionMedia objects).

[0051] The hapticObject attribute in HapticActionNode (as shown in Table 5) points to the hapticObject in MPEG_haptic, and the media index (mediaIndex) attribute in HapticActionMedia (as shown in Table 6) further points to the accessor in the above hapticObject, thereby accessing the tactile data.

[0052] Table 5

[0053] Table 6

[0054] The object in the embodiment of the present application includes at least one of the following: scene, node, mesh, material, vertices, face, primitive, etc.

[0055] The following describes in detail the tactile data processing method and related devices provided by the embodiments of the present application through some embodiments and their application scenarios in conjunction with the accompanying drawings.

[0056] As shown in FIG2 , an embodiment of the present application provides a method for processing tactile data, which is performed by an electronic device, which may be at least one of a rendering engine, a rendering device, a scene composition device, a scene composition engine, a presentation engine, and a presentation device. The method includes:

[0057] Step 201: Acquire multiple tactile signals corresponding to the same execution device group or the same action position group.

[0058] The same execution device group includes at least one execution device, and the same action position group includes at least one action position.

[0059] Optionally, there is spatial correlation among the multiple tactile signals corresponding to the same execution device group or the same action position group.

[0060] Step 202: Preprocess the multiple tactile signals to obtain processed tactile signals; wherein the preprocessing includes at least one of the following:

[0061] Tactile signal discarding processing;

[0062] Tactile signal processing is prioritized.

[0063] Here, the processing priority of certain tactile signals in the multi-channel tactile signals can be lowered by lowering the tactile signal processing priority, so that the priority of the tactile signal after the above processing is higher than or equal to the preset priority, thereby facilitating the subsequent compression or rendering processing of only the tactile signals that are higher than or equal to the preset priority.

[0064] Optionally, the method of the embodiment of the present application further includes: compressing or rendering the processed tactile signal.

[0065] In an embodiment of the present application, multiple tactile signals corresponding to the same execution device group or the same action position group are obtained; the multiple tactile signals are preprocessed to obtain processed tactile signals; wherein the preprocessing includes at least one of the following: tactile signal discarding processing; tactile signal processing priority reduction processing. In the above scheme, since the multiple tactile signals belong to the same execution device group or the same action position group, there may be overlapping signal content in the multiple tactile signals. The above preprocessing can effectively reduce the signal redundancy of the multiple tactile signals, thereby effectively reducing the processing resource usage of the multiple tactile signals. Therefore, the subsequent compression efficiency based on the preprocessed tactile signals can be effectively improved, and the processing resource usage of the multiple tactile signals can be effectively reduced without affecting the signal content of the multiple tactile signals.

[0066] Optionally, the method of the embodiment of the present application further includes:

[0067] Determine the execution device grouping or action location grouping based on object attribute information;

[0068] Alternatively, the execution device grouping or the action location grouping is determined according to the rules predetermined by the protocol.

[0069] In an embodiment of the present application, the execution device grouping or the action position grouping is determined based on the object attribute information of (glTF) or the rules predetermined by the protocol, so as to facilitate the subsequent preprocessing of multiple tactile signals corresponding to the same execution device grouping or the same action position grouping.

[0070] As an implementation manner, determining the execution device grouping or the action location grouping according to the object attribute information includes at least one of the following:

[0071] Item A1: Determine the execution devices corresponding to the body part mask (Body part mask) or body part target (Body part target) indicated by the object attribute information as the same execution device group or the same action position group.

[0072] In the embodiment of the present application, the object attribute information indicates a body part mask or a body part target, and it is determined that all execution devices on the body part mask or the body part target belong to the same execution device group or the same action position group.

[0073] Item A2: Determine the execution devices corresponding to a group of mesh vertices (mesh vertice(s)) or faces (face(s)) indicated by the object attribute information as the same execution device group or the same action position group.

[0074] In an embodiment of the present application, the object attribute information indicates a group of network vertices or faces, and it is determined that all execution devices on the group of network vertices or faces belong to the same execution device group or the same action position group.

[0075] Item A3: Determine the execution devices corresponding to a group of device identifiers indicated by the object attribute information as the same execution device group or the same action position group.

[0076] For example, if the object attribute information indicates a group of device IDs, it is determined that the execution devices corresponding to the group of device IDs belong to the same execution device group or the same action location group.

[0077] Item A4: Determine the actuator devices corresponding to a group of body part masks and actuator targets indicated by the object attribute information as the same actuator device group or the same action position group;

[0078] For example, the object attribute information indicates a group of body part masks and actuator targets, and then it is determined that all actuators on the group of body part masks and actuator targets belong to the same actuator group or the same action position group.

[0079] Item A5: Determine a group of actuators indicated by the object attribute information as the same execution device group or the same action position group.

[0080] The above method achieves the purpose of determining the execution device grouping or action position grouping corresponding to the execution device based on the object attribute information.

[0081] As an implementation manner, determining the execution device grouping or the action location grouping according to a predetermined rule of the protocol includes at least one of the following:

[0082] Item B1: The execution devices corresponding to at least one body part mask or body part target agreed upon in the protocol are determined to be the same execution device group or the same action position group.

[0083] For example, the protocol stipulates that all execution devices on one or more body part masks / body part targets belong to the same execution device group or the same action position group.

[0084] Item B2: The execution devices corresponding to at least one mesh vertex or face agreed upon in the protocol are determined to be the same execution device group or the same action position group.

[0085] For example, the protocol stipulates that all execution devices on certain mesh vertice(s) / face(s) belong to the same execution device group or the same action location group.

[0086] Item B3: Determine the execution devices corresponding to at least two adjacent vertices or faces of the avatar mesh agreed upon in the protocol as the same execution device group or the same action position group.

[0087] For example, all execution devices on M vertices / faces with adjacent numbers in the avatar network agreed upon by the protocol belong to the same execution device group or the same action position group.

[0088] It should be noted that, in an embodiment of the present application, the grouping information of the execution devices can be reported from the hardware device side to the rendering engine side, thereby allowing the manufacturer to report the grouping information of the execution devices based on the distribution of the execution devices on the hardware device.

[0089] Optionally, preprocessing the multiple tactile signals to obtain processed tactile signals includes:

[0090] determining a main signal among the multiple tactile signals;

[0091] The secondary signal is pre-processed according to the primary signal to obtain a processed tactile signal, where the secondary signal is a partial or complete tactile signal in the multiple tactile signals except the primary signal.

[0092] The processed tactile signal includes a primary signal and a pre-processed secondary signal.

[0093] In an embodiment of the present application, a main signal is first determined in a multi-channel tactile signal, and then at least one secondary signal is pre-processed (which can also be described as masking processing) based on the main signal, such as discarding a secondary signal that overlaps with the main signal or discarding a secondary signal with a smaller signal strength, so as to effectively reduce the processing resource usage of the multi-channel tactile signal without affecting the signal content of the multi-channel tactile signal.

[0094] As an implementation manner, determining the main signal from the multiple tactile signals includes at least one of the following:

[0095] Item C1: determining a main signal according to at least one tactile signal with the greatest signal strength among the multiple tactile signals.

[0096] For example, a tactile signal with the greatest signal strength is selected from multiple tactile signals as the main signal.

[0097] Alternatively, one tactile signal is selected as the main signal from L tactile signals with the largest signal strengths among the multiple tactile signals, where L is a positive integer.

[0098] Here, determining the primary signal based on the tactile signal with the largest channel strength can effectively ensure the signal strength of the primary signal, that is, effectively ensure the signal quality of the primary signal, and then subsequently discarding the low-quality secondary signal based on the high-quality primary signal.

[0099] Item C2: determining a main signal according to at least one tactile signal having a signal strength greater than a preset strength among the multiple tactile signals.

[0100] When the number of haptic signals with signal strength greater than a preset strength in the multiple haptic signals is greater than one, any one haptic signal may be selected as the main signal from the multiple haptic signals with signal strength greater than the preset strength.

[0101] Here, determining the main signal based on at least one tactile signal with an intensity greater than a preset intensity can effectively ensure the signal strength of the main signal, that is, effectively ensure the signal quality of the main signal, and then subsequently discarding the low-quality (signal strength lower than the preset intensity) secondary signal based on the high-quality main signal.

[0102] Item C3: determining a main signal among the multiple tactile signals according to object attribute information corresponding to the multiple tactile signals.

[0103] For example, if the object attribute information of glTF indicates actuator information, the signal corresponding to the actuator corresponding to the actuator information is used as the main signal.

[0104] Here, based on the object attribute information, the signal corresponding to a certain actuator can be flexibly used as the main signal.

[0105] Item C4: Determine a main signal from the multiple tactile signals based on the tactile signals corresponding to the preset execution device or the preset action position.

[0106] The above-mentioned preset execution device or preset action position is agreed upon by the protocol. For example, for a finger, the signal corresponding to the fingertip joint is used as the main signal.

[0107] Here, the tactile signal corresponding to a certain execution device or action position can be flexibly set as the main signal.

[0108] Optionally, the primary signal or the secondary signal is determined for a signal at a time domain sampling point, or the primary signal or the secondary signal is determined for signals at sampling points within a preset time period.

[0109] In the embodiment of the present application, the time dimension corresponding to the primary signal or the secondary signal may be a time domain sampling point or a sampling point of a preset time period.

[0110] Optionally, the time interval between each determination of the primary signal or the secondary signal should be greater than or equal to a first preset time interval to avoid frequent determination of the primary signal or the secondary signal. Alternatively, the time interval between each determination of the primary signal or the secondary signal should be less than or equal to a second preset time interval to ensure that the preprocessing of the secondary signal based on the primary signal does not affect the signal content of the multi-channel tactile signal (e.g., to avoid content loss). Alternatively, the primary signal or the secondary signal is determined periodically, for example, once within each time period.

[0111] As an implementation manner, preprocessing the secondary signal according to the primary signal to obtain a processed tactile signal includes:

[0112] preprocessing, based on the primary signal at the target moment, a secondary signal within a first time range, the first time range comprising at least one of a first time period and a second time period, the first time period comprising a time period of a first preset duration before the target moment, and the second time period comprising a time period of a second preset duration after the target moment;

[0113] Alternatively, target processing is performed on the secondary signal within the second time range based on the main signal corresponding to the preset time period, and the second time range includes at least one of a third time period and a fourth time period, the third time period includes a time period of a third preset length before the preset time period, and the fourth time period includes a time period of a fourth preset length after the preset time period.

[0114] The above solution can fully compress the secondary signal according to the hysteresis principle. The above first preset time length, second preset time length, third preset time length and fourth preset time length are static, semi-static or dynamic values.

[0115] Optionally, the tactile signal discarding process is used to discard tactile signals with signal strength less than or equal to a reference value, or to discard N tactile signals with the lowest priority, where N is a positive integer;

[0116] The tactile signal processing priority reduction process is used to reduce the processing priority of a tactile signal whose signal strength is less than or equal to a reference value.

[0117] Here, by lowering the haptic signal processing priority, the multi-channel haptic signals can be processed when the total information volume of the multi-channel haptic signals is small, thereby effectively ensuring the total information volume of the multi-channel haptic signals.

[0118] Optionally, the method of the embodiment of the present application further includes:

[0119] Determine the priority of the tactile signal according to the object attribute information;

[0120] Alternatively, the priority of the haptic signal corresponding to the actuator is determined according to the order of the actuator in the target object (glTF object).

[0121] The target object here is the virtual object corresponding to the actuator.

[0122] In the embodiment of the present application, the above-mentioned object attribute information may explicitly indicate the priority identifier of the tactile signal corresponding to a certain action position or a certain actuator.

[0123] Optionally, the method of the embodiment of the present application further includes:

[0124] At least one of the reference values ​​is determined based on the main signal and at least one threshold value.

[0125] Exemplarily, the reference value is obtained by multiplying the signal strength of the main signal by the threshold value. For example, if the signal strength of the main signal is A and the threshold value is 0.8, then the reference value is 0.8*A.

[0126] Optionally, the method of the embodiment of the present application further includes:

[0127] The at least one threshold is determined according to object attribute information or protocol agreement.

[0128] In the embodiment of the present application, different reference values ​​are obtained based on the primary signal and different thresholds. For example, different secondary signals correspond to different reference values.

[0129] Exemplarily, the object attribute information may indicate a threshold value for a main signal or a multi-channel tactile signal, or may indicate a threshold value for each of the multiple sub-signals of the main signal.

[0130] Exemplarily, the protocol may agree on corresponding thresholds based on the signal action position information of the main signal. For example, for the signal of the finger part, the agreed threshold is a first threshold, and for the signal of the chest, the agreed threshold is a second threshold.

[0131] Optionally, the method of the embodiment of the present application further includes:

[0132] Determine the signal strength of each tactile signal according to the signal strength of the signal at a time domain sampling point;

[0133] Alternatively, the signal strength of each tactile signal is determined according to the signal strength of the signal at the sampling point within a preset time period.

[0134] Optionally, a time unit for preprocessing the multi-channel tactile information is a time domain sampling point.

[0135] Optionally, determining the signal strength of each tactile signal based on the signal strength of the signal at the sampling point within a preset time period includes: processing the signal strength of the signal at the sampling point within the preset time period using a preset calculation method to obtain the signal strength of each tactile signal.

[0136] The above-mentioned preset calculation methods include taking an average, a weighted average (optionally, the weighted value can be obtained from a preset model), taking a maximum value or taking a minimum value, etc.

[0137] Optionally, the time unit for preprocessing the multi-channel tactile information is the preset time period.

[0138] Optionally, the method of the embodiment of the present application further includes:

[0139] The preset time period is determined according to the time period indicated by the object attribute information, the time period agreed upon in the protocol, or the time period implemented by the rendering engine.

[0140] For example, the duration of the preset time period is not greater than the delay time, and the specific time length can be determined by agreement, and can be selected between 0.3s and 0.5s to avoid affecting the user experience.

[0141] It should be noted that the primary signal and threshold information can be reported to the rendering engine by the hardware device. This allows the manufacturer to report this information based on the distribution of actuators on the hardware device and the actuator operating parameters. However, it is not ruled out that the rendering engine itself can determine the primary signal and threshold information.

[0142] Optionally, in the embodiment of the present application, it may also be determined whether to pre-process the multiple tactile signals according to object attribute information.

[0143] In an embodiment of the present application, multiple tactile signals corresponding to the same execution device group or the same action position group are obtained; the multiple tactile signals are preprocessed to obtain processed tactile signals; wherein the preprocessing includes at least one of the following: tactile signal discarding processing; tactile signal processing priority reduction processing. In the above scheme, since the multiple tactile signals belong to the same execution device group or the same action position group, there may be overlapping signal content in the multiple tactile signals. The above preprocessing can effectively reduce the signal redundancy of the multiple tactile signals, thereby effectively reducing the processing resource usage of the multiple tactile signals. Therefore, the subsequent compression efficiency based on the preprocessed tactile signals can be effectively improved, and the processing resource usage of the multiple tactile signals can be effectively reduced without affecting the signal content of the multiple tactile signals.

[0144] The tactile data processing method provided in the embodiment of the present application can be executed by a tactile data processing device. In the embodiment of the present application, the tactile data processing device executing the tactile data processing method is used as an example to illustrate the tactile data processing device provided in the embodiment of the present application.

[0145] As shown in FIG3 , an embodiment of the present application further provides a tactile data processing device 300 , including:

[0146] An acquiring unit 301 is configured to acquire multiple tactile signals corresponding to the same execution device group or the same action position group;

[0147] The processing unit 302 is configured to pre-process the multiple tactile signals to obtain processed tactile signals. The pre-processing may include at least one of the following:

[0148] Tactile signal discarding processing;

[0149] Tactile signal processing is prioritized.

[0150] Optionally, the device of the embodiment of the present application further includes:

[0151] A first determining unit, configured to determine execution device grouping or action location grouping according to object attribute information;

[0152] Alternatively, the execution device grouping or the action location grouping is determined according to the rules predetermined by the protocol.

[0153] Optionally, the first determining unit is configured to perform at least one of the following:

[0154] Determine the execution devices corresponding to the body part mask or the body part target indicated by the object attribute information as the same execution device group or the same action position group;

[0155] Determine the execution devices corresponding to a group of mesh vertices or faces indicated by the object attribute information as the same execution device group or the same action position group;

[0156] Determine the execution devices corresponding to a group of device identifiers indicated by the object attribute information as the same execution device group or the same action position group;

[0157] Determine a group of body part masks indicated by the object attribute information and actuator targets corresponding to the same actuator device group or the same action position group;

[0158] A group of actuators indicated by the object attribute information is determined as the same execution device group or the same action position group.

[0159] Optionally, the first determining unit is configured to perform at least one of the following:

[0160] Determine the execution devices corresponding to at least one body part mask or body part target agreed upon in the protocol as the same execution device group or the same action position group;

[0161] Determine the execution devices corresponding to at least one mesh vertex or face agreed upon in the protocol as the same execution device group or the same action position group;

[0162] The execution devices corresponding to at least two adjacent vertices or faces of the avatar grid agreed upon in the protocol are determined as the same execution device group or the same action position group.

[0163] Optionally, the processing unit includes:

[0164] a determination subunit, configured to determine a main signal among the multiple tactile signals;

[0165] The processing subunit is configured to pre-process the secondary signal according to the primary signal to obtain a processed tactile signal, wherein the secondary signal is a partial or complete tactile signal in the multiple tactile signals except the primary signal.

[0166] Optionally, the primary signal or the secondary signal is determined for a signal at a time domain sampling point, or the primary signal or the secondary signal is determined for signals at sampling points within a preset time period.

[0167] Optionally, the processing subunit is configured to:

[0168] preprocessing, based on the primary signal at the target moment, a secondary signal within a first time range, the first time range comprising at least one of a first time period and a second time period, the first time period comprising a time period of a first preset duration before the target moment, and the second time period comprising a time period of a second preset duration after the target moment;

[0169] Alternatively, the secondary signal within the second time range is preprocessed based on the main signal corresponding to the preset time period, and the second time range includes at least one of a third time period and a fourth time period, the third time period includes a time period of a third preset length before the preset time period, and the fourth time period includes a time period of a fourth preset length after the preset time period.

[0170] Optionally, the tactile signal discarding process is used to discard tactile signals with signal strength less than or equal to a reference value, or to discard N tactile signals with the lowest priority, where N is a positive integer;

[0171] The tactile signal processing priority reduction process is used to reduce the processing priority of a tactile signal whose signal strength is less than or equal to a reference value.

[0172] Optionally, the device of the embodiment of the present application further includes:

[0173] The second determining unit is configured to determine at least one reference value according to the main signal and at least one threshold value.

[0174] Optionally, the device of the embodiment of the present application further includes:

[0175] The third determining unit is configured to determine the at least one threshold value according to object attribute information or protocol agreement.

[0176] Optionally, the determining subunit is configured to perform at least one of the following:

[0177] determining a main signal according to at least one tactile signal having the greatest signal strength among the multiple tactile signals;

[0178] determining a main signal according to at least one tactile signal having a signal strength greater than a preset strength among the multiple tactile signals;

[0179] determining a main signal among the multiple tactile signals according to object attribute information corresponding to the multiple tactile signals;

[0180] A main signal is determined from the multiple tactile signals according to the tactile signals corresponding to the preset execution device or the preset action position.

[0181] Optionally, the device of the embodiment of the present application further includes:

[0182] a fourth determining unit, configured to determine the signal strength of each tactile signal according to the signal strength of the signal at a time domain sampling point;

[0183] Alternatively, the signal strength of each tactile signal is determined according to the signal strength of the signal at the sampling point within a preset time period.

[0184] Optionally, the device of the embodiment of the present application further includes:

[0185] The fifth determining unit is configured to determine the preset time period according to the time period indicated by the object attribute information, the time period agreed upon in the protocol, or the time period implemented by the rendering engine.

[0186] Optionally, the device of the embodiment of the present application further includes:

[0187] a sixth determining unit, configured to determine a priority of the tactile signal according to the object attribute information;

[0188] Alternatively, the priorities of the tactile signals corresponding to the actuators are determined according to the order of the actuators in the target object.

[0189] The above-mentioned scheme of the embodiment of the present application obtains multiple tactile signals corresponding to the same execution device group or the same action position group; pre-processes the multiple tactile signals to obtain processed tactile signals; wherein the pre-processing includes at least one of the following: tactile signal discarding processing; tactile signal processing priority reduction processing. In the above-mentioned scheme, since the multiple tactile signals belong to the same execution device group or the same action position group, there may be overlapping signal contents in the multiple tactile signals. The above-mentioned pre-processing can effectively reduce the signal redundancy of the multiple tactile signals, thereby effectively reducing the processing resource usage of the multiple tactile signals. Therefore, the subsequent compression efficiency based on the pre-processed tactile signals can be effectively improved, and the processing resource usage of the multiple tactile signals can be effectively reduced without affecting the signal content of the multiple tactile signals.

[0190] The tactile data processing device provided in the embodiment of the present application can implement each process implemented in the method embodiment of Figure 2 and achieve the same technical effect. To avoid repetition, it will not be described here.

[0191] Optionally, as shown in Figure 4, an embodiment of the present application also provides an electronic device 400, including a processor 401 and a memory 402, and the memory 402 stores programs or instructions that can be run on the processor 401. For example, when the electronic device 400 is a terminal, the program or instructions are executed by the processor 401 to implement the various steps of the above-mentioned tactile data processing method embodiment, and can achieve the same technical effect. To avoid repetition, they are not repeated here.

[0192] The present application also provides an electronic device including a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is configured to execute a program or instruction to implement the steps in the method embodiment shown in FIG2 . This device embodiment corresponds to the above-described method embodiment, and each implementation process and implementation method of the above-described method embodiment are applicable to this electronic device embodiment and can achieve the same technical effects.

[0193] The electronic device may be a terminal, or may be other devices other than a terminal, such as a server, a network attached storage (NAS), etc.

[0194] Among them, the terminal can be a mobile phone, tablet personal computer, laptop computer, notebook computer, personal digital assistant (PDA), handheld computer, netbook, ultra-mobile personal computer (UMPC), mobile Internet device (MID), augmented reality (AR), virtual reality (VR) equipment, mixed reality (MR) equipment, robot, wearable device, flight vehicle, vehicle user equipment (VUE), shipborne equipment, pedestrian user equipment (PUE), smart home (home appliances with wireless communication function, such as refrigerator, TV, washing machine or furniture, etc.), game console, personal computer (PC), ATM or self-service machine and other terminal-side devices. Wearable devices include: smart watches, smart bracelets, smart headphones, smart glasses, smart jewelry (smart bracelets, smart bracelets, smart rings, smart necklaces, smart anklets, smart anklets, etc.), smart wristbands, smart clothing, etc. Among them, vehicle-mounted devices can also be called vehicle-mounted terminals, vehicle-mounted controllers, vehicle-mounted modules, vehicle-mounted components, vehicle-mounted chips, or vehicle-mounted units, etc. It should be noted that the specific type of terminal is not limited in the embodiments of this application.

[0195] The server can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that can provide cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDNs), or cloud computing services based on big data and artificial intelligence platforms.

[0196] Taking an electronic device as a terminal as an example, FIG5 is a schematic diagram of the hardware structure of a terminal implementing an embodiment of the present application.

[0197] The terminal 500 includes but is not limited to: a radio frequency unit 501, a network module 502, an audio output unit 503, an input unit 504, a sensor 505, a display unit 506, a user input unit 507, an interface unit 508, a memory 509 and at least some of the components of the processor 510.

[0198] Those skilled in the art will appreciate that the terminal 500 may also include a power supply (such as a battery) to power various components. The power supply may be logically connected to the processor 510 via a power management system, thereby enabling the power management system to manage charging, discharging, and power consumption. The terminal structure shown in FIG5 does not limit the terminal. The terminal may include more or fewer components than shown, or may combine certain components, or have different component arrangements, which will not be described in detail here.

[0199] It should be understood that in the embodiment of the present application, the input unit 504 may include a graphics processing unit (GPU) 5041 and a microphone 5042. The graphics processor 5041 processes the image data of a static picture or video obtained by an image acquisition device (such as a camera) in a video acquisition mode or an image acquisition mode, or may process the obtained point cloud data. The display unit 506 may include a display panel 5061, which may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 507 includes a touch panel 5071 and at least one of other input devices 5072. The touch panel 5071 is also called a touch screen. The touch panel 5071 may include two parts: a touch detection device and a touch controller. Other input devices 5072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0200] In the embodiment of the present application, after receiving downlink data from a network-side device, the radio frequency unit 501 may transmit the data to the processor 510 for processing. Furthermore, the radio frequency unit 501 may send uplink data to the network-side device. Typically, the radio frequency unit 501 includes, but is not limited to, an antenna, an amplifier, a transceiver, a coupler, a low-noise amplifier, a duplexer, and the like.

[0201] The memory 509 can be used to store software programs or instructions and various data. The memory 509 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, applications or instructions required for at least one function (such as a sound playback function, an image playback function, etc.). In addition, the memory 509 may include a volatile memory or a non-volatile memory. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM), and a direct memory bus random access memory (DRRAM). The memory 509 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0202] Processor 510 may include one or more processing units. Optionally, processor 510 integrates an application processor and a modem processor. The application processor primarily handles operations related to the operating system, user interface, and application programs, while the modem processor primarily processes wireless communication signals, such as a baseband processor. It is understood that the modem processor may not be integrated into processor 510.

[0203] The processor 510 is configured to obtain multiple tactile signals corresponding to the same execution device group or the same action position group;

[0204] Preprocessing the multiple tactile signals to obtain processed tactile signals; wherein the preprocessing includes at least one of the following:

[0205] Tactile signal discarding processing;

[0206] Tactile signal processing is prioritized.

[0207] Optionally, the processor 510 is further configured to:

[0208] Determine the execution device grouping or action location grouping based on object attribute information;

[0209] Alternatively, the execution device grouping or the action location grouping is determined according to the rules predetermined by the protocol.

[0210] Optionally, the processor 510 is further configured to perform at least one of the following:

[0211] Determine the execution devices corresponding to the body part mask or the body part target indicated by the object attribute information as the same execution device group or the same action position group;

[0212] Determine the execution devices corresponding to a group of mesh vertices or faces indicated by the object attribute information as the same execution device group or the same action position group;

[0213] Determine the execution devices corresponding to a group of device identifiers indicated by the object attribute information as the same execution device group or the same action position group;

[0214] Determine a group of body part masks indicated by the object attribute information and actuator targets corresponding to the same actuator device group or the same action position group;

[0215] A group of actuators indicated by the object attribute information is determined as the same execution device group or the same action position group.

[0216] Optionally, the processor 510 is further configured to perform at least one of the following:

[0217] Determine the execution devices corresponding to at least one body part mask or body part target agreed upon in the protocol as the same execution device group or the same action position group;

[0218] Determine the execution devices corresponding to at least one mesh vertex or face agreed upon in the protocol as the same execution device group or the same action position group;

[0219] The execution devices corresponding to at least two adjacent vertices or faces of the avatar grid agreed upon in the protocol are determined as the same execution device group or the same action position group.

[0220] Optionally, the processor 510 is further configured to:

[0221] determining a main signal among the multiple tactile signals;

[0222] The secondary signal is pre-processed according to the primary signal to obtain a processed tactile signal, where the secondary signal is a partial or complete tactile signal in the multiple tactile signals except the primary signal.

[0223] Optionally, the primary signal or the secondary signal is determined for a signal at a time domain sampling point, or the primary signal or the secondary signal is determined for signals at sampling points within a preset time period.

[0224] Optionally, the processor 510 is further configured to:

[0225] preprocessing, based on the primary signal at the target moment, a secondary signal within a first time range, the first time range comprising at least one of a first time period and a second time period, the first time period comprising a time period of a first preset duration before the target moment, and the second time period comprising a time period of a second preset duration after the target moment;

[0226] Alternatively, the secondary signal within the second time range is preprocessed based on the main signal corresponding to the preset time period, and the second time range includes at least one of a third time period and a fourth time period, the third time period includes a time period of a third preset length before the preset time period, and the fourth time period includes a time period of a fourth preset length after the preset time period.

[0227] Optionally, the tactile signal discarding process is used to discard tactile signals with signal strength less than or equal to a reference value, or to discard N tactile signals with the lowest priority, where N is a positive integer;

[0228] The tactile signal processing priority reduction process is used to reduce the processing priority of a tactile signal whose signal strength is less than or equal to a reference value.

[0229] Optionally, the processor 510 is further configured to:

[0230] At least one of the reference values ​​is determined based on the main signal and at least one threshold value.

[0231] Optionally, the processor 510 is further configured to:

[0232] The at least one threshold is determined according to object attribute information or protocol agreement.

[0233] Optionally, the processor 510 is further configured to perform at least one of the following:

[0234] determining a main signal according to at least one tactile signal having the greatest signal strength among the multiple tactile signals;

[0235] determining a main signal according to at least one tactile signal having a signal strength greater than a preset strength among the multiple tactile signals;

[0236] determining a main signal among the multiple tactile signals according to object attribute information corresponding to the multiple tactile signals;

[0237] A main signal is determined from the multiple tactile signals according to the tactile signals corresponding to the preset execution device or the preset action position.

[0238] Optionally, the processor 510 is further configured to:

[0239] Determine the signal strength of each tactile signal according to the signal strength of the signal at a time domain sampling point;

[0240] Alternatively, the signal strength of each tactile signal is determined according to the signal strength of the signal at the sampling point within a preset time period.

[0241] Optionally, the processor 510 is further configured to:

[0242] The preset time period is determined according to the time period indicated by the object attribute information, the time period agreed upon in the protocol, or the time period implemented by the rendering engine.

[0243] Optionally, the processor 510 is further configured to:

[0244] Determine the priority of the tactile signal according to the object attribute information;

[0245] Alternatively, the priorities of the tactile signals corresponding to the actuators are determined according to the order of the actuators in the target object.

[0246] In an embodiment of the present application, multiple tactile signals corresponding to the same execution device group or the same action position group are obtained; the multiple tactile signals are preprocessed to obtain processed tactile signals; wherein the preprocessing includes at least one of the following: tactile signal discarding processing; tactile signal processing priority reduction processing. In the above scheme, since the multiple tactile signals belong to the same execution device group or the same action position group, there may be overlapping signal content in the multiple tactile signals. The above preprocessing can effectively reduce the signal redundancy of the multiple tactile signals, thereby effectively reducing the processing resource usage of the multiple tactile signals. Therefore, the subsequent compression efficiency based on the preprocessed tactile signals can be effectively improved, and the processing resource usage of the multiple tactile signals can be effectively reduced without affecting the signal content of the multiple tactile signals.

[0247] It can be understood that the implementation process of each implementation method mentioned in this embodiment can refer to the relevant description of the tactile data processing method of the method embodiment, and achieve the same or corresponding technical effects. To avoid repetition, it will not be described here.

[0248] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned embodiment of the method for processing tactile data is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0249] The processor is the processor in the terminal described in the above embodiment. The readable storage medium includes a computer-readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk. In some examples, the readable storage medium may be a non-transitory readable storage medium.

[0250] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned tactile data processing method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0251] It should be understood that the chip mentioned in the embodiments of the present application may include a system-level chip (also referred to as a system chip, a chip system or a system-on-chip chip), and may also include an independent display chip, etc.

[0252] An embodiment of the present application further provides a computer program / program product, which is stored in a storage medium and is executed by at least one processor to implement the various processes of the above-mentioned tactile data processing method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0253] It should be noted that, in this article, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in the opposite order according to the functions involved. For example, the described method may be performed in an order different from that described, and various steps may also be added, omitted or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0254] Through the description of the above embodiments, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of a computer software product plus a necessary general-purpose hardware platform, or of course, by hardware. The computer software product is stored in a storage medium (such as ROM, RAM, magnetic disk, optical disk, etc.) and includes a number of instructions for enabling a terminal or network-side device to execute the methods described in each embodiment of the present application.

[0255] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of this application, ordinary technicians in this field can also make many forms of implementation methods without departing from the purpose of this application and the scope of protection of the claims. These implementation methods are all within the protection of this application.

Claims

1. A method for processing tactile data, which is executed by an electronic device, including: Obtaining multiple tactile signals corresponding to the same execution device group or the same action position group; Performing preprocessing on the multiple tactile signals to obtain processed tactile signals; wherein, the preprocessing includes at least one of the following: Discarding processing of tactile signals; Reducing the processing priority of tactile signals.

2. The method according to claim 1, further including: Determining an execution device group or an action position group according to object attribute information; Or, determining an execution device group or an action position group according to rules predetermined by a protocol.

3. The method according to claim 2, wherein Determining an execution device group or an action position group according to object attribute information includes at least one of the following: Determining the execution devices corresponding to the body part mask or body part target indicated by the object attribute information as the same execution device group or the same action position group; Determining the execution devices corresponding to a set of mesh vertices or faces indicated by the object attribute information as the same execution device group or the same action position group; Determining the execution devices corresponding to a set of device identifiers indicated by the object attribute information as the same execution device group or the same action position group; Determining the execution devices corresponding to a set of body part masks and actuator targets indicated by the object attribute information as the same execution device group or the same action position group; Determining a set of actuators indicated by the object attribute information as the same execution device group or the same action position group.

4. The method according to claim 2, wherein Determining an execution device group or an action position group according to rules predetermined by a protocol includes at least one of the following: Determining the execution devices corresponding to at least one body part mask or body part target agreed by the protocol as the same execution device group or the same action position group; Determining the execution devices corresponding to at least one mesh vertex or face agreed by the protocol as the same execution device group or the same action position group; Determining the execution devices corresponding to at least two adjacent vertices or faces of the avatar mesh agreed by the protocol as the same execution device group or the same action position group.

5. The method according to any one of claims 1 to 4, wherein The performing preprocessing on the multiple tactile signals to obtain processed tactile signals includes: Determining a main signal in the multiple tactile signals; Performing preprocessing on the secondary signals according to the main signal to obtain processed tactile signals, where the secondary signals are some or all of the tactile signals in the multiple tactile signals other than the main signal.

6. The method according to claim 5, wherein, The main signal or the secondary signal is determined for the signal at one time domain sampling point, or the main signal or the secondary signal is determined for the signals at the sampling points within a preset time period.

7. The method according to claim 5 or 6, wherein The performing preprocessing on the secondary signals according to the main signal to obtain processed tactile signals includes: Performing preprocessing on the secondary signals within a first time range according to the main signal at the target moment, where the first time range includes at least one of a first time period and a second time period, the first time period includes a time period with a first preset duration before the target moment, and the second time period includes a time period with a second preset duration after the target moment; Alternatively, according to the main signal corresponding to a preset time period, preprocess the secondary signals within a second time range, where the second time range includes at least one of a third time period and a fourth time period, the third time period includes a time period of a third preset duration before the preset time period, and the fourth time period includes a time period of a fourth preset duration after the preset time period.

8. The method according to any one of claims 5 to 7, wherein, The tactile signal discarding process is used to discard tactile signals with a signal strength less than or equal to a reference value, or to discard the N tactile signals with the lowest priority, where N is a positive integer; The tactile signal processing priority reduction process is used to reduce the processing priority of tactile signals with a signal strength less than or equal to a reference value.

9. The method according to claim 8, further comprising: Determine at least one of the reference values according to the main signal and at least one threshold.

10. The method according to claim 9, further comprising: Determine the at least one threshold according to object attribute information or protocol agreement.

11. The method according to any one of claims 5 to 9, wherein, Determining the main signal among the multiple tactile signals includes at least one of the following: Determine the main signal according to at least one tactile signal with the maximum signal strength among the multiple tactile signals; Determine the main signal according to at least one tactile signal with a signal strength greater than a preset strength among the multiple tactile signals; Determine the main signal among the multiple tactile signals according to the object attribute information corresponding to the multiple tactile signals; Determine the main signal among the multiple tactile signals according to the tactile signal corresponding to a preset execution device or a preset action position.

12. The method according to claim 11, further comprising: Determine the signal strength of each tactile signal according to the signal strength of the signal at one time domain sampling point; Alternatively, determine the signal strength of each tactile signal according to the signal strength of the signal at the sampling points within a preset time period.

13. The method according to claim 12, further comprising: Determine the preset time period according to the time period indicated by object attribute information, the time period agreed upon by the protocol, or the time period implemented by the rendering engine.

14. The method according to claim 8, further comprising: Determine the priority of the tactile signal according to object attribute information; Alternatively, determine the priority of the tactile signal corresponding to the actuator according to the sorting of the actuators in the target object.

15. A tactile data processing device, comprising: An acquisition unit, configured to acquire multiple tactile signals corresponding to the same execution device group or the same action position group; A processing unit, configured to preprocess the multiple tactile signals to obtain processed tactile signals; wherein, the preprocessing includes at least one of the following: Tactile signal discarding process; Tactile signal processing priority reduction process.

16. The device according to claim 15, further comprising: A first determination unit, configured to determine the execution device group or the action position group according to object attribute information; Alternatively, determine the execution device group or the action position group according to the rules predetermined by the protocol.

17. The apparatus according to claim 16, wherein The first determination unit is configured to perform at least one of the following: Determine the execution devices corresponding to the body part mask or body part target indicated by the object attribute information as the same execution device group or the same action location group; Determine the execution devices corresponding to a set of mesh vertices or faces indicated by the object attribute information as the same execution device group or the same action location group; Determine the execution devices corresponding to a set of device identifiers indicated by the object attribute information as the same execution device group or the same action location group; Determine the execution devices corresponding to a set of body part masks and actuator targets indicated by the object attribute information as the same execution device group or the same action location group; Determine a set of actuators indicated by the object attribute information as the same execution device group or the same action location group.

18. The apparatus according to claim 16, wherein, The first determination unit is used to perform at least one of the following: Determine the execution devices corresponding to at least one body part mask or body part target agreed upon by the protocol as the same execution device group or the same action location group; Determine the execution devices corresponding to at least one mesh vertex or face agreed upon by the protocol as the same execution device group or the same action location group; Determine the execution devices corresponding to at least two adjacent vertices or faces of the avatar mesh agreed upon by the protocol as the same execution device group or the same action location group.

19. The device according to any one of claims 15 to 18, wherein, The processing unit includes: A determination subunit, configured to determine a main signal from the multiplexed tactile signals; A processing subunit, configured to preprocess the secondary signals according to the main signal to obtain processed tactile signals, where the secondary signals are some or all of the tactile signals other than the main signal in the multiplexed tactile signals.

20. The apparatus according to claim 19, wherein, The main signal or the secondary signal is determined for a signal at a time domain sampling point, or the main signal or the secondary signal is determined for signals at sampling points within a preset time period.

21. The device according to claim 19 or 20, wherein, The processing subunit is used to: Preprocess the secondary signals within a first time range according to the main signal at the target moment, where the first time range includes at least one of a first time period and a second time period, the first time period includes a time period of a first preset duration before the target moment, and the second time period includes a time period of a second preset duration after the target moment; Alternatively, preprocess the secondary signals within a second time range according to the main signal corresponding to the preset time period, where the second time range includes at least one of a third time period and a fourth time period, the third time period includes a time period of a third preset duration before the preset time period, and the fourth time period includes a time period of a fourth preset duration after the preset time period.

22. The device according to any one of claims 19 to 21, wherein, The tactile signal discarding process is used to discard tactile signals with a signal strength less than or equal to a reference value, or to discard the N lowest-priority tactile signals, where N is a positive integer; The tactile signal processing priority reduction process is used to reduce the processing priority of tactile signals with a signal strength less than or equal to a reference value.

23. The apparatus according to claim 22, further comprising: A second determination unit, configured to determine at least one of the reference values according to the main signal and at least one threshold.

24. The apparatus according to claim 23 further comprises: A third determination unit, configured to determine the at least one threshold according to object attribute information or protocol agreement.

25. The device according to any one of claims 19 to 23, wherein The determination subunit is configured to perform at least one of the following: Determine a main signal according to at least one tactile signal with the maximum signal strength among the multiplexed tactile signals; Determine a main signal according to at least one tactile signal with a signal strength greater than a preset strength among the multiplexed tactile signals; Determine a main signal among the multiplexed tactile signals according to the object attribute information corresponding to the multiplexed tactile signals; Determine a main signal among the multiplexed tactile signals according to the tactile signal corresponding to a preset execution device or a preset action position.

26. The apparatus according to claim 25 further comprises: A fourth determination unit, configured to determine the signal strength of each tactile signal according to the signal strength of the signal at one time-domain sampling point; Alternatively, determine the signal strength of each tactile signal according to the signal strength of the signals at the sampling points within a preset time period.

27. The apparatus according to claim 26 further comprises: A fifth determination unit, configured to determine the preset time period according to the time period indicated by object attribute information, the time period agreed upon by the protocol, or the time period implemented by a rendering engine.

28. The apparatus according to claim 22 further comprises: A sixth determination unit, configured to determine the priority of a tactile signal according to object attribute information; Alternatively, determine the priority of the tactile signal corresponding to the actuator according to the sorting of the actuators in the target object.

29. An electronic device, comprising a processor and a memory, where the memory stores a program or instruction that can run on the processor, and when the program or instruction is executed by the processor, the steps of the method for processing tactile data according to any one of claims 1 to 14 are implemented.

30. A readable storage medium, where a program or instruction is stored on the readable storage medium, and when the program or instruction is executed by a processor, the steps of the method for processing tactile data according to any one of claims 1 to 14 are implemented.

31. A chip, comprising a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to run a program or instruction to implement the steps of the method for processing tactile data according to any one of claims 1 to 14.

Images