Tactile signal processing method, device and equipment

Abstract

The present application provides a tactile signal processing method, device and equipment, which belongs to the field of tactile coding technology. The above method includes: obtaining a tactile signal corresponding to each spatial position in a block group of a target object; for each block group, performing the following operations respectively until each spatial position in the block group is marked as a target spatial position: selecting a first spatial position from a plurality of spatial positions to perform a spatial area selection operation, and determining at least one second spatial position associated with the first spatial position; determining a main tactile signal and a secondary tactile signal associated with the main tactile signal based on the tactile signal corresponding to the first spatial position and the tactile signal corresponding to at least one second spatial position; marking the first spatial position and the at least one second spatial position as target spatial positions; generating a mapping relationship between the spatial position of the main tactile signal and the spatial position of the associated secondary tactile signal, and processing according to the mapping relationship.

Description

Technical Field

[0001] The present application belongs to the field of tactile coding technology, and specifically relates to a tactile signal processing method, device and equipment. Background Art

[0002] Tactile information is broadly categorized into two main types: tactile information based on muscle movement, also known as kinesthetic information, and tactile information based on skin texture, also known as texture information. In some technical fields, such as virtual reality and autonomous driving, tactile information is tactilely encoded to generate tactile signals. These signals are then transmitted to the user via hardware, resulting in vibrations or pulses that enhance their tactile perception.

[0003] In the related art, the human body is divided into multiple blocks, and tactile coding is achieved based on the tactile signals in each block. However, this method has poor coding effect. Summary of the Invention

[0004] The embodiments of the present application provide a tactile signal processing method, apparatus, and device, which can solve the problem of poor encoding effect of existing encoding of single-point tactile signals.

[0005] In a first aspect, a tactile signal processing method is provided, comprising:

[0006] Acquire a tactile signal corresponding to each spatial position in a block group of a target object, wherein the target object includes at least one block group, and each block group includes a plurality of spatial positions;

[0007] For each block group, perform the following operations until each spatial position in the block group is marked as a target spatial position:

[0008] Selecting a first spatial position from the plurality of spatial positions and performing a spatial region selection operation to determine at least one second spatial position associated with the first spatial position; the first spatial position being determined based on a tactile signal corresponding to an unmarked spatial position in the corresponding block group;

[0009] determining, based on the tactile signal corresponding to the first spatial position and the tactile signal corresponding to the at least one second spatial position, a primary tactile signal and a secondary tactile signal associated with the primary tactile signal;

[0010] marking the first spatial location and the at least one second spatial location as target spatial locations;

[0011] A mapping relationship between the spatial position of the primary haptic signal and the spatial position of the associated secondary haptic signal is generated, and processing is performed according to the mapping relationship.

[0012] In a second aspect, a tactile signal processing device is provided, comprising:

[0013] an acquisition module, configured to acquire a tactile signal corresponding to each spatial position in a block group of a target object, wherein the target object includes at least one block group, and each block group includes a plurality of spatial positions;

[0014] The first processing module is configured to perform the following operations for each block group until each spatial position in the block group is marked as a target spatial position:

[0015] Selecting a first spatial position from the plurality of spatial positions and performing a spatial region selection operation to determine at least one second spatial position associated with the first spatial position; the first spatial position being determined based on a tactile signal corresponding to an unmarked spatial position in the corresponding block group;

[0016] determining, based on the tactile signal corresponding to the first spatial position and the tactile signal corresponding to the at least one second spatial position, a primary tactile signal and a secondary tactile signal associated with the primary tactile signal;

[0017] marking the first spatial position and the at least one second spatial position as target spatial positions until each spatial position in the block group is marked as a target spatial position;

[0018] The second processing module is configured to generate a mapping relationship between the spatial position of the primary tactile signal and the spatial position of the associated secondary tactile signal, and perform processing according to the mapping relationship.

[0019] In a third aspect, a terminal is provided, comprising a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the method described in the first aspect are implemented.

[0020] In a fourth aspect, a readable storage medium is provided, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0021] In a fifth aspect, a chip is provided, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is configured to run a program or instruction to implement the method described in the first aspect.

[0022] In a sixth aspect, a computer program / program product is provided, wherein the computer program / program product is stored in a storage medium and is executed by at least one processor to implement the steps of the method described in the first aspect.

[0023] The main tactile signal and the secondary tactile signal of the embodiment of the present application are determined based on the tactile signal corresponding to the first spatial position in the block group and the tactile signal corresponding to the second spatial position. The second spatial position is determined by performing a spatial area selection operation on the first spatial position, that is, there is a spatial correlation between the first spatial position and the second spatial position. In other words, after the tactile signal corresponding to each spatial position in the block group is divided, subsequent processing is performed based on the mapping relationship between the spatial position of the main tactile signal and the spatial position of the associated secondary tactile signal. Compared with the technical solution in the related art that does not divide the tactile signal, the tactile signal is divided, and the mapping relationship between the main tactile signal and the secondary tactile signal is obtained, so that the subsequent processing can improve the encoding effect based on the mapping relationship. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 This is one of the schematic diagrams of the human body block group provided in the embodiment of the present application;

[0025] Figure 2 This is the second schematic diagram of the human body block group provided in the embodiment of the present application;

[0026] Figure 3 This is the third schematic diagram of the human body block group provided in the embodiment of the present application;

[0027] Figure 4 is a flowchart of a tactile signal processing method provided in an embodiment of the present application;

[0028] Figure 5 This is one of the spatial matrix schematic diagrams provided in the embodiments of the present application;

[0029] Figure 6 This is the second spatial matrix diagram provided in the embodiment of the present application;

[0030] Figure 7 This is the third spatial matrix diagram provided in the embodiment of the present application;

[0031] Figure 8 This is the fourth spatial matrix diagram provided in the embodiment of the present application;

[0032] Figure 9 is a schematic diagram of a mask matrix provided in an embodiment of the present application;

[0033] Figure 10 is a structural diagram of a tactile signal processing device provided in an embodiment of the present application;

[0034] Figure 11 is a structural diagram of a communication device provided in an embodiment of the present application;

[0035] Figure 12 This is a schematic diagram of the hardware structure of the terminal provided in the embodiment of the present application. DETAILED DESCRIPTION

[0036] The following will be combined with the accompanying drawings in the embodiments of this application to clearly describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field are within the scope of protection of this application.

[0037] The terms "first," "second," and the like in the specification and claims of this application are used to distinguish similar objects, and are not used to describe a specific order or precedence. It should be understood that the terms used in this manner are interchangeable where appropriate, so that the embodiments of this application can be implemented in an order other than that illustrated or described herein, and that the objects distinguished by "first" and "second" are generally of the same type, and do not limit the number of objects. For example, the first object can be one or more. In addition, the term "and / or" in the specification and claims refers to at least one of the connected objects, and the character " / " generally indicates that the objects connected are in an "or" relationship.

[0038] In related art, the various parts of the human body can be divided into 32 blocks, and each block is labeled. For example, label 1: front of the head; label 2: back of the head; label 3: right side of the head; label 4: left side of the head; label 5: right upper chest; label 6: left upper chest; label 7: abdomen; label 8: waist; label 9: upper back; label 10: lower back; label 11: right upper arm; label 12: left upper arm; label 13: right forearm; label 14: left forearm; label 15: right wrist; label 16: left hand Wrist; Label 17: right palm; Label 18: left palm; Label 19: back of right hand; Label 20: back of left hand; Label 21: right fingers; Label 22: left fingers; Label 23: right thigh; Label 24: left thigh; Label 25: right calf; Label 26: left calf; Label 27: right sole; Label 28: left sole; Label 29: right instep; Label 30: left instep; Label 31: right toes; Label 32: left toes.

[0039] Alternatively, each block can be represented by a serial number, which is a 5-bit binary number corresponding to the index minus 1. For example, index 1 represents the front of the head, and the serial number corresponding to the front of the head is 00000; index 12 represents the left upper arm, and the serial number corresponding to the left upper arm is 01011; index 32 represents the left toe, and the serial number corresponding to the left toe is 11111.

[0040] In the embodiment of the present application, at least one block may be divided into a block group, such as Figure 1 As shown in , the right fingers and right upper palm are divided into the same block group; Figure 2As shown in , the left forearm is divided into a block group; Figure 3 As shown, the right upper chest, left upper chest, abdomen and waist are divided into one block group.

[0041] It should be understood that each block includes multiple spatial positions, and each spatial position corresponds to a tactile signal, also known as a single-point tactile signal. Figure 2 As shown, the left forearm includes 10 spatial positions.

[0042] The present invention provides a tactile signal processing method. The tactile signal processing method provided by the present invention is described in detail below with reference to the accompanying drawings through some embodiments and application scenarios.

[0043] See also Figure 4 , Figure 4 Flowchart of the tactile signal processing method according to an embodiment of the present application. The tactile signal processing method provided in this embodiment includes the following steps:

[0044] S401 , obtaining a tactile signal corresponding to each spatial position in a block group of a target object.

[0045] As described above, a block group is composed of at least one block, and each block includes multiple spatial positions, that is, the block group includes multiple spatial positions.

[0046] The target object includes at least one block group. In this step, a tactile signal corresponding to each spatial position in the block group of the target object is obtained, wherein the tactile signal is determined based on the position of the spatial position in the block, the vibration amplitude received by the spatial position, and the vibration duration.

[0047] S402: For each block group, perform the following operations respectively until each spatial position in the block group is marked as a target spatial position:

[0048] A first spatial position is selected from a plurality of spatial positions to perform a spatial region selection operation, and at least one second spatial position associated with the first spatial position is determined.

[0049] A primary tactile signal and a secondary tactile signal associated with the primary tactile signal are determined according to the tactile signal corresponding to the first spatial position and the tactile signal corresponding to the at least one second spatial position.

[0050] The first spatial location and the at least one second spatial location are marked as target spatial locations.

[0051] In this step, for each block group in the target object, perform the following operations:

[0052] A first unmarked spatial position is selected from the multiple spatial positions of the block group, and a spatial region selection operation is performed on the first spatial position to determine at least one second spatial position associated with the first spatial position. A primary tactile signal and a secondary tactile signal are determined based on the tactile signal corresponding to the first spatial position and the tactile signal corresponding to the second spatial position. For specific technical solutions for determining the primary tactile signal and the secondary tactile signal, please refer to the subsequent embodiments. Finally, the first and second spatial positions are marked as target spatial positions.

[0053] Specifically, during a spatial region selection operation, a first spatial location is determined based on tactile signals corresponding to unmarked spatial locations in the block group. This means that the first spatial location is not marked as a target spatial location. A spatial region selection operation is performed on this first spatial location to determine at least one second spatial location associated with the first spatial location. This means that the first and second spatial locations are spatially correlated. For more detailed technical solutions, please refer to the subsequent embodiments.

[0054] S403: Generate a mapping relationship between the spatial position of the primary tactile signal and the spatial position of the associated secondary tactile signal, and perform processing according to the mapping relationship.

[0055] It should be understood that the above steps can obtain multiple primary tactile signals and the secondary tactile signals associated with each primary tactile signal, thereby generating a mapping relationship between the spatial positions of the primary tactile signals and the spatial positions of the associated secondary tactile signals. Optionally, a tactile signal partitioning table corresponding to the block group can be generated based on the spatial positions of the primary tactile signals and the spatial positions of the secondary tactile signals. This tactile information partitioning table is used to represent the partitioning results of the tactile signals corresponding to each spatial position in the block group.

[0056] An optional implementation is to store the spatial position serial numbers corresponding to the primary tactile signal and the spatial position serial numbers corresponding to the secondary tactile signal in a tactile signal partition table. For technical solutions for determining the spatial position serial numbers, please refer to the following content.

[0057] Another optional implementation is: storing the power corresponding to the primary tactile signal and the power corresponding to the secondary tactile signal in a tactile signal division table.

[0058] For specific technical solutions on how to process according to the mapping relationship, please refer to the subsequent embodiments.

[0059] The main tactile signal and the secondary tactile signal of the embodiment of the present application are determined based on the tactile signal corresponding to the first spatial position in the block group and the tactile signal corresponding to the second spatial position. The second spatial position is determined by performing a spatial area selection operation on the first spatial position, that is, there is a spatial correlation between the first spatial position and the second spatial position. In other words, after the tactile signal corresponding to each spatial position in the block group is divided, subsequent processing is performed based on the mapping relationship between the spatial position of the main tactile signal and the spatial position of the associated secondary tactile signal. Compared with the technical solution in the related art that does not divide the tactile signal, the tactile signal is divided, and the mapping relationship between the main tactile signal and the secondary tactile signal is obtained, so that the subsequent processing can improve the encoding effect based on the mapping relationship.

[0060] Optionally, selecting a first spatial position from the multiple spatial positions to perform a spatial region selection operation, and determining at least one second spatial position associated with the first spatial position includes:

[0061] determining an unmarked spatial position corresponding to the tactile signal with the highest power as a first spatial position;

[0062] At least one second spatial position associated with the first spatial position in the spatial matrix corresponding to the block group is determined based on a preset target mask matrix corresponding to the first spatial position.

[0063] It should be noted that after the block groups are divided, a spatial matrix corresponding to each block group can be generated based on the distribution of the spatial positions corresponding to each block group, wherein the spatial matrix is ​​used to represent the positional relationship between each spatial position in the block group.

[0064] For example, Figure 1 The block group shown includes the right fingers and the right upper palm. The tactile signal corresponding to the spatial position of the right finger block can be understood as a one-dimensional signal, and the tactile signal corresponding to the spatial position of the right upper palm block can be understood as a two-dimensional signal. Figure 1 The distribution of each spatial position in the block group shown is generated as follows Figure 5 The spatial matrix shown, wherein the spatial matrix includes a serial number corresponding to each spatial position. The serial numbers corresponding to the above spatial positions can be customized. It should be understood that there is no tactile signal at the spatial position corresponding to number 0 in the spatial matrix.

[0065] For example, Figure 2 The block group shown includes the left forearm, and the tactile signal corresponding to the spatial position of the left forearm block can be understood as a three-dimensional signal. Figure 2 The distribution of each spatial position in the block group is shown, and the three-dimensional signal is flattened into a two-dimensional signal to generate the following Figure 6The spatial matrix shown, wherein the spatial matrix includes a sequence number corresponding to each spatial position.

[0066] For example, Figure 3 The block groups shown are right upper chest, left upper chest, abdomen and waist, based on Figure 3 The distribution of each spatial position in the block group shown is generated as follows Figure 7 The spatial matrix shown, wherein the spatial matrix includes a sequence number corresponding to each spatial position.

[0067] In this embodiment, the unmarked spatial positions in the block group are traversed, and the spatial position corresponding to the tactile signal with the highest power is determined as the first spatial position. Then, at least one second spatial position associated with the first spatial position is determined through a preset target mask matrix corresponding to the first spatial position. For technical solutions for determining the second spatial position, please refer to the subsequent embodiments. In other embodiments, the target matrix includes a serial number corresponding to each spatial position, the power of the tactile signal corresponding to each spatial position, and a power ranking of the tactile signal corresponding to each spatial position. The power ranking is a descending ranking of the power of the tactile signal corresponding to each spatial position in the block group.

[0068] Specifically, see Figure 8 , Figure 8 Show the space matrix and Figure 1 The block groups shown correspond to the following. The sequence number corresponding to the spatial position is the value in the lower right corner of the rectangular box, the power of the tactile signal corresponding to the spatial position is the value in the rectangular box, and the power ranking of the tactile signal corresponding to the spatial position is the value in the upper right corner of the rectangular box. The higher the value, the lower the power of the tactile signal corresponding to the spatial matrix.

[0069] Optionally, the determining, based on a preset target mask matrix corresponding to the first spatial position, at least one second spatial position associated with the first spatial position in the spatial matrix corresponding to the block group includes:

[0070] Determining a target mask matrix corresponding to the first spatial position according to a preset mapping relationship;

[0071] A spatial region selection operation is performed on the spatial matrix using a target mask matrix to determine at least one spatial position in the spatial matrix associated with the first spatial position as the at least one second spatial position.

[0072] The above mapping relationship is used to characterize the mapping between spatial positions and mask matrices. In this embodiment, the mapping relationship can be used to query the first spatial position to determine the target mask matrix corresponding to the first spatial position, and then a spatial region selection operation can be performed on the spatial matrix using the target mask matrix to determine at least one second spatial position.

[0073] Specifically, see Figure 9 , Figure 9 The mask matrix shown is a 9*9 matrix, specifically including four mask matrices: (a), (b), (c), and (d). In the mask matrix, the position corresponding to the number 1 indicates the spatial location where a tactile signal is present, and the position corresponding to the number 0 indicates the spatial location where a tactile signal is absent. Different spatial locations can correspond to different mask matrices. For example, for the palm, mask matrix (a) corresponds to the finger block, and mask matrix (d) corresponds to the palm block.

[0074] Alternatively, the first spatial position can be used as the center of the mask matrix, and a spatial region selection operation can be performed through the mask matrix to determine the second spatial position. Figure 9 In the case of the mask matrix (a) shown, the spatial position adjacent above the first spatial position and the spatial position adjacent below the first spatial position are determined as the second spatial position.

[0075] In this embodiment, a spatial region selection operation is performed on the spatial matrix through the target mask matrix to determine a second spatial position that is spatially correlated with the first spatial position. Then, a primary tactile signal is determined based on the tactile signal corresponding to the first spatial position, and a secondary tactile signal is determined based on the tactile signal corresponding to the second spatial position, thereby dividing the tactile signal corresponding to each spatial position in the block group.

[0076] Optionally, determining the primary tactile signal and the secondary tactile signal associated with the primary tactile signal according to the tactile signal corresponding to the first spatial position and the tactile signal corresponding to the at least one second spatial position includes:

[0077] determining the tactile signal corresponding to the first spatial position as the main tactile signal;

[0078] The tactile signal corresponding to each second spatial position in the at least one second spatial position is determined as a secondary tactile signal associated with the primary tactile signal.

[0079] In this embodiment, the tactile signal corresponding to the first spatial position is determined as the primary tactile signal, and the tactile signal corresponding to each second spatial position is determined as a secondary tactile signal associated with the primary tactile signal.

[0080] The above-mentioned second spatial position is an unmarked spatial position, or a marked target spatial position. That is to say, one possible situation is that if the second spatial position is an unmarked spatial position, then a secondary tactile signal is associated with only one main tactile signal. Another possible situation is that if the second spatial position is a marked target spatial position, a secondary tactile signal can be associated with multiple main tactile signals, that is, the second spatial position corresponding to a secondary tactile signal and the first spatial position corresponding to multiple main tactile signals have spatial correlation, and in the subsequent process of dividing the tactile signal corresponding to each spatial position in the block group, the secondary tactile signal and the associated multiple main tactile signals can be divided into one group.

[0081] It should be noted that when the second spatial position is an unmarked spatial position, if, except for the first spatial position, all other spatial positions are marked spatial positions, in this case, the tactile signal corresponding to the first spatial position is determined to be the primary tactile signal, and there is no secondary tactile signal associated with the primary tactile signal.

[0082] Optionally, the processing according to the mapping relationship includes:

[0083] Determining, according to the mapping relationship, a primary tactile signal corresponding to each block group and a secondary tactile signal associated with the primary tactile signal;

[0084] The primary tactile signal and the secondary tactile signal associated with the primary tactile signal are encoded to generate a target code stream.

[0085] In this embodiment, the above-mentioned mapping relationship is used to characterize the mapping between the spatial position of the main tactile signal corresponding to each block group and the spatial position of the associated secondary tactile signal, and then based on the mapping relationship, the main tactile signal corresponding to each block group and the secondary tactile signal associated with the main tactile signal are determined, and the above-mentioned main tactile signal and the secondary tactile signal associated with the main tactile signal are encoded. Since the above-mentioned mapping relationship can reflect the spatial correlation between the spatial position corresponding to the main tactile signal and the spatial position corresponding to the secondary tactile signal in the block group, it can reduce the information redundancy in the code stream formed by encoding the tactile signal corresponding to each spatial position, thereby improving the encoding effect.

[0086] The tactile signal processing method provided in the embodiment of the present application can be executed by a tactile signal processing device. In the embodiment of the present application, the tactile signal processing device performing the tactile signal processing method is taken as an example to illustrate the tactile signal processing device provided in the embodiment of the present application.

[0087] like Figure 10 As shown, the embodiment of the present application further provides a tactile signal processing device 1000, comprising:

[0088] An acquisition module 1001 is configured to acquire a tactile signal corresponding to each spatial position in a block group of a target object, wherein the target object includes at least one block group, and each block group includes multiple spatial positions;

[0089] The first processing module 1002 is configured to perform the following operations for each block group until each spatial position in the block group is marked as a target spatial position:

[0090] Selecting a first spatial position from the plurality of spatial positions and performing a spatial region selection operation to determine at least one second spatial position associated with the first spatial position; the first spatial position being determined based on a tactile signal corresponding to an unmarked spatial position in the corresponding block group;

[0091] determining, based on the tactile signal corresponding to the first spatial position and the tactile signal corresponding to the at least one second spatial position, a primary tactile signal and a secondary tactile signal associated with the primary tactile signal;

[0092] marking the first spatial position and the at least one second spatial position as target spatial positions until each spatial position in the block group is marked as a target spatial position;

[0093] The second processing module 1003 is configured to generate a mapping relationship between the spatial position of the primary tactile signal and the spatial position of the associated secondary tactile signal, and perform processing according to the mapping relationship.

[0094] Optionally, the first processing module 1002 is specifically configured to:

[0095] determining an unmarked spatial position corresponding to the tactile signal with the highest power as a first spatial position;

[0096] Based on a preset target mask matrix corresponding to the first spatial position, at least one second spatial position associated with the first spatial position in the spatial matrix corresponding to the block group is determined; the spatial matrix is ​​used to characterize the positional relationship between each spatial position in the block group.

[0097] Optionally, the first processing module 1002 is further specifically configured to:

[0098] Determining a target mask matrix corresponding to the first spatial position according to a preset mapping relationship, wherein the mapping relationship is used to represent the mapping between the spatial position and the mask matrix;

[0099] A spatial region selection operation is performed on the spatial matrix using a target mask matrix to determine at least one spatial position in the spatial matrix associated with the first spatial position as the at least one second spatial position.

[0100] Optionally, the first processing module 1002 is further specifically configured to:

[0101] determining the tactile signal corresponding to the first spatial position as the main tactile signal;

[0102] determining a tactile signal corresponding to each second spatial position in the at least one second spatial position as a secondary tactile signal associated with the primary tactile signal;

[0103] The second spatial position is an unmarked spatial position, or a marked target spatial position.

[0104] Optionally, the second processing module 1002 is specifically configured to:

[0105] Determining, according to the mapping relationship, a primary tactile signal corresponding to each block group and a secondary tactile signal associated with the primary tactile signal;

[0106] The primary tactile signal and the secondary tactile signal associated with the primary tactile signal are encoded to generate a target code stream.

[0107] The main tactile signal and the secondary tactile signal of the embodiment of the present application are determined based on the tactile signal corresponding to the first spatial position in the block group and the tactile signal corresponding to the second spatial position. The second spatial position is determined by performing a spatial area selection operation on the first spatial position, that is, there is a spatial correlation between the first spatial position and the second spatial position. In other words, after the tactile signal corresponding to each spatial position in the block group is divided, subsequent processing is performed based on the mapping relationship between the spatial position of the main tactile signal and the spatial position of the associated secondary tactile signal. Compared with the technical solution in the related art that does not divide the tactile signal, the tactile signal is divided, and the mapping relationship between the main tactile signal and the secondary tactile signal is obtained, so that the subsequent processing can improve the encoding effect based on the mapping relationship.

[0108] This device embodiment is similar to the above Figure 4 Corresponding to the embodiment of the tactile signal processing method shown, each implementation process and implementation method in the above method embodiment can be applied to the device embodiment and can achieve the same technical effect.

[0109] The tactile signal processing device in the embodiments of the present application can be an electronic device, such as an electronic device with an operating system, or a component in an electronic device, such as an integrated circuit or chip. The electronic device can be a terminal, or it can be other devices other than a terminal. For example, the terminal can include but is not limited to the types of terminals listed above, and other devices can be servers, network attached storage (NAS), etc., which are not specifically limited in the embodiments of the present application.

[0110] Alternatively, as Figure 11 As shown, an embodiment of the present application also provides a communication device 1100, including a processor 1101 and a memory 1102, wherein the memory 1102 stores programs or instructions that can be run on the processor 1101. For example, when the communication device 1100 is a terminal, the program or instructions are executed by the processor 1101 to implement the various steps of the above-mentioned tactile signal processing method embodiment and can achieve the same technical effect.

[0111] The present application also provides a terminal embodiment, which corresponds to the above-mentioned terminal side method embodiment. The various implementation processes and implementation methods of the above-mentioned method embodiment are applicable to the terminal embodiment and can achieve the same technical effects. Specifically, Figure 12 A schematic diagram of the hardware structure of a terminal for implementing an embodiment of the present application.

[0112] The terminal 1200 includes but is not limited to components such as a radio frequency unit 1201 , a network module 1202 , an audio output unit 1203 , an input unit 1204 , a sensor 1205 , a display unit 1206 , a user input unit 1207 , an interface unit 1208 , a memory 1209 , and a processor 1210 .

[0113] Those skilled in the art will understand that the terminal 1200 may also include a power supply (such as a battery) to power each component, and the power supply may be logically connected to the processor 1210 through a power management system, thereby implementing functions such as charging, discharging, and power consumption management through the power management system. Figure 12 The terminal structure shown in the figure does not constitute a limitation on the terminal. The terminal may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be repeated here.

[0114] It should be understood that in an embodiment of the present application, the input unit 1204 may include a graphics processing unit (GPU) 12041 and a microphone 12042, and the graphics processor 12041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 1206 may include a display panel 12061, and the display panel 12061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1207 includes a touch panel 12071 and at least one of other input devices 12072. The touch panel 12071 is also called a touch screen. The touch panel 12071 may include two parts: a touch detection device and a touch controller. Other input devices 12072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0115] In the embodiment of the present application, after receiving downlink data from a network-side device, the RF unit 1201 may transmit the data to the processor 1210 for processing; the RF unit 1201 may also send uplink data to the network-side device. Typically, the RF unit 1201 includes, but is not limited to, an antenna, an amplifier, a transceiver, a coupler, a low-noise amplifier, a duplexer, and the like.

[0116] The memory 1209 can be used to store software programs or instructions and various data. The memory 1209 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, applications or instructions required for at least one function (such as a sound playback function, an image playback function, etc.). In addition, the memory 1209 may include a volatile memory or a non-volatile memory, or the memory 1209 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct RAM bus random access memory (DRRAM). The memory 1209 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0117] Processor 1210 may include one or more processing units. Optionally, processor 1210 integrates an application processor and a modem processor. The application processor primarily handles operations related to the operating system, user interface, and application programs, while the modem processor primarily processes wireless communication signals, such as a baseband processor. It is understood that the modem processor may not be integrated into processor 1210.

[0118] The processor 1210 is configured to perform the following operations:

[0119] Obtaining a tactile signal corresponding to each spatial position in the block group of the target object;

[0120] For each block group, perform the following operations until each spatial position in the block group is marked as a target spatial position:

[0121] Selecting a first spatial position from the plurality of spatial positions to perform a spatial region selection operation, and determining at least one second spatial position associated with the first spatial position;

[0122] determining, based on the tactile signal corresponding to the first spatial position and the tactile signal corresponding to the at least one second spatial position, a primary tactile signal and a secondary tactile signal associated with the primary tactile signal;

[0123] marking the first spatial location and the at least one second spatial location as target spatial locations;

[0124] A mapping relationship between the spatial position of the primary haptic signal and the spatial position of the associated secondary haptic signal is generated, and processing is performed according to the mapping relationship.

[0125] An embodiment of the present application further provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned tactile signal processing method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, they are not repeated here.

[0126] The processor is the processor in the terminal described in the above embodiment. The readable storage medium includes a computer-readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0127] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned tactile signal processing method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0128] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0129] An embodiment of the present application further provides a computer program / program product, which is stored in a storage medium and executed by at least one processor to implement the various processes of the above-mentioned tactile signal processing method embodiment and can achieve the same technical effect. To avoid repetition, it is not repeated here.

[0130] It should be noted that, in this article, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the statement "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element. In addition, it should be noted that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in the opposite order according to the functions involved. For example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0131] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes a number of instructions for enabling a terminal (which can be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in each embodiment of the present application.

[0132] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of this application, ordinary technicians in this field can also make many forms without departing from the purpose of this application and the scope of protection of the claims, all of which are within the protection of this application.

Claims

1. A tactile signal processing method, characterized in that: include: Acquire a tactile signal corresponding to each spatial position in a block group of a target object, wherein the target object includes at least one block group, and each block group includes a plurality of spatial positions; For each block group, perform the following operations until each spatial position in the block group is marked as a target spatial position: Selecting a first spatial position from the plurality of spatial positions and performing a spatial region selection operation to determine at least one second spatial position associated with the first spatial position; the first spatial position being determined based on a tactile signal corresponding to an unmarked spatial position in the corresponding block group; determining, based on the tactile signal corresponding to the first spatial position and the tactile signal corresponding to the at least one second spatial position, a primary tactile signal and a secondary tactile signal associated with the primary tactile signal; marking the first spatial location and the at least one second spatial location as target spatial locations; A mapping relationship between the spatial position of the primary haptic signal and the spatial position of the associated secondary haptic signal is generated, and processing is performed according to the mapping relationship.

2. The method according to claim 1, characterized in that The selecting a first spatial position from the plurality of spatial positions to perform a spatial region selection operation and determining at least one second spatial position associated with the first spatial position includes: determining an unmarked spatial position corresponding to the tactile signal with the highest power as a first spatial position; Based on a preset target mask matrix corresponding to the first spatial position, at least one second spatial position associated with the first spatial position in the spatial matrix corresponding to the block group is determined; the spatial matrix is ​​used to characterize the positional relationship between each spatial position in the block group.

3. The method according to claim 2, characterized in that The determining, based on a preset target mask matrix corresponding to the first spatial position, at least one second spatial position associated with the first spatial position in the spatial matrix corresponding to the block group includes: Determining a target mask matrix corresponding to the first spatial position according to a preset mapping relationship, wherein the mapping relationship is used to represent the mapping between the spatial position and the mask matrix; A spatial region selection operation is performed on the spatial matrix using a target mask matrix to determine at least one spatial position in the spatial matrix associated with the first spatial position as the at least one second spatial position.

4. The method according to claim 1, wherein The determining, based on the tactile signal corresponding to the first spatial position and the tactile signal corresponding to the at least one second spatial position, a primary tactile signal and a secondary tactile signal associated with the primary tactile signal includes: determining the tactile signal corresponding to the first spatial position as the main tactile signal; determining a tactile signal corresponding to each second spatial position in the at least one second spatial position as a secondary tactile signal associated with the primary tactile signal; The second spatial position is an unmarked spatial position, or a marked target spatial position.

5. The method according to claim 1, wherein The processing according to the mapping relationship includes: Determining, according to the mapping relationship, a primary tactile signal corresponding to each block group and a secondary tactile signal associated with the primary tactile signal; The primary tactile signal and the secondary tactile signal associated with the primary tactile signal are encoded to generate a target code stream.

6. A tactile signal processing device, characterized in that: include: an acquisition module, configured to acquire a tactile signal corresponding to each spatial position in a block group of a target object, wherein the target object includes at least one block group, and each block group includes a plurality of spatial positions; The first processing module is configured to perform the following operations for each block group until each spatial position in the block group is marked as a target spatial position: Selecting a first spatial position from the plurality of spatial positions and performing a spatial region selection operation to determine at least one second spatial position associated with the first spatial position; the first spatial position being determined based on a tactile signal corresponding to an unmarked spatial position in the corresponding block group; determining, based on the tactile signal corresponding to the first spatial position and the tactile signal corresponding to the at least one second spatial position, a primary tactile signal and a secondary tactile signal associated with the primary tactile signal; marking the first spatial position and the at least one second spatial position as target spatial positions until each spatial position in the block group is marked as a target spatial position; The second processing module is configured to generate a mapping relationship between the spatial position of the primary tactile signal and the spatial position of the associated secondary tactile signal, and perform processing according to the mapping relationship.

7. The device according to claim 6, characterized in that The first processing module is specifically configured to: determining an unmarked spatial position corresponding to the tactile signal with the highest power as a first spatial position; Determining, based on a preset target mask matrix corresponding to the first spatial position, at least one second spatial position associated with the first spatial position in the spatial matrix corresponding to the block group; The spatial matrix is ​​used to represent the positional relationship between each spatial position in the block group.

8. The device according to claim 7, characterized in that The first processing module is further specifically configured to: Determining a target mask matrix corresponding to the first spatial position according to a preset mapping relationship, wherein the mapping relationship is used to represent the mapping between the spatial position and the mask matrix; A spatial region selection operation is performed on the spatial matrix using a target mask matrix to determine at least one spatial position in the spatial matrix associated with the first spatial position as the at least one second spatial position.

9. The device according to claim 6, characterized in that The first processing module is further specifically configured to: determining the tactile signal corresponding to the first spatial position as the main tactile signal; determining a tactile signal corresponding to each second spatial position in the at least one second spatial position as a secondary tactile signal associated with the primary tactile signal; The second spatial position is an unmarked spatial position, or a marked target spatial position.

10. The device according to claim 6, characterized in that The second processing module is specifically configured to: Determining, according to the mapping relationship, a primary tactile signal corresponding to each block group and a secondary tactile signal associated with the primary tactile signal; The primary tactile signal and the secondary tactile signal associated with the primary tactile signal are encoded to generate a target code stream.

11. A terminal, characterized in that: The method comprises a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the tactile signal processing method according to any one of claims 1 to 5 are implemented.

12. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by a processor, the steps of the tactile signal processing method according to any one of claims 1 to 5 are implemented.

Images