A skin display and display method

Abstract

This invention discloses a skin display and display method, belonging to the field of tactile feedback technology. The device is a non-invasive tactile image presentation device, composed of an array-type driving unit, a flexible fitting structure, and a control module. The driving unit employs an electrical pulse array or a multi-linear motor array. The electrical pulse array is a non-metallic electrode array, with independently controllable and electrically isolated electrodes; the motor array is arranged in a matrix, with the vibration direction perpendicular to the skin, and each motor is independently controlled. The flexible fitting structure can adapt to and tightly fix curved skin surfaces in various parts of the human body. The control module can analyze image pixels and grayscale / depth information, converting them into electrical stimulation or vibration parameters and outputting them in real time. The display method maps the image pixels to the corresponding driving unit positions, using parameters such as intensity and frequency to form skin-perceptible tactile signals, achieving non-visual image transmission. This invention can accurately present complete tactile images, adapt to multiple scenarios, and improve the inclusiveness and comfort of human-computer interaction.

Description

Technical Field

[0001] This invention relates to the field of haptic feedback technology and is a non-visual image presentation device that can convert image information into skin-perceptible signals, specifically a skin display and display method. Background Technology

[0002] In the fields of information transmission and human-computer interaction, traditional information interaction methods mainly rely on visual and auditory channels, such as visual presentation through displays and auditory feedback through voice devices. These audiovisual-dependent interaction methods have significant limitations in scenarios used by visually / hearingly impaired individuals, professional work scenarios where visual and auditory channels are occupied, and VR / AR immersive interaction scenarios. They cannot meet the needs for private, non-visual information transmission.

[0003] To address the aforementioned issues, haptic feedback technology has gradually become a research hotspot. Currently, some haptic feedback devices have been applied in consumer electronics, industrial control, and other fields. They mainly transmit simple tactile signals through vibration, pressure, and other means. However, these devices are mostly simple feedback structures with a single point or a small number of driving units, which cannot achieve complete conversion and presentation of image information. They also suffer from problems such as slow response of driving units, chaotic vibration directions that are prone to mutual interference, and poor adaptability, making it difficult to meet the skin's requirements for the accuracy and completeness of image-based tactile perception. Summary of the Invention

[0004] In view of the technical problems mentioned in the background section, the purpose of this invention is to provide a skin display and display method.

[0005] To achieve the objectives of this invention, the technical solution provided by this invention is as follows: First aspect This invention provides a skin display, which includes: an array-type driving unit, a flexible bonding structure, and a control module; The array-type drive unit is an electric pulse array, a multi-linear motor LRAs array, or a linear resonant actuator array. The skin display is a non-invasive tactile image presentation device used to convert image information into tactile signals that can be perceived by the skin.

[0006] Furthermore, the electrical pulse array is a micro-electrode array made of non-metallic conductive material; a single electrode can output an electrical pulse signal with adjustable intensity and frequency; multiple electrode sheets form an electrical pulse array in a preset manner, and the electrode sheets are electrically isolated from each other. The multi-linear motor array uses multi-linear motors of preset specifications as core drive units. All motors are arranged in an array in a matrix manner with equal spacing. The vibration direction of the motors is uniformly set to be perpendicular to the direction of human skin. Each motor in the array is an independent drive unit and is electrically connected to the control module through a circuit to realize independent vibration intensity, frequency and start / stop control.

[0007] Furthermore, the preset form includes an equally spaced matrix arrangement, an arc-shaped arrangement, or a strip arrangement; the preset specifications include 10×10, 5×5, 15×15, or 20×20.

[0008] Furthermore, when the electrical pulse array is a micro-electrode array, the flexible bonding structure is a flexible substrate; the flexible substrate is made of food-grade flexible silicone material or breathable flexible fabric material, and is designed to be bendable and bondable according to the curvature characteristics of human skin. The electrical pulse array is embedded and fixed on the inner side of the flexible substrate, and an elastic fixing band is provided on the outer side, so that the electrode array can be tightly and gaplessly bonded to the surface of human skin. When the array-type drive unit is a multi-linear motor array, the flexible fitting structure is a flexible fixing bracket. The flexible fixing bracket is made of a flexible, skin-friendly material with a certain degree of toughness. It is a matrix-type groove structure that matches the motor array. The multi-linear motor array is embedded in the groove and fixed. Adjustable binding structures, buckles or magnetic attraction are provided on both sides of the bracket to achieve the fitting and fixing of the device with human skin, and to adapt to different curved parts of the human body such as the forehead, arms, abdomen, back and thighs.

[0009] Furthermore, when the electrical pulse array is a micro-electrode array, the control module is an electrical pulse control module; the electrical pulse control module is the control core of the skin display, and is electrically or wirelessly connected to the electrical pulse array through a flexible wire. It has a built-in image information processing unit, an electrical pulse signal generation unit, and a real-time control unit, which can realize the digital analysis of image information, the precise generation of electrical pulse signals, and the real-time signal output at the second level. When the array-type drive unit is a multi-linear motor array, the control module is a motor impulse control module; the motor control module includes an image information processing unit, a vibration control unit, and a power supply unit. The image information processing unit is electrically connected to an external image input device and is used to receive image information and analyze pixel and grayscale / depth values; the vibration control unit is electrically connected to the image information processing unit and the multi-linear motor array respectively and is used to convert the analyzed image information into vibration control signals for the motor; the power supply unit provides power to the entire device.

[0010] Furthermore, the motor control module can be integrated or separate. The separate design separates the image information processing unit from the vibration control unit, and the signal transmission is achieved through wireless communication.

[0011] Second aspect This invention provides a skin display method, implemented using the aforementioned skin display, for converting image information into tactile signals perceptible to the skin.

[0012] Furthermore, when the array-type drive unit is an electrical pulse array and the control module is an electrical pulse control module, the following steps are included: Step 1: Image Information Input: The electrical pulse control module receives external image information, which can be static or dynamic digital image signals; Step 2: Image Information Analysis: The image information processing unit in the electrical pulse control module splits the image information by pixel dimension, maps the position of each pixel to the physical position of the electrode in the electrical pulse array, and converts the grayscale value / depth value of each pixel into parameters of the electrical pulse signal. Step 3: Electrical pulse signal generation and output: The electrical pulse signal generation unit generates a matching electrical pulse signal for each electrode plate according to the analyzed parameters. The real-time control unit refreshes and outputs the electrical pulse signal once per second to realize real-time control of the electrical pulse signal. Step 4: Skin electrical stimulation feedback: The electrical pulse array applies the received electrical pulse signals to the attached skin surface. The skin senses the electrical stimulation intensity and frequency of different electrode pads, forming a sensory feedback corresponding to the original image, realizing the non-visual transmission of image information. In step 2, the parameters of the electrical pulse signal include electrical pulse intensity parameters and frequency parameters, or the parameters of the electrical pulse signal include electrical pulse duty cycle, intensity parameters, and frequency parameters.

[0013] Furthermore, when the array-type drive unit is a multi-linear motor array and the control module is a motor control module, the following steps are included: Step 11: Image Information Input: The external image input device transmits image information to the image information processing unit of the control module; Step 22: Image Information Analysis: The image information processing unit performs pixel-level analysis on the image, determines the position coordinates, grayscale value or depth value of each pixel in the image, and maps the pixel position to the matrix position of the motor array one by one; Step 33: Vibration signal conversion: The vibration control unit converts the grayscale / depth value of the pixel into the vibration intensity and vibration frequency of the corresponding motor based on the parsed image information. The higher the grayscale / depth value, the greater the vibration intensity and frequency of the corresponding motor, and vice versa. This generates an independent vibration control signal for each motor. Step 44: Vibration scanning control: The vibration control unit controls the multi-linear motor array to vibrate synchronously or sequentially according to the preset frequency scanning rule, and converts the two-dimensional image pixel information into a two-dimensional tactile image that can be perceived by human skin through vibration scanning in the time dimension. Step 55: Tactile Perception Presentation: A multi-linear motor array fixed to the human skin transmits kinetic energy to the skin through uniaxial vibration perpendicular to the skin. The user receives information on the vibration position, intensity, and frequency of the motor array through tactile perception of the skin, and then identifies the corresponding image content. After long-term use, the user can form a neural conditioned reflex, improving the efficiency and accuracy of image tactile recognition.

[0014] Furthermore, the preset frequency rule is 1-20Hz, or 1-30Hz, or, static images use low-frequency scanning of 1-5Hz, and dynamic images use high-frequency scanning of 10-30Hz.

[0015] Compared with the prior art, the beneficial effects of the present invention are as follows: (1) The present invention takes non-invasive tactile image presentation as the core, and transforms image information into skin-sensible signals. It can be widely used in scenarios such as assistive perception for visually / hearing impaired people, professional work where the audiovisual channel is occupied, VR / AR immersive interaction, and private information transmission. It fills the gap in image information transmission technology that is non-visual and non-perceptual, and greatly improves the inclusiveness and scene adaptability of human-computer interaction.

[0016] (2) In this invention, an independent drive unit is used with an electric pulse array or a multi-linear motor array. The electrode sheets are electrically isolated and the motor vibration direction is uniformly perpendicular to the skin, thus avoiding signal interference and vibration disorder from the source. The control module can accurately convert image pixels and gray / depth values ​​into electrical stimulation or vibration parameters, realize complete digital analysis and real-time output of image information, solve the problems of traditional tactile devices being unable to present complete images, having lag in response, and insufficient accuracy, and ensure that the tactile image is clear, stable, and highly faithful.

[0017] (3) The flexible fitting structure in this invention uses skin-friendly materials such as food-grade silicone and breathable fabric, which can be bent to fit the curved skin of multiple parts of the human body such as the forehead, arms, abdomen, back, and thighs. It is combined with elastic straps, buckles, magnetic attraction and other fixing methods to achieve a tight fit without gaps. The device supports multiple array specifications, wired / wireless connection, integrated / split control, and static / dynamic images can be matched with different scanning frequencies. It is comfortable and breathable to wear for a long time. Users can form a conditioned reflex through training, which significantly improves the efficiency and accuracy of image tactile recognition. Attached Figure Description

[0018] Figure 1 This is a schematic diagram of the structure of the skin display provided in Embodiment 1 of this application; Figure 2 This is a schematic diagram of the structure of the skin display provided in Embodiment 2 of this application; In the figure, 1 is a micro-electrode array, 2 is a flexible substrate, 3 is an electrical pulse control module, 4 is a flexible fixing bracket, 5 is a multi-linear motor array, and 6 is the human skin surface. Detailed Implementation

[0019] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of the present invention.

[0020] It should be noted that the acquisition of data and collection of information in this application are legal, compliant, or obtained with the consent of the subject of the data collection.

[0021] Example 1 like Figure 1 As shown, this embodiment provides a skin display, which includes: an array-type driving unit, a flexible bonding structure, and a control module; The array-type driving unit is an electrical pulse array; The skin display is a non-invasive tactile image presentation device used to convert image information into tactile signals that can be perceived by the skin.

[0022] Preferably, the electrical pulse array is made of a non-metallic conductive material; a single electrode can output an electrical pulse signal with adjustable intensity and frequency; multiple electrode sheets form an electrical pulse array in a preset manner, and the electrode sheets are electrically isolated from each other to avoid signal interference.

[0023] The preset forms include equally spaced matrix arrangement, arc-shaped arrangement, or strip arrangement.

[0024] Preferably, the flexible bonding structure is a flexible substrate 2; the flexible substrate 2 is made of food-grade flexible silicone material or breathable flexible fabric material, and is designed to be bendable and fit according to the curvature characteristics of human skin. The electrical pulse array is embedded and fixed on the inner side of the flexible substrate 2, and an elastic fixing band is provided on the outer side, so that the electrode array can fit tightly and without gaps on the surface of human skin (such as the arm, back and other parts).

[0025] Preferably, the control module is an electrical pulse control module 3; the electrical pulse control module 3 is the control core of the skin display, and is electrically or wirelessly connected to the electrical pulse array through a flexible wire. It has a built-in image information processing unit, an electrical pulse signal generation unit, and a real-time control unit, which can realize digital analysis of image information, accurate generation of electrical pulse signals, and real-time signal output at the second level.

[0026] This embodiment also provides a skin display method, implemented using the aforementioned skin display, for converting image information into skin-perceptible tactile signals, including the following steps: Step 1: Image Information Input: The electrical pulse control module 3 receives external image information, such as obstacle outline images, VR / AR virtual object images, navigation sign images, etc. The external image information can be static or dynamic digital image signals; Step 2: Image Information Analysis: The image information processing unit in the electrical pulse control module 3 splits the image information according to the pixel dimension, and maps the position of each pixel to the physical position of the electrode in the electrical pulse array. It converts the gray value / depth value of each pixel into parameters of the electrical pulse signal (the higher the pixel gray value / depth value, the greater the corresponding electrical pulse intensity and the higher the pulse frequency). Step 3: Electrical pulse signal generation and output: The electrical pulse signal generation unit generates a matching electrical pulse signal for each electrode plate according to the analyzed parameters. The real-time control unit refreshes and outputs the electrical pulse signal once per second to realize real-time control of the electrical pulse signal. Step 4: Skin electrical stimulation feedback: The electrical pulse array applies the received electrical pulse signals to the attached skin surface. The skin senses the electrical stimulation intensity and frequency of different electrode pads, forming a sensory feedback corresponding to the original image, realizing the non-visual transmission of image information. In step 2, the parameters of the electrical pulse signal include an electrical pulse intensity parameter and a frequency parameter, or the parameters of the electrical pulse signal include an electrical pulse duty cycle, an intensity parameter, and a frequency parameter. Preferably, the parameters of the electrical pulse signal include an electrical pulse intensity parameter and a frequency parameter.

[0027] Example 2 like Figure 2 As shown, this embodiment provides a skin display, which includes: an array-type driving unit, a flexible bonding structure, and a control module; The array-type drive unit is a multi-linear motor LRAs array or a linear resonant actuator array; The skin display is a non-invasive tactile image presentation device used to convert image information into tactile signals that can be perceived by the skin.

[0028] The multi-linear motor array uses multi-linear motors of preset specifications as core drive units. All motors are arranged in a matrix with equal spacing to form an array. The vibration direction of the motors is uniformly set to be perpendicular to the direction of human skin. Each motor in the array is an independent drive unit and is electrically connected to the control module through a circuit to realize independent vibration intensity, frequency and start / stop control.

[0029] The preset specifications include 10×10, 5×5, 15×15, or 20×20. Preferably, 10×10 is selected.

[0030] Preferably, the flexible fitting structure is a flexible fixing bracket 4; the flexible fixing bracket 4 is made of a flexible, skin-friendly material with a certain degree of toughness, and it is a matrix groove structure that matches the motor array. The multi-linear motor array is embedded in the groove and fixed. Adjustable binding structures (such as Velcro, elastic straps), buckles or magnetic attraction are provided on both sides of the bracket to achieve the fitting and fixing of the device to the human skin surface 6, and to adapt to different curved parts of the human body such as the forehead, arms, abdomen, back and thighs.

[0031] Preferably, the control module is a motor control module; the motor control module includes an image information processing unit, a vibration control unit, and a power supply unit. The image information processing unit is electrically connected to an external image input device (such as a camera, VR / AR host, or navigation terminal) and is used to receive image information and analyze pixel and grayscale / depth values. The vibration control unit is electrically connected to the image information processing unit and the multi-linear motor array, respectively, and is used to convert the analyzed image information into vibration control signals for the motor. The power supply unit provides power to the entire device.

[0032] Preferably, the motor control module is either an integrated unit or a separate unit. The separate design separates the image information processing unit from the vibration control unit, and the signal transmission is achieved through wireless communication.

[0033] Accordingly, this embodiment also provides a skin display method, implemented using the aforementioned skin display, for converting image information into skin-perceptible tactile signals, including the following steps: Step 11: Image Information Input: The external image input device transmits image information (such as obstacle outlines, virtual object shapes, and navigation paths) to the image information processing unit of the control module; Step 22: Image Information Analysis: The image information processing unit performs pixel-level analysis on the image, determines the position coordinates, grayscale value or depth value of each pixel in the image, and maps the pixel position to the matrix position of the motor array (i.e., the row and column coordinates of the motor array correspond to the pixel row and column coordinates of the image). Step 33: Vibration signal conversion: The vibration control unit converts the grayscale / depth value of the pixel into the vibration intensity and vibration frequency of the corresponding motor based on the parsed image information. The higher the grayscale / depth value, the greater the vibration intensity and frequency of the corresponding motor, and vice versa. This generates an independent vibration control signal for each motor. Step 44: Vibration scanning control: The vibration control unit controls the multi-linear motor array to vibrate synchronously or sequentially according to the preset frequency scanning rule and the set scanning order (such as row by row, column by column), and converts the two-dimensional image pixel information into a two-dimensional tactile image that can be perceived by human skin through vibration scanning in the time dimension. Step 55: Tactile Perception Presentation: A multi-linear motor array fixed to the human skin transmits kinetic energy to the skin through uniaxial vibration perpendicular to the skin. The user receives information on the vibration position, intensity, and frequency of the motor array through tactile perception of the skin, and then identifies the corresponding image content. After long-term use, the user can form a neural conditioned reflex, improving the efficiency and accuracy of image tactile recognition.

[0034] The preset frequency rule is 1-20Hz, or 1-30Hz, or, static images use a low-frequency scan of 1-5Hz, and dynamic images use a high-frequency scan of 10-30Hz. Finally, it should be noted that the above embodiments are merely illustrative and explanatory of the present invention, and are not intended to limit the present invention to the scope of the described embodiments. Furthermore, those skilled in the art will understand that the present invention is not limited to the above embodiments, and many more variations and modifications can be made based on the teachings of the present invention, all of which fall within the scope of protection claimed by the present invention.

Claims

1. A skin display, characterized in that, The skin display includes: an array-type driving unit, a flexible bonding structure, and a control module; The array-type drive unit is an electric pulse array, a multi-linear motor LRAs array, or a linear resonant actuator array. The skin display is a non-invasive tactile image presentation device used to convert image information into tactile signals that can be perceived by the skin.

2. The skin display according to claim 1, characterized in that, The electric pulse array is a micro-electrode array (1), which is made of non-metallic conductive material; a single electrode can output an electric pulse signal with adjustable intensity and frequency; multiple electrode sheets form an electric pulse array in a preset form, and the electrode sheets are electrically isolated from each other. The multi-linear motor array uses multi-linear motors of preset specifications as core drive units. All motors are arranged in an array in a matrix manner with equal spacing. The vibration direction of the motors is uniformly set to be perpendicular to the direction of human skin. Each motor in the array is an independent drive unit and is electrically connected to the control module through a circuit to realize independent vibration intensity, frequency and start / stop control.

3. The skin display according to claim 2, characterized in that, The preset format includes an equally spaced matrix arrangement, an arc-shaped arrangement, or a strip arrangement; the preset specifications include 10×10, 5×5, 15×15, or 20×20.

4. The skin display according to claim 1, characterized in that, When the electric pulse array is a micro-electrode array (1), the flexible bonding structure is a flexible substrate (2); the flexible substrate (2) is made of food-grade flexible silicone material or breathable flexible fabric material, and is designed as a bendable and bondable structure according to the curvature characteristics of human skin. The electric pulse array is embedded and fixed inside the flexible substrate (2), and an elastic fixing band is provided on the outside so that the electrode array can be tightly and gaplessly bonded to the surface of human skin. When the array-type drive unit is a multi-linear motor array (5), the flexible fitting structure is a flexible fixing bracket (4); the flexible fixing bracket (4) is made of a flexible, skin-friendly, and resilient material. It is a matrix groove structure that matches the motor array. The multi-linear motor array is embedded in the groove and fixed. Adjustable binding structures, buckles, or magnetic attraction are provided on both sides of the bracket to achieve the fitting and fixing of the device with human skin and to adapt to different curved parts of the human body such as the forehead, arms, abdomen, back, and thighs.

5. The skin display according to claim 1, characterized in that, When the electric pulse array is a micro-electrode array (1), the control module is an electric pulse control module (3); the electric pulse control module (3) is the control core of the skin display, and is electrically or wirelessly connected to the electric pulse array through a flexible wire. It has a built-in image information processing unit, an electric pulse signal generation unit, and a real-time control unit, which can realize the digital analysis of image information, the accurate generation of electric pulse signals, and the real-time signal output at the second level. When the array-type drive unit is a multi-linear motor array (5), the control module is a motor impulse control module; the motor control module includes an image information processing unit, a vibration control unit and a power supply unit. The image information processing unit is electrically connected to an external image input device and is used to receive image information and perform pixel and grayscale / depth value analysis; the vibration control unit is electrically connected to the image information processing unit and the multi-linear motor array respectively and is used to convert the analyzed image information into a vibration control signal for the motor; the power supply unit provides power to the entire device.

6. The skin display according to claim 5, characterized in that, The motor control module can be integrated or separate. The separate design separates the image information processing unit from the vibration control unit, and the signal transmission is achieved through wireless communication.

7. A skin display method, characterized in that, Implemented using a skin display as described in any one of claims 1-6, for converting image information into skin-perceptible tactile signals.

8. The skin display method according to claim 7, characterized in that, When the array-type drive unit is an electric pulse array and the control module is an electric pulse control module (3), the following steps are included: Step 1: Image information input: The electrical pulse control module (3) receives external image information, which is a static or dynamic digital image signal; Step 2: Image information analysis: The image information processing unit in the electric pulse control module (3) splits the image information according to the pixel dimension, and the position of each pixel corresponds to the physical position of the electrode in the electric pulse array. The gray value / depth value of each pixel is converted into the parameters of the electric pulse signal. Step 3: Electrical pulse signal generation and output: The electrical pulse signal generation unit generates a matching electrical pulse signal for each electrode plate according to the analyzed parameters. The real-time control unit refreshes and outputs the electrical pulse signal once per second to realize real-time control of the electrical pulse signal. Step 4: Skin electrical stimulation feedback: The electrical pulse array applies the received electrical pulse signals to the attached skin surface. The skin senses the electrical stimulation intensity and frequency of different electrode pads, forming a sensory feedback corresponding to the original image, realizing the non-visual transmission of image information. In step 2, the parameters of the electrical pulse signal include electrical pulse intensity parameters and frequency parameters, or the parameters of the electrical pulse signal include electrical pulse duty cycle, intensity parameters, and frequency parameters.

9. The skin display method according to claim 7, characterized in that, When the array-type drive unit is a multi-linear motor array (5), and the control module is a motor control module, the following steps are included: Step 11: Image Information Input: The external image input device transmits image information to the image information processing unit of the control module; Step 22: Image Information Analysis: The image information processing unit performs pixel-level analysis on the image, determines the position coordinates, grayscale value or depth value of each pixel in the image, and maps the pixel position to the matrix position of the motor array one by one; Step 33: Vibration signal conversion: The vibration control unit converts the grayscale / depth value of the pixel into the vibration intensity and vibration frequency of the corresponding motor based on the parsed image information. The higher the grayscale / depth value, the greater the vibration intensity and frequency of the corresponding motor, and vice versa. This generates an independent vibration control signal for each motor. Step 44: Vibration scanning control: The vibration control unit controls the multi-linear motor array to vibrate synchronously or sequentially according to the preset frequency scanning rule, and converts the two-dimensional image pixel information into a two-dimensional tactile image that can be perceived by human skin through vibration scanning in the time dimension. Step 55: Tactile Perception Presentation: A multi-linear motor array fixed to the human skin transmits kinetic energy to the skin through uniaxial vibration perpendicular to the skin. The user receives information on the vibration position, intensity, and frequency of the motor array through tactile perception of the skin, and then identifies the corresponding image content. After long-term use, the user can form a neural conditioned reflex, improving the efficiency and accuracy of image tactile recognition.

10. The skin display method according to claim 9, characterized in that, The preset frequency rule is 1-20Hz, or 1-30Hz, or, static images use low-frequency scanning of 1-5Hz, and dynamic images use high-frequency scanning of 10-30Hz.

Images