Biological tissue detection device, system and method, electronic equipment and medium
By using multiple light emitting elements in the biological tissue detection device for multiple imaging and three-dimensional modeling, the problem that the prior art cannot obtain deep information of biological tissue is solved, and a more comprehensive structural information acquisition of biological tissue is achieved.
Patent Information
- Application Number
- CN202411279792.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-12
- Publication Date
- 2024-12-27
AI Technical Summary
The existing biological tissue detection methods can only measure the surface information of biological tissues, and cannot obtain information such as deep structures such as hemoglobin, collagen and fibrous tissue subcutaneously, and cannot achieve comprehensive biological tissue detection.
Using a biological tissue detection device including a light emitting module and a light shading component, the biological tissue is imaged at least twice in the imaging module through at least two light emitting elements, isolated external light, collected images that measure light transmission, and constructed three-dimensionally based on these images. Mode and optical absorption coefficient calculations are used to output three-dimensional scalar maps to characterize tissue hierarchical information at different depths of biological tissue.
Irradiation of light emitting elements at different locations causes changes in the light propagation path, highlighting or weakening the structural and component information of deep tissues, obtaining richer and specific image information, and achieving more comprehensive structural information acquisition of biological tissues.
Smart Images

Figure CN119198571A_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the field of optical detection technology, and specifically relates to a biological tissue detection device, system, method, electronic equipment and medium. Background Art
[0002] Biological tissue refers to a complex structure composed of multiple cells and intercellular matrix, which is widely present in various parts of the human body. At present, the health status of biological tissues has become a public health issue of increasing concern, and the study of the optical properties of biological tissues has also become an important direction in the field of scientific research.
[0003] At present, the market mainly uses infrared light for biological tissue scanning and detection. Specifically, infrared light is irradiated onto the surface of biological tissue, and then the sensor in the instrument collects and analyzes the reflected light from the biological tissue to obtain information such as the depth of the subject's skin color and the distribution of skin color. However, the above detection method can only measure information on the surface of biological tissue, but cannot obtain structural information on the deep layer of biological tissue, such as deep information such as subcutaneous hemoglobin, collagen and fibrous tissue.
[0004] As such, existing detection methods have certain limitations and are unable to obtain more comprehensive information about biological tissues. Therefore, how to conduct biological tissue testing to obtain comprehensive biological tissue information is a problem to be solved. Summary of the invention
[0005] The purpose of the embodiments of the present application is to provide a biological tissue structure detection device, system, method, electronic device and storage medium, which can enable the light to form different information distribution on the image after each imaging, so as to obtain richer and more specific image information, and then obtain more comprehensive structural information of the biological tissue.
[0006] In a first aspect, an embodiment of the present application provides a biological tissue structure detection device, which includes: a light-emitting module and a shading component, wherein the light-emitting module is located in the shading component, and the light-emitting module includes at least two light-emitting elements, and there is a gap between the positions of two adjacent light-emitting elements; the at least two light-emitting elements are used to sequentially emit measurement light to the biological tissue when the biological tissue is imaged at least twice by an imaging module; and the shading component is used to isolate external light from entering the light-emitting module.
[0007] In a second aspect, an embodiment of the present application provides a biological tissue structure detection system, which includes: a biological tissue structure detection device, an imaging module and a processing module; at least two light-emitting elements of the light-emitting module in the biological tissue structure detection device are used to sequentially emit measurement light to the biological tissue when the imaging module images the biological tissue at least twice; the imaging module is used to sequentially collect images of the measurement light transmitted through the biological tissue while isolating external light, so as to obtain at least two measurement images; the processing module is used to perform three-dimensional modeling and optical absorption coefficient calculation on the biological tissue based on the at least two measurement images, and output the three-dimensional scalar image, wherein the three-dimensional scalar image is used to characterize tissue composition information of tissue layers at different depths of the biological tissue.
[0008] In a third aspect, an embodiment of the present application provides a biological tissue detection method, the method comprising: while isolating external light, sequentially collecting images of measurement light transmitted through biological tissue at different positions to obtain at least two measurement images; based on the at least two measurement images, performing three-dimensional modeling and optical absorption coefficient calculation on the biological tissue, and outputting the three-dimensional scalar image, wherein the three-dimensional scalar image is used to characterize tissue composition information of tissue layers at different depths of the biological tissue.
[0009] In a fourth aspect, an embodiment of the present application provides another biological tissue detection device, which includes: an acquisition module and a processing module, wherein the acquisition module is used to sequentially acquire images of measurement light transmitted through biological tissue at different positions while isolating external light, to obtain at least two measurement images; the processing module is used to perform three-dimensional modeling and optical absorption coefficient calculation on the biological tissue based on the at least two measurement images, and output the three-dimensional scalar image, wherein the three-dimensional scalar image is used to characterize tissue composition information of tissue layers at different depths of the biological tissue.
[0010] In a fifth aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the third aspect are implemented.
[0011] In a sixth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the third aspect are implemented.
[0012] In a seventh aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the third aspect.
[0013] In an eighth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the third aspect.
[0014] The biological tissue detection device provided by the embodiment of the present application comprises: a light-emitting module and a shading component, the light-emitting module is located in the shading component, the light-emitting module comprises at least two light-emitting elements, there is a gap between the positions of two adjacent light-emitting elements, the at least two light-emitting elements are used to sequentially emit measurement light to the biological tissue when the biological tissue is imaged at least twice by the imaging module, and the shading component is used to isolate external light from entering the light-emitting module. Through the device, when the biological tissue to be measured is imaged at least twice by the imaging module, the measurement light can be sequentially emitted to the biological tissue to be measured by multiple light-emitting elements arranged at different positions during each imaging. When the same biological tissue is irradiated with light-emitting elements at different positions, the angle, distance, etc. between the light source and the surface of the biological tissue will change, which will cause the propagation path and interaction mode of the light in the biological tissue to change. Therefore, the irradiation of light sources at different positions will highlight or weaken the structure and composition information of certain deep tissues, so that the light forms different information distribution on the image after each imaging, thereby obtaining richer and more specific image information, and then being able to obtain more comprehensive structural information of the biological tissue, such as deep information such as subcutaneous hemoglobin, collagen and fibrous tissue. BRIEF DESCRIPTION OF THE DRAWINGS
[0015] Figure 1 One of the hardware structure diagrams of a biological tissue detection device provided in an embodiment of the present application;
[0016] Figure 2 A second schematic diagram of the hardware structure of a biological tissue detection device provided in an embodiment of the present application;
[0017] Figure 3 A third schematic diagram of the hardware structure of a biological tissue detection device provided in an embodiment of the present application;
[0018] Figure 4 A schematic cross-sectional view of a biological tissue detection device provided in an embodiment of the present application when in operation;
[0019] Figure 5 A schematic diagram of a biological tissue detection system provided in an embodiment of the present application;
[0020] Figure 6 One of the flow diagrams of a biological tissue detection method provided in an embodiment of the present application;
[0021] Figure 7A schematic diagram of layered grid modeling of the skin irradiation area provided in an embodiment of the present application;
[0022] Fig. 8A Schematic diagram of skin mole and melanoma skin samples provided in the embodiments of the present application;
[0023] Figure 8B One of the three-dimensional scalar graphs provided in the embodiment of the present application after scanning the skin sample and calculating the absorbance change;
[0024] Figure 8C The second three-dimensional scalar graph provided in the embodiment of the present application after scanning the skin sample and calculating the absorbance change;
[0025] Fig. 9 A second flow chart of a biological tissue detection method provided in an embodiment of the present application;
[0026] Fig.10 A schematic diagram of the structure of a biological tissue detection device provided in an embodiment of the present application;
[0027] Fig.11 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;
[0028] Fig.12 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0029] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.
[0030] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the terms used in this way are interchangeable where appropriate, so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.
[0031] The terms "at least one (item)", "at least one of" and the like in the specification and claims of the present application refer to any one, any two or a combination of more than two of the objects included therein. For example, at least one (item) of a, b, and c can be represented by: "a", "b", "c", "a and b", "a and c", "b and c" and "a, b and c", where a, b, and c can be single or multiple. Similarly, "at least two (items)" refers to two or more, and its meaning is similar to that of "at least one (item)".
[0032] The nouns or terms involved in this application are explained below.
[0033] NIR: Near Infrared.
[0034] Absorbance (optical absorption coefficient): The absorption rate of biological tissue to light in a certain band, generally the ratio of incident intensity to outgoing intensity.
[0035] Near-infrared light transmission technology: Near-infrared light is generated when the molecular vibration transitions from the ground state to the high energy level due to the non-resonance of molecular vibration, and has strong penetrating power. When light irradiates biological tissue, it will attenuate due to its surface reflection, internal absorption and scattering. After the light irradiates the body surface, part of it is reflected by the skin and the other part is absorbed. Red light and its nearby near- and short-wave infrared light penetrate deeply into the skin tissue and can directly act on the blood vessels, lymphatic vessels, nerve endings and other subcutaneous tissues of the skin, and can be used for functional imaging of tissues. Skin tissue can be regarded as a dense, non-uniform, turbid optical medium with obvious selectivity for the absorption of light - water, hemoglobin, collagen, fat, fibrous tissue and even cancerous tissue (skin tumors, etc.) have different absorption coefficients for near-infrared light, so subcutaneous tissue information can be obtained by analyzing the transmission results of near-infrared light.
[0036] Three-dimensional tomography technology based on near-infrared light: Diffuse optical tomography, also known as diffuse optical tomography (DOT / ODT), is a method for obtaining three-dimensional imaging of thick tissues using the transmission function of near-infrared light (600-900nm). Although it cannot match conventional structural imaging methods such as X-rays, ultrasound and nuclear magnetic resonance in terms of spatial resolution, it has obvious advantages in terms of sensitivity, specificity and dynamics of changes in tissue function, safety of use, portability and cost-effectiveness due to its low power consumption, simple imaging and no radioactivity.
[0037] Skin is the largest organ in the human body. Skin health has become a health issue that people are very concerned about today. The optical properties of skin have also been a research direction that has received much attention in recent years. There are many technologies on the market that use infrared light for skin scanning (mainly near-infrared short-wave band, wavelength of about 600 nanometers to 1200 nanometers). It includes shining infrared light on the surface of the skin, and then collecting the light reflected from the skin through the sensor in the instrument and analyzing and processing it to obtain information such as the depth of the subject's skin color, skin color distribution, skin moisture and oil content. However, in terms of skin imaging, there is no product that can make good use of the transmission function of infrared light to analyze the composition of skin tissue.
[0038] The present application proposes a biological tissue detection device, which is a portable imaging system that can be combined with electronic equipment to achieve three-dimensional functional imaging of subcutaneous tissue. It uses the transmission and diffusion function of 700-800 nanometer near-infrared light and is based on the principle of diffuse optical tomography to calculate the absorbance of each position of the subcutaneous tissue, thereby displaying the tissue components at the grid point as hemoglobin, collagen, fat or water, etc. based on the absorbance value, and can even identify neoplastic tissue. It is a system that can truly perform functional optical imaging of three-dimensional tissue deep in the subcutaneous layer.
[0039] Figure 1 A schematic diagram of the structure of a biological tissue detection device provided in an embodiment of the present application is shown in FIG. Figure 1 As shown, the biological tissue detection device includes a light emitting module 11 and a light shielding component 12. The light emitting module 11 is located in the light shielding component 12. The light emitting module 11 includes at least two light emitting elements, and there is a gap between the positions of two adjacent light emitting elements.
[0040] In some embodiments of the present application, the at least two light-emitting elements may include three light-emitting elements. Figure 1 As shown, the three light emitting elements can be represented as L1, L2 and L3 respectively.
[0041] In some embodiments of the present application, the at least two light-emitting elements may be light-emitting diodes (LEDs). Further, the light-emitting diodes may be near-infrared light-emitting diodes, that is, the light emitted by each near-infrared light-emitting diode is near-infrared light.
[0042] In some embodiments of the present application, the wavelength range of the light emitted by the at least two light-emitting elements may be 600nm-900nm.
[0043] It should be noted that the above wavelength range is only a possible example. In addition to the near-infrared band, visible light in a longer band is also penetrable. Therefore, light in other bands can also be used for scanning and detection. The embodiments of the present application do not limit the wavelength of the light emitted by the light-emitting element.
[0044] In some embodiments of the present application, a light board is provided in the above-mentioned light-emitting module, on which are integrated a plurality of light-emitting elements with wavelengths in the range of 700-800 nanometers, and the plurality of light-emitting elements are evenly distributed on the light board to ensure that the scanning light covers comprehensively and evenly.
[0045] It should be noted that the specific number of light-emitting elements can be determined according to the area of biological tissue to be scanned.
[0046] In some embodiments of the present application, the shading component 12 is used to isolate external light from entering the light-emitting module.
[0047] In some embodiments of the present application, the shading component may be a shading cover or a shading cloth.
[0048] Exemplarily, the sunshade is used to shield external light to avoid interfering with imaging, and can be replaced by a sunshade cloth.
[0049] In some embodiments of the present application, the material of the above-mentioned shading component can be metal, plastic, fabric, rubber, composite material, etc.
[0050] It should be noted that the material of the above-mentioned shading component can be any non-light-transmissive material, and the embodiments of the present application are not limited to this.
[0051] In some embodiments of the present application, the at least two light-emitting elements are used to sequentially emit measurement light to the biological tissue when the biological tissue is imaged at least twice by the imaging module.
[0052] It should be noted that the light-emitting module 11 including three light-emitting elements is only a possible example, and the number of light-emitting elements can be set according to actual needs, which is not limited in the embodiment of the present application.
[0053] In some embodiments of the present application, the above-mentioned biological tissues include but are not limited to any of the following: skin tissue, thick body tissue (such as arms, palms, soles of feet, breasts, etc.).
[0054] The biological tissue detection device provided in the embodiment of the present application can sequentially emit measurement light to the biological tissue to be measured through multiple light-emitting elements arranged at different positions during each imaging when imaging the biological tissue to be measured at least twice through the imaging module. When the light-emitting elements at different positions are used to irradiate the same biological tissue, the angle, distance, etc. between the light source and the surface of the biological tissue will change, which will cause the propagation path and interaction mode of the light in the biological tissue to change. Therefore, the irradiation of light sources at different positions will highlight or weaken the structure and composition information of certain deep tissues, so that the light forms a different information distribution on the image after each imaging, thereby obtaining richer and more specific image information, and then being able to obtain more comprehensive structural information of the biological tissue, such as deep information such as subcutaneous hemoglobin, collagen and fibrous tissue.
[0055] In some embodiments of the present application, Figure 2 As shown, the biological tissue detection device may further include a cover plate 13 disposed in the light shielding component 12, the light emitting module 11 is disposed on a first surface of the cover plate 13, the first surface is close to the biological tissue, and the cover plate 13 is used to fix the biological tissue.
[0056] In some embodiments of the present application, the first surface of the cover plate 13 may be the lower surface of the cover plate 13 .
[0057] In some embodiments of the present application, the surface of the cover 13 facing the biological tissue (ie, the first surface) can contact the biological tissue and fix the biological tissue so that the biological tissue is close to the camera of the electronic device.
[0058] In some embodiments of the present application, the material of the cover plate 13 may have good flatness and mechanical strength.
[0059] It should be noted that by providing a cover plate with good flatness and mechanical strength, the internal light source and other components are prevented from being directly exposed to the external environment to prevent the intrusion of pollutants such as dust and water vapor. The cover plate with a certain mechanical strength can provide a barrier to protect these components from contamination and damage. At the same time, it can provide a stable environment for biological tissue detection and reduce the impact of the external environment on the detection process.
[0060] In some embodiments of the present application, the cover plate 13 may be made of an opaque or low-transmittance material, such as a plastic cover plate, a metal cover plate (such as stainless steel), a ceramic cover plate, a glass cover plate, or a rubber cover plate.
[0061] It should be noted that the opaque or low-transmittance cover can effectively block external light from entering the detection area, reduce the interference of light on the biological tissue detection process, and thus improve the accuracy and reliability of the detection results.
[0062] In some embodiments of the present application, the cover plate 13 may be made of a low-absorption material.
[0063] It should be noted that low-absorption materials refer to those materials with low absorption capacity for light, heat or other forms of energy. Low-absorption cover can ensure that light is absorbed as little as possible by the cover when it is irradiated, reduce the scattering of light inside the cover, and avoid light loss or change of direction due to scattering, so as to ensure that the light emitted by the light-emitting module can fully irradiate the biological tissue to be tested, thereby improving the accuracy of the test results.
[0064] In some embodiments of the present application, the cover plate 13 may be made of a corrosion-resistant material.
[0065] It should be noted that during the detection process, the cover plate will come into contact with the biological tissue sample, so by using a cover plate made of corrosion-resistant material, the material can be prevented from being corroded and damaged.
[0066] In some embodiments of the present application, the material of the cover plate 13 may have good thermal stability and light stability, thereby ensuring that its performance can be maintained under different temperature and light conditions.
[0067] Exemplarily, the material of the cover plate 13 may have at least one of the following characteristics: good flatness and mechanical strength, opaque or low-transmittance material, low-absorption material, corrosion-resistant material, and good thermal stability and light stability.
[0068] In some embodiments of the present application, Figure 2 As shown, a first area of the first surface of the cover plate 13 is provided with a first protrusion 14, and the light-emitting module 11 is provided on the surface of the first protrusion 14 facing the biological tissue. The first area is the area on the first surface opposite to the biological tissue.
[0069] In some embodiments of the present application, the first area may be an area on the lower surface of the cover plate 13 that is opposite to the biological tissue. Further, the first area may be located on a first short side of the lower surface of the cover plate 13 .
[0070] In some embodiments of the present application, the first protrusion 14 may be combined with the cover plate body by processing, manufacturing or assembly, so as to form the final shape of the cover plate 13 .
[0071] In some embodiments of the present application, the cover plate 13 may be an integrally formed structure.
[0072] Exemplarily, the entire cover plate 13 can be injection molded at one time by a mold, so that there are no additional connectors or seams between the raised portion of the cover plate 13 and other portions of the cover plate, thereby ensuring the integrity and strength of the structure.
[0073] In some embodiments of the present application, the first protrusion 14 may be a rectangular protrusion, a square protrusion or a protrusion of other shapes, which is not limited in the embodiments of the present application.
[0074] In some embodiments of the present application, a light emitting module 11 is disposed on the first protrusion 14 on the lower surface of the cover plate 13 , and the light emitting surface of the light emitting module faces the biological tissue and the camera of the electronic device.
[0075] In the embodiment of the present application, the light-emitting module 11 is arranged on the first protrusion 14 on the lower surface of the cover plate 13, so that the light-emitting module can be better positioned or supported to ensure that it can stably and accurately illuminate the biological tissue, and can also protect the light-emitting module from direct contact with the external environment or biological tissue.
[0076] In some embodiments of the present application, Figure 2 As shown, a second protrusion 15 is provided in the second area of the first surface of the cover plate 13, and a telescopic structure 16 is provided on the surface of the second protrusion facing the biological tissue, and the telescopic structure is used to adjust the distance between the light-emitting module 11 and the biological tissue.
[0077] In some embodiments of the present application, the second area may be an area of the lower surface of the cover plate 13 away from the first area. Further, the second area may be located on the second short side of the lower surface of the cover plate 13 .
[0078] In some embodiments of the present application, the second protrusion 15 may be a rectangular protrusion, a square protrusion or a protrusion of other shapes, which is not limited in the embodiments of the present application.
[0079] In some embodiments of the present application, the top surface of the telescopic structure 16 is connected to the bottom surface of the protruding structure 15 on the cover plate 13 .
[0080] In some embodiments of the present application, the telescopic structure 16 may be connected to the protruding structure 15 by snapping, magnetic attraction, or other feasible methods, which is not limited in the embodiments of the present application.
[0081] In some embodiments of the present application, the telescopic structure 16 can be a thickness adjustment device that is telescopic and lockable along the vertical direction. The thickness (or height) of the telescopic structure 16 can be determined according to the measured thickness of the skin tissue or thick body tissue, and the embodiments of the present application are not limited to this.
[0082] In some embodiments of the present application, the thickness of the skin tissue or thick body tissue and the thickness of the electronic device may be less than or equal to the sum of the maximum height to which the telescopic structure 16 is stretched and the height of the protruding structure 15 .
[0083] In the embodiment of the present application, by setting a telescopic structure 16 under the cover 13, the distance between the light-emitting module and the biological tissue can be accurately adjusted, and it can adapt to the detection of biological tissues of different thicknesses. Whether it is a flat skin surface or a complex human body part, the telescopic structure can be adjusted to ensure good contact between the light-emitting module and the biological tissue, and ensure that the light is irradiated on the biological tissue with the optimal intensity, thereby improving the detection effect.
[0084] In some embodiments of the present application, Figure 3 As shown, the biological tissue detection device may further include a base component 17, and an opening is provided on the second surface of the base component 17, and the opening is used to accommodate the imaging module.
[0085] In some embodiments of the present application, the imaging module may be an independent imaging module, which may include a camera module, which may integrate key components such as a lens, a camera sensor, and an image processor to jointly realize image capture and processing functions.
[0086] In some embodiments of the present application, the imaging module may also be an imaging module inside an electronic device, that is, biological tissue images may be collected with the aid of the imaging module of the electronic device to perform biological tissue detection.
[0087] In some embodiments of the present application, when the imaging module is an imaging module inside an electronic device, the above opening can be used to accommodate the electronic device. Figure 3 As shown, the electronic device can be placed horizontally in the opening, and the camera 18 of the electronic device can be directed upward to capture images of biological tissue placed above the camera.
[0088] In some embodiments of the present application, the second surface of the base member 17 may be a surface facing the first protrusion 14 .
[0089] In some embodiments of the present application, the second surface of the base component 17 may be an upper surface or a top surface of the base component 17 .
[0090] In some embodiments of the present application, the base component 17 may be an integrally formed structure, and the base component 17 may be referred to as an electronic device fixing clip.
[0091] In some embodiments of the present application, the height of the opening may be less than or equal to the thickness of the electronic device.
[0092] In some embodiments of the present application, the base member 17 may be a retractable member, and the width of the base member 17 may be adjusted by stretching the base member 17 outward, so as to place electronic devices of different widths. Figure 3 As shown, the base member 16 can be stretched or retracted along the direction indicated by the arrow to accommodate electronic devices of different widths.
[0093] In an embodiment of the present application, by placing the imaging module in the bottom support component, the structure of the entire biological tissue detection device is made more compact, and the opening of the bottom support component provides stable support and positioning for the imaging module, which helps to ensure that the camera can maintain a stable position and angle when collecting biological tissue images, thereby improving the accuracy and consistency of image acquisition. At the same time, stable support also reduces the problem of image blur or distortion caused by shaking or moving the equipment. In addition, the user only needs to place the biological tissue above the camera to collect images. This operation method is very intuitive and convenient, and no additional alignment or adjustment steps are required, which reduces the user's operating difficulty and time cost. In addition, since the camera is fixed in the opening of the bottom support component and collects images upward, this design helps to reduce external light interference and shadow effects, thereby improving the quality of image acquisition. At the same time, stable support and positioning also help to reduce image blur caused by equipment vibration.
[0094] In some embodiments of the present application, the telescopic structure 16 is movably connected to a third area 18 of the bottom support member 17 , and the third area 18 is an area on the second surface adjacent to the opening.
[0095] In some embodiments of the present application, the third area may be a portion of the surface of the base member 17 that is adjacent to the opening and away from the direction of the opening or away from the edge of the opening.
[0096] In some embodiments of the present application, the third area 18 may be magnetically connected, snap-connected, or movably connected to the bottom surface of the telescopic structure 16 in other feasible ways.
[0097] In the embodiment of the present application, by movably connecting the telescopic structure 16 with the bottom support component 17, the user can flexibly adjust the distance between the light-emitting module and the biological tissue according to actual needs, thereby improving the adaptability and flexibility of the entire device, enabling it to cope with biological tissues of different shapes, sizes and positions, and ensuring that the light can accurately and effectively illuminate the target area. In addition, by fixing the telescopic structure to the third area of the bottom support component, it can be ensured that the light-emitting module maintains a stable position and angle during the adjustment process. This stable support helps to reduce positioning errors caused by shaking or moving the equipment, thereby improving the accuracy and reliability of detection.
[0098] In some embodiments of the present application, Figure 3 As shown, the first inner side wall of the opening is provided with a port connector 19, and the port connector 19 is used for communication connection with the imaging module.
[0099] In some embodiments of the present application, the port connector 19 is used to connect to a port of an electronic device and communicate with an imaging module of the electronic device through the port.
[0100] In some embodiments of the present application, the above-mentioned port may be a data port.
[0101] For example, Figure 3 As shown, the near-infrared camera of the electronic device faces upward and is pushed into the opening of the base member 17 from the opening edge of the base member 17 along the direction of the arrow, and the port of the electronic device is connected to the port connector 19 to enable communication between the imaging module of the electronic device and the device.
[0102] In combination with the above embodiments, Figure 4 A schematic cross-sectional view of a biological tissue detection device provided in an embodiment of the present application during operation is shown in FIG. Figure 4 As shown, the dotted arrows indicate the illumination direction of the three LED lights (L1, L2, L3). When in use, a portion of the skin tissue or thick body tissue 22 is required to be clamped between the structural cover 13 and the near-infrared camera 23 of the electronic device, and all LED lights and the near-infrared camera 23 are tightly covered by the surface of the skin tissue or thick body tissue 22, and no light leakage is allowed. The external dotted circle represents an opaque shield shell (i.e., a light-shielding component), and the entire device needs to be covered by the light-shielding shell when working. In the use state, the distance between the cover 13 and the electronic device can be adjusted by using the telescopic structure 16 to ensure that the measured skin tissue or thick body tissue 22 is tightly clamped by the cover 13 and the bottom support component 17.
[0103] At present, in the field of skin detection, imaging is usually performed by utilizing the reflection function of various lights (including white light, polarized light, ultraviolet light, and infrared light) or the reflection function of ultrasound, that is, the light wave or ultrasound transmitting end and the receiving imaging end are on the same side. Due to its long wavelength, near-infrared light has strong penetrating power regardless of whether it is thick or thin tissue; while the visible light band often cannot penetrate thick tissue. However, the biological tissue detection device proposed in the embodiment of the present application is in the form of a clip-type detector, which can make the transmitting end and the receiving end located on both sides of the detected tissue, making full use of the separability of skin and muscle tissue, thereby conveniently and accurately detecting the composition and structure of various biological tissues.
[0104] The present application embodiment provides a biological tissue detection system, such as Figure 5As shown, the biological tissue detection system 30 may include the above-mentioned biological tissue detection device 31, an imaging module 32 and a processing module 33, wherein at least two light-emitting elements of the light-emitting module in the biological tissue detection device are used to sequentially emit measurement light to the biological tissue when the imaging module images the biological tissue at least twice; the above-mentioned imaging module is used to sequentially collect images of the measurement light transmitted through the biological tissue while isolating external light, so as to obtain at least two measurement images; the above-mentioned processing module is used to perform three-dimensional modeling and optical absorption coefficient calculation on the biological tissue based on at least two measurement images, and output a three-dimensional scalar image, which is used to characterize tissue component information of tissue layers at different depths of the biological tissue.
[0105] In some embodiments of the present application, the imaging module may be an independent imaging module or an imaging module inside an electronic device.
[0106] Exemplarily, the imaging module may mainly constitute an infrared camera that is built into the electronic device. The pixels of the infrared camera may be at the million level, and the sensitivity of the infrared camera to infrared light may be as high as possible.
[0107] It should be noted that, for the convenience of description, the above-mentioned biological tissue detection device is referred to as a light source module in the embodiment of the present application.
[0108] Exemplarily, the light source module includes a light board, on which 2-5 700-800 nanometer near-infrared LED chip beads are placed side by side and equidistantly, with a density of approximately 1 to 1.5 cm2 per bead. The light-emitting bodies of the beads are as point-shaped as possible rather than sheet-shaped, so that the concentration of the light source is as high as possible.
[0109] Exemplarily, the at least two measurement images may be near-infrared transmission images.
[0110] In some embodiments of the present application, the system further includes a timing controller, which is used to control the light-emitting time and light-emitting sequence of each of at least two light-emitting elements; the light-emitting module is used to control at least two light-emitting elements to emit light in sequence according to the light-emitting time and light-emitting sequence.
[0111] It should be noted that the luminous time may include the moment when the luminous state starts and the duration of the luminous state. The luminous time may also be called the lighting time. The luminous sequence refers to the order in which multiple light-emitting elements emit light. The luminous sequence may also be called the lighting sequence. In some cases, the luminous time may also include the luminous sequence, for example, L1 emits light at 00 minutes and L2 emits light at 05 minutes.
[0112] For example, taking the light-emitting element as a near-infrared LED lamp, the timing controller is used to control the light-emitting time of each near-infrared LED lamp bead, and the lighting method is that a single lamp is lit in sequence, and the lighting time of each LED lamp can be about 10 to 20 milliseconds per lamp.
[0113] It should be noted that the lighting duration of each LED lamp (ie, the lighting duration) is related to the light source power.
[0114] In some embodiments of the present application, the above-mentioned imaging module may include a camera module and a linkage controller, wherein the above-mentioned linkage controller is used to control the image acquisition time according to the lighting time, and the above-mentioned camera module is used to collect images of the measurement light transmitted through the biological tissue according to the image acquisition time while isolating external light.
[0115] Exemplarily, the linkage controller can control the shutter according to the lighting time, and control the camera module to take a corresponding photo during the time when each light is on. This function can be implemented using the data transmission interface of the electronic device (i.e., the port mentioned above).
[0116] In some embodiments of the present application, the above-mentioned system also includes a data storage module, which is used to record the morphological characteristic information of the biological tissue, the intensity information of the measurement light, and the position information of the light-emitting element. The data storage module is also used to send the morphological characteristic information of the biological tissue, the intensity information of the measurement light, and the position information of the light-emitting element to the processing module.
[0117] In some embodiments of the present application, the above-mentioned morphological feature information includes thickness information of the biological tissue, and may also include information such as size and shape of the biological tissue.
[0118] Exemplarily, the data storage module can store various posture information of the above-mentioned device when it is working, including but not limited to: thickness information, LED light position information, camera position information, etc.
[0119] Specifically, the data storage module can record the distance from the light-emitting module (or a light board where at least one light-emitting element is located) to the plane where the camera of the electronic device is located through an internal thickness recorder (having a function similar to that of a vernier caliper), and determine the distance as the skin thickness at the time of this measurement.
[0120] Specifically, the data storage module can record the position information of the lit LED lamp through an internal position recorder.
[0121] Specifically, the data storage module can automatically identify the model of the electronic device used, and obtain the relative position of the near-infrared camera according to the structural parameters of the electronic device.
[0122] Exemplarily, the data storage module may send the morphological feature information of the biological tissue, the intensity information of the measurement light, and the position information of the light-emitting element to the processing module via an internal data transmitter.
[0123] In some embodiments of the present application, the imaging module is further used to capture images of biological tissues to obtain a background image when external light is isolated and at least two light-emitting elements are not emitting light.
[0124] In some embodiments of the present application, the above-mentioned processing module is specifically used to perform three-dimensional modeling of biological tissue according to morphological feature information of skin tissue, and obtain a three-dimensional grid model corresponding to the biological tissue, wherein the three-dimensional grid model includes at least one grid point, and one grid point corresponds to a tissue area of the biological tissue; through the above-mentioned three-dimensional grid model, according to the pixel information of at least two measurement images, the pixel information of the background image, the intensity information of the measurement light, and the position information of the light-emitting element that emits the measurement light, the absorbance corresponding to each grid point is calculated; the absorbance is color mapped, and a three-dimensional scalar graph is output, and the above-mentioned three-dimensional scalar graph is used to characterize the tissue composition information of tissue layers at different depths of the biological tissue.
[0125] In some embodiments of the present application, the above-mentioned processing module may include a computing module and a display module. The computing module is used to complete three-dimensional modeling and calculate the absorbance corresponding to each grid point, and obtain the absorbance distribution result of the biological tissue according to the absorbance corresponding to each grid point. The display module is used to display the above-mentioned absorbance distribution result in pseudo-color and interpret the properties of different areas.
[0126] Exemplarily, the processing module can receive image data captured by a charge-coupled device (CCD) of an electronic device, as well as information such as light source intensity and biological tissue thickness, complete three-dimensional modeling and calculation of optical absorption coefficient (also known as absorbance), and finally use pseudo-color staining to intuitively display tissue information such as water, protein, fat, and blood vessels under the skin, and obtain tissue composition information at different depths of biological tissue.
[0127] It should be noted that CCD is a semiconductor device that converts light images into electronic signals. In electronic devices such as digital cameras and camcorders, CCD plays a vital role as an image sensor. It is composed of many identical photosensitive elements, each of which is called a pixel. When light shines on the CCD, the photosensitive element converts the light signal into an electrical signal, which is then processed into an image.
[0128] It should be noted that the above-mentioned processing module can also be called a post-processing module.
[0129] In the embodiment of the present application, the scanning object is a two-layer symmetrical organism (such as skin tissue) sandwiched between the light source and the electronic device camera. The near-infrared imaging device based on the DOT diffusion optical principle can not only penetrate the skin tissue. As long as the light intensity of the near-infrared light source is adjusted as needed, infrared penetration can be achieved in 1-10cm thick tissues (such as arms, palms and soles, breasts, etc.), so that the structure of different tissues can be presented by calculating the optical absorption coefficient. In addition to analyzing subcutaneous tissue, it can also be used for more thick tissue imaging, and has a wide range of application scenarios.
[0130] The biological tissue detection system of the embodiment of the present application is a clamp-type skin near-infrared three-dimensional scanning system. The system can construct a discrete three-dimensional grid model of the clamped part of the skin, and use diffuse optical tomography technology to calculate the absorbance of each grid point in the three-dimensional grid based on the transmission function of near-infrared light. The tissue components at the grid point are displayed as hemoglobin, collagen, fat, water, etc. according to the absorbance value, and even tumor tissue can be identified. This is a system that can truly perform optical functional imaging of three-dimensional tissue deep under the skin.
[0131] The embodiment of the present application provides a biological tissue detection method, which can be applied to the above-mentioned biological tissue detection system. The execution subject of the biological tissue detection method provided by the embodiment of the present application can be a biological tissue detection device, and the biological tissue detection device can be an electronic device, or a functional module or functional entity in an electronic device. The following takes the execution of the biological tissue detection method by an electronic device as an example to illustrate the biological tissue detection method provided by the embodiment of the present application.
[0132] The biological tissue detection method provided in the embodiment of the present application is described in detail below through specific embodiments and their application scenarios in conjunction with the accompanying drawings.
[0133] like Figure 6 As shown, the biological tissue detection method may include the following steps 201 and 202:
[0134] Step 201: While isolating external light, the electronic device sequentially collects images of measurement light transmitted through biological tissue at different positions to obtain at least two measurement images.
[0135] Step 202: The electronic device performs three-dimensional modeling and optical absorption coefficient calculation on the biological tissue based on the at least two measurement images, and outputs a three-dimensional scalar image.
[0136] The three-dimensional scalar image is used to characterize tissue composition information at different depths of biological tissue.
[0137] In some embodiments of the present application, the electronic device can perform at least two transmission imaging of the biological tissue through a camera to obtain at least two measurement images.
[0138] It should be noted that transmission imaging can generate richer deep structure information than reflection imaging, rather than just analyzing the water and oil content or skin color information of the surface skin.
[0139] In some embodiments of the present application, the electronic device can use diffuse optical tomography technology to adopt a layered modeling approach to achieve three-dimensional functional imaging of subcutaneous tissue, and can even detect whether structures such as pigmented tumors have a risk of canceration.
[0140] The following is an explanation of the three-dimensional modeling of biological tissues and the calculation process of optical absorption coefficients using diffuse optical tomography technology.
[0141] Diffuse optical tomography technology is a three-dimensional absorbance calculation method derived from the principle of bio-optics. Its fundamental purpose is to calculate the optical absorption coefficient of each point inside the entire biological tissue. Since water, fat, hemoglobin, collagen, etc. have different absorbances, the tissue composition at that location can be known.
[0142] First, the three-dimensional space of the skin tissue illuminated by the LED light is discretized, such as Figure 7 As shown. For simplicity, we regard the skin tissue sandwiched by the light board plane and the camera plane (here it should be understood as two layers of symmetrical skin tissue folded in half) as a cube. The xy plane represents the upper and lower surfaces of the skin in contact with the light board and the camera, that is, the plane where the light board is located and the photosensitive imaging plane of the mobile phone camera; the z axis is the irradiation direction of the light path, and the distance the light path passes is the recorded skin thickness.
[0143] The specific discretization method is: the clamped skin tissue is evenly divided into 2 to 5 layers along the z-axis direction ( Figure 4 The display shows that the cross-section is divided into 4 layers. The specific number of layers depends on the thickness of the clamped skin. For example, if the thickness is about 1 cm, it can be divided into 2 to 3 layers. Then each cross-section is gridded, for example, divided into 30×8=240 grid points. The specific number of grid points depends on the accuracy requirements, and can usually be between 100 and 300.
[0144] Next, after completing the hierarchical grid modeling, the near-infrared light absorption coefficient of each grid point in the grid for a specific band is the object we need to solve. We can understand the entire light path diffusion process as follows: the position of the LED that lights up when taking the image is known, the intensity of the incident light is known, and the light path diffuses to Figure 4All grid points after the discretization of the skin tissue area undergo optical absorption, reflection and diffusion with each grid point, and finally form an image on the camera CCD. Each pixel of the image can be regarded as a CCD detector with a known position. The principle of solving the absorbance is roughly expressed by the following formula:
[0145]
[0146] It should be noted that this principle belongs to the category of physical optics, involving Lambert-Beer's law and the optical radiation transmission equation. The specific process can be found in related technologies.
[0147] Here we call each pixel in the image captured by the CCD detector a detector pixel point. In the above formula, Si,j is the intensity received by the detector pixel point j when the i-th LED light source is irradiated, n = 1, 2, ..., N means that the skin tissue area is divided into N grid points, α0 is the background optical absorption coefficient, which can be calculated from the light-off image captured in step 103. ri,n is the distance from the i-th LED light source to the n-th grid point, rn,j is the distance from the n-th grid point to the j-th detector pixel point, and ri,j is the distance from the i-th LED light source to the j-th detector pixel point. δμn is the change in absorbance at the n-th grid point relative to the background absorbance - this is the amount we need to calculate, which can reflect whether the subcutaneous tissue at the grid point corresponds to hemoglobin, water, fat or collagen, etc.
[0148] For each detector pixel j, the above formula can be written in matrix form:
[0149] s j =K j δμ n
[0150] For simplicity, Figure 1 Taking the 3 LED lights shown in the figure as an example, the following equation is obtained:
[0151]
[0152] Where y is the data received by the CCD detector, Bk is the position matrix, L is the regularization matrix, and x has the following structure:
[0153]
[0154] Among them, Δ, σ1, 2, 3 are constants, which are correction factors of the detector and LED light source respectively, and are related to the equipment parameters.
[0155] It should be noted that when there are at least two LED light sources, the equation is positive definite, so theoretically it has a unique true solution. The reconstructed solution requires x to be obtained from the known y and A, so as to obtain δμ. This equation must be solved inversely to obtain x. The inverse solution can only be a numerical method - for example, using the least squares method to gradually approximate the true solution.
[0156] Fig. 8A Schematic diagram of skin mole and melanoma (suspected skin cancer) samples. Figure 8B This is a comparative display diagram of the skin sample corresponding to the sample after scanning and calculating the absorbance change amount by this method, such as Figure 8B As shown in the figure, this is a three-dimensional scalar image, which has been pseudo-colored. Different colors in the image represent different components. Through this three-dimensional scalar image, we can clearly see the distribution information of different components of skin tissue, with the point with the smallest change in luminosity in blue and the point with the largest change in absorbance in red. The sample that developed into melanoma had a very rough tumor area in the scan result, which means that the subcutaneous tissue has undergone uneven changes, indicating the possibility of cancer. Figure 8C It is a three-dimensional scalar image of a normal skin sample after being scanned by this method and the absorbance change is calculated, such as Figure 8C As shown, the entire image area is relatively smooth, indicating that the skin tissue is in a normal state.
[0157] The biological tissue detection method provided in the embodiment of the present application realizes transmission imaging of biological tissues through multiple LED lights. It is non-radioactive and non-invasive, safe and harmless to the human body, can be measured every day, and has strong practicality. In addition, the system using this method only needs light-emitting elements, electronic device fixtures and light-shielding components, and can use the near-infrared camera of the electronic device for CCD imaging; data analysis and three-dimensional modeling steps can be transmitted to the electronic device for calculation, so the product form can be miniaturized and has strong portability, which belongs to a new type of intelligent portable skin analysis system.
[0158] The biological tissue detection method provided by the embodiment of the present application, in the case of isolating external light, the electronic device sequentially collects images of the measurement light transmitted through the biological tissue at different positions, obtains at least two measurement images, and based on the above at least two measurement images, performs three-dimensional modeling and optical absorption coefficient calculation on the biological tissue, and outputs a three-dimensional scalar map, which is used to characterize the tissue component information of the tissue layers at different depths of the biological tissue. Through this method, at each imaging, a plurality of light-emitting elements arranged at different positions sequentially emit measurement light to the biological tissue to be measured. When the light-emitting elements at different positions are used to irradiate the same biological tissue, the angle, distance, etc. between the light source and the surface of the biological tissue will change, which will cause the propagation path and interaction mode of the light in the biological tissue to change. Therefore, the irradiation of the light source at different positions will highlight or weaken the structure and component information of certain deep tissues, so that the light forms a different information distribution on the image after each imaging, thereby obtaining richer and more specific image information, and then being able to obtain more comprehensive structural information of the biological tissue, such as deep information such as subcutaneous hemoglobin, collagen and fibrous tissue.
[0159] In some embodiments of the present application, the biological tissue detection method further includes the following steps 203:
[0160] Step 203: The electronic device collects images of the biological tissue while isolating the external light and not receiving the measurement light to obtain a background image.
[0161] In some embodiments of the present application, the process of step 202 may include the following steps 202a to 202c:
[0162] Step 202a: The electronic device performs three-dimensional modeling on the biological tissue according to the morphological feature information of the skin tissue to obtain a three-dimensional mesh model corresponding to the biological tissue.
[0163] The three-dimensional grid model includes at least one grid point, and one grid point corresponds to one tissue region of the biological tissue.
[0164] Step 202b: The electronic device calculates the absorbance corresponding to each of the grid points through a three-dimensional grid model according to pixel information of the at least two measurement images, pixel information of the background image, intensity information of the measurement light, and position information of the light-emitting element emitting the measurement light.
[0165] Step 202c: The electronic device performs color mapping on the absorbance and outputs a three-dimensional scalar graph.
[0166] For example, Fig. 9 A schematic diagram of a scanning and imaging process provided in an embodiment of the present application, such as Fig. 9As shown, a scanning and imaging process may include the following steps 41 to 49:
[0167] Step 41: Use parts A and B to clamp a part of the skin to be tested, and adjust structure ⑥ so that the skin is tightened and covers all LED light sources and mobile phone cameras. The light shield needs to completely cover the entire device.
[0168] Step 42: Scanning starts, the thickness recorder records the thickness of the clamped skin, the position information of the three LED lights, and the position information of the near-infrared camera according to the model of the smart phone, and sends them to the data storage device.
[0169] Step 43: When all LED lights are off, start the near-infrared camera to take a photo as background image 0 for later use in subtracting noise and background information.
[0170] Step 44: Turn on the first LED light for about 10-20ms, and check whether there is light leakage. If there is, it will prompt that the scan failed, and the user is advised to adjust the clamping position and rescan; if not, start the near-infrared camera to capture image 1. Then turn off the first LED light.
[0171] Step 45: Light up the second LED for the same duration as the first LED, and check whether there is light leakage. If there is, it indicates that the scan failed, and the user is advised to adjust the clamping position and rescan; if not, start the near-infrared camera to capture image 2. Then turn off the second LED.
[0172] Step 46: Light up the top LED for the same duration as the first LED, and check if there is light leakage. If there is, it indicates that the scan failed, and the user is advised to adjust the clamping position and rescan; if not, start the near-infrared camera to capture image 3. Then turn off the third LED.
[0173] Step 47: Output all data to the smartphone terminal.
[0174] Step 48: Perform three-dimensional modeling calculations using diffuse optical tomography technology on the smart terminal.
[0175] Step 49: Display the calculation results on the smart terminal.
[0176] It should be noted that different absorbance values represent different tissues under the skin, and pseudo-color dyeing can be used to present the skin composition of different parts to the user. Different colors represent water, fat, hemoglobin, collagen, fibrous tissue, tumor tissue, etc.
[0177] The above-mentioned method embodiments, or various possible implementation methods in each method embodiment, can be executed separately, or, under the premise that there is no contradiction, can also be executed in combination with each other. The specific implementation can be determined according to actual usage requirements, and the embodiments of the present application do not limit this.
[0178] The biological tissue detection method provided in the embodiment of the present application can be executed by a biological tissue detection device. In the embodiment of the present application, the biological tissue detection device provided in the embodiment of the present application is described by taking the biological tissue detection device executing the biological tissue detection method as an example.
[0179] Fig.10 A schematic diagram of the structure of another biological tissue detection device provided in an embodiment of the present application is shown in FIG. Fig.10 As shown, the biological tissue detection device 400 may include: an acquisition module 401 and a processing module 402, wherein the acquisition module 401 is used to sequentially acquire images of measurement light transmitted through biological tissue at different positions while isolating external light, so as to obtain at least two measurement images; the processing module 402 is used to perform three-dimensional modeling and optical absorption coefficient calculation on the biological tissue based on the at least two measurement images, and output a three-dimensional scalar image, wherein the three-dimensional scalar image is used to characterize tissue component information of tissue layers at different depths of the biological tissue.
[0180] The biological tissue detection device provided in the embodiment of the present application, under the condition of isolating external light, sequentially collects images of measurement light transmitted through biological tissue at different positions, obtains at least two measurement images, performs three-dimensional modeling and optical absorption coefficient calculation on the biological tissue based on the above at least two measurement images, and outputs a three-dimensional scalar map, which is used to characterize the tissue component information of the tissue layers at different depths of the biological tissue. Through this method, at each imaging, a plurality of light-emitting elements arranged at different positions sequentially emit measurement light to the biological tissue to be measured, when the light-emitting elements at different positions are used to irradiate the same biological tissue, the angle, distance, etc. between the light source and the surface of the biological tissue will change, which will cause the propagation path and interaction mode of the light in the biological tissue to change, so the irradiation of the light source at different positions will highlight or weaken the structure and component information of certain deep tissues, so that the light forms different information distribution on the image after each imaging, thereby obtaining richer and more specific image information, and then being able to obtain more comprehensive structural information of the biological tissue, such as deep information such as subcutaneous hemoglobin, collagen and fibrous tissue.
[0181] In some embodiments of the present application, the acquisition module is further used to acquire an image of the biological tissue to obtain a background image when the external light is isolated and the measurement light is not received.
[0182] In some embodiments of the present application, the above-mentioned processing module is specifically used to: perform three-dimensional modeling of the above-mentioned biological tissue according to the morphological feature information of the skin tissue to obtain a three-dimensional grid model corresponding to the biological tissue, wherein the three-dimensional grid model includes at least one grid point, and one grid point corresponds to a tissue area of the biological tissue; through the above-mentioned three-dimensional grid model, according to the pixel information of at least two measurement images, the pixel information of the background image, the intensity information of the measurement light, and the position information of the light-emitting element that emits the measurement light, calculate the absorbance corresponding to each grid point; perform color mapping on the absorbance, and output a three-dimensional scalar map.
[0183] The biological tissue detection device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or other devices other than the terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a car electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., and the embodiment of the present application is not specifically limited.
[0184] The biological tissue detection device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.
[0185] The biological tissue detection device provided in the embodiment of the present application can implement each process implemented in the above method embodiment, and will not be described again here to avoid repetition.
[0186] Alternatively, if Fig.11As shown, an embodiment of the present application also provides an electronic device 500, including a processor 501 and a memory 502, wherein the memory 502 stores programs or instructions that can be executed on the processor 501, and when the program or instructions are executed by the processor 501, the various steps of the above-mentioned biological tissue detection method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, they are not described here.
[0187] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.
[0188] Fig.12 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.
[0189] The electronic device 100 includes but is not limited to components such as a radio frequency unit 101, a network module 102, an audio output unit 103, an input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, and a processor 110.
[0190] Those skilled in the art will appreciate that the electronic device 100 may also include a power source (such as a battery) for supplying power to various components, and the power source may be logically connected to the processor 110 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.12 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.
[0191] Among them, the above-mentioned input unit 104 is used to sequentially collect images of the measurement light transmitted through the biological tissue at different positions while isolating the external light, so as to obtain at least two measurement images; the above-mentioned processor 110 is used to perform three-dimensional modeling and optical absorption coefficient calculation on the biological tissue based on the at least two measurement images, and output the three-dimensional scalar image, which is used to characterize the tissue composition information of the tissue layers at different depths of the biological tissue.
[0192] The electronic device provided in the embodiment of the present application, under the condition of isolating external light, sequentially collects images of measurement light transmitted through biological tissue at different positions, obtains at least two measurement images, performs three-dimensional modeling and optical absorption coefficient calculation on the biological tissue based on the at least two measurement images, and outputs a three-dimensional scalar map, which is used to characterize the tissue component information of the tissue layers at different depths of the biological tissue. Through this method, at each imaging, a plurality of light-emitting elements arranged at different positions sequentially emit measurement light to the biological tissue to be measured, when the light-emitting elements at different positions are used to irradiate the same biological tissue, the angle, distance, etc. between the light source and the surface of the biological tissue will change, which will cause the propagation path and interaction mode of the light in the biological tissue to change, so the illumination of the light source at different positions will highlight or weaken the structure and component information of certain deep tissues, so that the light forms different information distribution on the image after each imaging, thereby obtaining richer and more specific image information, and then being able to obtain more comprehensive structural information of the biological tissue, such as deep information such as subcutaneous hemoglobin, collagen and fibrous tissue.
[0193] In some embodiments of the present application, the input unit 04 is further used to capture an image of the biological tissue to obtain a background image when the external light is isolated and the measurement light is not received.
[0194] In some embodiments of the present application, the processor 110 is specifically used to: perform three-dimensional modeling of the biological tissue according to the morphological feature information of the skin tissue to obtain a three-dimensional grid model corresponding to the biological tissue, wherein the three-dimensional grid model includes at least one grid point, and one grid point corresponds to a tissue area of the biological tissue; calculate the absorbance corresponding to each of the grid points according to the pixel information of the at least two measurement images, the pixel information of the background image, the intensity information of the measurement light, and the position information of the light-emitting element emitting the measurement light through the three-dimensional grid model; perform color mapping on the absorbance and output the three-dimensional scalar map.
[0195] It should be understood that in the embodiment of the present application, the input unit 104 may include a graphics processor (Graphics Processing Unit, GPU) 1041 and a microphone 1042, and the graphics processor 1041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 107 includes a touch panel 1071 and at least one of other input devices 1072. The touch panel 1071 is also called a touch screen. The touch panel 1071 may include two parts: a touch detection device and a touch controller. Other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.
[0196] The memory 109 can be used to store software programs and various data. The memory 109 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 109 may include a volatile memory or a non-volatile memory, or the memory 109 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 109 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.
[0197] The processor 110 may include one or more processing units; optionally, the processor 110 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 110.
[0198] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned biological tissue detection method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0199] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.
[0200] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned biological tissue detection method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0201] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.
[0202] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned biological tissue detection method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0203] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.
[0204] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.
[0205] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.
Claims
1. A biological tissue detection device, characterized in that: The device comprises: a light-emitting module and a light-shielding component, wherein the light-emitting module is located inside the light-shielding component, and the light-emitting module comprises at least two light-emitting elements, and there is a gap between the positions of two adjacent light-emitting elements; The at least two light emitting elements are used to sequentially emit measurement light to the biological tissue when the biological tissue is imaged at least twice by the imaging module; The shading component is used to isolate external light from entering the light-emitting module.
2. The device according to claim 1, characterized in that The at least two light-emitting elements are light-emitting diodes, and the wavelength range of the light emitted by each of the light-emitting diodes is 600nm-900nm.
3. The device according to claim 1, characterized in that The device also includes a cover plate arranged in the light-shielding component, the light-emitting module is arranged on a first surface of the cover plate, the first surface is close to the biological tissue, and the cover plate is used to fix the biological tissue.
4. The device according to claim 3, characterized in that A first protrusion is disposed in a first area of the first surface, the light emitting module is disposed on a surface of the first protrusion facing the biological tissue, and the first area is an area on the first surface opposite to the biological tissue.
5. The device according to claim 3, characterized in that A second protrusion is disposed in the second area of the first surface, and a telescopic structure is disposed on the surface of the second protrusion facing the biological tissue, and the telescopic structure is used to adjust the distance between the light emitting module and the biological tissue.
6. The device according to any one of claims 1 to 5, characterized in that The device further comprises: a base component, and an opening is arranged on the second surface of the base component, and the opening is used to accommodate the imaging module.
7. The device according to claim 6, characterized in that The telescopic structure is movably connected to a third area of the base component, the third area being an area on the second surface adjacent to the opening, and the telescopic structure is used to adjust the distance between the light-emitting module and the biological tissue.
8. The device according to claim 6 or 7, characterized in that The first inner side wall of the opening is provided with a port connector, and the port connector is used for communication connection with the imaging module.
9. A biological tissue detection system, characterized in that: The system comprises: a biological tissue detection device, an imaging module and a processing module as described in any one of claims 1 to 8; The at least two light-emitting elements of the light-emitting module in the biological tissue detection device are used to sequentially emit measurement light to the biological tissue when the imaging module images the biological tissue at least twice; The imaging module is used to sequentially collect images of the measurement light transmitted through the biological tissue while isolating external light, so as to obtain at least two measurement images; The processing module is used to perform three-dimensional modeling and optical absorption coefficient calculation on the biological tissue based on the at least two measurement images, and output the three-dimensional scalar image, which is used to characterize tissue component information of tissue layers at different depths of the biological tissue.
10. The system according to claim 9, characterized in that The system also includes a timing controller; The timing controller is used to control the light-emitting time of each of the at least two light-emitting elements; The light-emitting module is used to control the at least two light-emitting elements to emit light in sequence according to the light-emitting time.
11. The system according to claim 10, characterized in that The imaging module includes a camera module and a linkage controller; The linkage controller is used to control the image acquisition time according to the light-emitting time; The camera module is used to capture the image of the measurement light transmitted through the biological tissue according to the image acquisition time.
12. The system according to claim 9, characterized in that The system also includes a data storage module; The data storage module is used to record the morphological feature information of the biological tissue, the intensity information of the measurement light and the position information of the light emitting element; The data storage module is also used to send the morphological feature information of the biological tissue, the intensity information of the measurement light and the position information of the light emitting element to the processing module.
13. The system according to claim 9, characterized in that The imaging module is also used to capture images of the biological tissue when the at least two light-emitting elements are not emitting light, so as to obtain a background image.
14. The system according to claim 13, characterized in that The processing module is specifically used for: Performing three-dimensional modeling on the biological tissue according to the morphological feature information of the biological tissue to obtain a three-dimensional mesh model corresponding to the skin tissue; Calculating the absorbance corresponding to each of the grid points through the three-dimensional grid model according to pixel information of the at least two measurement images, pixel information of the background image, intensity information of the measurement light, and position information of the light-emitting element emitting the measurement light; The absorbance is subjected to color mapping to output the three-dimensional scalar map, wherein the three-dimensional scalar map is used to characterize tissue component information of tissue layers at different depths of the biological tissue.
15. A biological tissue detection method, applied to the biological tissue detection system according to any one of claims 9 to 14, characterized in that: The method comprises: Under the condition of isolating external light, sequentially collecting images of measurement light transmitted through biological tissue at different positions to obtain at least two measurement images; Based on the at least two measurement images, three-dimensional modeling and optical absorption coefficient calculation are performed on the biological tissue to output the three-dimensional scalar map, which is used to characterize tissue component information of tissue layers at different depths of the biological tissue.
16. The method according to claim 15, characterized in that The step of performing three-dimensional modeling and optical absorption coefficient calculation on the biological tissue based on the at least two measurement images and outputting the three-dimensional scalar image comprises: Performing three-dimensional modeling on the biological tissue according to the morphological feature information of the skin tissue to obtain a three-dimensional mesh model corresponding to the biological tissue; Calculating the absorbance corresponding to each of the grid points through the three-dimensional grid model according to pixel information of the at least two measurement images, pixel information of the background image, intensity information of the measurement light, and position information of the light-emitting element emitting the measurement light; The absorbance is color mapped and the three-dimensional scalar graph is output.
17. An electronic device, characterized in that: It comprises a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the biological tissue detection method as described in claim 15 or 16 are implemented.
18. A readable storage medium, characterized in that: The readable storage medium stores programs or instructions, and when the programs or instructions are executed by the processor, the steps of the biological tissue detection method as described in claim 15 or 16 are implemented.
