A multispectral local microscopic magnification 3D dermatoscope device and usage method

Abstract

The present invention discloses a multi-spectral local micro-magnification 3D dermatoscope device and a method of use, which relate to the field of stereoscopic imaging lens technology. The lamp board is integrated with LED lamp beads, UVA lamp beads, cross-polarized light lamp beads, and near-infrared lamp beads; the magnification module is embedded in the image inlet of the shell, the reflector module is embedded in the cavity of the shell, the 3D camera is embedded in the image outlet of the shell, and the lamp board is embedded in the image inlet of the shell; the magnification module is used to magnify the image on the skin surface, the reflector module is used to capture the image magnified by the magnification module and reflect the image to the 3D camera; the image is composed of light emitted by the lamp board and reflected on the skin surface. The multi-spectral local micro-magnification 3D dermatoscope device disclosed by the present invention integrates multi-spectral, magnification and 3D imaging functions, and can comprehensively evaluate skin problems, especially for skin problems that require three-dimensional evaluation, such as skin bumps, burns, unevenness, vascular subcutaneous tissue, etc.

Description

Technical Field

[0001] The present invention relates to the technical field of stereoscopic imaging lenses, and more particularly to a multi-spectral local micro-magnification 3D dermatoscope device and a method of use. Background Art

[0002] Dermatoscopes, especially portable ones, are the dermatologist's "stethoscope," used for diagnosing skin diseases, identifying skin problems, and performing skin assessments. However, existing devices are limited in functionality, offering only magnification and cross-polarized light, without multispectral detection that integrates natural light, UVA, cross-polarized light, and near-infrared. This makes them incapable of in-depth analysis of skin conditions, and they lack 3D imaging capabilities, preventing them from detecting the three-dimensional state of the skin. Therefore, providing a dermatoscope with multispectral detection and 3D imaging analysis is an urgent need for those skilled in the art. Summary of the Invention

[0003] In view of this, the present invention provides a multispectral local micro-magnification 3D dermatoscope device and usage method, which integrates multispectral (one or more of natural light, UVA, cross-polarized light, near-infrared can be selected according to needs), magnification function and 3D imaging function to achieve the purpose of obtaining multispectral stereoscopic images of the skin.

[0004] In order to achieve the above object, the present invention adopts the following technical solutions:

[0005] A multispectral local microscopic magnification 3D dermatoscope device, comprising:

[0006] Amplification module, reflector module, 3D camera, housing, light board;

[0007] The light board is integrated with LED lamp beads, UVA lamp beads, cross-polarized light lamp beads, and near-infrared lamp beads;

[0008] The amplification module is embedded in the image inlet of the housing, the reflector module is embedded in the cavity of the housing, the 3D camera is embedded in the image outlet of the housing, and the light board is embedded in the image inlet of the housing;

[0009] The amplification module is used to amplify the image on the skin surface, and the reflector module is used to capture the image amplified by the amplification module and reflect the image to the 3D camera; the image is composed of light emitted by the light board and reflected on the skin surface.

[0010] The outer shell comprises a focusing module and a shell; the focusing module is fixedly connected to the shell.

[0011] The magnifying module includes a convex lens group;

[0012] The amplifying module is embedded in the focusing module, and the focusing module is used to adjust the focal length of the amplifying module.

[0013] The focusing module includes a first lens holder, a second lens holder, and a focusing mechanism;

[0014] The first lens holder is screwed to the focusing mechanism, the second lens holder is fixedly connected to the housing, a limiting groove is provided between the second lens holder and the housing, the focusing mechanism is limited in the limiting groove, and the second lens holder is fixedly connected to the housing.

[0015] The amplifying module further includes a first convex lens and a second convex lens;

[0016] The first convex lens is embedded in the first lens seat, and the second convex lens is embedded in the second lens seat; the first convex lens, the second convex lens, the first lens seat, and the second lens seat are coaxially arranged.

[0017] The light board is fixedly connected to the lens, and the light board is used to illuminate the observed skin.

[0018] The reflector module includes a first left reflector, a first right reflector, and a V-shaped reflector assembly; the V-shaped reflector assembly is formed by hingedly connecting a second left reflector and a second right reflector;

[0019] The V-shaped reflector assembly is arranged at the center of the housing, and the first left reflector and the first right reflector are respectively arranged on both sides of the central reflector assembly and their tilt directions are consistent with the side corresponding to the central reflector assembly.

[0020] The 3D camera includes a camera housing, a left optical lens, and a right optical lens;

[0021] The left optical lens and the right optical lens are respectively embedded in the camera housing.

[0022] The 3D camera further includes a left photosensitive element and a right photosensitive element;

[0023] The left photosensitive element and the right photosensitive element are respectively embedded in the camera housing;

[0024] The amplifying module, the first left reflector, the second left reflector, the left optical lens, and the left photosensitive element are connected in sequence through the first optical path; the amplifying module, the first right reflector, the second right reflector, the right optical lens, and the right photosensitive element are connected in sequence through the first optical path.

[0025] A method for using a multi-spectral local micro-magnification 3D dermatoscope,

[0026] The specific steps for use include:

[0027] The skin reflected light enters the amplification module and the cavity of the housing in sequence to obtain a skin reflected image; wherein the reflected light is any one of LED white light, UVA, cross-polarized light, and near infrared;

[0028] Reflecting the first region image in the skin reflected image to the second left reflector through the mirror surface of the first left reflector, and reflecting the second region image in the skin reflected image to the second right reflector through the mirror surface illuminated by the first right reflector;

[0029] The second left reflector reflects the first area image to the left optical lens, and the second right reflector reflects the second area image to the right optical lens;

[0030] The first area image is irradiated onto the left photosensitive element through the left optical lens, and the second area image is irradiated onto the right photosensitive element through the right optical lens;

[0031] The first area image is sent to the processor of the 3D camera through AD conversion of the left photosensitive element;

[0032] Synthesize 3D images through a processor;

[0033] Skin problems are analyzed through the synthesized 3D image.

[0034] It can be seen from the above technical solutions that, compared with the prior art, the present invention discloses a multi-spectral local micro-magnification 3D dermatoscope device and a method of use, which can achieve the following beneficial effects:

[0035] The multispectral local micro-magnification 3D dermatoscope device disclosed in the present invention integrates multispectral (natural light, UVA, cross-polarized light, near-infrared - optional according to needs), magnification function and 3D imaging function, and can comprehensively evaluate skin problems, especially skin problems that require three-dimensional evaluation, such as skin bumps, burns, unevenness, vascular subcutaneous tissue, etc. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are merely embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying any creative work.

[0037] Figure 1 It is a schematic diagram of the structural anatomy of the present invention.

[0038] Figure 2 It is a schematic diagram of the structural appearance of the present invention.

[0039] In the figure: 11-first convex lens, 12-second convex lens, 21-first left reflector, 22-second left reflector, 31-first right reflector, 32-second right reflector, 4-3D camera, 41-left optical lens, 42-right optical lens, 5-focusing module, 6-housing, 7-light board, 8-first optical path, 9-second optical path, 101-image inlet, 102-image outlet, 103-skin. DETAILED DESCRIPTION

[0040] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention.

[0041] A multispectral local microscopic magnification 3D dermatoscope device, comprising:

[0042] Amplification module, reflector module, 3D camera 4, housing, light board 7;

[0043] The light board 7 is integrated with LED lamp beads, UVA lamp beads, cross-polarized light lamp beads, and near-infrared lamp beads;

[0044] The amplification module is embedded in the image inlet 101 of the housing, the reflector module is embedded in the cavity of the housing, the 3D camera 4 is embedded in the image outlet 102 of the housing, and the light board 7 is embedded in the image inlet 101 of the housing;

[0045] The amplification module is used to amplify the image on the surface of the skin 103 , and the reflector module is used to capture the image amplified by the amplification module and reflect the image to the 3D camera 4 ; the image is composed of light emitted by the light board 7 and reflected on the surface of the skin 103 .

[0046] The outer shell includes a focusing module 5 and a shell 6 ; the focusing module 5 is fixedly connected to the shell 6 .

[0047] The magnifying module includes a convex lens group;

[0048] The magnifying module is embedded in the focusing module 5 , and the focusing module 5 is used to adjust the focal length of the magnifying module.

[0049] The focusing module 5 includes a first lens holder, a second lens holder, and a focusing mechanism;

[0050] The first lens holder is screwed to the focusing mechanism, the second lens holder is fixedly connected to the housing 6, a limiting groove is provided between the second lens holder and the housing 6, the focusing mechanism is limited in the limiting groove, and the second lens holder is fixedly connected to the housing 6.

[0051] Furthermore, the focusing mechanism can adjust the magnification, magnification: 10X-140X, field of view: Φ22±2mm.

[0052] The magnifying module further includes a first convex lens 11 and a second convex lens 12;

[0053] The first convex lens 11 is embedded in the first lens holder, and the second convex lens 12 is embedded in the second lens holder. The first convex lens 11, the second convex lens 12, the first lens holder, and the second lens holder are coaxially arranged.

[0054] The light board 7 is fixedly connected to the lens, and the light board 7 is used to illuminate the observed skin 103.

[0055] Furthermore, the light board 7 is composed of integrated multi-spectral lamp beads LED white light, UVA, cross-polarized light, near infrared - which can be selected according to needs, and the type of integrated lamp beads can be selected according to user needs;.

[0056] The light source illumination of the light board 7 is: 13000Lux<Ev<19000Lux.

[0057] The reflector module includes a first left reflector 21, a first right reflector 31, and a V-shaped reflector assembly; the V-shaped reflector assembly is formed by hingedly connecting a second left reflector 22 and a second right reflector 32;

[0058] The V-shaped reflector assembly is arranged at the center of the housing. The first left reflector 21 and the first right reflector 31 are respectively arranged on both sides of the central reflector assembly and their tilt directions are consistent with the corresponding side of the central reflector assembly.

[0059] The 3D camera 4 includes a camera housing, a left optical lens 41 and a right optical lens 42;

[0060] The left optical lens 41 and the right optical lens 42 are respectively embedded in the camera housing.

[0061] The 3D camera 4 further includes a left photosensitive element and a right photosensitive element;

[0062] The left photosensitive element and the right photosensitive element are respectively embedded in the camera housing;

[0063] The amplifying module, the first left reflector 21, the second left reflector 22, the left optical lens 41, and the left photosensitive element are connected in sequence through the first optical path 8, and the amplifying module, the first right reflector 31, the second right reflector 32, the right optical lens 42, and the right photosensitive element are connected in sequence through the second optical path 9.

[0064] A method for using a multi-spectral local micro-magnification 3D dermatoscope,

[0065] The specific steps for use include:

[0066] The skin reflected light enters the amplification module and the cavity of the housing in sequence to obtain a skin reflected image; wherein the reflected light is any one of LED white light, UVA, cross-polarized light, and near infrared;

[0067] The first region image in the skin reflection image is reflected to the second left reflection mirror 22 through the mirror surface of the first left reflection mirror 21, and the second region image in the skin reflection image is reflected to the second right reflection mirror 32 through the mirror surface illuminated by the first right reflection mirror 31;

[0068] The second left reflector 22 reflects the first area image to the left optical lens 41 , and the second right reflector 32 reflects the second area image to the right optical lens 42 ;

[0069] The first area image is irradiated onto the left photosensitive element through the left optical lens 41, and the second area image is irradiated onto the right photosensitive element through the right optical lens 42;

[0070] The first area image is sent to the processor of the 3D camera 4 through AD conversion of the left photosensitive element;

[0071] Synthesize 3D images through a processor;

[0072] Analyze skin 103 problems through synthesized 3D images.

[0073] Furthermore, the method of synthesizing 3D images includes using structured light and double-sided imaging principles to realize 3D modeling functions, and using computer vision algorithms to realize the generation of 3D objects through registration, stitching and other technologies.

[0074] For the points of real target objects, each frame of data obtained by the camera scan includes not only the color RGB image of the object, but also the distance value from each point to the vertical plane where the depth camera is located. With the camera position as the origin, the direction of the camera as the Z axis, and the two axes of the vertical plane of the camera as the X and Y axes, the local three-dimensional coordinate system of the camera can be established; using ICP calculation, given the input original data source and target data target, as well as the correspondence between the data points of the two, ICP calculation obtains the transfer matrix between the original data and the target data. This matrix minimizes the sum of the distances of all target data points to the tangent plane where their corresponding original data points are located, thereby realizing configuration fusion, building a 3D model, and obtaining 3D object data.

[0075] Furthermore, the method of analyzing skin problems 103 by synthesizing 3D images includes,

[0076] AI is used to analyze and process skin 103 problems, and interfaces such as Micro-USB / USB are used to connect with smart terminals, PCs and other systems. This allows the terminal's computing power to be used for graphic image analysis, and AI to be used for segmentation, recognition, positioning and other analysis and processing.

[0077] Deep learning-based AI, through data annotation and neural network training, can achieve functions such as skin lesion segmentation, identification, and localization. A deep neural network consists of an input layer, hidden layers, and an output layer. The input layer is the data fed into the neural network. Each hidden layer is composed of a certain number of neurons, and multiple hidden layers can be present to enhance the model's expressiveness. The output layer is the neural network's final output.

[0078] In the calculations of the aforementioned layers, the output value obtained after a round of neural network calculations is often inconsistent with the actual desired value. This results in an error value. The error value is the difference between the correct answer given by the training data and the actual output value. However, this error is the result of the combined effect of multiple nodes. Backpropagation can be used to determine the error value of each node.

[0079] The above method can be used to realize the identification of various skin lesions, and the segmentation and identification of diseases, acne, wrinkles, spots and other related problems.

[0080] It should be noted that the structures, proportions, sizes, etc. illustrated in the drawings of this specification are only used to match the contents disclosed in the specification for understanding and reading by those familiar with this technology, and are not used to limit the conditions for implementation of the present invention. Therefore, they have no substantial technical significance. Any modification of the structure, change in the proportional relationship, or adjustment of the size should still fall within the scope of the technical content disclosed by the present invention without affecting the efficacy and purpose that can be achieved by the present invention. At the same time, the terms such as "upper", "lower", "left", "right", "middle" and "one" quoted in this specification are only for the convenience of description and are not used to limit the scope of implementation of the present invention. Changes or adjustments in their relative relationships should also be regarded as the scope of implementation of the present invention without substantially changing the technical content.

[0081] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on the differences from other embodiments. Reference can be made to the common and similar parts between the various embodiments. For the devices disclosed in the embodiments, since they correspond to the methods disclosed in the embodiments, the description is relatively simple, and the relevant parts can be referred to the method description.

[0082] The above description of the disclosed embodiments is intended to enable one skilled in the art to implement or use the present invention. Various modifications to these embodiments will be readily apparent to one skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention is not limited to the embodiments shown herein but is intended to conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A multispectral local microscopic magnification 3D dermatoscope device, characterized in that: include: Amplification module, reflector module, 3D camera (4), housing, light board (7); The light board (7) is integrated with LED lamp beads, UVA lamp beads, cross-polarized light lamp beads, and near-infrared lamp beads; The amplifying module is embedded in the image inlet (101) of the housing, the reflector module is embedded in the cavity of the housing, the 3D camera (4) is embedded in the image outlet (102) of the housing, and the light board (7) is embedded in the image inlet (101) of the housing; The amplification module is used to amplify the image on the surface of the skin (103), and the reflector module is used to capture the image amplified by the amplification module and reflect the image to the 3D camera (4); the image is composed of light emitted by the light board (7) and reflected on the surface of the skin (103); The housing comprises a focusing module (5) and a shell (6); The magnifying module comprises a convex lens group; the magnifying module is embedded in the focusing module (5), and the focusing module (5) is used to adjust the focal length of the magnifying module; The focusing module (5) comprises a first lens holder, a second lens holder, and a focusing mechanism; The first lens seat is screwed to the focusing mechanism, the second lens seat is fixedly connected to the housing (6), a limiting groove is provided between the second lens seat and the housing (6), the focusing mechanism is limited in the limiting groove, and the second lens seat is fixedly connected to the housing (6); The amplifying module further comprises a first convex lens (11) and a second convex lens (12); The first convex lens (11) is embedded in the first lens seat, and the second convex lens (12) is embedded in the second lens seat; the first convex lens (11), the second convex lens (12), the first lens seat, and the second lens seat are coaxially arranged; The reflector module comprises a first left reflector (21), a first right reflector (31), and a V-shaped reflector assembly; the V-shaped reflector assembly is formed by hingedly connecting a second left reflector (22) and a second right reflector (32); The V-shaped reflector assembly is arranged at the center of the housing, and the first left reflector (21) and the first right reflector (31) are respectively arranged on both sides of the central reflector assembly and their tilt directions are consistent with the corresponding side of the central reflector assembly; The 3D camera (4) comprises a camera housing, a left optical lens (41), and a right optical lens (42); The left optical lens (41) and the right optical lens (42) are respectively embedded in the camera housing; The 3D camera (4) further includes a left photosensitive element and a right photosensitive element; The left photosensitive element and the right photosensitive element are respectively embedded in the camera housing; The amplifying module, the first left reflector (21), the second left reflector (22), the left optical lens (41), and the left photosensitive element are connected in sequence via a first optical path (8); and the amplifying module, the first right reflector (31), the second right reflector (32), the right optical lens (42), and the right photosensitive element are connected in sequence via a second optical path (9).

2. A multispectral local microscopic magnification 3D dermatoscope device according to claim 1, characterized in that: The focusing module (5) is fixedly connected to the housing (6).

3. The multispectral local microscopic magnification 3D dermatoscope device according to claim 1, characterized in that: The light panel (7) is fixedly connected to the housing (6), and the light panel (7) is used to illuminate the observed skin (103).

4. A method for using a multispectral local microscopic magnification 3D dermatoscope, characterized in that: The specific steps for use include: The light board (7) illuminates the observed skin (103), and the skin reflected light sequentially enters the amplification module and the cavity of the housing to obtain a skin reflection image; wherein the reflected light integrates LED white light, UVA, cross-polarized light, and near-infrared light; The skin reflected light passes through the first convex lens (11) and the second convex lens (12) in the amplification module in sequence, and then passes through the first optical path (8) and the second optical path (9) to illuminate the reflector module; The reflector module comprises a first left reflector (21), a first right reflector (31), and a V-shaped reflector assembly; the V-shaped reflector assembly is formed by hingedly connecting a second left reflector (22) and a second right reflector (32); The V-shaped reflector assembly is arranged at the center of the housing, and the first left reflector (21) and the first right reflector (31) are respectively arranged on both sides of the central reflector assembly and their tilt directions are consistent with the corresponding side of the central reflector assembly; The skin reflected light located in the first area on the right side passes through the first optical path (8) and reflects the first area image in the skin reflected image to the second left reflector (22) through the mirror surface of the first left reflector (21); the skin reflected light located in the second area on the left side passes through the second optical path (9) and reflects the second area image in the skin reflected image to the second right reflector (32) through the mirror surface illuminated by the first right reflector (31); The second left reflector (22) reflects the first area image to the left optical lens (41) located in the 3D camera, and the second right reflector (32) reflects the second area image to the right optical lens (42) located in the 3D camera; The first area image is irradiated onto the left photosensitive element through the left optical lens (41), and the second area image is irradiated onto the right photosensitive element through the right optical lens (42); The first area image is sent to the processor of the 3D camera (4) through AD conversion of the left photosensitive element; Synthesize 3D images through a processor; Analysis of skin (103) problems through synthetic 3D images.

Images