Tongue image detection device based on RGB image and hyperspectral image fusion

Abstract

The utility model provides a tongue image detection device based on RGB image and hyperspectral image fusion, comprising a box body, one side of which is provided with an acquisition port; the chin supporting bracket is arranged at the collecting opening and is used for providing support for the chin of the user when the user puts the head at the collecting opening; and the shooting module is mounted on the box body and is used for shooting tongue images of a user. According to the device, through the arrangement of the box body and the collection port in the box body, a tongue image of a user at a fixed angle can be conveniently collected, and through the arrangement of the chin supporting bracket, the user can maintain a shooting posture in the shooting process, so that the reliability of the shooting process is ensured.

Description

Technical Field

[0001] The utility model relates to the technical field of tongue diagnosis image acquisition, and in particular to a tongue image detection device based on the fusion of RGB images and hyperspectral images. Background Art

[0002] Health has always been a concern for people. The development of science and technology and the improvement of industrialization have accelerated the pace of people's lives, changed their living habits and dietary structure, and led to a surge in the number of sub-healthy people. When the human body is in a sub-healthy state, if it is not prevented and treated in time, it may cause many chronic diseases. However, the early symptoms of some diseases are almost imperceptible, and they are often discovered only after they worsen to the point where the human body has obvious reactions and seeks medical treatment. Therefore, people hope to obtain a faster, more convenient and more accurate diagnostic method to understand their personal physical condition, and then realize personal disease warning and health management.

[0003] Tongue diagnosis is an important part of TCM's "visual" diagnosis, providing an important basis for TCM diagnosis, and has played an indispensable role in TCM for thousands of years. Clinical research in TCM shows that the tongue is closely connected to the internal organs through the meridians. Therefore, tongue diagnosis can be used to understand the deficiency and excess of the internal organs, qi, blood, and body fluids of the human body, as well as the nature, severity, and changes of pathogenic factors. Traditional tongue diagnosis mainly involves doctors observing the patient's tongue through the naked eye, evaluating the tongue information such as tongue color, coating color, thickness of tongue coating, and area of ​​tongue coating. The diagnostic results are highly subjective and are affected by factors such as the doctor's diagnosis and treatment level and the external environment.

[0004] The objective research of tongue diagnosis has become the mainstream trend. Currently, most of the related technologies are based on the RGB tongue images taken by ordinary cameras to replace manual analysis. Although the detection efficiency is improved, it can only perceive the external information of the tongue such as tongue color, tongue shape, and tongue coating, and cannot fully explore the relationship between the biological information of the tongue and the disease, and it is difficult to ensure the subsequent diagnostic accuracy. Hyperspectral imaging technology combines images and spectra to quickly obtain the microscopic structure and composition information of the rich physiological and pathological changes of tissue cells in the tongue, and can solve the problem of isochromaticity in RGB images. In the existing technology, there is a lack of dedicated equipment to collect multi-dimensional tongue images of users. Utility Model Content

[0005] In view of the above defects of the prior art, the utility model provides a tongue image detection device based on the fusion of RGB image and hyperspectral image to solve the technical problems of inconvenient user tongue image collection and inconsistent shooting position.

[0006] To achieve the above-mentioned purpose and other related purposes, the utility model provides a tongue image detection device based on the fusion of RGB image and hyperspectral image, comprising: a box body, a collection port is provided on one side of the box body; a chin support bracket is provided at the collection port, and is used to provide support for the user's chin when the user places the head at the collection port; and a shooting module, which is installed on the box body and is used to shoot the user's tongue image.

[0007] In one embodiment of the utility model, the shooting module includes a camera, a hyperspectral imager and a light source, the camera and the hyperspectral imager are used to capture a color image and a hyperspectral image of the user's tongue, respectively, and the light source provides illumination for the camera and the hyperspectral imager.

[0008] In one embodiment of the utility model, a camera mounting hole is provided on a side of the box body away from the collection port for mounting the camera and the hyperspectral imager.

[0009] In one embodiment of the present invention, the camera mounting hole is circular, the light source is annular and its inner diameter is larger than the outer diameter of the camera mounting hole, and the light source is concentrically arranged with the camera mounting hole.

[0010] In one embodiment of the utility model, the light source includes a mounting base, an insulating pad, a circuit board, LED lamp beads, infrared lamp beads and a diffuse reflection ring. The mounting base is fixedly connected to the box body, the circuit board is fixedly mounted on the mounting base through an insulating pad, the LED lamp beads and the infrared lamp beads are mounted on the circuit board, and the diffuse reflection ring is arranged on the light emitting side of the LED lamp beads and the infrared lamp beads for uniformly emitting light.

[0011] In an embodiment of the present invention, the tongue image detection device further includes a cleaning module, and the cleaning module is used to clean the space in the box.

[0012] In one embodiment of the utility model, the cleaning module includes a spray unit and a drying unit, the spray unit is used to spray the cleaning agent and / or disinfectant into the box body, and the drying unit is used to dry the cleaning agent and / or disinfectant in the box body.

[0013] In one embodiment of the utility model, the spray unit includes a nozzle and a liquid injection port, and the nozzle and the liquid injection port are respectively installed at the lower and upper parts of the top plate of the box body. The nozzle sprays the cleaning agent and / or disinfectant into the box body from top to bottom, and the liquid injection port is used to add the cleaning agent and / or disinfectant into the spray unit.

[0014] In one embodiment of the utility model, the tongue image detection device also includes a control module; the control module is electrically connected to the camera and the hyperspectral imager, and is used to control the camera and the hyperspectral imager to capture images; the control module is electrically connected to the light source, and is used to control the lighting and extinguishing of the light source; the control module is also electrically connected to the spray unit and the drying unit, and is used to control the start and stop of the spray unit and the drying unit.

[0015] Beneficial effects of the utility model: The utility model proposes a tongue image detection device based on the fusion of RGB image and hyperspectral image. The device is convenient for collecting the user's tongue image at a fixed angle by setting a box and a collection port on the box. The setting of the chin support bracket allows the user to maintain the shooting posture during the shooting process to ensure the reliability of the shooting process. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the embodiments of the utility model or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the utility model. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0017] Figure 1 A schematic diagram of the structure of the tongue image detection tongue provided in one embodiment of the utility model;

[0018] Figure 2 A schematic diagram of the structure of a light source provided in one embodiment of the utility model;

[0019] Figure 3 A schematic diagram of the structure of a cleaning module provided in one embodiment of the utility model;

[0020] Figure 4 A structural block diagram provided for an embodiment of the utility model.

[0021] Explanation of the reference numerals: 100, housing; 200, chin support bracket; 300, shooting module; 310, camera; 320, hyperspectral imager; 330, light source; 331, mounting base; 332, insulating pad; 333, circuit board; 334, LED lamp beads; 335, infrared lamp beads; 336, diffuse reflection ring; 400, cleaning module; 410, spray unit; 411, liquid filling port; 412, nozzle; 420, drying unit; 500, control module. DETAILED DESCRIPTION

[0022] The following is an explanation of the implementation of the present invention through specific specific embodiments. Those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. It should be noted that the following embodiments and the features in the embodiments can be combined with each other without conflict. In addition to the specific methods, equipment, and materials used in the embodiments, according to the technical personnel in this technical field's grasp of the prior art and the records of the present invention, any methods, equipment, and materials of the prior art that are similar or equivalent to the methods, equipment, and materials described in the embodiments of the present invention can also be used to implement the present invention.

[0023] It should be understood that the terms used in the embodiments of the present invention are to describe specific embodiments rather than to limit the scope of protection of the present invention. Unless otherwise defined, all technical and scientific terms used in the present invention have the same meaning as those commonly understood by those skilled in the art.

[0024] The structures, proportions, sizes, etc. illustrated in the drawings of this specification are only used to match the contents disclosed in the specification for people familiar with this technology to understand and read, and are not used to limit the restrictive conditions for the implementation of the utility model, so they have no substantive technical significance. Any modification of the structure, change of the proportional relationship or adjustment of the size should still fall within the scope of the technical content disclosed by the utility model without affecting the effects and purposes that can be achieved by the utility model. In addition, the drawings only show the components related to the utility model rather than the number, shape and size of the components in the actual implementation. The type, quantity and proportion of each component in the actual implementation can be changed arbitrarily, and the component layout type may also be more complicated.

[0025] See also Figure 1 , Figure 1 A tongue image detection device based on the fusion of RGB images and hyperspectral images provided in one embodiment of the utility model includes a box 100, a chin support bracket 200 and a shooting module 300. A collection port is provided on one side of the box 100; the chin support bracket 200 is provided at the collection port to provide support for the user's chin when the user places the head at the collection port; and the shooting module 300 is installed on the box 100 to shoot the user's tongue image. The device facilitates the collection of the user's tongue image at a fixed angle by providing the box 100 and the collection port on the box 100. The provision of the chin support bracket 200 allows the user to maintain the shooting posture during the shooting process to ensure the reliability of the shooting process.

[0026] In a specific embodiment of the present invention, the box body 100 is generally square and can be made of metal or plastic. Since the shooting module 300 needs to capture the user's tongue image, in order to avoid interference from ambient light, the box body 100 is preferably made of an opaque material, and a black absorption layer is also required to be coated on the inside of the box body 100 to reduce reflected stray light and improve the quality of the captured tongue image.

[0027] In a specific embodiment of the utility model, a cover plate can be provided on one side of the collection port of the box 100, and the cover plate is hinged on the box 100. When in use, the cover plate is opened to expose the collection port. When not in use, the cover plate can be closed to shield the collection port and other components in the box 100.

[0028] In a specific embodiment of the utility model, the shooting module 300 includes a camera 310, a hyperspectral imager 320 and a light source 330. The camera 310 and the hyperspectral imager 320 are respectively used to capture a color image and a hyperspectral image of the user's tongue, and the light source 330 provides lighting for the camera 310 and the hyperspectral imager 320. The camera 310 uses a common high-definition color camera 310 to capture an RGB image of the user's tongue. The hyperspectral imager 320 is a device that can obtain fine spectral information of an object. It combines imaging technology with spectral technology. The main function of the hyperspectral imager 320 is to obtain spectral data of an object at different wavelengths, including radiation brightness and radiation illumination, so as to accurately measure and analyze the reflectivity, transmittance and other characteristics of the object. In this embodiment, the RGB image and spectral image of the user's tongue are collected by the camera 310 and the hyperspectral imager 320 respectively, so that the internal and external features of the user's tongue obtained in this way are more conducive to subsequent analysis. Since the user places the entire face at the collection port when taking pictures, and due to the light-proof design of the box 100, the shooting environment inside the box 100 is very dark, so a light source 330 needs to be provided.

[0029] During installation, the camera 310 and the hyperspectral imager 320 can be installed on the box 100, with their shooting lenses facing the collection port. In a specific embodiment of the utility model, a camera mounting hole is provided on the side of the box 100 away from the collection port for installing the camera 310 and the hyperspectral imager 320. The camera mounting hole is provided so that the camera 310 and the hyperspectral imager 320 can be easily installed and removed, which is beneficial for subsequent maintenance.

[0030] In a specific embodiment of the present invention, the camera mounting hole is circular, the light source 330 is annular and its inner diameter is larger than the outer diameter of the camera mounting hole, and the light source 330 is arranged concentrically with the camera mounting hole. The annular light source 330 is arranged, and its illumination effect is better. The lenses of the camera 310 and the hyperspectral imager 320 are located just inside the annular light source 330, which can further improve the quality of the captured image.

[0031] See also Figure 2 In a specific embodiment of the utility model, the light source 330 includes a mounting seat 331, an insulating pad 332, a circuit board 333, an LED lamp bead 334, an infrared lamp bead 335 and a diffuse reflection ring 336. The mounting seat 331 is fixedly connected to the box 100, the circuit board 333 is fixedly mounted on the mounting seat 331 through the insulating pad 332, the LED lamp bead 334 and the infrared lamp bead 335 are mounted on the circuit board 333, and the diffuse reflection ring 336 is arranged on the light emitting side of the LED lamp bead 334 and the infrared lamp bead 335 for uniform light emission. The mounting seat 331 facilitates the installation of the light source 330 on the box 100; the function of the insulating pad 332 is to prevent the circuit from being broken and ensure that the circuit board 333 has good insulation with other metals; the LED lamp bead 334 and the infrared lamp bead 335 can be installed at the designated position on the circuit board 333 using surface mounting technology; the diffuse reflection ring 336 mainly makes the light source 330 more uniform and soft.

[0032] It can be understood that the insulating pad 332, the circuit board 333 and the diffuse reflection ring 336 are all annular structures. The mounting seat 331 can be directly fixed on the side wall of the box 100, or fixed to the bottom of the box 100 through a bracket. The mounting seat 331 and the bracket can be made of metal materials such as aluminum, which is light, strong, corrosion-resistant, easy to process and has good heat dissipation performance.

[0033] See also Figure 4 In a specific embodiment of the present utility model, the tongue image detection device further includes a cleaning module 400, which is used to clean the space in the box 100. By setting the cleaning module 400 to sterilize and disinfect the space in the box 100, the health safety of other users is guaranteed and possible cross infection is prevented.

[0034] In a specific embodiment of the utility model, the cleaning module 400 includes a spray unit 410 and a drying unit 420. The spray unit 410 is used to spray a cleaning agent and / or a disinfectant into the box 100, and the drying unit 420 is used to dry the cleaning agent and / or the disinfectant in the box 100. The spray unit 410 can spray the cleaning agent and / or the disinfectant into the box 100 in a mist form. For example, the disinfectant can be sprayed first for disinfection, and then the cleaning agent can be sprayed for cleaning. The spray unit 410 is preferably electric to facilitate user operation or automatic control. Since the ventilation in the box 100 is not smooth, the cleaning agent and / or the disinfectant sprayed into the box 100 is difficult to volatilize, so the box 100 is dried by the drying unit 420. The drying unit 420 can use a blower, for example.

[0035] See also Figure 3In a specific embodiment of the utility model, the spray unit 410 includes a spray head 412 and a liquid injection port 411, which are respectively installed at the lower part and the upper part of the top plate of the box body 100. The spray head 412 sprays the cleaning agent and / or disinfectant into the box body 100 from top to bottom, and the liquid injection port 411 is used to add the cleaning agent and / or disinfectant into the spray unit 410. The spray unit 410 is installed on the top of the box body 100, which is convenient for adding the cleaning agent and / or disinfectant into the liquid injection port 411, and the cleaning agent and / or disinfectant can be sprayed from top to bottom, so that the cleaning and disinfection effects are better.

[0036] See also Figure 4 In a specific embodiment of the utility model, the tongue image detection device also includes a control module 500; the control module 500 is electrically connected to the camera 310 and the hyperspectral imager 320, and is used to control the camera 310 and the hyperspectral imager 320 to capture images; the control module 500 is electrically connected to the light source 330, and is used to control the lighting and extinguishing of the light source 330; the control module 500 is also electrically connected to the spray unit 410 and the drying unit 420, and is used to control the start and stop of the spray unit 410 and the drying unit 420. The control module 500 is electrically connected to other modules, and can be fixedly installed on the outer wall of the box 100, or installed on other platforms together with the box 100. The control unit can centrally control other components to further improve the convenience of user operation.

[0037] The above embodiments are merely illustrative of the principles and effects of the present invention, and are not intended to limit the present invention. Anyone familiar with the technology may modify or alter the above embodiments without departing from the spirit and scope of the present invention. Therefore, all equivalent modifications or alterations made by a person of ordinary skill in the art without departing from the spirit and technical concept disclosed in the present invention shall still be covered by the claims of the present invention.

Claims

1. A tongue image detection device based on the fusion of RGB image and hyperspectral image, characterized in that: include: A box body, one side of which is provided with a collection port; A chin support bracket, which is arranged at the collection port and is used to provide support for the user's chin when the user places the head at the collection port; as well as A shooting module, which is installed on the box and is used to shoot an image of the user's tongue; The shooting module includes a camera, a hyperspectral imager and a light source, wherein the camera and the hyperspectral imager are used to respectively shoot a color image and a hyperspectral image of a user's tongue, and the light source provides illumination for the camera and the hyperspectral imager; A camera mounting hole is provided on one side of the box body away from the collection port for mounting the camera and the hyperspectral imager.

2. The tongue image detection device based on fusion of RGB image and hyperspectral image according to claim 1 is characterized in that: The camera mounting hole is circular, the light source is annular and its inner diameter is larger than the outer diameter of the camera mounting hole, and the light source is concentrically arranged with the camera mounting hole.

3. The tongue image detection device based on fusion of RGB image and hyperspectral image according to claim 2 is characterized in that: The light source includes a mounting base, an insulating pad, a circuit board, an LED lamp bead, an infrared lamp bead and a diffuse reflection ring. The mounting base is fixedly connected to the box body, the circuit board is fixedly mounted on the mounting base through an insulating pad, the LED lamp bead and the infrared lamp bead are mounted on the circuit board, and the diffuse reflection ring is arranged on the light emitting side of the LED lamp bead and the infrared lamp bead for uniformly emitting light.

4. The tongue image detection device based on fusion of RGB image and hyperspectral image according to claim 1 is characterized in that: The tongue image detection device further comprises a cleaning module, and the cleaning module is used to clean the space inside the box.

5. The tongue image detection device based on fusion of RGB image and hyperspectral image according to claim 4 is characterized in that: The cleaning module includes a spray unit and a drying unit. The spray unit is used to spray a cleaning agent and / or a disinfectant into the box body, and the drying unit is used to dry the cleaning agent and / or the disinfectant in the box body.

6. The tongue image detection device based on fusion of RGB image and hyperspectral image according to claim 5 is characterized in that: The spray unit includes a nozzle and a liquid injection port, which are respectively installed at the lower and upper parts of the top plate of the box body. The nozzle sprays the detergent and / or disinfectant into the box body from top to bottom, and the liquid injection port is used to add the detergent and / or disinfectant into the spray unit.

7. The tongue image detection device based on fusion of RGB image and hyperspectral image according to claim 5 is characterized in that: The tongue image detection device also includes a control module; the control module is electrically connected to the camera and the hyperspectral imager, and is used to control the camera and the hyperspectral imager to capture images; the control module is electrically connected to the light source, and is used to control the lighting and extinguishing of the light source; the control module is also electrically connected to the spray unit and the drying unit, and is used to control the start and stop of the spray unit and the drying unit.

Images