Portable auricular point positioning projection device

Abstract

The invention relates to the technical field of otology, in particular to a portable auricular point positioning projection device, which comprises a shell part, an image acquisition module, an auricular point identification system, an acupoint indication module and a display module, the shell part is provided with an occlusion groove, so that the projection device is fixed by the mouth of a user, and even if the head of the user shakes, the projection device can be fixed. The shell part is also relatively fixed relative to the head, and only slightly deviates in actual use, so that high-definition images of ears can be shot in a close range through the image acquisition module, projection images and projection coordinate systems with auricular point position coordinates can be generated through the auricular point identification system, and the projection images and the projection coordinate systems are projected to the ears through the acupoint indication module; real-time ear images are displayed through the display module, the two hands can be freed, auricular point pressing, magnet therapy, massage and other operations can be conducted on the acupuncture points indicated by the acupuncture point indication module, the outer shell part can be changed into a short rod shape by rotating the second shell, and storage and carrying are convenient.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of otology, in particular to a portable ear acupoint positioning projection device. BACKGROUND

[0002] Ear acupoint is a point distributed on the auricle, also called reaction point or stimulation point. When the internal organs or body has a disease, local reaction such as tenderness, nodule, discoloration, and electrical conductivity will appear on certain parts of the auricle. This phenomenon can be used as a reference for diagnosis, or the reaction points (ear acupoints) can be stimulated to prevent and treat diseases. The ear has a close relationship with the viscera and meridians. Each viscera tissue has a corresponding reaction area (ear acupoint) on the auricle. Stimulating the ear acupoint has a certain regulating effect on the corresponding viscera. The main methods of stimulating the ear acupoint include acupuncture, needle embedding, bloodletting, ear acupoint sticking, magnet therapy, and massage. When a certain part of the human body is sick, it will react on certain parts of the auricle. These parts are the stimulation points of ear acupuncture treatment, collectively known as ear acupoints. Therefore, the determination of the position of the ear acupoint is crucial. Currently, the positioning of the ear acupoint is determined by experienced doctors in combination with the standard GB / T13734-2008 "Ear Acupoint Name and Positioning". This requires patients to go to the hospital for diagnosis, increasing the burden of medical treatment.

[0003] At present, with the rapid development of artificial intelligence, through the analysis of ear photos, image recognition can be carried out based on convolutional neural network, and the position of auricular points can be determined. For example, a Chinese patent with application number 2022109563270 discloses an auricular point positioning method, positioning device and storage medium, which comprises obtaining a human ear image; detecting the human ear image based on a pre-established auricular point detection model to label the physiological structure region on the human ear image; analyzing the physiological structure region to obtain the distribution points of each acupoint to obtain an ear sticker navigation map; and a Chinese patent with application number 2022101066123 discloses an auricular point positioning method, which completes the matching of feature points of the measured picture through the steps of training sample picture preprocessing, AAM model training, determining the initial position of the measured picture ear, and optimizing and solving the shape weight p and texture weight λ in the AAM model, and finally realizes the positioning of the auricular point. The above technical solutions perform image processing on the ear image at the software and algorithm level, complete the positioning of the auricular point, and depend on high-definition ear photos to realize the positioning, and the positioning result can only be displayed in the software, and the user also needs to operate the acupoint based on the positioning information displayed by the software. How to take appropriate ear photos also has problems; a Chinese patent with application number 2014100502313 discloses a human ear acupoint positioning device, which comprises a computer, an image acquisition and acupoint indication device, a base and a support, the image acquisition and acupoint indication device and the support are fixed on the base; the image acquisition and acupoint indication device comprises a supporting table, a two-dimensional driver, a two-dimensional driving mechanism, a laser indication instrument and a camera, the supporting table is fixed on the base, the bottom of the laser indication instrument is fixed on the supporting table through a universal shaft, the cameras are all fixed on the supporting table, the two-dimensional driving mechanism is used for driving the tail of the laser indication instrument, so that the laser emission end of the laser indication instrument moves in two dimensions, the computer outputs a driving signal to the two-dimensional driver, and the two-dimensional driver is used for driving the two-dimensional driving mechanism; the computer also outputs a laser indication instrument start-stop signal to the control signal output end of the laser indication instrument; and the camera outputs image information to the computer. This technical solution provides a device which can take appropriate ear photos, but the device is large in size and cannot be carried. Therefore, it is urgent to provide a portable auricular point positioning projection device. SUMMARY

[0004] The present application aims to provide a portable auricular point positioning projection device to solve the problems in the background art. The specific technical solution is as follows:

[0005] To achieve the above object and other related objects, the present application provides a portable auricular point positioning projection device, which comprises:

[0006] A housing portion is provided with a bite groove;

[0007] an image collecting module, configured to collect ear images;

[0008] an ear point recognition system, configured to recognize ear point position coordinates in the images collected by the image collecting module, and to generate a projection image and a projection coordinate system with the ear point position coordinates;

[0009] a point indicating module, configured to project the projection image onto the projection coordinate system;

[0010] a display module, configured to continuously capture and display the ear images in real time.

[0011] Preferably, the shell part comprises a first shell and a second shell, the first shell is rotatably installed on the second shell, the bite groove is arranged on the first shell, and the image collecting module, the ear point recognition system and the point indicating module are arranged on the second shell, and the second shell is rotated to be arranged in an "L" shape with the first shell by rotating the second shell.

[0012] Preferably, the first shell comprises a first cylinder and a second cylinder, the bite groove is arranged on the first cylinder, the second cylinder is slidingly inserted into the first cylinder, an end of the second cylinder is arranged as a first inclined surface, an end of the second shell is arranged as a second inclined surface, the first inclined surface is rotatably connected with the second inclined surface, the second shell comprises a third cylinder and a fourth cylinder, the second inclined surface is arranged on the third cylinder, the third cylinder is rotatably connected with the fourth cylinder, and the image collecting module and the point indicating module are arranged on the fourth cylinder.

[0013] Preferably, the second shell has the same outer diameter as the second cylinder, so that the second shell and the second cylinder are inserted into the first cylinder together, and when the first shell is arranged horizontally, the second shell can be rotated to a horizontal state or an inclined state by rotating the second shell.

[0014] Preferably, the image collecting module comprises a camera and a distance sensor, the distance sensor is configured to measure distance information from the ear, and the focus of the camera is automatically adjusted according to the distance information.

[0015] Preferably, the point indicating module adopts a DMD projector.

[0016] Preferably, the display module is a mobile electronic device with a display screen, a WiFi module is arranged in the ear point recognition system, and the WiFi module is configured to connect the mobile electronic device and to transmit the images captured by the camera to the mobile electronic device for display in real time.

[0017] Preferably, a silica gel pad is arranged on the bite groove.

[0018] The portable ear acupoint positioning projection device has the following beneficial effects:

[0019] By arranging the occlusal groove on the shell part, the user can fix the projection device with the mouth part, even if the user's head shakes, the shell part is relatively fixed relative to the head, and only slight deviation occurs during actual use, high-definition images of the ear part can be captured by the image acquisition module at a close distance, the projection image with the ear acupoint position coordinates and the projection coordinate system can be generated by the ear acupoint recognition system, and the acupoint indication module can project the acupoint indication module onto the ear, and the display module can display the real-time ear image, so that the user can free his hands to perform ear acupoint sticking, magnetic therapy, massage and other operations on the acupoint indicated by the acupoint indication module, and the shell part can be changed into a short rod by rotating the second shell, so as to facilitate storage and carrying. BRIEF DESCRIPTION OF DRAWINGS

[0020] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings needed to be used in the embodiments or the prior art description. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can also be obtained by those skilled in the art without creative labor.

[0021] Figure 1 is a schematic view of the portable ear acupoint positioning projection device in a use state according to the present application;

[0022] Figure 2 is a schematic view of the portable ear acupoint positioning projection device in a state according to the present application;

[0023] Figure 3 is a schematic view of the portable ear acupoint positioning projection device in a state according to the present application;

[0024] Figure 4 is a system block diagram of the portable ear acupoint positioning projection device according to the present application. DETAILED DESCRIPTION

[0025] The following will further describe the portable ear acupoint positioning projection device according to the present application in combination with the drawings and specific embodiments. The advantages and features of the present application will be more apparent according to the following description. It should be noted that the drawings are very simplified and use non-precise proportions, only for the purpose of conveniently and clearly assisting the description of the embodiments of the present application.

[0026] In the description of the present application, the terms "first", "second" are only used for description purposes, and cannot be understood as indicating or

[0027] The relative importance is implied or the number of indicated technical features is implicitly specified. Thus, features defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of this invention, "a plurality of" means at least two, such as two, three, etc., unless otherwise explicitly specified.

[0028] It should be noted that the illustrations provided in the following embodiments are merely schematic representations of the basic concept of the present invention, and are therefore not intended to be construed as follows:

[0029] The illustrations only show the components relevant to this invention and are not drawn according to the actual number, shape and size of the components in the actual implementation. In the actual implementation, the shape, quantity and proportion of each component can be changed arbitrarily, and the layout of the components may also be more complex.

[0030] A portable auricular acupoint positioning projection device, such as Figures 1-4 As shown, the device includes a housing 100, a battery module 500 installed inside the housing 100, an image acquisition module 200 installed on the housing 100, an ear acupoint recognition system 600 installed inside the housing 100, an acupoint indicator module 300 installed inside the housing 100, and a display module 400 connected to the ear acupoint recognition system 600. The housing 100 is provided with a jaw groove 110 for the mouth to bite and fix the housing 100. In use, the user bites the jaw groove 110 to fix the housing 100, and the image acquisition module 200 on the housing 100 acquires images of the ear. By providing the jaw groove 110, even if the user's head moves, the housing 100 remains relatively fixed relative to the head. In actual use, only a slight offset will occur, making the ear images captured by the image acquisition module 200 basically the same, with only a small offset. The image acquisition module 200 sends the ear image to the ear acupoint recognition system 600. The ear acupoint recognition system 600 performs image preprocessing and feature extraction on the image, and then uses the trained target neural network to identify the ear acupoint position coordinates in the image, as well as the size and posture information of the ear, and generates a projection image and projection coordinate system with ear acupoint position coordinates. This image is projected onto the ear through the acupoint indicator module 300 and the real-time ear image is displayed through the display module 400. The patient can fix the device with their mouth, freeing up their hands to perform ear acupoint pressing, magnetic therapy, massage and other operations on the acupoints indicated by the acupoint indicator module 300.

[0031] As an embodiment of the present application, the shell part 100 comprises a first shell 120 and a second shell 130, the first shell 120 is rotatably mounted on the second shell 130, the occlusion slot 110 is arranged on the first shell 120, the image acquisition module 200, the ear point recognition system 600 and the acupoint indication module 300 are arranged on the second shell 130, by rotating the second shell 130, the second shell 130 is rotated to be arranged in an "L" shape with the first shell 120, so that the image acquisition module 200 and the acupoint indication module 300 on the second shell 130 are lifted to a position horizontally with the ear part, so as to shoot a front view photo of the ear part.

[0032] As an embodiment of the present application, the first shell 120 comprises a first cylinder 121 and a second cylinder 122, the occlusion slot 110 is arranged on the first cylinder 121, the second cylinder 122 is slidingly inserted into the first cylinder 121, a battery module 500 is arranged in the second cylinder 122, an end of the second cylinder 122 is arranged as a first inclined surface, an end of the second shell 130 is arranged as a second inclined surface, the first inclined surface is rotatably connected with the second inclined surface, the outer diameter of the second shell 130 is the same as that of the second cylinder 122, so that the second shell 130 is inserted into the first cylinder 121 together with the second cylinder 122, by rotating the second shell 130 when the first shell 120 is horizontally arranged, the second shell 130 can be rotated to a horizontal state or an inclined state, when the second shell 130 and the second cylinder 122 are in the horizontal state, the second cylinder 122 can be inserted into the first cylinder 121 together with the second shell 130, so as to limit the second shell 130, at this time, the shell part 100 is in a short rod shape, which is convenient for carrying, when used, the second shell 130 and the second cylinder 122 are pulled out together, the second shell 130 is rotated, at this time, the shell part 100 is arranged in an "L" shape, so that the image acquisition module 200 and the acupoint indication module 300 are lifted to a position horizontally with the ear part, further, the second shell 130 comprises a third cylinder 131 and a fourth cylinder 132, the second inclined surface is arranged on the third cylinder 131, the third cylinder 131 is rotatably connected with the fourth cylinder 132, the image acquisition module 200 and the acupoint indication module 300 are arranged on the fourth cylinder 132, so as to rotate the fourth cylinder 132 when used, so that the working direction of the image acquisition module 200 and the acupoint indication module 300 corresponds to the ear part.

[0033] As an embodiment of the present application, the image acquisition module 200 comprises a camera 210 and a distance sensor 220, the distance sensor 220 is used to measure the distance information of the ear, and the focal length of the camera 210 is automatically adjusted according to the distance information, the auricular point recognition system 600 is a control system based on an MCU control system, taking the camera 210, the distance sensor 220, the point indication module 300 and the display module 400 as input and output devices, integrating a central processor, a memory, an input / output interface, a timer / counter and other functional modules, and internally built with software, the software part includes an auricular point positioning program, the point indication module 300 adopts a DMD projector, specifically, the auricular point positioning program is configured to: convert the ear image collected by the camera 210 into a grayscale image and perform noise reduction processing, use an edge detection algorithm on the noise-reduced grayscale image to identify the complete ear contour, calculate the geometric parameters of the ear such as the ear area, the circumference, the length of the major axis and the length of the minor axis based on the contour features, establish a standard ear point template library based on the national standard “Auricular Point Name and Positioning”, the template contains the relative position information of each auricular point on the standard ear model, match the extracted ear contour with the standard model in the template library, calculate the similarity using a correlation algorithm, find the most matched template, calculate the approximate positions of each auricular point in the current ear image according to the relative positions of the auricular points in the template and combining the size and posture information of the actual ear, train the ear image using a convolutional neural network model, collect a large number of ear images with accurate auricular point annotations as training data sets, train a convolutional neural network model capable of identifying auricular point positions, input the real-time collected ear image into the trained model, the model outputs the probability distribution of each auricular point in the image, set a threshold to determine the accurate position of the auricular point, fuse the results of the convolutional neural network model and the template matching-based results to further improve the accuracy of auricular point position calculation; convert the calculated auricular point position coordinates from the image coordinate system to the projection coordinate system of the projector, use the coordinate transformation matrix to realize the coordinate conversion according to the relative position calibration parameters of the camera 210 and the projector, calibrate the converted coordinates to ensure that the auricular point position is accurately matched with the actual ear position during projection, generate a pattern for projection according to the auricular point position coordinates; specifically, for each auricular point position, generate a circular pattern with a diameter of 1-2 mm, or generate a text pattern with the point name or number according to the requirements, use the drive software interface of the DMD projector to send the generated projection pattern data to the projector, control the projector to accurately project the auricular point position to the ear, and judge the ear position change through the comparison of the continuously photographed images during the projection process, dynamically adjust the position of the projection pattern according to the real-time monitored ear position change to maintain the accuracy of the projection.

[0034] In order to improve the comfort of the teeth, the occlusal groove 110 is provided with a silica gel pad 111.

[0035] In order to further improve the portability, the display module 400 adopts a mobile electronic device with a display screen, such as a mobile phone or a tablet computer, and the auricular point recognition system 600 is provided with a WiFi module for connecting the mobile electronic device, and the video captured is sent to the mobile electronic device in real time for display through the WiFi module.

[0036] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application and are not limiting. Although the present application has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present application can be modified or replaced by equivalents without departing from the spirit and scope of the technical solutions of the present application.

Claims

1. A portable ear-acupoint positioning projection device, characterized in that, The application relates to an ear acupoint image acquisition device. The device comprises a shell part provided with a bite groove; an image acquisition module for acquiring ear images; an ear acupoint recognition system for recognizing ear acupoint position coordinates in the images acquired by the image acquisition module, and the size and posture information of the ear, and generating a projection image with the ear acupoint position coordinates and a projection coordinate system; an acupoint indication module for projecting the projection image on the projection coordinate system; and a display module for continuously shooting the ear images and performing real-time display. The shell part comprises a first shell and a second shell, the first shell is rotationally installed on the second shell, the bite groove is arranged on the first shell, the image acquisition module, the ear acupoint recognition system and the acupoint indication module are arranged on the second shell, and the second shell is rotated to an L-shaped arrangement with the first shell by rotating the second shell. The first shell comprises a first cylinder and a second cylinder, the bite groove is arranged on the first cylinder, the second cylinder is slidingly inserted into the first cylinder, the end of the second cylinder is provided with a first inclined surface, the end of the second shell is provided with a second inclined surface, the first inclined surface is rotationally connected with the second inclined surface, the second shell comprises a third cylinder and a fourth cylinder, the second inclined surface is arranged on the third cylinder, the third cylinder is rotationally connected with the fourth cylinder, and the image acquisition module and the acupoint indication module are arranged on the fourth cylinder. The outer diameter of the second shell is the same as that of the second cylinder, so that the second shell and the second cylinder are inserted into the first cylinder together, and when the first shell is arranged horizontally, the second shell can be rotated to a horizontal state or an inclined state by rotating the second shell. The image acquisition module comprises a camera and a distance sensor, the distance sensor is used for measuring distance information of the ear, and the focal length of the camera is automatically adjusted according to the distance information.

2. The portable ear-acupoint positioning projection device according to claim 1, characterized in that, The acupoint indication module adopts a DMD projector.

3. The portable ear-acupoint positioning projection device according to claim 2, characterized in that, The display module is a mobile electronic device with a display screen, a WiFi module is arranged in the ear acupoint recognition system, the WiFi module is used for connecting the mobile electronic device, and the images shot by the camera are sent to the mobile electronic device for display in real time.

4. The portable ear-acupoint positioning projection device according to claim 3, characterized in that, The bite groove is provided with a silica gel pad.

5. The portable ear-acupoint positioning projection device according to claim 1, wherein, ​ 6. The portable ear-acupoint positioning projection device according to claim 1, wherein, ​ 7. The portable ear-acupoint positioning projection device according to claim 5, characterized in that, ​ 8. The portable ear-acupoint positioning projection device according to claim 1, wherein, ​

Images