Eye detection system and body part detection system
Through the eye detection system combining wearable slit lamps and voice interactive devices, the problem of low detection efficiency of ophthalmologists is solved, automated detection is realized, detection efficiency and portability are improved, and it is suitable for a variety of application scenarios and improves user experience and health management.
Patent Information
- Application Number
- CN202322367593.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Utility models(China)
- Current Assignee / Owner
- Filing Date
- 2023-08-30
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2033-08-30
AI Technical Summary
In the prior art, ophthalmologists use slit lamps to detect eye detection efficiency on patients, and the lack of professional ophthalmologists has caused the inability to conduct eye examinations in time at the grassroots and remote areas, affecting user experience and health management.
Provide an eye detection system, combining wearable slit lamps and voice interaction devices, collect image or video information through intelligent event cameras, and collect health information through voice interaction devices, realizing an automated eye detection process and reducing the risk of professional ophthalmologists. dependency.
Improves the efficiency and portability of eye detection, realizes a fully automated process, alleviates the demand for professional ophthalmologists, and is suitable for a variety of application scenarios, including eye disease screening, emergency room and daily eye care, improving the user experience of patients and health management level.
Smart Images

Figure CN222055391U_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of medical equipment, and in particular to an eye detection system and a body part detection system. Background Art
[0002] In daily life, eyes are a sensory organ that people rely on. When infectious keratitis, conjunctivitis, dry eyes and other diseases occur in the eyes, it will seriously affect people's production and life.
[0003] In some related technologies, an ophthalmologist may use a slit lamp to examine a patient's eyes and, combined with the ophthalmologist's expertise, identify eye diseases.
[0004] Since the diagnosis of eye diseases requires professional ophthalmologists to perform tests, it takes a long time, resulting in low detection efficiency. Utility Model Content
[0005] The present application provides an eye detection system and a body part detection system to solve the problem of low detection efficiency in the related art in which ophthalmologists use slit lamps to detect patients' eyes.
[0006] In a first aspect, the present application provides an eye detection system, comprising:
[0007] A wearable slit lamp, the wearable slit lamp comprises a lamp body and an intelligent event camera, and is used to collect images or video information containing an observed eye through the intelligent event camera under the illumination of the lamp body;
[0008] Voice interaction devices, used to collect users’ health information through voice;
[0009] The detection equipment is connected to a wearable slit lamp and a voice interaction device respectively, and is used to obtain eye detection results based on image or video information and health information.
[0010] In some possible implementations, the wearable slit lamp also includes a zoom lens, which is disposed at the front end of the smart event camera and connected to the smart event camera, and is used to focus layer by layer on the ocular tissue of the observed eye.
[0011] In some possible implementations, the voice interaction device includes: a voice input module, a voice recognition module, and a voice engine module;
[0012] The voice input module is used to receive the voice information sent by the user;
[0013] The speech recognition module is used to recognize speech information and obtain health information corresponding to the speech information;
[0014] The voice engine module is used for voice interaction based on health information.
[0015] In some possible implementations, the system further includes: a treatment measure generating device;
[0016] The processing measure generating device is connected to the detection device and is used to determine the processing measures according to the detection results.
[0017] In some possible implementations, the system further includes: a display;
[0018] The display is respectively connected to the wearable slit lamp, the voice interaction device, the detection device, and the treatment measure generating device, and is used to display image or video information, health information, detection results, and treatment measures.
[0019] In some possible implementations, the system further includes: a memory;
[0020] The memory is respectively connected to the wearable slit lamp, the voice interaction device, the detection device, and the treatment measure generating device, and is used to store image or video information, health information, detection results, and treatment measures.
[0021] In some possible implementations, the treatment measures include follow-up information; the system further includes: a monitoring device;
[0022] The monitoring device is connected to the memory and is used to monitor the test results in the memory so as to send a follow-up consultation reminder message to the user.
[0023] In some possible implementations, the detection device includes an information analysis device and a detection sub-device;
[0024] An information analysis device is connected to the wearable slit lamp, the display and the memory, respectively, and is used to process the image or video information to obtain an augmented reality image, and send the augmented reality image to the display for display, and send the augmented reality image to the memory for storage;
[0025] The detection sub-device is connected to the information analysis device, the voice interaction device, the display and the memory respectively, and is used to obtain eye detection results based on the augmented reality image and health information, and send the detection results to the display for display and send the detection results to the memory for storage.
[0026] In some possible implementations, the information analysis device stores an organ perspective metaverse of the eye and its diseases; the information analysis device includes a virtual information module and a virtual-real hybrid module;
[0027] The virtual information module is connected to the wearable slit lamp and is used to determine corresponding virtual information in the organ perspective metaverse of the eye and its diseases based on the image or video information;
[0028] The virtual-reality mixing module is connected to the wearable slit lamp and the virtual information module respectively, and is used to take the image or video information as the real information based on the augmented reality technology, to fuse the real information and the virtual information, and obtain the augmented reality image.
[0029] In a second aspect, the present application provides a body part detection system, comprising:
[0030] Information collection equipment, used to collect images or video information containing the part to be detected;
[0031] Voice interaction devices, used to collect users’ health information through voice;
[0032] The detection equipment is connected to the information collection equipment and the voice interaction equipment respectively, and is used to obtain the detection results of the part to be detected based on the image or video information and health information.
[0033] The present application provides an eye detection system and a body part detection system. A wearable slit lamp can collect images or video information of the observed eye under the illumination of the lamp body, and an intelligent event camera can collect images or video information of the observed eye. The voice interaction device collects the user's health information through voice. The detection device obtains the eye detection result based on the image or video information and health information. The eye detection system of the present application uses a wearable slit lamp to improve portability. At the same time, the entire process of eye detection can be automatically realized, with a high degree of automation, which improves the detection efficiency and effectively alleviates the demand for professional ophthalmologists. BRIEF DESCRIPTION OF THE DRAWINGS
[0034] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.
[0035] Figure 1 A schematic diagram of an application scenario of an eye detection system provided in an embodiment of the present application;
[0036] Figure 2 A schematic diagram of an eye detection system provided in an embodiment of the present application Figure 1 ;
[0037] Figure 3 An eye detection system provided in an embodiment of the present application is shown in FIG. Figure 2 ;
[0038] Figure 4 Schematic diagram of an eye detection system provided in an embodiment of the present application Figure 3 ;
[0039] Figure 5 A schematic diagram of a body part detection system provided in an embodiment of the present application.
[0040] The above drawings have shown clear embodiments of the present application, which will be described in more detail later. These drawings and text descriptions are not intended to limit the scope of the present application in any way, but to illustrate the concept of the present application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION
[0041] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.
[0042] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.
[0043] First, the terms involved in this application are explained:
[0044] Machine vision: A branch of artificial intelligence that uses machines to replace human eyes for measurement and judgment.
[0045] The eye is a transparent organ whose function is to see the outside world clearly and to be seen clearly by the outside world. Eye diseases are mainly examined through the doctor's visual system, which gave rise to the slit lamp examination, including the photography and video recording functions of the slit lamp.
[0046] The slit lamp, which is now popular in ophthalmic examinations, is a useful professional tool for examining ophthalmic patients. Using the professional knowledge of ophthalmologists, doctors use their eyes to examine eye patients, which is a direct and effective method. The slit lamp can also be called a slit lamp microscope. It is a tool that uses slit light in conjunction with a microscope to detect eye lesions. It consists of a slit and diffuse multi-color light source, a manually focusable binocular microscope, and a camera or video system. Currently, there are two types of slit lamps: desktop and handheld. Both require trained ophthalmologists to use to test patients' eyes, and the detection efficiency is low. At the same time, because the slit lamp is relatively bulky, it is less portable.
[0047] Since the slit lamp is a professional ophthalmic examination tool, untrained general practitioners cannot use it skillfully, and ordinary users without professional background cannot use the slit lamp for eye examination. However, there is a shortage of ophthalmologists at present. At the same time, the eye, as a sensory organ, occupies less resources in the field of health care than important life-sustaining organs, and the resources are concentrated in urban hospitals. Therefore, the lack of ophthalmologists in primary hospitals and rural areas is more serious. Therefore, it is impossible to examine the patient's eyes in time, which may cause further damage to the patient's eyes and lead to a poor user experience.
[0048] Based on the above problems, the present application provides an eye detection system, in which a slit lamp is used as a detection tool for ophthalmologists. The ophthalmologist's professional intelligence, i.e., detection equipment, is combined with the slit lamp to realize the robotization of ophthalmologists. At the same time, the eye detection system may also include a voice interaction device to collect the user's health information. The eye detection system of the present application can realize eye examinations in a fully automated process. While improving the detection efficiency, there is no need for professional ophthalmologists to interview patients to obtain the user's health information, ophthalmologists to conduct manual examinations, etc. It can be realized by patients themselves or users who do not have professional knowledge of ophthalmology. It is convenient and portable, and effectively alleviates the demand for ophthalmic examinations at the grassroots and remote areas through ophthalmic robot doctors.
[0049] The eye detection system of the present application can be applied to a variety of application scenarios, for example, it can be used for eye disease screening and census, hospital ophthalmology triage and pre-examination system, medical student education and training, ophthalmic emergency on-site treatment guidance, hospital ophthalmology patient drainage tool, public eye health care, popular eye health care knowledge to improve the level of eye preventive health care, etc. The eye detection system of the present application can also be used as an auxiliary tool for general practitioners to see ophthalmic patients on a daily basis, and can also be used as an auxiliary tool for ophthalmologists to provide professional examinations when personnel in non-health industries such as the insurance industry need to provide on-site ophthalmology-related consultation and guidance.
[0050] The eye detection system of the present application serves as an ophthalmic robot doctor, which has low time and geographical restrictions and can improve the coverage of ophthalmic robot doctors, thereby effectively alleviating the demand for ophthalmologists at the grassroots and remote areas. It can also realize all-weather eye detection and timely detect the patient's eyes, better serve the daily needs of eye health, improve the quality of life, reduce the cost of ophthalmic care and disease treatment, and help improve the patient's user experience.
[0051] The eye detection system of the present application can be used for self-testing by patients, and eye detection can be achieved without the assistance of other users; the eye detection system of the present application can also be used by ophthalmologists or ordinary users other than ophthalmologists to assist patients in testing, and can be used as an auxiliary tool for professional examinations by ophthalmologists, and the present application does not impose any restrictions on this.
[0052] Figure 1 A schematic diagram of an application scenario of an eye detection system provided in an embodiment of the present application is shown in FIG. Figure 1 As shown, patients can wear a wearable slit lamp to obtain images of the eye, and the detection device ( Figure 1 (not shown) detects the image of the eye to obtain the detection result of the patient's eye, and displays the eye detection result.
[0053] The technical solution of the present application and how the technical solution of the present application solves the above-mentioned technical problems are described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below in conjunction with the accompanying drawings.
[0054] Figure 2 A schematic diagram of an eye detection system provided in an embodiment of the present application Figure 1 The eye detection system is an intelligent detection system for ophthalmologist robots, which can be used as an ophthalmic robot doctor to perform eye detection.
[0055] like Figure 2 As shown, the system may include:
[0056] A wearable slit lamp 21, the wearable slit lamp 21 comprises a lamp body and an intelligent event camera, and is used to collect images or video information containing an observed eye through the intelligent event camera under the illumination of the lamp body;
[0057] A voice interaction device 22, used to collect health information of the user through voice;
[0058] The detection device 23 is connected to the wearable slit lamp 21 and the voice interaction device 22 respectively, and is used to obtain eye detection results based on image or video information and health information.
[0059] In some embodiments, what the wearable slit lamp 21 sees is what the ophthalmologist sees, and is also the information collected by the ophthalmologist's brain. At the same time, since the mixed virtual and real augmented reality (AR) wearable devices have developed to a high level, they can be applied to the professional field of ophthalmology, that is, the slit lamp is used as a detection tool for professional ophthalmologists, combined with the augmented reality wearable device, and the slit lamp light source and microscope are used in the camera system of the AR wearable device to obtain a wearable slit lamp, thereby improving portability.
[0060] In some embodiments, the lamp body, i.e., the light source, of the wearable slit lamp 21 may include a white light source, a green fluorescent slit light source, and a diffuse light source, and a plurality of adjustable azimuth angles may be set, thereby facilitating illumination of the outer eye and the anterior segment of the eye to display various aspects of the characteristics of various lesions.
[0061] In some embodiments, the wearable slit lamp 21 further includes a zoom lens, which is disposed at the front end of the intelligent event camera and connected to the intelligent event camera, and is used to focus layer by layer on the ocular tissue of the observed eye. The zoom lens can realize automatic focusing based on the light source, including a magnification, aperture, ranging, focus and zoom system corresponding to the examination of ocular lesion tissue.
[0062] In one implementation scenario, the intelligent event camera uses visible light sources as the positioning standard and serves as the real-view input of the slit lamp ultra-high-resolution depth vision sensor. The intelligent event camera cooperates with the zoom lens to focus on the eye tissue layer by layer, automatically adjust the magnification, and dynamically and intelligently obtain the details of the observed eye. This application applies the intelligent event camera to eye examination, which is an application example of the feasibility of the intelligent event camera in a professional field, and verifies the general intelligence of the intelligent event camera, including its abstract compatibility.
[0063] In some embodiments, the voice interaction device 22 can use a general voice intelligent interaction system, which is conducive to guiding the patient to self-test, and the help of people around him, to achieve the basic process of eye examination, and to obtain the patient's health information. The user's health information includes but is not limited to the user's medical history information and the current user's physical condition information.
[0064] In some embodiments, the voice interaction device 22 can also be connected to the wearable slit lamp 21. The voice interaction device 22 can preliminarily determine the target abnormal part based on the collected health information, so that the wearable slit lamp 21 can detect the target abnormal part and obtain the image or video information corresponding to the target abnormal part. It should be noted that the connection relationship between the voice interaction device 22 and the wearable slit lamp 21 is not Figure 2 Shown in.
[0065] In some embodiments, the detection device 23 can be an enhanced display device, which detects image or video information and health information based on augmented reality technology, collects the signs of each layer of eye appendages and eyeballs in layers, and obtains the detection results of the eye. Among them, the eye appendages include but are not limited to eyelids, conjunctiva, lacrimal apparatus, extraocular muscles and eye sockets, etc., which have the functions of maintaining, supporting and moving the eyeball. The eyeball includes but is not limited to the ocular surface, cornea, anterior chamber, iris, lens, etc.
[0066] In one implementation scenario, the eye detection results may include the specific location of the eye where the abnormality or lesion occurs and the abnormal situation. The eye location may include the eyeball and eye appendages.
[0067] It should be noted that the wearable slit lamp 21, voice interaction device 22 and detection device 23 included in the eye detection system of the present application can be integrated together, or any two devices can be integrated, or the above three devices can be independent devices respectively, and the present application does not impose any restrictions on this.
[0068] In one implementation scenario, if the wearable slit lamp 21, the voice interaction device 22, and the detection device 23 are all independent devices, the voice interaction device 22 can be a device such as a mobile phone that can provide a voice interaction function, and the detection device 23 can be an augmented reality device, etc. The wearable slit lamp 21, the voice interaction device 22, and the detection device 23 can be connected by wires, etc., or by providing a wireless communication module inside the above devices to communicate wirelessly, and this application does not limit this.
[0069] The eye detection system of this application is used as an ophthalmic robot doctor to detect the eyes. It is a professional application example of highly intelligent machine vision in ophthalmology and a successful application of general visual cognitive intelligence in the professional field of ophthalmology detection. Based on objective and transparent machine vision intelligence, the eye detection system can improve the coverage of ophthalmology technology and detection efficiency, and promote communication between doctors and patients.
[0070] The embodiment of the present application provides an eye detection system. The wearable slit lamp 21 can collect images or video information of the observed eye through an intelligent event camera under the illumination of the lamp body. The voice interaction device 22 collects the user's health information through voice. The detection device 23 obtains the eye detection results based on the image or video information and the user's health information. The eye detection system of the present application can be used as an ophthalmic robot doctor to automatically realize the whole process of eye detection. It has a high degree of automation and improves the detection efficiency. It can also be used by non-professional ophthalmologists to replace ophthalmologists in the examination of eye diseases, effectively alleviating the demand for professional ophthalmologists. At the same time, since eye detection can be realized automatically, the time limit for eye detection is reduced, and detection can be performed for patients around the clock, which is beneficial to improving the patient's user experience. In addition, the slit lamp is wearable, which improves the portability of the slit lamp in use and movement.
[0071] Figure 3 An eye detection system provided in an embodiment of the present application is shown in FIG. Figure 2 ,like Figure 3 As shown, the voice interaction device 22 includes: a voice input module 221, a voice recognition module 222 and a voice engine module 223;
[0072] The voice input module 221 is used to receive voice information sent by the user;
[0073] The voice recognition module 222 is used to recognize voice information and obtain health information corresponding to the voice information;
[0074] The voice engine module 223 is used for performing voice interaction according to health information.
[0075] In one implementation scenario, the voice engine module 223 can use a conversational search for an ophthalmic robot engine, and can obtain corresponding health information based on the voice information sent by the user in the current conversation based on the voice recognition module 222, and further initiate the next round of conversation with the user based on the health information, thereby obtaining the user's complete health information based on human-computer conversation.
[0076] The user's health information includes but is not limited to the user's medical history information and current status information, wherein the medical history information includes systemic medical history information related to the eyes, such as hypertension, diabetes and other diseases; the current status information includes information such as the left eye is swollen but the right eye is normal.
[0077] In some embodiments, the system further includes: a treatment measure generating device 24; the treatment measure generating device 24 is connected to the detection device 23, and is used to determine the treatment measure according to the detection result.
[0078] The treatment measure generating device 24 can give corresponding treatment measures in time according to the detection results, such as flushing with sterile saline, etc. Further treatment measures can also include information such as drug and surgical treatment, referral, prognosis, and follow-up visits to inform the patient of the treatment measures.
[0079] In some embodiments, the system further includes: a display 25; the display 25 is respectively connected to the wearable slit lamp 21, the voice interaction device 22, the detection device 23, and the treatment measure generation device 24, and is used to display image or video information, health information, detection results, and treatment measures. Based on the display 25, the above information can be displayed to the patient or other users who detect the patient, so that the patient or other users can understand the corresponding situation in time, which is conducive to improving the user experience.
[0080] In another implementation scenario, the above information may also be integrated and the integrated information may be sent to the patient via email or other means.
[0081] In some embodiments, the system further includes: a memory 26; the memory 26 is respectively connected to the wearable slit lamp 21, the voice interaction device 22, the detection device 23, and the treatment measure generation device 24, and is used to store image or video information, health information, detection results, and treatment measures. The above information is stored in the memory 26, thereby avoiding the loss of the above information.
[0082] In some embodiments, since the treatment measures include follow-up information, the system further includes: a monitoring device 27; the monitoring device 27 is connected to the memory 26, and is used to monitor the test results in the memory 26 to send a follow-up reminder message to the user.
[0083] In one implementation scenario, the follow-up reminder information can also be displayed through the display 25, or the eye detection system can also be provided with an indicator light to remind the user through the indicator light.
[0084] In summary, the eye detection system can guide the user based on the voice interaction device 22, and can automatically obtain the user's health information with high efficiency. At the same time, the eye detection system also includes a treatment measure generation device 24, which can determine the corresponding treatment measures in time according to the test results. Compared with the ophthalmologist's determination of treatment measures based on the examination of the anterior segment disease, it is more objective and accurate. The display 25 included in the eye detection system displays the information generated during the eye detection process, the memory 26 stores the generated information, and the monitoring device 27 prompts the user, which is conducive to improving the user experience in all aspects.
[0085] Figure 4 Schematic diagram of an eye detection system provided in an embodiment of the present application Figure 3 ,like Figure 4 As shown, the detection device 23 includes an information analysis device 231 and a detection sub-device 232;
[0086] The information analysis device 231 is connected to the wearable slit lamp 21, the display 25 and the memory 26 respectively, and is used to process the image or video information to obtain an augmented reality image, and send the augmented reality image to the display 25 for display, and send the augmented reality image to the memory 26 for storage;
[0087] The detection sub-device 232 is respectively connected to the information analysis device 231, the voice interaction device 22, the display 25 and the memory 26, and is used to obtain eye detection results based on the augmented reality image and health information, and send the detection results to the display 25 for display and send the detection results to the memory 26 for storage.
[0088] In some embodiments, the information analysis device 231 may be an AR wearable device, which is provided with an eyeball and eye disease digitization system. Applying high-level machine vision to the AR wearable device is a preliminary application of robot vision.
[0089] In some embodiments, the detection sub-device 232 can be an ophthalmic disease knowledge classification system of ophthalmologists' knowledge, which classifies augmented reality images and health information, classifies according to anatomical parts, determines feature values, determines pathogens, and requires further inspection, etc., to obtain corresponding test results, which are objective and accurate, and improve the accuracy of the test results. Among them, the feature value can be a feature parameter of a certain part such as the transparency of the cornea and the depth of the anterior chamber.
[0090] In an implementation scenario, data resources can be collected through multiple channels as ophthalmological expert knowledge. The data are universal and the data collected through multiple channels are compatible with each other.
[0091] In some embodiments, the information analysis device 231 stores an organ perspective metaverse of the eye and its diseases; the information analysis device 231 includes a virtual information module 2311 and a virtual-real mixing module 2312;
[0092] The virtual information module 2311 is connected to the wearable slit lamp 21 and is used to determine corresponding virtual information in the organ perspective metaverse of the eye and its diseases based on the image or video information;
[0093] The virtual-reality mixing module 2312 is connected to the wearable slit lamp 21 and the virtual information module 2311 respectively, and is used to use the image or video information as real information based on the augmented reality technology, to fuse the real information and the virtual information, and obtain the augmented reality image.
[0094] In some embodiments, for the virtual information module 2311, the anatomy, physiology and pathology of ophthalmology can be used as the virtual scene generation system of the AR wearable device, and the organ perspective metaverse of the eye and its diseases is a virtual transparent digital eyeball constructed based on the cutting-edge intelligent perception algorithm of the anatomy, physiology and pathology of the eye.
[0095] In one implementation scenario, the basic framework can be built with multimodal distributed intelligent perception of ophthalmologists' daily consultation time, an eye disease database can be established based on the anatomical structure of the eyeball and its appendages, anterior segment eye diseases can be composed of a mapping system set, and eye tissue lesions can be used as their element mappings. The human eye and ophthalmic diseases can be digitized, thereby establishing an organ-perspective metaverse of the human eye and its diseases.
[0096] The wearable slit lamp 21 can take digital photos of the eye at multiple angles and multiple levels, and the obtained digital photos of the anterior segment and fundus are the real situation of the eye. The virtual-real mixing module 2312 obtains an augmented reality image by interactively mixing the obtained digital photos of the anterior segment and fundus with the virtual transparent digital eyeball, so that the detection sub-device 232 analyzes the enhanced display image to obtain a logical detection result, thereby realizing the scientific positioning and quantitative lesion at the visible light size level.
[0097] In summary, the detection device 23 of the present application is based on enhanced display technology. It obtains an augmented reality image by coordinating images or video information that can reflect the real condition of the eyes with the three-dimensional size positioning of the virtual transparent digitized eyeball, and further obtains corresponding detection results based on the augmented reality image and health information. It can be automatically realized without human intervention, thereby improving detection efficiency.
[0098] The eye detection system provided based on the above embodiment can be extended to other medical specialties, namely the detection of other body parts, in addition to eye detection, so as to improve the detection efficiency and give full play to the functions of on-site rescue and emergency treatment.
[0099] Figure 5 A schematic diagram of a body part detection system provided in an embodiment of the present application is shown in FIG. Figure 5 As shown, including:
[0100] Information collection equipment 51, used to collect images or video information containing the part to be detected;
[0101] A voice interaction device 52, used to collect health information of the user through voice;
[0102] The detection device 53 is connected to the information collection device 51 and the voice interaction device 52 respectively, and is used to obtain the detection result of the part to be detected based on the image or video information and the health information.
[0103] It should be noted that the body part detection system of the present application can be used as a robot general practitioner to detect multiple parts of the body, or can be used as a robot specialist to detect a certain part of the body.
[0104] The process of the body part detection system detecting the part to be detected can refer to the process of the eye detection system detecting the eye in the above embodiment. The specific implementation principle is similar and will not be repeated in this application.
[0105] In the several embodiments provided in this application, it should be understood that the disclosed device can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of the modules is only a logical function division, and there may be other division methods in actual implementation, such as multiple modules can be combined or integrated into another system, or some features can be ignored or not executed.
[0106] The memory may include a high-speed RAM memory, and may also include a non-volatile storage NVM, such as at least one disk memory, and may also be a USB flash drive, a mobile hard disk, a read-only memory, a magnetic disk or an optical disk, etc.
[0107] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.
[0108] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.
[0109] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the application disclosed herein. The present application is intended to cover any modification, use or adaptation of the present application, which follows the general principles of the present application and includes common knowledge or customary techniques in the art that are not disclosed in the present application. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present application are indicated by the following claims.
[0110] It should be understood that the present application is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.
Claims
1. An eye detection system, It is characterized in that include: A wearable slit lamp, the wearable slit lamp comprising a lamp body and an intelligent event camera, for collecting images or video information containing an observed eye through the intelligent event camera under the illumination of the lamp body; Voice interaction devices, used to collect users’ health information through voice; The detection device is connected to the wearable slit lamp and the voice interaction device respectively, and is used to obtain eye detection results based on the image or video information and the health information; The detection device is an augmented reality device, comprising an information analysis device and a detection sub-device; The system also includes: a display and a memory; An information analysis device, connected to the wearable slit lamp, the display and the memory, respectively, for processing the image or video information to obtain an augmented reality image, and sending the augmented reality image to the display for display, and sending the augmented reality image to the memory for storage; The detection sub-device is respectively connected to the information analysis device, the voice interaction device, the display and the memory, and is used to obtain eye detection results based on the augmented reality image and the health information, and send the detection results to the display for display and send the detection results to the memory for storage.
2. The system according to claim 1, It is characterized in that The wearable slit lamp also includes a zoom lens, which is arranged at the front end of the smart event camera and connected to the smart event camera, and is used to focus on the eye tissue of the observed eye layer by layer.
3. The system according to claim 1, It is characterized in that The voice interaction device includes: a voice input module, a voice recognition module and a voice engine module; The voice input module is used to receive voice information sent by the user; The voice recognition module is used to recognize the voice information and obtain the health information corresponding to the voice information; The voice engine module is used to perform voice interaction according to the health information.
4. A system according to any one of claims 1 to 3, It is characterized in that The system further comprises: a treatment measure generating device; The processing measure generating device is connected to the detection device and is used to determine the processing measure according to the detection result.
5. The system according to claim 4, It is characterized in that The display is respectively connected to the wearable slit lamp, the voice interaction device, the detection device, and the treatment measure generation device, and is used to display the image or video information, the health information, the detection results, and the treatment measures.
6. The system according to claim 5, It is characterized in that The memory is respectively connected to the wearable slit lamp, the voice interaction device, the detection device, and the treatment measure generation device, and is used to store the image or video information, the health information, the detection results, and the treatment measures.
7. The system according to claim 6, It is characterized in that The treatment measures include follow-up information; the system also includes: monitoring equipment; The monitoring device is connected to the memory and is used to monitor the test results in the memory so as to send a follow-up consultation reminder message to the user.
8. The system according to claim 1, It is characterized in that The information analysis device stores an organ perspective metaverse of the eye and its diseases; the information analysis device includes a virtual information module and a virtual-real hybrid module; The virtual information module is connected to the wearable slit lamp and is used to determine corresponding virtual information in the organ perspective metaverse of the eye and its diseases according to the image or video information; The virtual-reality mixing module is connected to the wearable slit lamp and the virtual information module respectively, and is used to use the image or video information as real information based on augmented reality technology, to perform virtual-reality fusion on the real information and the virtual information, and obtain an augmented reality image.
9. A body part detection system, It is characterized in that include: Information collection equipment, used to collect images or video information containing the part to be detected; Voice interaction devices, used to collect users’ health information through voice; The detection device is connected to the information collection device and the voice interaction device respectively, and is used to obtain the detection result of the part to be detected based on the image or video information and the health information.
