Optical sensing module and handheld optical inspection device

Abstract

An optical sensing module includes an optical beamsplitter, a light source assembly, a first image sensor, a first optical filter, a second image sensor and a second optical filter. The spectroscope includes a first surface and a second surface. The light source assembly faces the first surface and includes a visible light source and a short-wave infrared light source. The first and second image sensors face the first and second surfaces, respectively. The first optical filter is located between the first surface and the first image sensor. The second optical filter is located between the second surface and the second image sensor. Light from the light source assembly is emitted to the beamsplitter, and a part of the light is reflected by the beamsplitter and emitted to the object. The light emitted to the object is reflected back to the beamsplitter by the object, and the light reflected back to the beamsplitter is split to two parts by the beamsplitter, passes through the first optical filter and the second optical filter, and enters the first image sensor and the second image sensor.

Description

[Technical Field]

[0001] This invention relates to a sensing module and a detection device, and more particularly to an optical sensing module and a handheld optical detection device. [Previous Technology]

[0002] Traditional otoscopes use fiber optics or light bulbs to provide a light source, allowing the doctor to directly observe ear symptoms by placing their eye close to the otoscope's window. Because the traditional otoscope's window is a lens design, later developments allowed the window to be opened, enabling a camera to be placed in the original window for photographing and recording, which is also convenient for patients to view. Later, with advancements in digital cameras and microelectronic circuits, digital otoscopes were developed, which can directly acquire digital medical images.

[0003] However, as mentioned above, both light sources and images are within the visible light range. However, many substances have special absorption characteristics in non-visible light bands. For example, water has a more significant absorption characteristic in infrared light than in visible light. Therefore, short-wave infrared (SWIR) technology has gained attention in recent years. Currently, it is mainly used for detection in agriculture, but its application in medicine is not yet widespread.

[0004] Currently, otological examinations primarily involve observing the eardrum with an otoscope to assess eardrum damage and to detect some cases of purulent otitis media. Since the fluid in purulent otitis media is often pale yellow or dark brown, it can be observed with a traditional otoscope that uses visible light. However, many patients with otitis media have clear fluid buildup in their ear, making it impossible to observe with a traditional otoscope. Therefore, doctors use tympanography (ear pressure mapping) to perform hearing tests to assist in diagnosis, but this method is often inaccurate. Doctors may perform minimally invasive procedures on the eardrum, as is often the method used to initially diagnose hydropsytitis media, to confirm its diagnosis. Damage to the eardrum directly affects hearing, and some patients have poor self-repair capabilities, requiring eardrum repair surgery to restore hearing. If a technology could accurately assist in diagnosing hydropsytitis media, it would significantly reduce unnecessary subsequent medical procedures, decrease patient discomfort, and improve patient well-being. [Summary of the Invention]

[0005] The present invention relates to an optical sensing module that can acquire visible light images and short-wave infrared images.

[0006] The present invention relates to a handheld optical inspection device, which includes the above-mentioned optical sensing module.

[0007] According to an embodiment of the present invention, an optical sensing module suitable for sensing an object includes a beam splitter, a light source assembly, a first image sensor, a first filter, a second image sensor, and a second filter. The beam splitter includes a first surface and a second surface facing each other. The light source assembly faces the first surface and includes at least one visible light source and at least one short-wave infrared light source. The first image sensor faces the first surface. The first filter is located between the first surface of the beam splitter and the first image sensor. The second image sensor faces the second surface. The second filter is located between the second surface of the beam splitter and the second image sensor. Light emitted from the light source assembly is directed towards the beam splitter, and a portion of the light is reflected by the beam splitter and directed towards the object. The light directed towards the object is reflected back to the beam splitter by the object. A portion of the light reflected back to the beam splitter is reflected by the beam splitter, passes through the first filter, and enters the first image sensor. Another portion of the light reflected back to the beam splitter penetrates the beam splitter, passes through the second filter, and enters the second image sensor.

[0008] In an embodiment of the present invention, the optical sensing module further includes at least one first focusing lens and at least one second focusing lens. The at least one first focusing lens is disposed between the first image sensor and the first filter. The at least one second focusing lens is disposed between the second image sensor and the second filter.

[0009] In an embodiment of the present invention, the light source assembly is coaxial with the first image sensor, the light source assembly is located between the first image sensor and the beam splitter, and the light source assembly is arranged in a ring.

[0010] In an embodiment of the present invention, the light-emitting surface of the light source assembly is closer to the beam splitter than the first filter.

[0011] In an embodiment of the present invention, the optical sensing module further includes a light guide column, the light source assembly and the first image sensor are not coaxial, and the light guide column is disposed between the light source assembly and the beam splitter.

[0012] In an embodiment of the present invention, the optical sensing module further includes a lens assembly disposed next to the first surface of the beam splitter and located on the path of the light rays reflected by the beam splitter and directed toward the object and the light rays reflected back to the beam splitter by the object.

[0013] In an embodiment of the present invention, at least one visible light source is a plurality of visible light sources, and at least one short-wave infrared light source is a plurality of short-wave infrared light sources, and these visible light sources and these short-wave infrared light sources are arranged alternately.

[0014] In an embodiment of the present invention, one of the first image sensor and the second image sensor is a visible light image sensor and the other is a short-wave infrared image sensor. The first filter or the second filter corresponding to the visible light image sensor is used to allow light between 400 nanometers and 700 nanometers to pass through, and the second filter or the first filter corresponding to the short-wave infrared sensor is used to allow light between 700 nanometers and 2500 nanometers to pass through.

[0015] In an embodiment of the present invention, both the first image sensor and the second image sensor are image sensors for receiving visible light and short-wave infrared light. One of the first filter and the second filter is used to allow light between 400 nanometers and 700 nanometers to pass through, and the other is used to allow light between 700 nanometers and 2500 nanometers to pass through.

[0016] According to an embodiment of the present invention, a handheld optical detection device suitable for detecting the ear canal and eardrum includes a handle, a main unit, and a lens integration. The main unit is disposed next to the handle. The lens integration is electrically connected to the main unit and includes a funnel-shaped outer cover and an optical sensing module. The funnel-shaped outer cover includes an opening. The optical sensing module is disposed inside the funnel-shaped outer cover. Light rays reflected by a beam splitter and incident on an object, as well as light rays reflected back to the beam splitter by the object, exit through the opening of the funnel-shaped outer cover and enter the lens integration.

[0017] The light source assembly of the optical sensing module of the handheld optical inspection device of the present invention faces the first surface of the beam splitter and includes a visible light source and a short-wave infrared light source. A first image sensor faces the first surface of the beam splitter. A first filter is located between the first surface of the beam splitter and the first image sensor. A second image sensor faces the second surface. A second filter is located between the second surface of the beam splitter and the second image sensor. Light emitted from the light source assembly is directed towards the beam splitter, and part of the light is reflected by the beam splitter and directed towards an object. The light directed towards the object is reflected back to the beam splitter by the object, and a portion of the light reflected back to the beam splitter is reflected by the beam splitter, passes through the first filter, and enters the first image sensor. Another portion of the light reflected back to the beam splitter penetrates the beam splitter, passes through the second filter, and enters the second image sensor. Therefore, the optical sensing module of the handheld optical inspection device of the present invention can acquire visible light images and short-wave infrared images, and can detect different items.

Implementation Method

[0018] Reference will now be made in detail to exemplary embodiments of the invention, examples of which are illustrated in the accompanying drawings. Wherever possible, the same element symbols are used in the drawings and description to denote the same or similar parts.

[0019] Figures 1 and 2 are schematic diagrams of the appearance of a handheld optical inspection device from different perspectives according to an embodiment of the present invention. Figure 3 is an exploded view of the handheld optical inspection device of Figure 1.

[0020] Please refer to Figures 1 to 3. The handheld optical inspection device 10 of this embodiment is suitable for inspecting the ear canal and eardrum. The handheld optical inspection device 10 includes a handle 20, a main unit 30, and a lens integration 40 (Figure 3). The main unit 30 is disposed next to the handle 20. A power module (not shown) may be disposed inside the handle 20. A first button 22 and a second button 24 may be provided on the handle 20. The first button 22 can control the power module's on / off switch, and the second button 24 is used to confirm image capture. The main unit 30 may include a processing unit (not shown), a display module 32 (which may include a touch module), a storage unit (not shown), and a communication module (not shown).

[0021] The lens integration 40 is electrically connected to the main unit 30 and includes a funnel-shaped outer cover 50 and an optical sensing module 100. The funnel-shaped outer cover 50 includes an opening 52. The optical sensing module 100 is disposed inside the funnel-shaped outer cover 50. Since the length of the human external auditory canal is approximately 25 mm and the inner diameter is 4-8 mm, the front diameter of the funnel-shaped outer cover 50 can be 3 mm or more to facilitate the insertion of the otoscope into the external auditory canal for a certain distance, thereby avoiding interference from external light and allowing for clearer observation of the morphology of the tissues surrounding the eardrum. Of course, the detection area of ​​the handheld optical detection device 10 is not limited to this.

[0022] Figure 4 is an enlarged schematic diagram of a partial area of ​​Figure 3 from different perspectives. Figure 5 is a schematic diagram of the light source assembly of the handheld optical detection device of Figure 1. Referring to Figures 4 and 5, the optical sensing module 100 of this embodiment includes a beam splitter 110, a light source assembly 120, a first image sensor 130, a first filter 132, a second image sensor 140, and a second filter 142.

[0023] The beam splitter 110 includes a first surface 112 and a second surface 114 facing each other. The beam splitter 110 is supported by a first support member 170. The light source assembly 120 faces the first surface 112 and includes a substrate 126, at least one visible light source 122 and at least one short-wave infrared source 124 disposed on the substrate 126. The first image sensor 130 faces the first surface 112.

[0024] The first filter 132 is located between the first surface 112 of the beam splitter 110 and the first image sensor 130. In this embodiment, the light source assembly 120 is coaxial with the first image sensor 130, and the light source assembly 120 is located between the first image sensor 130 and the beam splitter 110. The first image sensor 130 is supported by the second support member 172.

[0025] As shown in FIG. 4, at least one visible light source 122 of the light source assembly 120 is composed of multiple visible light sources 122, and at least one short-wave infrared light source 124 is composed of multiple short-wave infrared light sources 124. These visible light sources 122 and these short-wave infrared light sources 124 are arranged alternately. The substrate 126 is annular, and these visible light sources 122 and these short-wave infrared light sources 124 are arranged in an annular shape.

[0026] The second image sensor 140 faces the second surface 114. The second filter 142 is located between the second surface 114 of the beam splitter 110 and the second image sensor 140. The second image sensor 140 is supported by the third support member 174.

[0027] In this embodiment, one of the first image sensor 130 and the second image sensor 140 is a visible light image sensor and the other is a short-wave infrared image sensor. The first filter 132 or the second filter 142 corresponding to the visible light image sensor is used to allow light between 400 nanometers and 700 nanometers to pass through, and the second filter 142 or the first filter 132 corresponding to the short-wave infrared light is used to allow light between 700 nanometers and 2500 nanometers to pass through.

[0028] Therefore, the first image sensor 130 can acquire a visible light image, and the second image sensor 140 can acquire a short-wave infrared image. Since water molecules have a peak at 1460 nanometers in the short-wave infrared range, the short-wave infrared image can be used to detect water molecules. In one embodiment, since lipids have a peak at 1200 nanometers in the short-wave infrared range, the short-wave infrared image can also be used to detect lipids.

[0029] Of course, in other embodiments, the first image sensor 130 and the second image sensor 140 may both be image sensors for receiving visible light and short-wave infrared light. One of the first filter 132 and the second filter 142 is used to allow light between 400 nanometers and 700 nanometers to pass through, and the other is used to allow light between 700 nanometers and 2500 nanometers to pass through. In this way, the first image sensor 130 can still acquire visible light images, and the second image sensor 140 can still acquire short-wave infrared images. Of course, in other embodiments, the first image sensor 130 may acquire short-wave infrared images, and the second image sensor 140 may acquire visible light images; this is not a limitation.

[0030] The optical sensing module 100 may optionally include at least one first focusing lens 134 and at least one second focusing lens 144. The at least one first focusing lens 134 is disposed between the first image sensor 130 and the first filter 132. The at least one second focusing lens 144 is disposed between the second image sensor 140 and the second filter 142. In this embodiment, the number of first focusing lenses 134 is, for example, one, and the number of second focusing lenses 144 is, for example, one. However, in other embodiments, the number of first focusing lenses 134 may also be multiple, and these first focusing lenses 134 can collectively enable light to be focused onto the first image sensor 130. Similarly, the number of second focusing lenses 144 may also be multiple, and these second focusing lenses 144 can collectively enable light to be focused onto the second image sensor 140.

[0031] The optical sensing module 100 also includes a lens assembly 160, which is disposed next to the first surface 112 of the beam splitter 110 and is located on the path of the light rays reflected by the beam splitter 110 toward the object 5 and the light rays reflected by the object 5 back to the beam splitter 110. In this embodiment, the lens assembly 160 includes, for example, two lenses with opposing convex surfaces, but the number and type of lenses are not limited thereto.

[0032] Figure 6 is a schematic diagram of the light path from the light source assembly of the handheld optical inspection device in Figure 1 to the object 5. Referring to Figure 6, in this embodiment, the light source assembly 120 can be raised to make its light-emitting surface closer to the beam splitter 110 than the first filter 132. This design prevents the light emitted by the light source assembly 120 from directly hitting the first filter 132. The light source assembly 120 can be raised by studs, encapsulation materials, or injection molded parts, but this is not a limitation. As shown in Figure 6, the light emitted by the light source assembly 120 hits the beam splitter 110, and part of the light is reflected by the beam splitter 110 and hits the object 5.

[0033] Figure 7 is a schematic diagram of the light path reflected by the object in Figure 6. Referring to Figure 7, the light rays incident on the object 5 are reflected back to the beam splitter 110 by the object 5. A portion of the light rays reflected back to the beam splitter 110 is reflected by the beam splitter 110, passes through the first filter 132 and the second focusing lens 144, and enters the first image sensor 130. The other portion of the light rays reflected back to the beam splitter 110 passes through the beam splitter 110, passes through the second filter 142 and the second focusing lens 144, and enters the second image sensor 140.

[0034] That is to say, in this embodiment, the visible light sources 122 and the short-wave infrared sources 124 are arranged in a cross ring and mounted on the substrate 126. The visible light sources 122 and the short-wave infrared sources 124 can emit light simultaneously. The light is reflected by the beam splitter 110 to the opening 52 of the funnel-shaped outer cover 50 and irradiates the eardrum and surrounding tissue through the opening 52. After the light irradiates the eardrum, the light reflected and absorbed by the tissue and the fluid in the ear returns to the funnel-shaped outer cover 50. The beam is focused by the lens assembly 160 to avoid light scattering. The light is split into two beams by the beam splitter 110 (one beam penetrates and the other beam is reflected). The energy of the two beams is approximately 1:1. The required wavelengths are filtered by the first filter 132 and the second filter 142 respectively to the first image sensor 130 and the second image sensor 140 to obtain visible light images and short-wave infrared images. The captured image can be transmitted to the processing unit (not shown) via a transmission interface (not shown), and then transmitted to the display module 32 via the processing unit (not shown) for display.

[0035] It should be noted that, since half of the light emitted by the light source assembly 120 passes through the beam splitter 110 and shines into the funnel-shaped cover 50 when it is directed towards the beam splitter 110, the inner surface of the funnel-shaped cover 50 can be covered with a light-absorbing material (not shown) or coated with black paint (not shown) to prevent the light from being reflected by the inner surface of the funnel-shaped cover 50 and affecting the light collection effect of the first image sensor 130 and the second image sensor 140.

[0036] In addition, the relative positions of the light source assembly 120, the first image sensor 130, the first filter 132, the first focusing lens 134, the second image sensor 140, the second filter 142, and the second focusing lens 144 are not limited by the diagram. In other embodiments, the positions of the first image sensor 130, the first filter 132, and the first focusing lens 134 may also be interchanged with the positions of the second image sensor 140, the second filter 142, and the second focusing lens 144.

[0037] FIG8 is a schematic diagram of a light source assembly of a handheld optical detection device according to another embodiment of the present invention. Referring to FIG8, in this embodiment, the main difference between the light source assembly 120a of FIG8 and the light source assembly 120 of FIG5 is that, in this embodiment, the substrate 126 of the light source assembly 120a is, for example, a disk without a central hole, although the shape of the substrate 126 is not limited thereto. Furthermore, in this embodiment, the visible light sources 122 and the short-wave infrared sources 124 are arranged alternately vertically to provide uniform and sufficient brightness for observation.

[0038] Figure 9 is a schematic diagram of the light path emitted by the light source assembly of the handheld optical inspection device in Figure 8 and illuminating the object. Figure 10 is a schematic diagram of the light path reflected by the object in Figure 7. Referring to Figures 9 and 10, in this embodiment, the light source assembly 120a and the first image sensor 130 are not coaxial. The optical sensing module 100 also includes a light guide column 150, which is disposed between the light source assembly 120a and the beam splitter 110. The light guide column 150 is, for example, a rod-shaped lens, but the type of light guide column 150 is not limited thereto. The light guide column 150 is used to allow more light to reach the beam splitter 110 to reduce light loss.

[0039] Similarly, as shown in Figure 9, the light emitted by the light source assembly 120a is directed toward the beam splitter 110, and part of the light is reflected by the beam splitter 110 and directed toward the object 5.

[0040] As shown in Figure 10, the light rays incident on the object 5 are reflected back to the beam splitter 110 by the object 5. Part of the light rays reflected back to the beam splitter 110 are reflected by the beam splitter 110, pass through the first filter 132, and enter the first image sensor 130. The other part of the light rays reflected back to the beam splitter 110 penetrates the beam splitter 110, passes through the second filter 142, and enters the second image sensor 140.

[0041] The light source assembly of the optical sensing module of the handheld optical inspection device of the present invention faces the first surface of the beam splitter and includes a visible light source and a short-wave infrared light source. A first image sensor faces the first surface of the beam splitter. A first filter is located between the first surface of the beam splitter and the first image sensor. A second image sensor faces the second surface. A second filter is located between the second surface of the beam splitter and the second image sensor. Light emitted from the light source assembly is directed towards the beam splitter, and part of the light is reflected by the beam splitter and directed towards an object. The light directed towards the object is reflected back to the beam splitter by the object, and a portion of the light reflected back to the beam splitter is reflected by the beam splitter, passes through the first filter, and enters the first image sensor. Another portion of the light reflected back to the beam splitter penetrates the beam splitter, passes through the second filter, and enters the second image sensor. Therefore, the optical sensing module of the handheld optical inspection device of the present invention can acquire visible light images and short-wave infrared images, and can detect different items.

[0042] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or make equivalent substitutions for some or all of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention. [Simplified Explanation of the Diagram]

[0043] Figures 1 and 2 are schematic diagrams of the appearance of a handheld optical inspection device according to an embodiment of the present invention from different perspectives. Figure 3 is an exploded view of the handheld optical inspection device of Figure 1. Figure 4 is an enlarged schematic diagram of a partial area of ​​Figure 3 from different perspectives. Figure 5 is a schematic diagram of the light source assembly of the handheld optical inspection device of Figure 1. Figure 6 is a schematic diagram of the optical path of light emitted from the light source assembly of the handheld optical inspection device of Figure 1 illuminating an object. Figure 7 is a schematic diagram of the optical path of light reflected by the object in Figure 6. Figure 8 is a schematic diagram of the light source assembly of a handheld optical inspection device according to another embodiment of the present invention. Figure 9 is a schematic diagram of the optical path of light emitted from the light source assembly of the handheld optical inspection device of Figure 8 illuminating an object. Figure 10 is a schematic diagram of the optical path of light reflected by the object in Figure 7.

Claims

1. An optical sensing module, suitable for sensing objects, comprising: A beam splitter, comprising a first surface and a second surface facing each other; The light source assembly faces the first surface and includes at least one visible light source and at least one short-wave infrared light source; The first image sensor is facing the first surface; A first filter is located between the first surface of the beam splitter and the first image sensor; a second image sensor faces the second surface; a second filter is located between the second surface of the beam splitter and the second image sensor, wherein light emitted from the light source assembly is directed toward the beam splitter, a portion of the light is reflected by the beam splitter and directed toward the object, the light directed toward the object is reflected back to the beam splitter by the object, a portion of the light reflected back to the beam splitter is reflected by the beam splitter, passes through the first filter, and enters the first image sensor, and another portion of the light reflected back to the beam splitter penetrates the beam splitter, passes through the second filter, and enters the second image sensor; and a lens assembly is disposed beside the first surface of the beam splitter and located on the path of the light reflected by the beam splitter and directed toward the object and the light reflected back to the beam splitter by the object.

2. The optical sensing module as described in claim 1, further comprising: At least one first focusing lens is disposed between the first image sensor and the first filter; And at least one second focusing lens, disposed between the second image sensor and the second filter.

3. The optical sensing module as claimed in claim 1, wherein the light source assembly is coaxial with the first image sensor, the light source assembly is located between the first image sensor and the beam splitter, and the light source assembly is arranged in a ring.

4. The optical sensing module as claimed in claim 3, wherein the light-emitting surface of the light source component is closer to the beam splitter than the first filter.

5. The optical sensing module as described in claim 1, further comprising: A light guide column is provided, wherein the light source assembly is not coaxial with the first image sensor, and the light guide column is disposed between the light source assembly and the beam splitter.

6. The optical sensing module as claimed in claim 1, wherein the at least one visible light source is a plurality of visible light sources, the at least one short-wave infrared light source is a plurality of short-wave infrared light sources, and the plurality of visible light sources and the plurality of short-wave infrared light sources are arranged alternately.

7. The optical sensing module as claimed in claim 1, wherein one of the first image sensor and the second image sensor is a visible light image sensor and the other is a short-wave infrared image sensor, wherein the first filter or the second filter corresponding to the visible light image sensor is used to allow light between 400 nanometers and 700 nanometers to pass through, and the second filter or the first filter corresponding to the short-wave infrared image sensor is used to allow light between 700 nanometers and 2500 nanometers to pass through.

8. The optical sensing module as claimed in claim 1, wherein the first image sensor and the second image sensor are both image sensors for receiving visible light and short-wave infrared light, and one of the first filter and the second filter is used to allow light between 400 nanometers and 700 nanometers to pass through, and the other is used to allow light between 700 nanometers and 2500 nanometers to pass through.

9. A handheld optical detection device suitable for detecting the ear canal, comprising: Handle; The main unit is located next to the handle. The device includes a lens integration, electrically connected to the host, and comprising: a funnel-shaped housing including an opening; an optical sensing module as claimed in any one of claims 1 to 8, disposed within the funnel-shaped housing, wherein light rays reflected by the beam splitter and directed toward the object, and light rays reflected back to the beam splitter by the object, exit through the opening of the funnel-shaped housing and enter the lens integration.

Images