Solid-state imaging element, electronic device, and semiconductor device
By forming the same OCL as the pixel area in the dam area of the solid-state imaging element, and installing the chip and filling resin through the flip method, the problem of strong surface reflection in the slit area is solved, and the effect of improving the flash characteristics is achieved.
Patent Information
- Application Number
- CN201880014254.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2017-03-03
- Filing Date
- 2018-02-19
- Publication Date
- 2024-11-19
- Estimated Expiration
- 2038-02-19
AI Technical Summary
In the prior art, the surface reflection of the slit region of the solid-state imaging element is strong, resulting in poor flash characteristics.
The same OCL as the pixel area is formed in the dam area of the solid-state imaging element, and the chip is installed and resin is filled by flip-floping, and a slit preventing the resin from flowing out is formed to reduce surface reflection.
Effectively reduce surface reflection in the slit area, improve flash characteristics, and improve image quality.
Smart Images

Figure CN110352490B_ABST
Abstract
Description
Technical Field
[0001] The present technology relates to a solid-state imaging element, an electronic device, and a semiconductor device. More specifically, the present technology relates to a solid-state imaging element, an electronic device, and a semiconductor device that make it possible to reduce surface reflection in a region where a slit is formed and improve flash characteristics. Background Art
[0002] When flip chip mounting is performed on a substrate by solder bumps, as a means of improving connection reliability, a resin called underfill resin is injected and filled between the substrate and the chip, and then the filling resin is cured.
[0003] In Patent Document 1, the present applicant proposes a structure in which a slit (groove) that blocks the outflow of an underfill resin is formed around a region on a substrate where a chip is mounted.
[0004] Reference List
[0005] Patent Literature
[0006] Patent Document 1: WO 2016 / 039173 Summary of the invention
[0007] Technical issues
[0008] However, in the structure proposed in Patent Document 1, the region where the slits are formed has a flat surface, and therefore, surface reflection from the flat surface is strong, causing flare to occur.
[0009] The present technology has been accomplished in view of such circumstances as described above, and an object of the present technology is to make it possible to reduce surface reflection in a region where slits are formed and to improve sparkle characteristics.
[0010] Solution to the problem
[0011] According to the first aspect of the present technology, a solid-state imaging element includes: a pixel area in which a plurality of pixels are two-dimensionally arranged in a matrix; a chip mounting area in which a chip is mounted by a flip-chip method; and a dam area which is arranged around the chip mounting area and in which one or more slits are formed to block outflow of resin, wherein in the dam area, an OCL identical to the OCL in the pixel area is formed.
[0012] An electronic device according to a second aspect of the present technology includes a solid-state imaging element having: a pixel area in which a plurality of pixels are two-dimensionally arranged in a matrix; a chip mounting area in which a chip is mounted by a flip-chip method; and a dam area which is arranged around the chip mounting area and in which one or more slits are formed to block the outflow of resin, and in which an OCL identical to the OCL in the pixel area is formed.
[0013] In the first and second aspects of the present technology, there are provided: a pixel area in which a plurality of pixels are two-dimensionally arranged in a matrix; a chip mounting area in which a chip is mounted by a flip-chip method; and a dam area which is arranged around the chip mounting area and in which one or more slits are formed to block outflow of resin, wherein in the dam area, an OCL identical to the OCL in the pixel area is formed.
[0014] A semiconductor device according to a third aspect of the present technology includes: an OCL region in which OCLs form a matrix; a chip mounting region in which a chip is mounted by a flip-chip method; and a dam region which is arranged around the chip mounting region and in which one or more slits are formed to block outflow of resin, wherein in the dam region, an OCL identical to that in the OCL region is formed.
[0015] In a third aspect of the present technology, there are provided: an OCL region in which the OCLs form a matrix; a chip mounting region in which a chip is mounted by a flip-chip method; and a dam region which is arranged around the chip mounting region and in which one or more slits are formed to block the outflow of resin, wherein an OCL identical to that in the OCL region is formed in the dam region.
[0016] The solid-state imaging element, the electronic device, and the semiconductor device may be independent devices or modules incorporated into other devices.
[0017] [Beneficial Effects of the Invention]
[0018] According to the first to third aspects of the present technology, it is possible to reduce surface reflection in a region where the slits are formed and improve sparkle characteristics.
[0019] In addition, the advantageous effects disclosed herein are not necessarily limited thereto, and may be any effects disclosed in the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0020] Figure 1 This is a plan view of a solid-state imaging element to which the present technology is applied.
[0021] Figure 2is a cross-sectional view of a solid-state imaging element according to the first embodiment.
[0022] Figure 3 yes Figure 2 A cross-sectional view of the vicinity of the slit region shown in FIG.
[0023] Figure 4 is a cross-sectional view of a solid-state image pickup element according to a second embodiment.
[0024] Figure 5 is a cross-sectional view showing an example of a low-reflection protrusion formed on the bottom surface of a slit.
[0025] Figure 6 It is a cross-sectional view according to a modification example of the first embodiment.
[0026] Figure 7 It is a cross-sectional view according to a modification example of the second embodiment.
[0027] Figure 8 is a flowchart showing a method for manufacturing a solid-state imaging element.
[0028] Fig. 9 : is a block diagram showing a configuration example of an imaging device as an electronic device to which the present technology is applied.
[0029] Fig.10 A diagram showing an example of use of an image sensor.
[0030] Fig.11 is a block diagram showing a schematic configuration example of an in-vivo information acquisition system.
[0031] Fig.12 is a diagram showing a schematic configuration example of an endoscopic surgery system.
[0032] Fig.13 is a block diagram showing a functional configuration example of a camera head and a camera control unit (CCU).
[0033] Fig.14 is a block diagram showing a schematic configuration example of a vehicle control system.
[0034] Fig.15 It is a diagram for assisting in explaining an example of the installation positions of the vehicle exterior information detection unit and the camera unit. DETAILED DESCRIPTION
[0035] Hereinafter, a mode for implementing the present technology (hereinafter, referred to as an embodiment) will be described. In addition, the description will be made in the following order.
[0036] 1. Plan view of a solid-state imaging element
[0037] 2. Cross-sectional view of the first embodiment
[0038] 3. Cross-sectional view of the second embodiment
[0039] 4. Modifications
[0040] 5. Manufacturing method
[0041] 6. Application examples of electronic devices
[0042] 7. Examples of image sensor use
[0043] 8. Application examples of in vivo information acquisition systems
[0044] 9. Application examples of endoscopic surgery systems
[0045] 10. Application examples for mobile objects
[0046] <1. Plan view of solid-state imaging element>
[0047] Figure 1 This is a plan view of a solid-state imaging element to which the present technology is applied.
[0048] Figure 1 The solid-state imaging element 1 shown in FIG. 1 includes, on a semiconductor substrate 10 using, for example, silicon (Si) as a semiconductor, a pixel region 11 in which a plurality of pixels are two-dimensionally arranged in a matrix in the row direction and the column direction, a chip 61 ( Figure 2 ) is mounted by a flip chip method in a chip mounting area 12 and a dam area 13 arranged around the chip mounting area 12, each pixel has a photoelectric conversion unit that generates and accumulates photoelectric charges corresponding to the amount of light received, and a circuit for performing predetermined signal processing is formed in the chip 61. Figure 1 The area depicted by the oblique lines shown in the figure is the dam area 13. In the dam area 13, a plurality of slits 21 (in Figure 1 In the example shown, two slits 21 are formed. The slits 21 that block the outflow of the resin are also called dams.
[0049] A plurality of electrode pads 22 are formed on the outer peripheral portion of the solid-state imaging element 1. The electrode pads 22 are used for probe contact or wire bonding in an inspection step.
[0050] <2. Cross-sectional view of the first embodiment>
[0051] Figure 2 is a cross-sectional view of the solid-state image pickup element 1 according to the first embodiment.
[0052] Figure 2 It is a cross-sectional view including respective end portions of the pixel region 11 and the chip mounting region 12 and the bank region 13 therebetween.
[0053] In the pixel region 11, a photodiode (not shown) serving as a photoelectric conversion unit is formed in the pixel unit within the semiconductor substrate 10. In addition, an OCL (on-chip lens) 41 is formed in the pixel unit on the upper side of the semiconductor substrate 10. For example, an anti-reflection film (low-reflection film) 42 using an LTO (Low Temperature Oxide) film is formed on the upper surface of the OCL 41. In addition, a color filter layer 43 that transmits light of a predetermined wavelength such as R (red), G (green), or B (blue) is formed between the OCL 41 and the semiconductor substrate 10.
[0054] For example, the OCL 41 is formed of silicon nitride (SiN) or a resin material such as a styrene resin, an acrylic resin, a styrene-acrylic copolymer resin, or a siloxane resin. Furthermore, the anti-reflective film 42 can be formed using materials such as silicon nitride (SiN), hafnium oxide (HfO2), aluminum oxide (Al2O3), zirconium dioxide (ZrO2), tantalum oxide (Ta2O5), titanium oxide (TiO2), lanthanum oxide (LA2O3), praseodymium oxide (Pr2O3), cerium oxide (CeO2), neodymium oxide (Nd2O3), promethium oxide (Pm2O3), samarium oxide (Sm2O3), europium oxide (Eu2O3), gadolinium oxide (Gd2O3), terbium oxide (Tb2O3), dysprosium oxide (Dy2O3), holmium oxide (Ho2O3), thulium oxide (Tm2O3), ytterbium oxide (Yb2O3), lutetium oxide (Lu2O3), and yttrium oxide (Y2O3).
[0055] In the chip mounting area 12, a chip 61 is mounted on the semiconductor substrate 10 by a flip chip method. Specifically, an electrode portion 62 of the chip 61 and an electrode portion 63 of the semiconductor substrate 10 are electrically connected through a solder bump 64.
[0056] The gap outside the solder bump 64 between the chip 61 and the semiconductor substrate 10 is filled with an underfill resin 65. For example, the underfill resin 65 includes a UV (ultraviolet) curing resin, a thermosetting resin, etc. Further, the underfill resin 65 is injected into the gap between the chip 61 and the semiconductor substrate 10 and then cured.
[0057] The upper surface and side surface of the chip 61 and the bottom filling resin 65 around the chip 61 are covered with a light-shielding resin 66 composed of a black resin or the like having a light-shielding effect. The light-shielding resin 66 also includes a UV (ultraviolet) curing resin, a thermosetting resin, etc. Further, the light-shielding resin 66 is applied by a dispenser and then cured.
[0058] On the other hand, the color filter layer 43 and the OCL 41 formed in the pixel region 11 are arranged and formed in the bank region 13 in an extended manner. Figure 2 In the example shown in , the pixel region 11 and the dam region 13 are spaced apart from each other by a distance corresponding to four pixels. Further, the OCL 41, the anti-reflection film 42, and the color filter layer 43 are formed even in the region between the pixel region 11 and the dam region 13. The region between the pixel region 11 and the dam region 13 may be omitted or may be regarded as a part of the dam region 13.
[0059] A plurality of slits 21 are formed in the bank region 13. Figure 2 , an example in which five slits 21A to 21E are formed in the bank region 13 is shown; however, when the number of the slits 21 is equal to or greater than two, the number of the slits 21 is not particularly limited.
[0060] exist Figure 2 In the example shown, the three slits 21A to 21C near the pixel region 11 are slits that block the light-shielding resin 66 from flowing out toward the pixel region 11 and the electrode pad 22. Further, the two slits 21D and 21E near the chip mounting region 12 are slits that block the bottom filling resin 65 from flowing out toward the pixel region 11 and the electrode pad 22. Therefore, the dam region 13 includes at least a light-shielding resin dam region 71 in which the slits 21 that block the light-shielding resin 66 from flowing out toward the pixel region 11 and the electrode pad 22 are formed, and a UF (underfill) dam region 72 in which the slits 21 that block the bottom filling resin 65 from flowing out toward the pixel region 11 and the electrode pad 22 are formed.
[0061] For example, the width SL_W of the slit 21 is formed to be about 2 to 10 μm. The depth SL_D of the slit 21 depends on the height OCL_H of the OCL 41. For example, when the height OCL_H of the OCL 41 is set to be about 1.5 to 3.0 μm, the depth SL_D of the slit 21 needs to be about 1.0 μm.
[0062] Figure 2 The example shown in is an example in the case where the slit 21 is manufactured by a manufacturing method in which the slit 21 is formed after the OCL 41 and the anti-reflection film 42 are formed. Therefore, the anti-reflection film 42 is not formed on the inner peripheral surface of the slit 21. However, the anti-reflection film 42 may be formed after the OCL 41 and the slit 21 are formed. In this case, the anti-reflection film 42 may also be formed on the inner peripheral surface (side surface and bottom surface) of the slit 21.
[0063] like Figure 3As shown in , for example, the plane size of the slit region 81 as the region where the slits 21 are formed can be formed to a size corresponding to two pixels or three pixels of the pixel region 11, in other words, can be formed to a plane size that is an integer multiple of the plane size of the OCL 41. It should be pointed out that, of course, the plane size of the slit region 81 is not limited to an integer multiple of the plane size of the OCL 41, and can be formed to any size.
[0064] Furthermore, if Figure 3 As shown in , the slit region 81 needs to be formed so that the distance 82 from the outer peripheral surface (each end surface) of the slit region 81 to the slit 21 is equal to or greater than the radius R of the OCL 41 in the pixel region 11 and the formation position error ΔSL in the plane direction when the slit is formed (R+ΔSL). As a result, the angle θ formed between the vertical surface of the slit 21 and the top of the OCL material becomes an angle close to 90 degrees. Therefore, the function of the dam that blocks the bottom filling resin 65 or the light shielding resin 66 is strengthened. It should be pointed out that when the distance 82 is excessively increased, the flat area of the OCL material is expanded, and therefore, the process conditions and layout need to be optimized.
[0065] In the foregoing description, as referenced Figure 2 and Figure 3 As described, according to the first embodiment, an OCL similar to the OCL 41 in the pixel region 11 is disposed and formed in an extended manner in the bank region 13 around the chip mounting region 12, thereby eliminating a flat region. Therefore, surface reflection can be reduced and flash characteristics can be improved.
[0066] Further, the upper surface and the side surface of the chip 61 mounted by the flip chip method and the underfill resin 65 are covered with the light shielding resin 66. Therefore, the flash characteristic can be further improved.
[0067] A plurality of slits 21 for blocking the outflow of the resin are formed in the bank region 13. Therefore, the slits 21 can block the underfill resin 65 and the light shielding resin 66 from flowing toward the pixel region 11 and the electrode pad 22.
[0068] <3. Cross-sectional view of the second embodiment>
[0069] Figure 4 is a cross-sectional view according to a second embodiment of the solid-state imaging element 1 .
[0070] Figure 4 is the same as that according to the first embodiment Figure 2 Components common to those in the first embodiment are denoted by the same reference numerals, and description thereof is appropriately omitted.
[0071] In the second embodiment, the OCL 41 which is the same as the OCL 41 in the pixel region 11 is formed as a low-reflection protrusion on the bottom surface of the slits 21F and 21G formed in the slit region 81 of the bank region 13. Figure 4 In the example shown, an example in which two OCLs 41 are formed on the bottom surfaces of the slits 21F and 21G is shown. Further, the number of OCLs 41 formed on the bottom surfaces of the slits 21F and 21G is arbitrary. In addition, an anti-reflection film 42 is also formed on the upper surface of the OCL 41 formed on the bottom surfaces of the slits 21F and 21G.
[0072] Therefore, one or more OCLs identical to the OCL 41 formed in the pixel region 11 may be formed on the bottom surface of the slit 21 formed in the bank region 13 as low-reflection protrusions.
[0073] Alternatively, one or more OCLs different from the OCL 41 formed in the pixel region 11 , for example, an OCL having a size smaller than that of the OCL 41 , may be formed.
[0074] Alternatively, the low-reflective protrusion 91 may be formed to have a shape different from that of the OCL 41 formed in the pixel region 11, for example, Figure 5 The low-reflection protrusion 91 shown in FIG. 1 has a triangular pyramid or quadrangular pyramid shape. An anti-reflection film 42 is also formed on the upper surface of the low-reflection protrusion 91.
[0075] As described above, according to the second embodiment, OCLs 41 similar to those in the pixel region 11 are arranged and formed in an extended manner in the bank region 13 around the chip mounting region 12, thereby eliminating a flat region. Therefore, surface reflection can be reduced and flash characteristics can be improved.
[0076] In addition, the upper surface and the side surfaces of the chip 61 and the underfill resin 65 are covered with the light shielding resin 66, and therefore, the flash characteristics can be further improved.
[0077] A plurality of slits 21 for blocking the outflow of the resin are formed in the bank region 13. Therefore, the underfill resin 65 and the light shielding resin 66 can be blocked from flowing out toward the pixel region 11 and the electrode pad 22.
[0078] Further, an OCL or the like which is the same as the OCL 41 in the pixel region 11 is formed as a low-reflection protrusion on the bottom surface of one or more slits 21 formed in the bank region 13. Therefore, the flash characteristic can be improved.
[0079] <4. Modifications>
[0080] Modifications of the first and second embodiments will be described.
[0081] Figure 6 is a cross-sectional view showing a modified example of the first embodiment, Figure 7 It is a cross-sectional view showing a modification of the second embodiment.
[0082] exist Figure 6 and Figure 7 In the illustrated modification, the shape of the OCL in the UF bank region 72 is changed from the OCL shape of the first and second embodiments.
[0083] Specifically, according to Figure 2 In the UF bank region 72 of the first embodiment shown in FIG, two slits 21D and 21E are formed in a portion where the OCL material is formed flatly. Figure 6 In the illustrated modification, similarly to the light-shielding resin bank region 71 , the OCL 41 is formed and two slits 21D and 21E are formed in a portion forming the shape of the OCL each having a planar dimension that is an integral multiple of the planar dimension of the OCL 41 .
[0084] Further, in Figure 7 In the illustrated modification, a slit region 81 formed with slits 21K is provided in the UF bank region 72 similarly to the light shielding resin bank region 71 according to the second embodiment. Further, the OCL 41 identical to the OCL 41 in the pixel region 11 is formed as a low-reflection protrusion on the bottom surface of the slit 21K.
[0085] As described above, the shape of the OCL material in which the slits 21 are formed in the UF bank region 72 can be adapted to the shape of the OCL in the light-shielding resin bank region 71 .
[0086] <5. Manufacturing method>
[0087] Will refer to Figure 8 A method of manufacturing the solid-state image pickup element 1 is described.
[0088] On the upper surface of the light emitting surface side of the semiconductor substrate 10 where a photodiode, a plurality of transistors, etc. are formed, a color filter layer 43 is formed. Then, in step S1, an OCL 41 is formed on the color filter layer 43. The OCL 41 is provided in an extended manner from the pixel region 11 and is also formed in the bank region 13. Further, in the slit region 81 where the slit 21 is formed in the bank region 13, an OCL having a size larger than a planar size of the OCL 41 is formed.
[0089] In step S2 , an antireflection film 42 is formed on the upper surfaces of the OCL 41 in the pixel region 11 and the bank region 13 (including the OCL in the slit region 81 as well).
[0090] In step S3, the slits 21 are formed in the slit region 81 of the bank region 13. It should be noted that, as described above, the order of forming the slits 21 and the anti-reflection film 42 may be reversed.
[0091] In step S4 , the chip 61 is mounted in the chip mounting region 12 of the semiconductor substrate 10 by a flip chip method.
[0092] In step S5 , the underfill resin 65 is filled and cured between the chip 61 in the chip mounting region 12 and the semiconductor substrate 10 .
[0093] In step S6 , in a region including the upper surface and side surfaces of the chip 61 and the upper surface of the underfill resin 65 , the light shielding resin 66 is applied and then cured.
[0094] As described above, the solid-state image pickup element 1 is manufactured.
[0095] <6. Application examples of electronic devices>
[0096] The solid-state image pickup element 1 described above can be applied to various electronic devices, for example, an image pickup device such as a digital camera or a digital video camera, a mobile phone with an image pickup function, or an audio player with an image pickup function.
[0097] Fig. 9 : is a block diagram showing a configuration example of an imaging device as an electronic device to which the present technology is applied.
[0098] Fig. 9 An imaging device 101 shown in FIG. 1 includes an optical system 102, a shutter device 103, a solid-state imaging element 104, a control circuit 105, a signal processing circuit 106, a display 107, and a memory 108, and can capture still images and moving images.
[0099] The optical system 102 includes one or more lenses, guides light (incident light) from a subject to the solid-state imaging element 104 , and forms an image on a light receiving surface of the solid-state imaging element 104 .
[0100] The shutter device 103 is arranged between the optical system 102 and the solid-state imaging element 104. Further, the shutter device 103 controls the light irradiation period and the light shielding period of the solid-state imaging element 104 according to the control of the control circuit 105.
[0101] The solid-state imaging element 104 includes the solid-state imaging element 1 described above. The solid-state imaging element 104 accumulates signal charges for a certain period of time according to the light that forms an optical image on the light receiving surface through the optical system 102 and the shutter device 103. The signal charges accumulated in the solid-state imaging element 104 are transferred according to the drive signal (timing signal) provided from the control circuit 105. The solid-state imaging element 104 can be configured as a single chip. Alternatively, the solid-state imaging element 104 can be configured as a part of a camera module packaged together with the optical system 102, the signal processing circuit 106, etc.
[0102] The control circuit 105 outputs a drive signal for controlling a transfer operation of the solid-state imaging element 104 and a shutter operation of the shutter device 103 , and drives the solid-state imaging element 104 and the shutter device 103 .
[0103] The signal processing circuit 106 performs various signal processing on the pixel signal output from the solid-state imaging element 104. The image (image data) obtained by the signal processing performed by the signal processing circuit 106 is supplied to the display 107 to be displayed thereon, or supplied to the memory 108 to be stored (recorded) therein.
[0104] As described above, the solid-state imaging element 1 according to each embodiment described above is used as the solid-state imaging element 104, so that shooting with improved flash characteristics can be achieved. Therefore, in the imaging device 101 as a video camera, a digital camera, a camera module for mobile devices such as mobile phones, etc., the quality of the captured image can also be improved.
[0105] <7. Example of using image sensor>
[0106] Fig.10 This is a diagram showing a usage example of an image sensor using the above-mentioned solid-state imaging element 1.
[0107] For example, as described below, an image sensor using the above-described solid-state imaging element 1 can be used in various situations of sensing light such as visible light, infrared light, ultraviolet light, or X-rays.
[0108] A device used to capture images for viewing, such as a digital camera or a mobile device with a camera function.
[0109] Devices used for traffic, such as on-board sensors that capture images of the front, rear, surroundings, or interior of a vehicle for safe driving such as automatic stopping or for identifying the driver's status, surveillance cameras that monitor moving vehicles or roads, and ranging sensors that measure the distance between vehicles.
[0110] A device used in household appliances such as televisions, refrigerators or air conditioners to capture the user's gestures and operate the device based on the gestures.
[0111] Devices used in medical care, such as endoscopes or devices that take images of blood vessels by receiving infrared light.
[0112] Devices used for security, such as surveillance cameras for security purposes or cameras for personal identification purposes.
[0113] Devices used for cosmetic purposes, such as a dermatometer for photographing the skin or a microscope for photographing the scalp.
[0114] Devices for sports, such as action cameras or wearable cameras for sports purposes, etc.
[0115] Devices used in agriculture, such as cameras used to monitor the status of fields or crops.
[0116] <8. Application examples of in vivo information acquisition systems>
[0117] The technology according to the present disclosure (the present technology) can be applied to various products. For example, the technology according to the present disclosure can be applied to a system for acquiring in vivo information of a patient using a capsule endoscope.
[0118] Fig.11 : is a block diagram showing a schematic configuration example of a patient's in vivo information acquisition system using a capsule endoscope to which the technology according to an embodiment of the present disclosure (the present technology) can be applied.
[0119] The in-vivo information acquisition system 10001 includes a capsule endoscope 10100 and an external control device 10200 .
[0120] During the examination, the patient swallows the capsule endoscope 10100. The capsule endoscope 10100 has an imaging function and a wireless communication function, and sequentially captures images of the inside of an organ (hereinafter referred to as in-vivo images) at predetermined intervals while it moves inside an organ such as the stomach or intestine for a period of time by peristaltic motion until it is naturally discharged from the patient's body. Then, the capsule endoscope 10100 sequentially transmits information of the in-vivo images to the external control device 10200 outside the body by wireless transmission.
[0121] The external control device 10200 controls the operation of the in-vivo information acquisition system 10001 as a whole. Further, the external control device 10200 receives in-vivo image information transmitted thereto from the capsule endoscope 10100, and generates image data for displaying the in-vivo image on a display device (not shown) based on the received in-vivo image information.
[0122] In the in-vivo information acquiring system 10001, in this way, in-vivo images that image the state inside the body of the patient can be acquired at any time within the period after the capsule endoscope 10100 is swallowed until the capsule endoscope 10100 is excreted.
[0123] The configuration and functions of the capsule endoscope 10100 and the external control device 10200 are described in more detail below.
[0124] The capsule endoscope 10100 includes a capsule-shaped shell 10101, which contains a light source unit 10111, a camera unit 10112, an image processing unit 10113, a wireless communication unit 10114, a power supply unit 10115, a power supply unit 10116 and a control unit 10117.
[0125] The light source unit 10111 is composed of a light source, such as a light emitting diode (LED), and irradiates light onto the imaging field of the imaging unit 10112 .
[0126] The imaging unit 10112 is composed of an imaging element and an optical system including a plurality of lenses arranged in the previous stage of the imaging element. Reflected light (hereinafter referred to as observation light) of light irradiated on the body tissue as the observation target is converged by the optical system and introduced into the imaging element. In the imaging unit 10112, the incident observation light is photoelectrically converted by the imaging element, thereby generating an image signal corresponding to the observation light. The image signal generated by the imaging unit 10112 is provided to the image processing unit 10113.
[0127] The image processing unit 10113 is composed of a processor such as a central processing unit (CPU) or a graphics processing unit (GPU), and performs various signal processing on the image signal generated by the camera unit 10112. Therefore, the image processing unit 10113 provides the image signal on which the signal processing has been performed to the wireless communication unit 10114 as RAW data.
[0128] The wireless communication unit 10114 performs predetermined processing such as modulation processing on the image signal on which the signal processing has been performed by the image processing unit 10113, and transmits the obtained image signal to the external control device 10200 through the antenna 10114A. In addition, the wireless communication unit 10114 receives a control signal related to the drive control of the capsule endoscope 10100 from the external control device 10200 through the antenna 10114A. The wireless communication unit 10114 provides the control signal received from the external control device 10200 to the control unit 10117.
[0129] The power supply unit 10115 is composed of an antenna coil for power reception, a power regeneration circuit for regenerating power from current generated in the antenna coil, a voltage booster circuit, etc. The power supply unit 10115 generates power using the non-contact charging principle.
[0130] The power supply unit 10116 is composed of a secondary battery and stores the power generated by the power supply unit 10115. Fig.11 In order to avoid complicated illustration, arrow marks indicating the supply destination of power from the power supply unit 10116 and the like are omitted. However, the power stored in the power supply unit 10116 is supplied to the light source unit 10111, the camera unit 10112, the image processing unit 10113, the wireless communication unit 10114, and the control unit 10117, and can be used to drive the light source unit 10111, the camera unit 10112, the image processing unit 10113, the wireless communication unit 10114, and the control unit 10117.
[0131] The control unit 10117 is composed of a processor such as a CPU, and appropriately controls the driving of the light source unit 10111, the camera unit 10112, the image processing unit 10113, the wireless communication unit 10114 and the power supply unit 10115 according to the control signal transmitted thereto from the external control device 10200.
[0132] The external control device 10200 is composed of a processor (such as a CPU or a GPU) or a microcomputer or a control board in which a processor and a storage element (such as a memory) are installed in a mixed manner. The external control device 10200 transmits a control signal to the control unit 10117 of the capsule endoscope 10100 through the antenna 10200A to control the operation of the capsule endoscope 10100. In the capsule endoscope 10100, for example, the light irradiation condition of the light source unit 10111 when observing the target can be changed according to the control signal from the external control device 10200. In addition, the imaging condition (for example, the frame rate or exposure value of the imaging unit 10112, etc.) can be changed according to the control signal from the external control device 10200. In addition, the content of the processing of the image processing unit 10113 or the condition for transmitting the image signal from the wireless communication unit 10114 (for example, the transmission interval or the number of transmitted images, etc.) can be changed according to the control signal from the external control device 10200.
[0133] In addition, the external control device 10200 performs various image processing on the image signal sent thereto from the capsule endoscope 10100 to generate image data for displaying the captured in-vivo image on the display device. As image processing, various signal processing may be performed, for example, development processing (demosaic processing), image quality improvement processing (bandwidth enhancement processing, super-resolution processing, noise reduction (NR: noise reduction) processing and / or image stabilization processing (image stabilization process)) and / or magnification processing (electronic zoom processing). The external control device 10200 controls the driving of the display device so that the display device displays the captured in-vivo image based on the generated image data. Alternatively, the external control device 10200 may also control a recording device (not shown) to record the generated image data, or control a printing device (not shown) to output the generated image data by printing.
[0134] In the above, an example of an in vivo information acquisition system to which the technology according to the present disclosure can be applied has been described. The technology according to the present disclosure can be applied to the imaging unit 10112 in the above configuration. Specifically, the solid-state imaging element 1 according to each embodiment described above can be applied to the imaging unit 10112. The technology according to the present disclosure is applied to the imaging unit 10112, thereby providing an image captured with improved flash characteristics. Therefore, a clearer image of the surgical area can be obtained and the accuracy of the inspection can be improved.
[0135] <9. Application examples of endoscopic surgery systems>
[0136] The technology according to the present disclosure (the present technology) can be applied to various products. For example, the technology according to the present disclosure can be applied to an endoscopic surgery system.
[0137] Fig.12 : is a diagram showing a schematic configuration example of an endoscopic surgery system to which the technology according to an embodiment of the present disclosure (the present technology) can be applied.
[0138] exist Fig.12 , a state is shown in which an operator (doctor) 11131 is using an endoscopic surgery system 11000 to perform surgery on a patient 11132 on a bed 11133. As shown in the figure, the endoscopic surgery system 11000 includes an endoscope 11100, other surgical tools 11110 such as a pneumoperitoneum tube 11111 and an energy device 11112, a support arm device 11120 supporting the endoscope 11100 thereon, and a cart 11200 on which various devices for endoscopic surgery are mounted.
[0139] The endoscope 11100 includes a lens barrel 11101, a region of a predetermined length from the distal end of the lens barrel is inserted into the body cavity of a patient 11132, and a camera head 11102, the camera head being connected to the proximal end of the lens barrel 11101. In the example shown, the endoscope 11100 configured as a rigid endoscope having a rigid lens barrel 11101 is shown. However, the endoscope 11100 may also be configured as a flexible endoscope having a flexible lens barrel 11101.
[0140] The lens barrel 11101 has an opening at its distal end in which an objective lens is mounted. The light source device 11203 is connected to the endoscope 11100 so that the light generated by the light source device 11203 is introduced into the distal end of the lens barrel 11101 through a light guide extending into the interior of the lens barrel 11101, and irradiated onto an observation object in the body cavity of the patient 11132 through the objective lens. It should be noted that the endoscope 11100 may be a forward-looking endoscope or may be an oblique-looking endoscope or a side-looking endoscope.
[0141] The optical system and the imaging element are arranged inside the camera head 11102 so that the reflected light (observation light) from the observation object is gathered on the imaging element through the optical system. The observation light is photoelectrically converted by the imaging element to generate an electric signal corresponding to the observation light, that is, an image signal corresponding to the observation image. The image signal is transmitted to the CCU 11201 as raw (RAW) data.
[0142] The CCU 11201 includes a central processing unit (CPU), a graphics processing unit (GPU), etc., and centrally controls the operations of the endoscope 11100 and the display device 11202. Further, for example, the CCU 11201 receives an image signal from the camera head 11102, and performs various image processing such as development processing (demosaic processing) on the image signal to display an image based on the image signal.
[0143] The display device 11202 displays thereon an image based on an image signal that has been image-processed by the CCU 11201 under the control of the CCU 11201 .
[0144] For example, the light source device 11203 includes a light source such as a light emitting diode (LED) and provides the endoscope 11100 with illumination light for imaging the surgical area.
[0145] The input device 11204 is an input interface of the endoscopic surgery system 11000. The user can input various information or instructions to the endoscopic surgery system 11000 through the input device 11204. For example, the user may input instructions to change the imaging conditions (type of irradiation light, magnification, focal length, etc.) of the endoscope 11100.
[0146] The treatment tool control device 11205 controls the driving of the energy device 11112 to burn or cut tissue, seal blood vessels, etc. The pneumoperitoneum device 11206 supplies gas into the body cavity of the patient 11132 through the pneumoperitoneum tube 11111 to expand the body cavity in order to ensure the field of view of the endoscope 11100 and to ensure the working space of the operator. The recorder 11207 is a device capable of recording various information related to the operation. The printer 11208 is a device capable of printing various information related to the operation in various forms such as text, images, or graphics.
[0147] It should be noted that the light source device 11203 that provides irradiation light when imaging the surgical area to the endoscope 11100 can be composed of a white light source, for example, a white light source composed of an LED, a laser light source, or a combination thereof. In the case where the white light source is composed of a combination of red, green, and blue (RGB) laser light sources, since the output intensity and output timing of each color (each wavelength) can be controlled with high precision, the white balance of the captured image can be adjusted by the light source device 11203. Further, in this case, if the laser beams from the respective RGB laser light sources are irradiated on the observed object in a time-division manner, the drive of the imaging element of the camera head 11102 is controlled synchronously with the irradiation timing. Then, images corresponding to the R, G, and B colors, respectively, can also be captured in a time-division manner. According to this method, a color image can be obtained even if a color filter is not configured for the imaging element.
[0148] Furthermore, the drive of the light source device 11203 can be controlled so as to change the intensity of the light to be output at predetermined intervals. By controlling the drive of the imaging element of the camera head 11102 in synchronization with the timing of the change in light intensity to acquire images in a time-division manner and synthesize the images, it is possible to create an image with a high dynamic range without underexposed shadows and overexposed highlights.
[0149] Further, the light source device 11203 can be configured to provide light of a predetermined wavelength band corresponding to special light observation. For example, in special light observation, by utilizing the wavelength dependence of light absorption of body tissue, light of a narrow band compared to the irradiation light (i.e., white light) during ordinary observation is irradiated, and narrow-band observation (narrow-band imaging) is performed on predetermined tissues such as blood vessels in the surface layer of the mucosa with high contrast. Alternatively, in special light observation, fluorescence observation for obtaining an image from fluorescence generated by irradiating excitation light can be performed. In fluorescence observation, fluorescence observation (autofluorescence observation) of body tissue can be performed by irradiating excitation light on body tissue, or a fluorescent image can be obtained by locally injecting a reagent such as indocyanine green (ICG) into the body tissue and irradiating excitation light corresponding to the fluorescence wavelength of the reagent on the body tissue. The light source device 11203 can be configured to provide such narrow-band light and / or excitation light suitable for special light observation as described above.
[0150] Fig.13 It is shown Fig.12 A block diagram of a functional configuration example of the camera head 11102 and the CCU 11201 shown in FIG.
[0151] The camera head 11102 includes a lens unit 11401, an imaging unit 11402, a driving unit 11403, a communication unit 11404, and a camera head control unit 11405. The CCU 11201 includes a communication unit 11411, an image processing unit 11412, and a control unit 11413. The camera head 11102 and the CCU 11201 are connected via a transmission cable 11400 so as to communicate with each other.
[0152] The lens unit 11401 is an optical system provided at a connection position with the lens barrel 11101. Observation light entering from the distal end of the lens barrel 11101 is guided to the camera head 11102 and introduced into the lens unit 11401. The lens unit 11401 is composed of a combination of a plurality of lenses including a zoom lens and a focus lens.
[0153] The number of imaging elements included in the imaging unit 11402 can be one (single-board type) or multiple (multi-board type). For example, when the imaging unit 11402 is configured as a multi-board type, image signals corresponding to each R, G and B are generated by the imaging element, and the image signals can be synthesized to obtain a color image. The imaging unit 11402 can also be configured to have a pair of imaging elements for acquiring a right eye image signal and a left eye image signal corresponding to a three-dimensional (3D) display. If a 3D display is performed, then the operator 11131 can more accurately grasp the depth of the living tissue in the surgical area. It should be noted that when the imaging unit 11402 is configured as a stereoscopic type, a plurality of lens unit 11401 systems are set corresponding to each imaging element.
[0154] Further, the camera unit 11402 may not necessarily be disposed on the camera head 11102. For example, the camera unit 11402 may be disposed just behind the objective lens inside the lens barrel 11101.
[0155] The driving unit 11403 is composed of an actuator, and moves the zoom lens and the focus lens of the lens unit 11401 by a predetermined distance along the optical axis under the control of the camera head control unit 11405. Therefore, the magnification and focus of the image captured by the imaging unit 11402 can be appropriately adjusted.
[0156] The communication unit 11404 is constituted by a communication device for sending and receiving various information to and from the CCU 11201. The communication unit 11404 transmits the image signal acquired from the imaging unit 11402 to the CCU 11201 as RAW data via the transmission cable 11400.
[0157] In addition, the communication unit 11404 receives a control signal for controlling the driving of the camera head 11102 from the CCU 11201, and supplies the control signal to the camera head control unit 11405. For example, the control signal includes information related to imaging conditions, such as information specifying a frame rate of an image to be captured, information specifying an exposure value when capturing an image, and / or information specifying a magnification and a focus of an image to be captured.
[0158] It should be noted that the imaging conditions such as the frame rate, exposure value, magnification or focus may be specified by the user or may be automatically set based on the acquired image signal by the control unit 11413 of the CCU 11201. In the latter case, an automatic exposure (AE) function, an automatic focus (AF) function and an automatic white balance (AWB) function are provided in the endoscope 11100.
[0159] The camera head control unit 11405 controls the driving of the camera head 11102 based on a control signal received from the CCU 11201 through the communication unit 11404 .
[0160] The communication unit 11411 is constituted by a communication device for transmitting and receiving various information to and from the camera head 11102. The communication unit 11411 receives an image signal transmitted thereto from the camera head 11102 through the transmission cable 11400.
[0161] Further, the communication unit 11411 transmits a control signal for controlling the driving of the camera head 11102 to the camera head 11102. The image signal and the control signal may be transmitted through electrical communication, optical communication, or the like.
[0162] The image processing unit 11412 performs various image processing on the image signal in the form of RAW data transmitted thereto from the camera head 11102 .
[0163] The control unit 11413 performs various controls related to image capturing of the operation area, etc. through the endoscope 11100 and display of captured images obtained by image capturing of the operation area, etc. For example, the control unit 11413 creates a control signal for controlling the driving of the camera head 11102 .
[0164] Further, the control unit 11413 controls the display device 11202 to display a captured image in which the surgical area, etc., is imaged based on the image signal that has been image-processed by the image processing unit 11412. At this time, the control unit 11413 can use various image recognition technologies to recognize various objects in the captured image. For example, the control unit 11413 can recognize surgical tools such as surgical forceps, specific living areas, bleeding, fog when the energy device 11112 is used, etc. by detecting the shape, color, etc. of the edge of the object contained in the captured image. When the control unit 11413 controls the display device 11202 to display the captured image, it can use the recognition result to display various surgical support information in an overlapping manner with the image of the surgical area. In the case where the surgical support information is displayed in an overlapping manner and presented to the operator 11131, the burden of the operator 11131 can be reduced and the operator 11131 can reliably perform the operation.
[0165] The transmission cable 11400 connecting the camera head 11102 and the CCU 11201 to each other is an electric signal cable for electric signal communication, an optical fiber for optical communication, or a composite cable for electric communication and optical communication.
[0166] Here, although in the illustrated example, communication is performed by wired communication using the transmission cable 11400, communication between the camera head 11102 and the CCU 11201 may be performed by wireless communication.
[0167] In the foregoing description, an example of an endoscopic surgery system to which the technology according to the present disclosure can be applied is described. The technology according to the present disclosure can be applied to the imaging unit 11402 of the camera head 11102 in the above-described configuration. Specifically, the solid-state imaging element 1 according to each embodiment described above can be applied to the imaging unit 11402. The technology according to the present disclosure is applied to the imaging unit 11402, thereby providing an image captured with improved flash characteristics. Therefore, a clearer image of the surgical area can be obtained.
[0168] It should be noted that this document describes an endoscopic surgery system by way of example, and further, the technology according to the present disclosure can be applied to other examples, such as a microsurgery system, etc.
[0169] <10. Application examples for mobile objects>
[0170] The technology according to the present disclosure (the present technology) can be applied to various products. For example, the technology according to the present disclosure can be implemented as a device installed on any type of mobile body such as a car, an electric car, a hybrid electric car, a motorcycle, a bicycle, a personal mobile device, an airplane, a drone, a ship, a robot, etc.
[0171] Fig.14 : is a block diagram showing a schematic configuration example of a vehicle control system as an example of a moving body control system to which the technology according to the embodiment of the present disclosure can be applied.
[0172] The vehicle control system 12000 includes a plurality of electronic control units connected to each other via a communication network 12001. Fig.14 In the example shown, the vehicle control system 12000 includes a drive system control unit 12010, a body system control unit 12020, an external information detection unit 12030, an internal information detection unit 12040, and an integrated control unit 12050. In addition, a microcomputer 12051, a sound and image output unit 12052, and an in-vehicle network interface (I / F) 12053 are shown as the functional configuration of the integrated control unit 12050.
[0173] The drive system control unit 12010 controls the operation of devices related to the drive system of the vehicle according to various programs. For example, the drive system control unit 12010 serves as a control device for the following devices: a drive force generating device such as an internal combustion engine or a drive motor for generating a drive force for the vehicle; a drive force transmitting mechanism for transmitting the drive force to the wheels; a steering mechanism for adjusting the steering angle of the vehicle; and a braking device for generating a braking force for the vehicle, etc.
[0174] The body system control unit 12020 controls the operation of various devices provided to the vehicle body according to various programs. For example, the body system control unit 12020 is used as a control device for a keyless entry system, a smart key system, a power window device, or various lights such as a headlight, a taillight, a brake light, a turn signal light, or a fog light. In this case, radio waves transmitted from a portable device as a substitute for a key or signals of various switches can be input to the body system control unit 12020. The body system control unit 12020 receives these input radio waves or signals, and controls the door lock device, the power window device, and lights of the vehicle.
[0175] The vehicle exterior information detection unit 12030 detects information about the exterior of the vehicle having the vehicle control system 12000. For example, the vehicle exterior information detection unit 12030 is connected to the camera unit 12031. The vehicle exterior information detection unit 12030 causes the camera unit 12031 to image the exterior of the vehicle and receives the imaged image. Based on the received image, the vehicle exterior information detection unit 12030 can perform detection processing on objects such as people, vehicles, obstacles, signs, or symbols on the road surface, or detection processing of the distance to these objects.
[0176] The imaging unit 12031 is an optical sensor for receiving light and outputting an electrical signal corresponding to the amount of light received. The imaging unit 12031 may output the electrical signal as an image, or may output the electrical signal as information about the measured distance. In addition, the light received by the imaging unit 12031 may be visible light, or may be invisible light such as infrared rays.
[0177] The in-vehicle information detection unit 12040 detects information about the interior of the vehicle. For example, the in-vehicle information detection unit 12040 is connected to a driver state detection unit 12041 that detects the driver's state. The driver state detection unit 12041 includes, for example, a camera that images the driver. Based on the detection information input from the driver state detection unit 12041, the in-vehicle information detection unit 12040 can calculate the driver's fatigue level or the driver's concentration level, or can determine whether the driver is dozing off.
[0178] The microcomputer 12051 can calculate the control target value of the driving force generating device, the steering mechanism or the braking device based on the information about the inside or outside of the vehicle (the information is obtained by the outside information detection unit 12030 or the inside information detection unit 12040), and output the control command to the driving system control unit 12010. For example, the microcomputer 12051 can perform the coordinated control aimed at realizing the functions of the advanced driver assistance system (ADAS), which includes: collision avoidance or collision mitigation of the vehicle, following driving based on the vehicle-to-vehicle distance, vehicle speed maintenance driving, vehicle collision warning or vehicle lane departure warning, etc.
[0179] In addition, the microcomputer 12051 can perform collaborative control intended for autonomous driving, which enables the vehicle to drive autonomously by controlling a driving force generating device, a steering mechanism, or a braking device, etc. based on information about the interior or exterior of the vehicle (the information is obtained by the exterior information detection unit 12030 or the interior information detection unit 12040), without relying on the driver's operation.
[0180] In addition, the microcomputer 12051 can output a control command to the body system control unit 12020 based on information about the exterior of the vehicle, which is obtained by the exterior information detection unit 12030. For example, the microcomputer 12051 can perform cooperative control aimed at preventing glare by controlling the headlights to change from high beam to low beam according to the position of the preceding vehicle or the oncoming vehicle detected by the exterior information detection unit 12030.
[0181] The audio and video output unit 12052 transmits an output signal of at least one of audio and video to an output device that can visually or auditorily notify the vehicle's passengers or the outside of the vehicle of the information. Fig.14 In the example of FIG. 1 , an audio speaker 12061, a display portion 12062, and an instrument panel 12063 are shown as output devices. For example, the display portion 12062 may include at least one of an in-vehicle display and a head-up display.
[0182] Fig.15 12031 is a diagram showing an example of the installation position of the camera unit 12031.
[0183] exist Fig.15 In the figure, the camera unit 12031 includes camera units 12101, 12102, 12103, 12104 and 12105.
[0184] The camera units 12101, 12102, 12103, 12104 and 12105 are, for example, arranged at positions on the front nose, side mirrors, rear bumper and rear door of the vehicle 12100 and at positions on the upper part of the windshield inside the vehicle. The camera unit 12101 arranged on the front nose and the camera unit 12105 arranged on the upper part of the windshield inside the vehicle mainly obtain images in front of the vehicle 12100. The camera units 12102 and 12103 arranged on the side mirrors mainly obtain images on the sides of the vehicle 12100. The camera unit 12104 arranged on the rear bumper or rear door mainly obtains images at the rear of the vehicle 12100. The camera unit 12105 arranged on the upper part of the windshield inside the vehicle is mainly used to detect vehicles in front, pedestrians, obstacles, signals, traffic signs or lanes, etc.
[0185] By the way, Fig.15 An example of the photographing range of the camera units 12101 to 12104 is shown. The photographing range 12111 indicates the photographing range of the camera unit 12101 provided to the front nose. The photographing ranges 12112 and 12113 respectively indicate the photographing ranges of the camera units 12102 and 12103 provided to the side mirrors. The photographing range 12114 indicates the photographing range of the camera unit 12104 provided to the rear bumper or the rear door. For example, by superimposing the image data photographed by the camera units 12101 to 12104, an overhead image of the vehicle 12100 viewed from above is obtained.
[0186] At least one of the imaging units 12101 to 12104 may have a function of obtaining distance information. For example, at least one of the imaging units 12101 to 12104 may be a stereo camera composed of a plurality of imaging elements, or may be an imaging element having pixels for phase difference detection.
[0187] For example, the microcomputer 12051 can determine the distance to each three-dimensional object within the imaging ranges 12111 to 12114 and the time change of the distance (relative speed with respect to the vehicle 12100) based on the distance information obtained from the imaging units 12101 to 12104, thereby extracting the nearest three-dimensional object as the leading vehicle, in particular, the three-dimensional object exists on the driving path of the vehicle 12100 and travels in substantially the same direction as the vehicle 12100 at a predetermined speed (e.g., equal to or greater than 0 km / h). In addition, the microcomputer 12051 can pre-set the inter-vehicle distance to be maintained in front of the leading vehicle, and perform automatic braking control (including follow-up stop control) or automatic acceleration control (including follow-up start control), etc. Therefore, cooperative control intended for automatic driving can be performed, which allows the vehicle to travel autonomously without relying on the driver's operation, etc.
[0188] For example, the microcomputer 12051 can classify the three-dimensional object data about the three-dimensional object into three-dimensional object data of two-wheeled vehicles, standard-sized vehicles, large vehicles, pedestrians, utility poles, and other three-dimensional objects based on the distance information obtained from the camera units 12101 to 12104, extract the classified three-dimensional object data, and use the extracted three-dimensional object data to automatically avoid obstacles. For example, the microcomputer 12051 identifies obstacles around the vehicle 12100 as obstacles that can be visually identified by the driver of the vehicle 12100 and obstacles that are difficult for the driver of the vehicle 12100 to visually identify. Then, the microcomputer 12051 determines the collision risk representing the risk of collision with each obstacle. When the collision risk is equal to or higher than the set value and therefore there is a possibility of collision, the microcomputer 12051 outputs a warning to the driver via the audio speaker 12061 or the display unit 12062, and performs forced deceleration or evasive steering through the drive system control unit 12010. The microcomputer 12051 can thereby assist driving to avoid collision.
[0189] At least one of the camera units 12101 to 12104 may be an infrared camera that detects infrared rays. For example, the microcomputer 12051 may identify a pedestrian by determining whether there is a pedestrian in the captured images of the camera units 12101 to 12104. For example, such identification of pedestrians is performed by a program that extracts feature points in the captured images of the camera units 12101 to 12104 that are infrared cameras and a program that determines whether it is a pedestrian by performing pattern matching processing on a series of feature points that represent the outline of an object. When the microcomputer 12051 determines that there is a pedestrian in the captured images of the camera units 12101 to 12104 and thus identifies the pedestrian, the sound image output unit 12052 controls the display unit 12062 so that a square contour line for emphasis is displayed in a manner superimposed on the identified pedestrian. The sound image output unit 12052 may also control the display unit 12062 so that an icon or the like representing a pedestrian is displayed at a desired position.
[0190] In the foregoing description, an example of a vehicle control system to which the technology according to the present disclosure can be applied is described. The technology according to the present disclosure can be applied to the camera section 12031 in the above-mentioned configuration. Specifically, the solid-state imaging element 1 according to each embodiment described above can be applied to the camera section 12031. The technology according to the present disclosure is applied to the camera section 12031, so that the flash characteristics can be improved and a captured image that allows the driver to easily view can be obtained. In addition, by using the obtained captured image, the driver's fatigue can be relieved, and the safety of the driver and the vehicle can be improved.
[0191] Furthermore, the present technology is not limited to being applied to a solid-state imaging element for detecting the distribution of incident amounts of visible light and capturing the detected distribution as an image. Further, the present technology can be applied to a solid-state imaging element for capturing an image representing the distribution of incident amounts of infrared rays, X-rays, or particles, etc., and a general-purpose solid-state imaging element (physical quantity distribution detection device) in a broad sense such as a fingerprint detection sensor for detecting the distribution of other physical quantities such as pressure and static capacitance to capture their images.
[0192] In addition, the present technology is not limited to the solid-state imaging element, but can be applied to a general semiconductor device having other semiconductor integrated circuits. The semiconductor device in this case includes an OCL region (corresponding to the pixel region 11 of the solid-state imaging element 1) in which the OCL 41 is formed in a matrix, a chip mounting region 12 in which the chip 61 is mounted by flip-chip method, and a dam region 13 provided around the chip mounting region 12, and in the dam region 13, an OCL identical to the OCL in the OCL region is formed.
[0193] The embodiments of the present technology are not limited to the embodiments described above, and various changes can be made within the scope not departing from the spirit of the present technology.
[0194] For example, any combination of all or part of the above-described embodiments may be adopted.
[0195] It should be noted that the effects disclosed in this specification are merely exemplary and non-limiting, and thus there may be effects other than those disclosed in this specification.
[0196] It should be noted that the present technology can have the following configurations.
[0197] (1) A solid-state imaging element comprising:
[0198] a pixel region in which a plurality of pixels are two-dimensionally arranged in a matrix;
[0199] a chip mounting region in which a chip is mounted by a flip-chip method; and
[0200] a dam region which is arranged around the chip mounting region and in which one or more slits are formed to block outflow of the resin, wherein
[0201] In the bank region, an OCL identical to the OCL in the pixel region is formed.
[0202] (2) The solid-state imaging device according to (1) above, further comprising:
[0203] A low reflective protrusion on the bottom surface of the slot.
[0204] (3) The solid-state imaging device according to (2) above, wherein
[0205] The low-reflective protrusion has the same OCL shape as the OCL in the pixel area.
[0206] (4) The solid-state imaging device according to (2) above, wherein
[0207] The low-reflective protrusion has an OCL shape that is smaller than the OCL in the pixel area.
[0208] (5) The solid-state imaging device according to (2) above, wherein
[0209] The low-reflective protrusion has an OCL shape different from the OCL in the pixel area.
[0210] (6) The solid-state imaging element according to any one of (1) to (5) above, wherein
[0211] A planar size of the OCL in which the slits are formed has a size that is an integral multiple of a planar size of the OCL in the pixel region.
[0212] (7) The solid-state imaging element according to any one of (1) to (6) above, wherein
[0213] The slits include slits that block outflow of a light shielding resin covering the upper surface and the side surfaces of the chip.
[0214] (8) The solid-state imaging device according to any one of (1) to (6) above, wherein
[0215] The slit includes a slit that blocks outflow of an underfill resin filled in a range in which the chip is mounted by a flip-chip method.
[0216] (9) The solid-state imaging device according to any one of (1) to (8) above, wherein
[0217] An anti-reflection film is formed on an upper surface of the OCL in the bank region.
[0218] (10) An electronic device comprising:
[0219] A solid-state imaging element comprising
[0220] A pixel area in which a plurality of pixels are arranged two-dimensionally in a matrix,
[0221] a chip mounting area in which a chip is mounted by a flip-chip method, and
[0222] a dam region which is arranged around the chip mounting region and in which one or more slits are formed to block outflow of the resin, wherein
[0223] In the bank region, an OCL identical to the OCL in the pixel region is formed.
[0224] (11) A semiconductor device comprising:
[0225] OCL region, where OCLs form a matrix;
[0226] a chip mounting region in which a chip is mounted by a flip-chip method; and
[0227] a dam region which is arranged around the chip mounting region and in which one or more slits are formed to block outflow of the resin, wherein
[0228] In the bank region, an OCL identical to that in the OCL region is formed.
[0229] Reference numerals list
[0230] 1 Solid-state imaging element
[0231] 10 Semiconductor substrate
[0232] 11 Pixel Area
[0233] 12 Chip mounting area
[0234] 13. Dam area
[0235] 21 (21A to 21G) Slit
[0236] 22 Electrode pad
[0237] 41 OLC
[0238] 42 Anti-reflective film
[0239] 43 Color filter layer
[0240] 61 Chip
[0241] 64 Solder Bumps
[0242] 65 Underfill resin
[0243] 66 Light-shielding resin
[0244] 91 Low reflective protrusions
[0245] 101 Camera Device
[0246] 104 Solid-state imaging element
Claims
1. A solid-state imaging element, comprising: a pixel region in which a plurality of pixels are two-dimensionally arranged in a matrix; a chip mounting area, in which a chip is mounted by a flip-chip method; and a dam region which is arranged around the chip mounting region and in which a plurality of slits are formed, wherein The plurality of slits include a first slit and a second slit, The distance between the first slit and the pixel area is smaller than the distance between the second slit and the pixel area. The first slit is configured to block the light shielding resin covering the upper surface and the side surface of the chip from flowing out, and The second slit is configured to block outflow of an underfill resin filled in a range in which the chip is mounted by a flip-chip method.
2. The solid-state imaging element according to claim 1, wherein In the bank region, a second OCL identical to the first OCL in the pixel region is formed.
3. The solid-state imaging element according to claim 2, wherein A plurality of the second OCLs are disposed in a manner extending from the pixel region and formed in the bank region.
4. The solid-state imaging element according to claim 1, further comprising: A low reflective protrusion on a bottom surface of at least one of the plurality of slots.
5. The solid-state imaging element according to claim 4, wherein The low-reflective protrusion has the same OCL shape as the first OCL in the pixel area.
6. The solid-state imaging element according to claim 4, wherein The low-reflective protrusion has an OCL shape that is smaller than a first OCL in the pixel area.
7. The solid-state imaging element according to claim 4, wherein The low-reflective protrusion has an OCL shape different from that of the first OCL in the pixel area.
8. The solid-state imaging element according to any one of claims 1 to 7, wherein The slit is formed in the second OCL in the bank region, and A plane size of the second OCL formed with the slit has a size that is an integral multiple of a plane size of the first OCL in the pixel region.
9. The solid-state imaging element according to any one of claims 1 to 7, wherein An anti-reflection film is formed on an upper surface of the second OCL formed in the bank region.
10. An electronic device comprising: A solid-state imaging device according to any one of claims 1 to 9.
11. A semiconductor device comprising: OCL region, where OCLs form a matrix; a chip mounting area, in which a chip is mounted by a flip-chip method; and a dam region which is arranged around the chip mounting region and in which a plurality of slits are formed, wherein The plurality of slits include a first slit and a second slit, The distance between the first slit and the OCL area is smaller than the distance between the second slit and the OCL area. The first slit is configured to block the light shielding resin covering the upper surface and the side surface of the chip from flowing out, and The second slit is configured to block outflow of an underfill resin filled in a range in which the chip is mounted by a flip-chip method.
