Information processing device
Patent Information
- Application Number
- JP2023129852
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-08-09
- Publication Date
- 2025-03-07
- Estimated Expiration
- 2043-08-09
AI Technical Summary
【0009】 本開示によれば、対面利用と会議室利用の二つの用途を両立することができるという効果を奏する。
Smart Images

Figure 0007642025000002 
Figure 0007642025000003 
Figure 0007642025000004
Abstract
Description
[Technical field]
[0001] The present disclosure relates to an imaging device and an information processing device. [Background technology]
[0002] 2. Description of the Related Art In recent years, in personal computers (PCs) such as laptop personal computers, communication such as remote conferences over the Web is carried out via an imaging device such as a camera provided in the bezel of the case (see, for example, Patent Document 1). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Patent No. 7275239 Summary of the Invention [Problem to be solved by the invention]
[0004] Meanwhile, remote conferences via the web are intended for face-to-face use with one person participating. In recent years, hybrid work, which combines working in the office with remote work, has become widespread. For this reason, when users hold remote conferences while in the office, they are not only using face-to-face meetings, but also using multiple people with only one PC by entering the field of view of the same imaging device.
[0005] However, the above-mentioned Patent Document 1 does not anticipate situations of face-to-face use and multiple use, and there has been a demand for technology that can achieve both of these two uses.
[0006] The present disclosure has been made in consideration of the above, and aims to provide an imaging device and an information processing device that can be used for both face-to-face use and multiple use. [Means for solving the problem]
[0007] In order to solve the above-mentioned problems and achieve the object, an imaging device according to a first aspect of the present disclosure includes an imaging lens composed of a plurality of lenses arranged in order from the object side to the image side, a solid-state imaging element that receives an image formed by the imaging lens and generates an imaging signal, a first optical member that forms a circle formed at a predetermined length from the center of an object surface of the lens arranged closest to the object side of the plurality of lenses and transmits light of a predetermined wavelength band, and a second optical member that forms an annular shape formed from the first optical member toward the outer edge of the object surface and has a transmittance of a blue wavelength band higher than the transmittance of other wavelength bands.
[0008] Also, an information processing device according to a third aspect of the present disclosure includes the above-mentioned imaging device, an image processing unit that performs image processing on the imaging signal to generate a display image, and a control unit that controls the image processing by the image processing unit. Effect of the Invention
[0009] According to the present disclosure, it is possible to achieve the effect of enabling both face-to-face use and conference room use to be compatible. [Brief description of the drawings]
[0010] [Figure 1] FIG. 1 is a diagram showing a schematic configuration of an information processing device according to an embodiment. [Diagram 2] FIG. 2 is a block diagram illustrating a functional configuration of an information processing device according to an embodiment. [Diagram 3] FIG. 3 is a diagram showing a lens configuration of an imaging lens included in an imaging device according to an embodiment. [Figure 4] FIG. 4 is a cross-sectional view of a light ray having a predetermined angle passing through an imaging lens according to one embodiment. [Diagram 5] FIG. 5 is a perspective view showing a schematic configuration of a part of an imaging lens included in an imaging device according to an embodiment. [Figure 6] FIG. 6 is a longitudinal aberration diagram of an imaging lens provided in an imaging device according to an embodiment. [Figure 7] FIG. 7 is a diagram showing a schematic diagram of an incident route of a light ray from a subject when an imaging lens included in an imaging device according to one embodiment is used. [Figure 8] FIG. 8 is a schematic diagram for explaining a region of a second lens coating in an imaging lens included in an imaging device according to one embodiment. [Figure 9] FIG. 9 is a diagram showing the transmission characteristics of a second lens coating in an imaging lens included in an imaging device according to one embodiment. [Figure 10] FIG. 10 is a flowchart showing an outline of the process executed by the information processing device according to the embodiment. [Figure 11] FIG. 11 is a diagram illustrating a situation in which an information processing device according to an embodiment is used face-to-face. [Figure 12] FIG. 12 is a diagram illustrating an example of a captured image generated by a solid-state imaging element included in an information processing device according to an embodiment. [Figure 13] FIG. 13 is a diagram illustrating an example of a display image generated by an image processing unit included in the information processing device according to an embodiment. [Figure 14] FIG. 14 is a diagram illustrating a schematic diagram of a situation in which multiple information processing devices according to an embodiment are used. [Figure 15] FIG. 15 is a diagram showing an example of a captured image generated by the solid-state imaging element according to one embodiment. [Figure 16] FIG. 16 is a diagram illustrating an example of a display image generated by an image processing unit according to an embodiment. [Figure 17] FIG. 17 is a diagram showing the transmission characteristics of a second lens coating in an imaging lens included in an imaging device according to a first modification of the embodiment. [Figure 18] FIG. 18 is a diagram showing the transmission characteristics of a second lens coating in an imaging lens included in an imaging device according to a first modification of the embodiment. [Figure 19] FIG. 19 is a diagram showing a schematic configuration of an imaging lens according to a third modification of the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0011] Hereinafter, an imaging device and an information processing device according to the present disclosure will be described with reference to the drawings. Note that the present disclosure is not limited to the following embodiments. Also, each figure referred to in the following description merely shows the shape, size, and positional relationship in a schematic manner to the extent that the contents of the present disclosure can be understood. That is, the present disclosure is not limited to only the shape, size, and positional relationship exemplified in each figure. Also, the same parts are given the same reference numerals, and detailed description is omitted.
[0012] (Embodiment) [Configuration of information processing device] Fig. 1 is a diagram showing a schematic configuration of an information processing device according to an embodiment of the present invention, and Fig. 2 is a block diagram showing a functional configuration of the information processing device according to an embodiment of the present invention.
[0013] The information processing device 1 shown in Figures 1 and 2 is assumed to be a laptop computer or a tablet terminal. The information processing device 1 shown in Figures 1 and 2 includes at least an imaging device 10, a signal processing unit 11, an image processing unit 12, a display unit 13, an audio input / output unit 14, a storage unit 15, a communication unit 16, an input unit 17, a detection unit 18, and a control unit 19. The information processing device 1 also includes a base unit 2 provided with the input unit 17, and a cover unit 3 that is rotatable with respect to the base unit 2 and has the display unit 13.
[0014] The imaging device 10 generates an imaging signal by capturing an image of a predetermined field of view under the control of the control unit 19, and outputs the imaging signal to the signal processing unit 11. The imaging device 10 is disposed in the bezel part 31 on the front side of the cover part 3. Specifically, the imaging device 10 is disposed in a position where it can capture an image of the user when the information processing device 1 is in use, and where it faces the user. Of course, the position of the imaging device 10 can be appropriately changed depending on the shape, size, and usage mode of the information processing device 1.
[0015] As shown in FIG. 2, the imaging device 10 includes a cover 101, an imaging lens 102, a solid-state imaging element 103, a first lens coating 104 functioning as a first optical element, and a second lens coating 105 functioning as a second optical element.
[0016] The cover 101 is configured using a cover glass or the like that is a member for preventing dirt and dust from being applied to the imaging lens 102. Note that the information processing device 1 may further provide the cover 101 with a lid or the like that opens and closes in response to a user's operation.
[0017] The imaging lens 102 is configured using a plurality of lenses, and collects light from a predetermined viewing area to form an image on the imaging surface of the solid-state imaging element 103. The detailed configuration of the imaging lens 102 will be described later.
[0018] The solid-state imaging element 103 receives an image of an object to be imaged formed by the imaging lens 102, and generates an imaging signal by performing photoelectric conversion. The solid-state imaging element 103 is configured using a CCD sensor, a CMOS sensor, or the like. The solid-state imaging element 103 is preferably configured with effective pixels of 8 million pixels or more, so-called 4K or more (3840×2160 or more), arranged in a two-dimensional matrix. Of course, the solid-state imaging element 103 may be configured with effective pixels of 2 million pixels, so-called 2K or more (1920×1080), arranged in a two-dimensional matrix.
[0019] The first lens coating 104 forms a circle formed at a predetermined length from the center of the object surface of the lens disposed closest to the object side of the imaging lens 102, and transmits light of a predetermined wavelength band. The first lens coating 104 is disposed by applying a clear coating with high transmittance, for example 93%, to the imaging lens 102 to form a layer (film).
[0020] The second lens coating 105 has an annular shape extending from the first lens coating 104 toward the outer edge of the object surface of the lens disposed closest to the object side of the imaging lens 102, and has a characteristic that the transmittance of the blue wavelength band is higher than the transmittance of other wavelength bands. The second lens coating 105 is disposed by applying a blue light coating having a high transmittance of the blue wavelength band to the imaging lens 102 to form a layer (film). Details of the second lens coating 105 will be described later.
[0021] Under the control of the control unit 19, the signal processing unit 11 performs A / D conversion processing and the like on the imaging signal input from the solid-state imaging element 103 to convert it into a digital imaging signal and outputs it to the image processing unit 12. The signal processing unit 11 is configured using, for example, a DSP (Digital Signal Processor) or the like.
[0022] Under the control of the control unit 19, the image processing unit 12 performs predetermined image processing on the digital imaging signal input from the signal processing unit 11 and outputs the result to the display unit 13 or the storage unit 15. The image processing unit 12 is configured using, for example, a GPU (Graphics Processing Unit) or the like. Here, the predetermined image processing includes electrical shading correction processing, white balance adjustment processing, image center trimming processing, noise reduction processing, and the like.
[0023] Under the control of the control unit 19, the display unit 13 displays a moving image being captured that has been image-processed by the image processing unit 12, a captured captured image, a display image corresponding to an imaging signal stored in the storage unit 15, and various information related to the information processing device 1. The display unit 13 is disposed on the cover unit 3. The display unit 13 is configured using a liquid crystal display, an organic electroluminescent display (OLED), or the like.
[0024] Under the control of the control unit 19, the audio input / output unit 14 receives an input of an external sound, converts it into an audio signal, and outputs it to the storage unit 15 or the communication unit 16. Also, under the control of the control unit 19, the audio input / output unit 14 converts an audio signal input from the storage unit 15 or the communication unit 16 and outputs it to the outside. The audio input / output unit 14 is configured using a microphone, a speaker, and the like.
[0025] The storage unit 15 stores various information related to the information processing device 1, programs executed by the information processing device 1, and imaging signals (RAW data and JPEG data) captured by the imaging device 10. The storage unit 15 is configured using a flash memory, an SSD (Solid State Drive), an HDD (Hard Disk Drive), a memory card, etc.
[0026] The communication unit 16 transmits an imaging signal captured by the imaging device 10 to the outside via a network in accordance with a predetermined communication standard under the control of the control unit 19, and receives various information input from the outside. The communication unit 16 uses a communication standard that complies with communication standards such as 3GPP (registered trademark), 4G established by IEEE, LTE, 5G, 6G, WiMAX, and Wi-Fi (registered trademark), etc.
[0027] The input unit 17 receives an operation input from a user, and outputs operation information corresponding to the received operation to the control unit 19. The input unit 17 is disposed on the base unit 2. The input unit 17 is configured using, for example, a touch panel, a keyboard, a mouse, etc.
[0028] The detection unit 18 detects the direction of the optical axis of the imaging lens 102, and outputs the detection result to the control unit 19. Specifically, the detection unit 18 detects whether the optical axis of the imaging lens 102 faces in a substantially horizontal direction perpendicular to the direction of gravity, and outputs the detection result to the control unit 19. Of course, the detection unit 18 detects whether the optical axis of the imaging lens 102 faces in a substantially direction of gravity, for example, in the vertical direction, and outputs the detection result to the control unit 19. The detection unit 18 detects the acceleration and angular velocity in the direction of gravity perpendicular to the optical axis of the imaging lens 102, and outputs the detection result to the control unit 19. The detection unit 18 is configured using an acceleration sensor and a three-axis angular velocity sensor.
[0029] The control unit 19 controls each unit constituting the information processing device 1. The control unit 19 includes a processor and a memory. The processor is configured using a CPU, a Field-Programmable Gate Array (FPGA), etc. The memory is configured using a Random Access Memory (RAM), a Read Only Memory (ROM), etc.
[0030] [Configuration of Imaging Lens] Next, the detailed configuration of the imaging lens 102 will be described. FIG. 3 is a diagram showing the lens configuration of the imaging lens 102. FIG. 4 is a cross-sectional view of a light beam having a predetermined angle passing through the imaging lens 102. FIG. 5 is a perspective view showing a schematic configuration of a part of the imaging lens 102. In FIG. 4, the light beam is described as being at angles of -90°, -45°, 0°, 45°, and 90°. In addition, in FIG. 3 to FIG. 5, an optical system in which the diagonal angle of view is set to approximately 180° is described, but the present invention is not limited to this, and the present invention can also be applied to angles of view expected in web conferences using PCs, for example, in the range of a horizontal angle of view of 80° to 120° and a diagonal angle of view of 55° to 120°.
[0031] 3 to 5 includes, from the object side, a first group G1 having negative power, a reflecting section L4, a stop S (STOP), and a second group G2 having positive power. Note that a cover glass CG represents a transparent parallel plate equivalent to a cover glass of the solid-state imaging element 103 and at least one of various filters.
[0032] The first group G1 is composed of three consecutive single lenses L1 to L3 each having negative power. The reflecting section L4 is composed of a prism or the like having a function of bending a light beam by 90 degrees on a reflecting surface. The second group G2 is composed of positive lenses L5, L6, L8, and L10, and negative lenses L7 and L9.
[0033] Next, the RDN of the imaging lens 102 will be described. The symbols in Table 1 have the following meanings: R: Lens curvature radius D: Surface spacing Nd: Refractive index of the d line Vd: Abbe number of d line f lens: focal length of each lens, f group: focal length of group In the surface numbers, * indicates an aspheric surface, R indicates a reflecting surface, S indicates a stop, and (i) indicates an image surface. Also, the D of the surface numbers 9 and above is negative, but it is displayed as negative due to the reflecting surfaces and beyond.
[0034] [Table 1]
[0035] 6 is a longitudinal aberration diagram of the imaging lens 102. In the spherical aberration diagram, the amount of spherical aberration is shown for each of the B line (blue: wavelength 435 nm), G line (green: wavelength 546 nm), and R line (red: 656 nm). In the astigmatism diagram, the solid line S indicates the amount of astigmatism on the sagittal image plane, and the dashed line T indicates the amount of astigmatism on the tangential image plane. Furthermore, in the distortion diagram, the amount of distortion only for the d line is shown. Also, Angle (deg) indicates the imaging half angle of view (°).
[0036] Next, the details of the single lens L1 will be described. As shown in Figures 3 to 5, the single lens L1 is formed by coating the surface on the object side, and has a first lens coating 104 and a second lens coating 105 with different transmittances.
[0037] The first lens coating 104 is substantially circular and is formed by coating from the center (optical axis O1) of the single lens L1 to a predetermined area. The first lens coating 104 is formed by coating a clear coat or the like that blocks light in the ultraviolet wavelength band to form a layer on the object surface of the single lens L1. That is, the first lens coating 104 has a transmission characteristic of about 95% transmittance for light in the wavelength band of 420 nm to 750. Of course, the first lens coating 104 may be a double-sided coating or a single-sided coating. In the case of a double-sided coating, it is sufficient that the transmittance for light in the wavelength band of 420 nm to 750 is 95% or more, and preferably the transmittance for light in the wavelength band of 420 nm to 750 is about 98%. Of course, the transmittance of the first lens coating 104 for light in the wavelength band can be appropriately changed.
[0038] The second lens coating 105 has a substantially circular ring shape and is formed by coating from the outer edge of the first lens coating 104 to the outer edge of the single lens L1. The second lens coating 105 is formed by coating a blue coat or the like that blocks light of a predetermined wavelength band, forming a layer on the object surface of the single lens L1. The first lens coating 104 and the second lens coating 105 may be formed integrally, or the order of coating may be reversed.
[0039] [Second lens coating application area] Here, the application area of the second lens coating 105 will be described. Fig. 7 is a diagram showing a typical incident route of light rays (light flux) from a subject when using an imaging lens 102. Fig. 8 is a schematic diagram for explaining the application area of the second lens coating 105.
[0040] As shown in Fig. 7, the imaging lens 102 is assumed to be a so-called diagonal fisheye lens. As shown in Fig. 7, the imaging lens 102 is an ultra-wide-angle lens that can capture an image over a wide range of approximately 180°. For this reason, the imaging lens 102 uses an equidistant projection format.
[0041] Here, as shown in FIG. 8, if the angle of view of imaging lens 102 is A, if the radius of the image circle from the center position of the image circle on the light receiving surface of solid-state imaging element 103 is R (dots), the angular position at which the application areas of first lens coating 104 and second lens coating 105 are changed is B, and the coating change position (boundary position) on the image circle of solid-state imaging element 103 is R', then the following equation (1) holds. R' = R * (B / A) (1)
[0042] For example, when the imaging lens 102 is configured as a 180° equidistant projection fisheye lens, and the change position R′ is 90°, the following formula (2) is satisfied. R' = R * (90 / 180) (2) Similarly, when the imaging lens 102 is configured as a 120° equidistant projection fisheye lens, if the change position R′ is 90°, the following formula (3) is satisfied. R' = R * (90 / 120) (3) Furthermore, if the imaging lens 102 is configured as a 120° equidistant projection fisheye lens, and the change position R′ is 60°, the following formula (4) is satisfied. R' = R * (60 / 120) (4)
[0043] In this way, the application areas of the first lens coating 104 and the second lens coating 105 can be set according to the angle of view of the imaging lens 102 .
[0044] Transmission Characteristics of Second Lens Coating 105 Next, the transmission characteristics of the second lens coating 105 will be described. Fig. 9 is a diagram showing the transmission characteristics of the second lens coating 105. In Fig. 9, the horizontal axis represents wavelength (nm) and the vertical axis represents transmittance (%). In Fig. 9, a curve W1 represents the transmission characteristics of the second lens coating 105.
[0045] As shown by curve W1 in FIG. 9, the second lens coating 105 has transmission characteristics in which the transmittance of blue (430 nm to 490 nm) is the highest, and the transmittance of green (490 nm to 550 nm) and red (640 nm to 770 nm) are both low.
[0046] This allows the second lens coating 105 to transmit light in the green and red wavelength bands while suppressing light reflection. As a result, the image processor 12 can generate an image of appropriate color by adjusting the gain for the green and red imaging signals that include the annular image corresponding to the region of the second lens coating 105, which is an image corresponding to the imaging signal, and adjusting the gain based on the blue imaging signal.
[0047] [Processing of information processing device] Next, a description will be given of the processing executed by the information processing device 1. Fig. 10 is a flowchart showing an outline of the processing executed by the information processing device 1.
[0048] 10, the control unit 19 determines whether the imaging device 10 has started up (step S101), and if it is determined that the imaging device 10 has started up (step S101: Yes), it acquires the optical axis direction of the imaging device 10 detected by the detection unit 18 (step S102). In this case, the imaging device 10 starts imaging upon startup. After step S102, the information processing device 1 proceeds to step S103. On the other hand, if the control unit 19 determines that the imaging device 10 has not started up (step S101: No), the information processing device 1 ends this process.
[0049] In step S103, the control unit 19 determines whether or not the imaging device 10 is in a first mode (hereinafter simply referred to as "first mode") in which the imaging device 10 captures an image with the optical axis O1 of the imaging device 10 directed substantially horizontally with respect to the direction of gravity, based on the orientation of the optical axis O1 of the imaging device 10 acquired from the detection unit 18. Specifically, as shown in Fig. 11, the control unit 19 determines whether or not the imaging device 10 is in the first mode, i.e., the face-to-face use mode, based on the orientation of the optical axis O1 of the imaging device 10 acquired from the detection unit 18. If the control unit 19 determines that the imaging device 10 is in the first mode (step S103: Yes), the information processing device 1 proceeds to step S104.
[0050] Next, the control unit 19 causes the image processing unit 12 to execute image processing corresponding to the first mode (step S104). Specifically, the control unit 19 causes the image processing unit 12 to generate a display image based on an imaging signal of a circular image formed on the light receiving surface of the solid-state imaging element 103 corresponding to the region transmitting the first lens coating 104. After step S104, the information processing device 1 proceeds to step S105, which will be described later.
[0051] Fig. 12 is a diagram showing an example of a captured image generated by the solid-state image sensor 103. Fig. 13 is a diagram showing an example of a display image generated by the image processing unit 12.
[0052] 12 and 13, the control unit 19 causes the image processing unit 12 to generate a display image P2 based on an imaged image P1 corresponding to an image signal of a circular image D1 formed on the light receiving surface of the solid-state image sensor 103 corresponding to an area transmitting the first lens coating 104. Specifically, the control unit 19 causes the image processing unit 12 to crop the image signal of the circular image D1 formed on the light receiving surface of the solid-state image sensor 103, and to perform a process of converting the cropped image signal from a known equidistant projection system to a central projection system to generate a rectangular display image P2.
[0053] Returning to FIG. 10, the description of step S105 and subsequent steps will be continued. In step S105, the control unit 19 outputs the display image P2 generated by the image processing unit 12 to the display unit 13. This allows the user to hold a face-to-face remote conference or the like while checking the clear display image P2 transmitted through the first lens coating 104.
[0054] Next, the control unit 19 determines whether the imaging device 10 has stopped based on the operation signal input from the input unit 17 (step S106). If the control unit 19 determines that the imaging device 10 has stopped (step S106: Yes), the information processing device 1 ends this process. On the other hand, if the control unit 19 determines that the imaging device 10 has not stopped (step S106: No), the information processing device 1 returns to step S102.
[0055] In step S103, if the control unit 19 determines that the imaging device 10 is not in the first mode (step S103: Yes), the information processing device 1 proceeds to step S107. Specifically, as shown in Fig. 14, if the control unit 19 determines that the imaging device 10 is in a second mode (hereinafter simply referred to as "second mode") in which the imaging device 10 captures an image with the optical axis O1 of the imaging device 10 facing the direction of gravity, that is, the conference room mode, based on the orientation of the optical axis O1 of the imaging device 10 acquired from the detection unit 18, the information processing device 1 proceeds to step S107.
[0056] Next, the control unit 19 causes the image processing unit 12 to execute image processing corresponding to the second mode (step S107). Specifically, the control unit 19 causes the image processing unit 12 to generate a display image based on an imaging signal of an annular image formed on the light receiving surface of the solid-state imaging element 103 corresponding to the region transmitting the second lens coating 105. After step S107, the information processing device 1 proceeds to step S108, which will be described later.
[0057] Fig. 15 is a diagram showing an example of a captured image generated by the solid-state image sensor 103. Fig. 16 is a diagram showing an example of a display image generated by the image processing unit 12.
[0058] 15 and 16, the control unit 19 causes the image processing unit 12 to generate a display image P4 using a captured image P3 corresponding to an imaging signal of an annular image D2 formed on the light receiving surface of the solid-state imaging element 103 corresponding to an area transmitting the second lens coating 105. Specifically, the control unit 19 causes the image processing unit 12 to detect subjects K1 to K3 from the circular image D2 formed on the light receiving surface of the solid-state imaging element 103 corresponding to an area transmitting the second lens coating 105, using a well-known subject detection process. Then, the control unit 19 causes the image processing unit 12 to cut out imaging signals of an area including the subjects K1 to K3 from the image D2, and to perform a process of converting the cut-out imaging signals from a well-known equidistant projection system to a central projection system, thereby generating a rectangular display image P4.
[0059] Returning to FIG. 10, the description of step S108 and subsequent steps will be continued. In step S108, the control unit 19 causes the display unit 13 to output the display image P4 generated by the image processing unit 12. This allows the user to hold a remote conference or the like while checking the display image P4 transmitted through the second lens coating 105. In this case, the user can see the display image P4 in which the second lens coating 105 suppresses reflection of light from ceiling lighting or the like.
[0060] According to the embodiment described above, the second lens coating 105 has a circular ring shape extending from the first lens coating 104 toward the outer edge of the object surface of the imaging lens 102, and the transmittance of the blue wavelength band is higher than the transmittance of the other wavelength bands. Therefore, when multiple users are using the device, light reflection from ceiling lighting, etc. is reduced, allowing the user to view comfortable images.
[0061] Furthermore, according to one embodiment, the second lens coating 105 is a blue light cut coating, so that when multiple lenses are used, it is possible to reduce the reflection of light from ceiling lighting, etc.
[0062] Furthermore, according to one embodiment, the control unit 19 controls the content of image processing by the image processing unit 12 based on the detection result of the detection unit 18, so that the situation of face-to-face use and use in a conference room is not anticipated, and it is possible to achieve both of these two uses.
[0063] Furthermore, according to one embodiment, the control unit 19 causes the image processing unit 12 to generate a display image P2 based on an imaged image P1 corresponding to an imaging signal of a circular image D1 formed on the light receiving surface of the solid-state imaging element 103 corresponding to the area that transmits the first lens coating 104, thereby enabling a user to hold a remote conference, etc. with an appropriate image when using face-to-face.
[0064] Furthermore, according to one embodiment, the control unit 19 causes the image processing unit 12 to generate a display image P4 using an imaged image P3 corresponding to an imaging signal of an annular image D2 formed on the light receiving surface of the solid-state imaging element 103 corresponding to the area that transmits the second lens coating 105. Therefore, when a user is using the camera for a conference, the user can view a display image P4 in which light reflections and flare caused by ceiling lighting, etc. are suppressed by the second lens coating 105.
[0065] Furthermore, according to one embodiment, the control unit 19 causes the image processing unit 12 to detect subjects K1-K3 using a well-known subject detection process for the circular image D2 formed on the light receiving surface of the solid-state imaging element 103 corresponding to the area transmitted through the second lens coating 105, cut out the image signal of the area including the subjects K1-K3 from the image D2, and then converts the cut-out image signal from the well-known equidistant projection method to the central projection method to generate a rectangular display image P4, so that all subjects present around the information processing device 1 can be displayed.
[0066] In one embodiment, the control unit 19 may cause the image processing unit 12 to perform calibration processing based on a preset value on the imaging signals corresponding to the respective regions (images D1 and D2) of the first lens coating 104 and the second lens coating 105. This makes it possible to generate a display image that is natural and has a smooth boundary between the first lens coating 104 and the second lens coating 105. Of course, the control unit 19 may cause the image processing unit 12 to generate a display image by gradually changing the calibration processing value from the boundary between the first lens coating 104 and the second lens coating 105 for the imaging signals of the respective regions (images D1 and D2) of the first lens coating 104 and the second lens coating 105.
[0067] Furthermore, in one embodiment, the control unit 19 may control the exposure of the solid-state imaging element 103 to change the exposure time of the light receiving surface of the solid-state imaging element 103 corresponding to each of the regions (images D1 and D2) of the first lens coating 104 and the second lens coating 105. For example, the exposure time of the light receiving surface of the solid-state imaging element 103 corresponding to the region of the second lens coating 105 (image D2) may be set longer than the exposure time of the light receiving surface of the solid-state imaging element 103 corresponding to the region of the first lens coating 104 (image D1).
[0068] (Variation 1) Next, a first modification of the embodiment will be described. In the first modification, the transmission characteristics of the second lens coating 105 described above are different. Therefore, in the following, the transmission characteristics of the second lens coating 105 will be described.
[0069] Fig. 17 is a diagram showing the transmission characteristics of the second lens coating 105 according to the first modification of an embodiment. In Fig. 17, the horizontal axis represents wavelength (nm) and the vertical axis represents transmittance (%). In Fig. 17, a curve W2 represents the transmission characteristics of the second lens coating 105.
[0070] As shown by curve W2 in Fig. 17, the second lens coating 105 transmits only light in the blue wavelength band. Therefore, the image processor 12 generates a pseudo-color captured image by interpolating the green and red imaging signals that are included in the captured image corresponding to the imaging signal and that is an annular captured image corresponding to the region of the second lens coating 105, based on the blue imaging signal.
[0071] According to the first modification of the embodiment described above, even in the second mode, it is possible to display a pseudo-color display image.
[0072] (Variation 2) Next, a second modification of an embodiment will be described. Fig. 18 is a diagram showing the transmission characteristics of the second lens coating 105 according to the first modification of an embodiment. In Fig. 18, the horizontal axis indicates wavelength (nm) and the vertical axis indicates transmittance (%). Also, in Fig. 18, a curve W2 indicates the transmission characteristics of the second lens coating 105.
[0073] As shown by curve W3 in Fig. 18, the second lens coating 105 attenuates the overall transmittance of each of the blue, green, and red colors. In this case, the image processor 12 adjusts the gain of each of the blue, green, and red imaging signals that are included in the annular captured image corresponding to the region of the second lens coating 105, thereby generating a display image.
[0074] According to the second modification of the embodiment described above, similarly to the embodiment described above, it is possible to achieve both face-to-face use and conference room use.
[0075] In the second modification of the second embodiment, the second lens coating 105 is applied to the object surface of the single lens L1 to form a coating, but the present invention is not limited to this and may be realized by, for example, an ND filter having the transmission characteristics of the curve W3 in Fig. 18. In this case, the ND filter may be disposed between the imaging lens 102 and the cover 101.
[0076] (Variation 3) Next, a third modified example of the embodiment will be described. In the embodiment described above, the first lens coating 104 and the second lens coating 105 are applied to the object surface of the single lens L1, but the present invention is not limited to this, and filters having different transmittances may be disposed between the light receiving surface of the solid-state imaging element 103 and the imaging lens.
[0077] Fig. 19 is a diagram showing a schematic configuration of an imaging lens according to Modification 3 of an embodiment. Imaging lens 102A shown in Fig. 19 is configured using a single lens L1A and lenses L11 to L14. Furthermore, imaging lens 102A has a first filter 200 functioning as a first optical member and a second filter 201 functioning as a second optical member between imaging lens 102A and solid-state imaging element 103A.
[0078] The first filter 200 has a transmittance similar to that of the above-mentioned first lens coating 104. Furthermore, the first filter 200 has a size of an area corresponding to the circular image D1 formed on the light receiving surface of the solid-state imaging element 103, which corresponds to the area of the above-mentioned first lens coating 104.
[0079] The second filter 201 has a transmittance similar to that of the above-mentioned second lens coating 105. Furthermore, the second filter 201 has a size of an area corresponding to the annular image D2 formed on the light receiving surface of the solid-state imaging element 103, which corresponds to the area of the above-mentioned second lens coating 105.
[0080] The solid-state imaging element 103A has a light receiving surface with an effective pixel area larger than the image formed by the imaging lens 102A.
[0081] According to the third modification of the embodiment described above, similarly to the embodiment described above, it is possible to achieve both face-to-face use and conference room use.
[0082] (Other embodiments) In the above-described embodiment of the present disclosure, a PC has been described as an example of the information processing device 1, but the imaging device 10 may be applied to imaging devices such as tablet terminals, mobile phones, etc. Of course, the imaging device 10 may be applied to a Web camera or the like that can communicate with a PC or the like via wired or wireless communication.
[0083] In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the information processing device according to an embodiment of the present disclosure. For example, some components may be deleted from all the components described in the information processing device according to the embodiment of the present disclosure. Furthermore, the components described in the information processing device according to the embodiment of the present disclosure may be appropriately combined.
[0084] Furthermore, in the information processing device according to the embodiment of the present disclosure, the above-mentioned "unit" can be read as "means" or "circuit", etc. For example, the control unit can be read as control means or a control circuit.
[0085] In addition, the program to be executed by an information processing device according to one embodiment of the present disclosure is provided as file data in an installable or executable format recorded on a computer-readable recording medium such as a CD-ROM, a flexible disk (FD), a CD-R, a Digital Versatile Disk (DVD), a USB medium, or a flash memory.
[0086] Furthermore, the program executed by the information processing device according to an embodiment of the present disclosure may be configured to be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network.
[0087] In addition, a part of the program executed by the information processing device according to an embodiment of the present disclosure may be executed by a GPU or the like of an image processing unit, thereby achieving high speed and low power consumption.
[0088] Although some of the embodiments of the present application have been described in detail above with reference to the drawings, these are merely examples, and the present invention can be embodied in other forms that incorporate various modifications and improvements based on the knowledge of those skilled in the art, including the forms described in the disclosure of the present invention. [Explanation of symbols]
[0089] 1. Information processing device 2 Base 3 Cover 10. Imaging device 11 Signal Processing Section 12 Image processing section 13 Display section 14 Audio input / output section 15 Storage section 16 Communications Department 17 Input section 18 Detection section 19: Control section 31 Bezel 101 Cover 102,102A Imaging lens 103,103A Solid-state image sensor 104 First Lens Coating 105 Second Lens Coating 200 First Filter 201 Second Filter
Claims
1. an imaging lens including a plurality of lenses arranged in order from an object side to an image side; a solid-state image sensor that receives an image formed by the imaging lens and generates an image signal; a first optical member that forms a circle with a predetermined length from the center of an object surface of a lens that is disposed closest to an object side among the plurality of lenses, and has a transmission characteristic of 95% or more for light in a wavelength band of 420 nm to 750; a second optical member having a ring shape extending from the first optical member toward an outer edge of the object surface, the second optical member having a transmittance in a blue wavelength band higher than a transmittance in other wavelength bands; An imaging device comprising: an image processing unit that performs image processing on the imaging signal to generate a display image; A detection unit that detects an optical axis direction of the imaging lens; A control unit that controls image processing by the image processing unit; Equipped with The control unit is determining whether the mode is a first mode in which an image is captured with the optical axis directed substantially horizontally relative to the direction of gravity, or a second mode in which an image is captured with the optical axis directed substantially relative to the direction of gravity, based on a detection result of the detection unit; In the first mode, the image processor generates the display image based on the imaging signal of a circular image formed on a light receiving surface of the solid-state imaging element corresponding to a region that transmits the first optical member, while When the second mode is selected, the image processor is caused to generate the display image based on the imaging signal of the annular image formed on the light receiving surface of the solid-state imaging element corresponding to a region transmitting the second optical member. Information processing device.
2. 2. The information processing device according to claim 1, The first optical member includes: a layer formed by a clear coating applied to the object surface, The second optical member includes: A layer formed by a blue light coating applied to the object surface. Information processing device.
3. 2. The information processing device according to claim 1, The first optical member and the second optical member are an ND filter, which is disposed on the object side of the object plane; Information processing device.
4. 2. The information processing device according to claim 1, The first optical member and the second optical member are a filter disposed between the imaging lens and the light receiving surface of the solid-state imaging element; Information processing device.
5. 2. The information processing device according to claim 1, The control unit is When the second mode is selected, the image processing unit is caused to detect a subject from a captured image corresponding to the imaging signal; causing the image processing unit to extract an area including the subject from the captured image and generate the display image; Information processing device.
6. 6. The information processing device according to claim 5, The control unit is In the second mode, when the image processing unit detects a plurality of the subjects, the image processing unit is caused to extract areas including each of the plurality of subjects from the captured image and generate the display image. Information processing device.
7. 7. The information processing device according to claim 6, A base unit having an input unit capable of performing input operations; A cover portion that is rotatable relative to the base portion and has a display portion; Equipped with The detection unit and the imaging device are and disposed on a bezel portion of the cover portion. Information processing device.
Citation Information
Patent Citations
Camera and imaging method
JP2005198295A
Optical inspection device, optical inspection method for specimen, and optical inspection method for shape of specimen
JP2023015793A
Electronic apparatus and control method
JP2023084910A
Electronic device and control method
JP7275239B1