Electronic device including image sensor and method of operating the same

Abstract

An electronic device is provided, including an image sensor, a camera module, and a processor. The image sensor identifies an operation setting and an external environment condition of the camera module, and when it is identified that the operation setting is a preview mode and the external environment condition is a high-illuminance environment, the image sensor identifies a first area signal corresponding to signals of first and second photodiodes that are connected in series to each other and included in a first unit pixel, and a second area signal corresponding to signals of fifth and sixth photodiodes included in a second unit pixel and corresponding to positions of the first and second photodiodes, and forms first auto focus (AF) information based on the first and second area signals.

Description

Technical Field

[0001] This disclosure relates to electronic devices including image sensors and methods of operating such electronic devices. Background Technology

[0002] An image sensor is a device that converts optical images into electrical signals. With the development of the computer and communications industries, the demand for high-performance image sensors is increasing in various electronic devices such as digital cameras, portable video cameras, personal communication systems (PCS), game consoles, security cameras, medical miniature cameras, and robots.

[0003] An image sensor may include at least one microlens. At least one pixel may be disposed below the microlens.

[0004] In image sensors that include unit pixels, where multiple pixels are positioned below a single microlens, it may be difficult to generate a high-resolution image using both the left and right images. Summary of the Invention

[0005] Technical solutions

[0006] This disclosure aims to address the aforementioned problems and shortcomings, and provides at least the following advantages.

[0007] According to one aspect of this disclosure, an electronic device is provided including an image sensor comprising a first unit pixel and a second pixel unit. The first unit pixel includes a first microlens facing each other and a plurality of first photodiodes, wherein a first color filter is inserted between the plurality of first photodiodes. The second unit pixel includes a second microlens facing each other and a plurality of second photodiodes, wherein a second color filter is inserted between the plurality of second photodiodes. A camera module including the image sensor and a processor operatively connected to the image sensor are also provided. The first unit pixel includes a first photodiode, a second photodiode, a third photodiode, and a fourth photodiode arranged in a square shape such that the horizontal number of photodiodes is equal to the vertical number of photodiodes. The second unit pixel includes a fifth photodiode, a sixth photodiode, a seventh photodiode, and an eighth photodiode arranged in a square shape such that the horizontal number of photodiodes is equal to the vertical number of photodiodes. The image sensor identifies the camera module's operating settings and external environmental conditions. When it identifies that the operating setting is preview mode and the external environmental condition is a high-light environment, it identifies a first region signal corresponding to the signals of the first photodiode and the second photodiode, which are connected in series and included in the first unit pixel. It also identifies a second region signal corresponding to the signals of the fifth photodiode and the sixth spot diode, which are included in the second unit pixel and correspond to the position of the first photodiode and the sixth spot diode, and forms first autofocus (AF) information based on the first region signal and the second region signal.

[0008] According to another aspect of this disclosure, an operating method for an electronic device is provided. The electronic device includes an image sensor comprising a first unit pixel and a second unit pixel. The first unit pixel includes a first microlens and a plurality of photodiodes arranged in a square shape such that the horizontal number of photodiodes is equal to the vertical number of photodiodes. The second unit pixel includes a second microlens facing each other and a plurality of photodiodes arranged in a square shape such that the horizontal number of photodiodes is the same as the vertical number of photodiodes. The method also includes a camera module comprising the image sensor and a processor operably connected to the image sensor. The method includes identifying operating settings of the camera module and external environmental conditions by the image sensor, and in identifying… When the operation setting is preview mode and the external environment is a high-light environment, or when the operation setting is video mode and the external environment is a low-light environment, a first region signal corresponding to the signals of the first photodiode and the second photodiode is identified. The first photodiode and the second photodiode are connected in series and included in the first unit pixel. A second region signal corresponding to the signals of the fifth photodiode and the sixth photodiode is identified. The fifth photodiode corresponds to the position of the first photodiode, and the sixth photodiode corresponds to the position of the second photodiode. The fifth photodiode and the sixth photodiode are included in the second unit pixel. First AF information is formed based on the first region signal and the second region signal.

[0009] Beneficial effects of the invention

[0010] According to the embodiments disclosed in this specification, high-resolution images can be achieved by applying AF information and image sensor output differently depending on camera operating settings and external environmental conditions.

[0011] In addition, it can provide a variety of effects that can be understood directly or indirectly through the instruction manual. Attached Figure Description

[0012] The above and other aspects, features, and advantages of specific embodiments of the present disclosure will become clearer from the following description taken in conjunction with the accompanying drawings, in which:

[0013] Figure 1 This is a block diagram of an electronic device in a network environment 100 according to an embodiment;

[0014] Figure 2 This is a block diagram illustrating a camera module according to an embodiment;

[0015] Figure 3 This is a diagram illustrating an image sensor according to an embodiment;

[0016] Figure 4 This is a diagram describing a unit pixel according to an embodiment;

[0017] Figure 5 This is an illustration based on an embodiment. Figure 4 A cross-sectional view of a single pixel unit taken along line z-z' in the middle;

[0018] Figure 6 This is a flowchart describing the operation of an image sensor according to an embodiment;

[0019] Figure 7 This is a block diagram illustrating hardware included in an image sensor according to an embodiment;

[0020] Figure 8 This is a diagram illustrating unit pixels included in an image sensor according to an embodiment;

[0021] Figure 9 This is a diagram illustrating an example of forming a Bayer pattern image based on signals from an image sensor, according to an embodiment.

[0022] Figure 10 This is a diagram illustrating two cases of the signal from the output image sensor according to an embodiment;

[0023] Figure 11 A diagram illustrating a method for calculating the disparity of an image sensor according to an embodiment; and

[0024] Figure 12 This is a diagram illustrating, according to an embodiment, unit pixels included in a pixel array of an image sensor. Detailed Implementation

[0025] This application is based on and claims priority to Korean Patent Application No. 10-2019-0172916, filed with the Korean Intellectual Property Office on December 23, 2019, the disclosure of which is incorporated herein by reference in its entirety.

[0026] One aspect of this disclosure is to provide an image sensor capable of realizing high-resolution images.

[0027] Various embodiments of the present disclosure will be described below with reference to the accompanying drawings. However, it should be understood that this is not intended to limit the present disclosure to specific implementations, but rather to include various modifications, equivalents, and / or alternatives to the embodiments of the present disclosure.

[0028] Figure 1 These are diagrams illustrating electronic devices in a network environment according to various embodiments. Reference Figure 1In network environment 100, electronic device 101 can communicate with electronic device 102 via a first network 198 (e.g., a short-range wireless communication network), or with electronic device 104 or server 108 via a second network 199 (e.g., a long-range wireless communication network). According to an embodiment, electronic device 101 can communicate with electronic device 104 via server 108. According to an embodiment, electronic device 101 may include a processor 120, a memory 130, an input device 150, a sound output device 155, a display device 160, an audio module 170, a sensor module 176, an interface 177, a haptic module 179, a camera module 180, a power management module 188, a battery 189, a communication module 190, a subscriber identification module 196, or an antenna module 197. According to some embodiments, at least one component of electronic device 101 may be omitted, or one or more other components may be added to electronic device 101. According to some embodiments, some of the above components may be implemented using a single integrated circuit. For example, sensor module 176 (e.g., fingerprint sensor, iris sensor, or illuminance sensor) may be embedded in display device 160 (e.g., display).

[0029] Processor 120 can execute software (e.g., program 140) to control at least one of other components (e.g., hardware or software components) of electronic device 101 connected to processor 120, and can process or compute various types of data. According to embodiments, as part of data processing or operation, processor 120 can load sets of commands or data received from other components (e.g., sensor module 176 or communication module 190) into volatile memory 132, can process the commands or data loaded into volatile memory 132, and can store the resulting data into non-volatile memory 134. According to embodiments, processor 120 may include a main processor 121 (e.g., a central processing unit or application processor) and an auxiliary processor 123 (e.g., a graphics processing device, image signal processor, sensor hub processor, or communication processor), the auxiliary processor 123 operating independently of or in conjunction with the main processor 121. Additionally or alternatively, auxiliary processor 123 may use less power than the main processor 121 or be dedicated to a specific function. The auxiliary processor 123 can be implemented separately from the main processor 121 or as part of the main processor 121.

[0030] For example, when the main processor 121 is inactive (e.g., in sleep) mode, the auxiliary processor 123 (instead of the main processor 121) can control at least some of the functions or states associated with at least one component of the electronic device 101 (e.g., display device 160, sensor module 176, or communication module 190), or when the main processor 121 is active (e.g., application execution), the auxiliary processor 123 can work with the main processor 121 to control at least some of the functions or states associated with at least one component of the electronic device 101 (e.g., display device 160, sensor module 176, or communication module 190). According to embodiments, the auxiliary processor 123 (e.g., an image signal processor or a communication processor) can be implemented as part of another component (e.g., camera module 180 or communication module 190) functionally associated with the auxiliary processor 123.

[0031] Memory 130 may store various data used by at least one component of electronic device 101 (e.g., processor 120 or sensor module 176). For example, the data may include software (e.g., program 140) and input or output data regarding commands associated with the software. Memory 130 may include volatile memory 132 or non-volatile memory 134.

[0032] Program 140 may be stored as software in memory 130 and may include, for example, an operating system 142, middleware 144, or application 146.

[0033] Input device 150 can receive commands or data for components of electronic device 101 (e.g., processor 120) from outside electronic device 101 (e.g., a user). Input device 150 may include, for example, a microphone, mouse, keyboard, or digital pen (e.g., stylus).

[0034] The sound output device 155 can output sound signals to the outside of the electronic device 101. The sound output device 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback, while the receiver can be used to receive calls. According to embodiments, the receiver and speaker can be implemented integratedly or separately.

[0035] Display device 160 can provide visual information to the outside of electronic device 101 (e.g., to a user). For example, display device 160 may include a display, holographic device, or projector, and control circuitry for controlling the corresponding device. According to an embodiment, display device 160 may include touch circuitry configured to sense touch or sensor circuitry (e.g., a pressure sensor) for measuring the pressure intensity on the touch.

[0036] The audio module 170 can bidirectionally convert sound and electrical signals. According to an embodiment, the audio module 170 can acquire sound through the input device 150, or output sound through the sound output device 155 or directly or wirelessly connected to an external electronic device (e.g., electronic device 102 (e.g., speaker or headphones)) of the electronic device 101.

[0037] Sensor module 176 can generate electrical signals or data values ​​corresponding to the internal operating state (e.g., power or temperature) of electronic device 101 or the external environmental state (e.g., user state). According to embodiments, sensor module 176 may include, for example, a posture sensor, gyroscope sensor, atmospheric pressure sensor, magnetic sensor, accelerometer, grip sensor, proximity sensor, color sensor, infrared sensor, biometric sensor, temperature sensor, humidity sensor, or illuminance sensor.

[0038] Interface 177 may support one or more specified protocols to allow electronic device 101 to connect directly or wirelessly to external electronic device (e.g., electronic device 102). According to embodiments, interface 177 may include, for example, an HDMI (High-Definition Multimedia Interface), a USB (Universal Serial Bus) interface, an SD card interface, or an audio interface.

[0039] Connection terminal 178 may include a connector for physically connecting electronic device 101 to an external electronic device (e.g., electronic device 102). According to embodiments, connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0040] The tactile module 179 can convert electrical signals into mechanical stimulation (e.g., vibration or movement) or electrical stimulation perceived by the user through touch or kinesthesia. According to embodiments, the tactile module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulator.

[0041] Camera module 180 can capture still images or video images. According to an embodiment, camera module 180 may include, for example, at least one or more lenses, an image sensor, an image signal processor, or a flash.

[0042] The power management module 188 can manage the power supplied to the electronic device 101. According to an embodiment, the power management module 188 can be implemented as at least part of a power management integrated circuit (PMIC).

[0043] Battery 189 can power at least one component of electronic device 101. According to embodiments, battery 189 may include, for example, a non-rechargeable (primary) battery, a rechargeable (secondary) battery, or a fuel cell.

[0044] Communication module 190 can establish a direct (e.g., wired) or wireless communication channel between electronic device 101 and external electronic devices (e.g., electronic device 102, electronic device 104, or server 108), and support communication execution through the established communication channel. Communication module 190 may include at least one communication processor that operates independently of processor 120 (e.g., application processor) and supports direct (e.g., wired) or wireless communication. According to embodiments, communication module 190 may include wireless communication module 192 (e.g., cellular communication module, short-range wireless communication module, or GNSS (Global Navigation Satellite System) communication module) or wired communication module 194 (e.g., LAN (Local Area Network) communication module or powerline communication module). The corresponding communication modules described above can communicate with external electronic device 104 through a first network 198 (e.g., a short-range communication network such as Bluetooth, WiFi Direct, or IrDA (Infrared Data Association)) or a second network 199 (e.g., a long-range wireless communication network such as a cellular network, the Internet, or a computer network (e.g., LAN or WAN)). The various communication modules described above can be implemented in a single component (e.g., a single chip) or in separate components (e.g., multiple chips). The wireless communication module 192 can use user information (e.g., International Mobile Subscriber Identity (IMSI)) stored in the subscriber identification module 196 in a communication network such as the first network 198 or the second network 199 to identify and authenticate the electronic device 101.

[0045] Antenna module 197 can transmit or receive signals or power to or from the outside of electronic device 101 (e.g., external electronic device). According to an embodiment, antenna module 197 may include an antenna comprising a radiating element made of conductive material or conductive pattern formed in or on a substrate (e.g., a PCB). According to an embodiment, antenna module 197 may include multiple antennas. In this case, for example, communication module 190 (e.g., wireless communication module 192) may select at least one antenna from the multiple antennas suitable for a communication scheme used in a communication network such as a first network 198 or a second network 199. Signals or power can then be transmitted or received between communication module 190 and external electronic device via the selected at least one antenna. According to an embodiment, additional components besides the radiating element (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of antenna module 197.

[0046] At least some of the components can be connected to each other via communication methods used between peripheral devices (e.g., bus, GPIO (General Purpose Input and Output), SPI (Serial Peripheral Interface), or MIPI (Mobile Industrial Processor Interface)) to exchange signals (e.g., commands or data).

[0047] According to an embodiment, commands or data can be sent or received between electronic device 101 and external electronic device 104 via server 108 connected to the second network 199. Each of electronic devices 102 and 104 can be of the same or different type as electronic device 101. According to an embodiment, all or some of the operations performed by electronic device 101 can be performed by one or more external electronic devices 102, 104, or 108. For example, when electronic device 101 performs some functions or services automatically or upon request from a user or another device, in addition to performing the functions or services itself, electronic device 101 can also request one or more external electronic devices to perform at least some of the functions related to the functions or services. Upon receiving the request, one or more external electronic devices can perform at least part of the requested functions or services or additional functions or services associated with the request, and send the execution results to electronic device 101. Electronic device 101 can provide the results as is or after additional processing as at least part of the response to the request. For this purpose, cloud computing, distributed computing, or client-server computing technologies can be used, for example.

[0048] Figure 2 This is a block diagram 200 illustrating a camera module 180 according to various embodiments. Reference Figure 2 Camera module 180 may include lens assembly 210, flash 220, image sensor 230, image stabilizer 240, memory 250 (e.g., buffer memory), or image signal processor 260. Lens assembly 210 may collect light emitted from an object whose image is to be captured. Lens assembly 210 may include one or more lenses. According to embodiments, camera module 180 may include multiple lens assemblies 210. In this case, camera module 180 may form, for example, a dual-camera, a 360-degree camera, or a spherical camera. Some of the multiple lens assemblies 210 may have the same lens properties (e.g., angle of view, focal length, autofocus, f-number, or optical zoom), or at least one lens assembly may have one or more lens properties different from another lens assembly. Lens assembly 210 may include, for example, a wide-angle lens or a telephoto lens.

[0049] Flash 220 can emit light to enhance light emitted or reflected from an object. According to embodiments, flash 220 may include one or more light-emitting diodes (LEDs) (e.g., red-green-blue (RGB) LEDs, white LEDs, infrared (IR) LEDs, or ultraviolet (UV) LEDs) or xenon lamps. Image sensor 230 can acquire an image corresponding to an object by converting light emitted or reflected from the object and transmitted via lens assembly 210 into an electrical signal. According to embodiments, image sensor 230 may include one image sensor selected from image sensors with different properties (such as an RGB sensor, a black-and-white (BW) sensor, an IR sensor, or a UV sensor), multiple image sensors having the same properties, or multiple image sensors with different properties. Each image sensor included in image sensor 230 can be implemented using, for example, a charge-coupled device (CCD) sensor or a complementary metal-oxide-semiconductor (CMOS) sensor.

[0050] Image stabilizer 240 can move image sensor 230 or at least one lens included in lens assembly 210 in a specific direction, or control the operating properties of image sensor 230 (e.g., adjust readout timing) in response to movement of camera module 180 or electronics 101 including camera module 180. This allows compensation for at least some of the negative impacts (e.g., image blur) caused by the movement on the captured image. According to embodiments, image stabilizer 240 can use a gyroscope sensor (not shown) or an accelerometer sensor (not shown) disposed inside or outside camera module 180 to sense such movement of camera module 180 or electronics 101. According to embodiments, image stabilizer 240 can be implemented as, for example, an optical image stabilizer. Memory 250 can at least temporarily store at least a portion of the images acquired via image sensor 230 for subsequent image processing tasks. For example, when image capture is delayed due to shutter lag or multiple images are captured rapidly, the acquired original image (e.g., Bayer pattern image, high-resolution image) can be stored in memory 250, and its corresponding copy image (e.g., low-resolution image) can be previewed via display device 160. Subsequently, when specified conditions are met (e.g., via user input or system commands), at least a portion of the original image stored in memory 250 can be acquired and processed, for example, by image signal processor 260. According to embodiments, memory 250 can be configured as at least a portion of memory 130, or as a separate memory operating independently of memory 130.

[0051] Image signal processor 260 can perform one or more image processing operations on images acquired via image sensor 230 or stored in memory 250. One or more image processing operations may include, for example, depth map generation, 3D modeling, panorama generation, feature point extraction, image compositing, or image compensation (e.g., noise reduction, resolution adjustment, brightness adjustment, blurring, sharpening, or softening). Additionally or alternatively, image signal processor 260 may control (e.g., exposure time control or readout timing control) at least one of the components included in camera module 180 (e.g., image sensor 230). Images processed by image signal processor 260 may be stored back in memory 250 for further processing or may be provided to external components outside camera module 180 (e.g., memory 130, display device 160, electronics 102, electronics 104, or server 108). According to embodiments, image signal processor 260 may be configured as at least a portion of processor 120 or as a separate processor operating independently of processor 120. When the image signal processor 260 is configured as a processor separate from the processor 120, at least one image processed by the image signal processor 260 can be displayed by the processor 120 via the display device 160 as is or after further processing.

[0052] According to an embodiment, the electronic device 101 may include a plurality of camera modules 180 with different attributes or functions. In this case, at least one of the plurality of camera modules 180 may form, for example, a wide-angle camera, and at least another of the plurality of camera modules 180 may form a telephoto camera. Similarly, at least one of the plurality of camera modules 180 may form, for example, a front-facing camera, and at least another of the plurality of camera modules 180 may form a rear-facing camera.

[0053] In the following text, reference will be made to Figure 3 , Figure 4 and Figure 5 Describe the electronic device. For clarity, briefly describe or omit details identical to those above.

[0054] Figure 3 This is a diagram illustrating an image sensor 300 according to an embodiment. Figure 4 Figure 400 illustrates a description of a unit pixel according to an embodiment. Figure 5 This is an illustration based on an embodiment. Figure 4 A cross-sectional view 500 of a single unit pixel intercepted along line z-z'.

[0055] refer to Figure 3 The image sensor 300 includes a pixel array 332, a first scanning circuit 331, a second scanning circuit 333, and a readout circuit 335.

[0056] The pixel array 332 may include a plurality of pixel units, including a first pixel unit 310, a second pixel unit 311, a third pixel unit 312, a fourth pixel unit 320, a fifth pixel unit 321, and a sixth pixel unit 322. Additional pixel units may also be included among the plurality of pixel units. The plurality of pixel units may be arranged along the X direction (e.g., row direction) and the Y direction (e.g., column direction).

[0057] Each of the multiple unit pixels may include a microlens. For example, the first unit pixel 310 may include a first microlens 305 and / or the second unit pixel 311 may include a second microlens 306.

[0058] Each of the plurality of unit pixels may include at least one photodiode (e.g., a first photodiode 301, a second photodiode 302, a third photodiode 303, and a fourth photodiode 304). The number of photodiodes included in each of the plurality of unit pixels may be based on the number of pixels included in each of the plurality of unit pixels.

[0059] The first scanning circuit 331 and the second scanning circuit 333, under the control of the processor, can detect the signal of each of a plurality of pixel units, including a first pixel unit 310, a second pixel unit 311, a third pixel unit 312, a fourth pixel unit 320, a fifth pixel unit 321, and a sixth pixel unit 322. The first scanning circuit 331 can detect the signal of each of the plurality of pixel units, including the first pixel unit 310, the second pixel unit 311, the third pixel unit 312, the fourth pixel unit 320, the fifth pixel unit 321, and the sixth pixel unit 322, in the Y direction. The second scanning circuit 333 can detect the signal of each of the plurality of pixel units, including the first pixel unit 310, the second pixel unit 311, the third pixel unit 312, the fourth pixel unit 320, the fifth pixel unit 321, and the sixth pixel unit 322, in the X direction. The reading circuit 335 can read the detected signals.

[0060] Each of the plurality of pixel units, including first pixel unit 310, second pixel unit 311, third pixel unit 312, fourth pixel unit 320, fifth pixel unit 321, and sixth pixel unit 322, may include n x n pixels (where "n" is a natural number greater than 1). First pixel unit 310 may include n x n pixels overlapping with first microlens 305, and / or second pixel unit 311 may include n x n pixels overlapping with second microlens 306. Each of the n x n pixels may correspond to a single photodiode.

[0061] Each of the plurality of pixels, including the first pixel unit 310, the second pixel unit 311, the third pixel unit 312, the fourth pixel unit 320, the fifth pixel unit 321, and the sixth pixel unit 322, may include a single microlens, a plurality of photodiodes, and a color filter for a color (e.g., green).

[0062] The following will refer to Figure 4 and Figure 5 Detailed description Figure 3 The image sensor 300 includes unit pixels in its pixel array 332.

[0063] refer to Figure 4 Each of the multiple unit pixels includes 2x2 photodiodes. For example, the first unit pixel 310 may include a first photodiode 301, a second photodiode 302, a third photodiode 303, and a fourth photodiode 304 arranged to overlap with the first microlens 305. The first photodiode 301 and the third photodiode 303 may be arranged along a first row. The second photodiode 302 and the fourth photodiode 304 may be arranged along a second row. The first photodiode 301 and the second photodiode 302 may be arranged along a first column. The third photodiode 303 and the fourth photodiode 304 may be arranged along a second column. Each of the first photodiode 301, the second photodiode 302, the third photodiode 303, and the fourth photodiode 304 may correspond to a single pixel.

[0064] The first unit pixel 310 may include a microlens 305, a first photodiode 301, a second photodiode 302, a third photodiode 303, a fourth photodiode 304, and a green (G) color filter. The second unit pixel 311 may have the same structure as the first unit pixel 310, and therefore its description will be omitted. However, the color of the color filter included in each unit pixel may be green (G), or it may be different from each other, such as red (R) or blue (B).

[0065] refer to Figure 5 In the first pixel unit 310, the first microlens 305, the first photodiode 301, and the second photodiode 302 can be arranged facing each other with a color filter 501 inserted between them. Light incident on the image sensor can be focused by the first microlens 305 and can be incident on different photodiodes. The signal of the light incident on each photodiode can be detected by the first scanning circuit 331 or the second scanning circuit 333.

[0066] In the following text, reference will be made to Figure 6 , Figure 7 , Figure 8 and Figure 9 The operation of the electronic device according to the embodiments is described. For clarity, content identical to the details above is briefly described or omitted.

[0067] In the following text, it is assumed that... Figure 3 Image sensor 300 performs Figure 6 The process described as being performed by the image sensor 300 can be executed by the synthetic signal forming unit 701, the parallax calculation unit 702, and / or the remosaic processing unit 703 included in the image sensor 300.

[0068] Figure 6 This is a flowchart 600 describing the operation of the image sensor 300 according to an embodiment. Figure 7 This is a block diagram 700 illustrating hardware included in the image sensor 300 according to an embodiment. Figure 8 Figure 800 illustrates a unit pixel included in an image sensor 300 according to an embodiment. Figure 9 Figure 900 illustrates an example of forming a Bayer pattern image based on signals from an image sensor, according to an embodiment.

[0069] refer to Figure 6 In step 610, the image sensor identifies camera operating settings and / or external environmental conditions.

[0070] The camera operation settings can indicate which of the following modes—preview mode, photo mode, and video mode—the mode of the camera module 180 included in the electronic device 101 corresponds to. Preview mode can be a mode in which the screen captured by the image sensor is provided to the user as a preview when the camera module is not performing photo or video capture. Photo mode can be a mode in which the camera module takes a photo. Video mode can be a mode in which the camera module captures video.

[0071] External environmental conditions can indicate whether the external environment of an electronic device corresponds to high or low illumination. High illumination indicates that the luminance value (BV) corresponding to lux is not less than a certain threshold. Low illumination indicates that the BV is less than a certain threshold.

[0072] The image sensor may not directly recognize camera operating settings and external environmental conditions, but it can receive information recognized by the processor 120 from the processor of the electronic device.

[0073] In step 620, the image sensor determines its operation and the signal to be output based on the camera operation settings and / or external environmental conditions identified in step 610. The operation and output signal of the image sensor based on the identified camera operation settings and / or external environmental conditions will be described in detail below with reference to Table 1.

[0074] Table 1

[0075]

[0076] In Table 1, the first camera operation settings, the second camera operation settings, and the third camera operation settings can each be different modes of the camera module 180. For example, the first camera operation setting can be a preview mode; the second camera operation setting can be a video mode; and the third camera operation setting can be a photo mode.

[0077] In Table 1, the first external environmental condition and the second external environmental condition can indicate different conditions of the surrounding environment of the camera module 180. For example, the first external environmental condition can be a high-light condition; the second external environmental condition can be a low-light condition.

[0078] In Table 1, depending on the identified camera operating settings and / or external environmental conditions, the operation of the image sensor can indicate which signal from the image sensor is read out by the image sensor.

[0079] In Table 1, AF information can be information about autofocus and can represent AF information formed by the image sensor depending on the identified camera operating settings and / or external environmental conditions and output to the processor 120.

[0080] In Table 1, the output signal can be a signal output by the display device 160 of the electronic device, and can represent an output signal formed by the image sensor and output to the processor 120 depending on the identified camera operation settings and / or external environmental conditions.

[0081] Referring to Table 1, based on the first camera operation settings and the first external environmental conditions, the image sensor can detect the first vertical region signal, the second vertical region signal, the third vertical region signal, and the fourth vertical region signal, and can generate and output first AF information, second AF information, and a first output signal. In the following text, reference will be made to... Figure 7 and Figure 8 Describe in detail the vertical region signal, AF information, and output signal.

[0082] refer to Figure 7 and Figure 8 The image sensor 300 includes a synthetic signal forming unit 701, a parallax calculation unit 702, and a re-mosaic processing unit 703. Figure 7 The synthesized signal forming unit 701, disparity calculation unit 702, and re-mosaic processing unit 703 are shown as a block diagram of hardware included in the image sensor 300. However, the synthesized signal forming unit 701, disparity calculation unit 702, and re-mosaic processing unit 703 can be implemented in software.

[0083] Based on the first camera operation settings and the first external environmental conditions, the image sensor 300 can detect the first vertical region signal, the second vertical region signal, the third vertical region signal, and the fourth vertical region signal.

[0084] Based on the first camera operation settings and the first external environmental conditions, the image sensor 300 can detect the first vertical region signal 816 (which is the signal of light incident on the first photodiode 811 and the second photodiode 812 through the first microlens 815 of the first unit pixel 810) through the scanning circuit, and can send the first vertical region signal 816 to the composite signal forming unit 701 of the image sensor 300.

[0085] In the same manner, based on the first camera operation setting mode and the first external environmental conditions, the image sensor 300 can send the third vertical region signal 826 (which is the signal of light incident on the fifth photodiode 821 and the sixth photodiode 822 through the second microlens 825 of the second unit pixel 820) to the composite signal forming unit 701.

[0086] In the same manner, based on the first camera operation setting mode and the first external environmental conditions, the image sensor 300 can send the second vertical region signal 817 (which is the signal of light incident on the third photodiode 813 and the fourth photodiode 814) to the composite signal forming unit 701.

[0087] In the same manner, based on the first camera operation setting mode and the first external environmental conditions, the image sensor 300 can send the fourth vertical region signal 827 (which is the signal of light incident on the seventh photodiode 823 and the eighth photodiode 824) to the composite signal forming unit 701.

[0088] The reason why the image sensor 300 does not detect the signals of each of the first photodiode 811, second photodiode 812, third photodiode, fourth photodiode, fifth photodiode, and sixth photodiode, but instead detects the signals by grouping the photodiodes in each region, is likely because, since the preview mode requires real-time output to the screen, the power consumption of the electronic device may be excessive when outputting the screen at high resolution in a high-light environment. Therefore, by grouping the photodiodes in each region to detect the signals, the signal detected by the image sensor is reduced by half, thus reducing power consumption.

[0089] Based on the first camera operation settings and the first external environmental conditions, the image sensor 300 can generate first AF information and second AF information, and can output the first AF information and second AF information to the processor 120.

[0090] The image sensor 300's signal synthesis unit 701 can synthesize the received first vertical region signal 816 and the received third vertical region signal 826 to form first AF information.

[0091] The image sensor 300's signal synthesis unit 701 can synthesize the received second vertical region signal 817 and the received fourth vertical region signal 827 to form second AF information.

[0092] The image sensor 300 can output the first AF information and the second AF information formed to the processor 120.

[0093] The fact that the image sensor 300 can output only the first AF information and the second AF information (which is horizontal focus information) to the processor 120 can be attributed to the fact that focusing is easier to adjust in high-light environments, thus reducing the power consumption of the electronic device by adjusting the focus using only the horizontal focus information and not the vertical focus information. Therefore, an image sensor that outputs horizontal focus information to the processor has been described. However, the image sensor can also output only the vertical focus information to the processor. Vertical focus information will be described later.

[0094] Based on the first camera operation settings and the first external environmental conditions, the image sensor 300 can generate a first output signal to output to the processor 120. Based on the first camera operation settings and the first external environmental conditions, the image sensor 300 can generate a first output signal that is the sum of a first vertical region signal 816 and a second vertical region signal 817 of the first unit pixel 810, to output to the processor. Based on the first camera operation settings and the first external environmental conditions, the image sensor 300 can generate an output signal corresponding to the first output signal of each of the unit pixels included in the pixel array 332, to output to the processor.

[0095] The fact that the image sensor 300 can output multiple photodiodes included in a unit pixel as a single signal, without having to process the signal of each of the multiple photodiodes included in a unit pixel, can reduce the power consumption of electronic devices, even if the resolution is reduced, since resolution is of low importance in preview mode.

[0096] Returning to Table 1, based on the first camera operation settings and the second external environmental conditions, the image sensor 300 can detect the first pixel signal, the second pixel signal, the third pixel signal, and the fourth pixel signal of the first unit pixel 810; it can detect the fifth pixel signal, the sixth pixel signal, the seventh pixel signal, and the eighth pixel signal of the second unit pixel 820; and it can generate and output first AF information, second AF information, third AF information, fourth AF information, and a second output signal. In the following text, reference will be made to... Figure 7 and Figure 9 This will be described in detail.

[0097] refer to Figure 7 and Figure 9 Based on the first camera operation settings and the second external environmental conditions, the image sensor 300 can detect the first pixel signal, the second pixel signal, the third pixel signal, and the fourth pixel signal of the first unit pixel 810. The first pixel signal can correspond to the light signal incident on the first photodiode 811. The second pixel signal can correspond to the light signal incident on the second photodiode 812. The third pixel signal can correspond to the light signal incident on the third photodiode 813. The fourth pixel signal can correspond to the light signal incident on the fourth photodiode 814.

[0098] The image sensor 300 can detect the detected first pixel signal, the detected second pixel signal, the detected third pixel signal, and the detected fourth pixel signal through a scanning circuit, and send the detected first pixel signal, the detected second pixel signal, the detected third pixel signal, and the detected fourth pixel signal to the composite signal forming unit 701 of the image sensor 300.

[0099] Based on the first camera operation settings and the second external environmental conditions, the image sensor 300 can detect the fifth pixel signal, the sixth pixel signal, the seventh pixel signal, and the eighth pixel signal of the second unit pixel 820. The fifth pixel signal can correspond to the light signal incident on the fifth photodiode 821. The sixth pixel signal can correspond to the light signal incident on the sixth photodiode 822. The seventh pixel signal can correspond to the light signal incident on the seventh photodiode 823. The eighth pixel signal can correspond to the light signal incident on the eighth photodiode 824.

[0100] The image sensor 300 can detect the detected fifth pixel signal, the detected sixth pixel signal, the detected seventh pixel signal, and the detected eighth pixel signal through a scanning circuit, and send the detected fifth pixel signal, the detected sixth pixel signal, the detected seventh pixel signal, and the detected eighth pixel signal to the composite signal forming unit 701 of the image sensor 300.

[0101] Based on the first camera operation settings and the second external environmental conditions, the image sensor 300 can generate first AF information, second AF information, third AF information and fourth AF information, and output the first AF information, second AF information, third AF information and fourth AF information to the processor 120.

[0102] The image sensor 300's signal synthesis unit 701 can synthesize the received first pixel signal, the received second pixel signal, the received fifth pixel signal, and the received sixth pixel signal to form first AF information.

[0103] The image sensor 300's signal synthesis unit 701 can synthesize the received third pixel signal, the received fourth pixel signal, the received seventh pixel signal, and the received eighth pixel signal to form second AF information.

[0104] The image sensor 300's signal synthesis unit 701 can synthesize the received first pixel signal, the received third pixel signal, the received fifth pixel signal, and the received seventh pixel signal to form third AF information.

[0105] The image sensor 300's signal synthesis unit 701 can synthesize the received second pixel signal, the received fourth pixel signal, the received sixth pixel signal, and the received eighth pixel signal to form fourth AF information.

[0106] The image sensor 300 can output the first AF information, the second AF information, the third AF information and the fourth AF information formed to the processor 120.

[0107] The fact that the image sensor 300 can generate all of the first and second AF information as horizontal focus information and the third and fourth AF information as vertical focus information, and output the first, second, third and fourth AF information to the processor 120, allows the vertical and horizontal focus information to complement each other, so that focus can be adjusted by using both the vertical and horizontal focus information, since it may be difficult to adjust focus in low-light environments.

[0108] Based on the first camera operation settings and the second external environmental conditions, the image sensor 300 can generate a second output signal to output to the processor 120. Based on the first camera operation settings and the second external environmental conditions, the image sensor 300 can generate a second output signal obtained by summing the first pixel signal, the second pixel signal, the third pixel signal, and the fourth pixel signal, and output the summation result to the processor. Based on the first camera operation settings and the second external environmental conditions, the image sensor 300 can generate an output signal corresponding to the second output signal of each of the unit pixels included in the pixel array 332.

[0109] The reason why the image sensor 300 sums the signals of multiple photodiodes included in a unit pixel and outputs the sum as a single signal (second output signal) may be because the resolution of the displayed screen is of little importance in preview mode.

[0110] Returning to Table 1, based on the second camera operating settings and the first external environmental conditions, the image sensor 300 can detect the first pixel signal, second pixel signal, third pixel signal, and fourth pixel signal of the first unit pixel 810; it can detect the fifth pixel signal, sixth pixel signal, seventh pixel signal, and eighth pixel signal of the second unit pixel 820; and it can generate and output first AF information, second AF information, third AF information, fourth AF information, and a third output signal. The description of the operation and AF information output of the image sensor 300 based on the second camera operating settings and the first external environmental conditions is the same as the description under the first camera operating settings and second external environmental conditions, and therefore will be omitted. The third output signal may correspond to a Bayer pattern image. In the following text, reference will be made to... Figure 7 and Figure 9 Describe the third output signal in detail.

[0111] refer to Figure 7 and Figure 9The pixel array 910 of the image sensor 300 may include multiple photodiodes, including a first photodiode 811, a second photodiode 812, a third photodiode 813, a fourth photodiode 814, a fifth photodiode 821, a sixth photodiode 822, a seventh photodiode 823, and an eighth photodiode 824. Additional photodiodes may also be included among the multiple photodiodes. Based on a second camera operation setting and a first external environmental condition, the image sensor 300 can detect first pixel signals, second pixel signals, third pixel signals, fourth pixel signals, fifth pixel signals, sixth pixel signals, seventh pixel signals, and eighth pixel signals from the multiple photodiodes including first photodiode 811, second photodiode 812, third photodiode 813, fourth photodiode 814, fifth photodiode 821, sixth photodiode 822, seventh photodiode 823, and eighth photodiode 824, respectively.

[0112] The heavy mosaic processing unit 703 of the image sensor 300 can form a Bayer pattern image 920 by converting the detected first pixel signal, the detected second pixel signal, the detected third pixel signal, the detected fourth pixel signal, the detected fifth pixel signal, the detected sixth pixel signal, the detected seventh pixel signal, and the detected eighth pixel signal.

[0113] A Bayer pattern image can represent a pattern in which, depending on human visual characteristics, green (G) intersects with each of red (R) and blue (B), such that green (G) is 50% and each of red (R) and blue (B) is 25%. Furthermore, when the image signal processor 260 performs image signal processing (ISP), it may be necessary to convert the signal detected by the image sensor into a Bayer pattern image.

[0114] The process of converting the signals detected by the image sensor (first pixel signal, second pixel signal, third pixel signal, fourth pixel signal, fifth pixel signal, sixth pixel signal, seventh pixel signal, and eighth pixel signal) into a Bayer pattern image 920 may include processes such as rearranging, synthesizing, averaging, weighting, and adjusting the contrast of the edge portions of the signals detected by the image sensor 300. The algorithm applied to the signals detected by the image sensor 300 to form the Bayer pattern image 920 can be referred to as a re-mosaic algorithm. The specific re-mosaic algorithm may vary for each image sensor manufacturer. Algorithms applied to the signals detected by the image sensor to form an image can be collectively referred to as re-mosaic algorithms.

[0115] Based on the second camera operation settings and the first external environmental conditions, the image sensor 300 can generate a third output signal (i.e., Bayer pattern image 920) to output the third output signal to the processor 120.

[0116] The reason why the image sensor 300 can detect the signal of each of the plurality of photodiodes included in a unit pixel to form and output a Bayer pattern image through processing may be because, in video mode, maintaining resolution may be more important than reducing the power consumption of the electronic device. Returning to Table 1, based on the second camera operating settings and the second external environmental conditions, the image sensor 300 can detect the first vertical region signal, the second vertical region signal, the third vertical region signal, and the fourth vertical region signal, and can generate and output first AF information, second AF information, and a first output signal. The description of the operation, AF information, and output signal of the image sensor 300 based on the second camera operating settings and the second external environmental conditions is the same as the description under the first camera operating settings and the first external environmental conditions, and therefore will be omitted.

[0117] When the image sensor 300 is in the second camera operation setting and the second external environment condition, the image sensor 300 can detect signals by grouping multiple photodiodes by region, without needing to detect the signal of each of the multiple photodiodes included in the unit pixel, and the fact that it only outputs the first AF information and the second AF information (which is horizontal focus information) to the processor can reduce detection noise (readout noise) by reducing the signal detected by the image sensor, in order to compensate for the quality of the video in low-light environments, since sufficient exposure time cannot be guaranteed in low-light conditions.

[0118] Returning to Table 1, based on the third camera operating settings and the first external environmental conditions, the image sensor 300 can detect the first pixel signal, the second pixel signal, the third pixel signal, and the fourth pixel signal of the first unit pixel 810; it can detect the fifth pixel signal, the sixth pixel signal, the seventh pixel signal, and the eighth pixel signal of the second unit pixel 820; and it can generate and output a third output signal. The description of the operation and output signal of the image sensor 300 based on the third camera operating settings and the first external environmental conditions is the same as the description under the second camera operating settings and the first external environmental conditions, and therefore this description will be omitted.

[0119] Under the third camera operating settings and the first external environmental conditions, the image sensor 300 may not generate AF information. This is likely because as long as the AF information formed in preview mode is used, there is no need to separately form AF information in photo mode. Furthermore, the fact that the image sensor 300 forms a third output signal (Bayer pattern image) when the image sensor 300 is in the third camera operating settings and the first external environmental conditions allows for the output of high-resolution photos in high-light environments. Referring back to Table 1, based on the third camera operating settings and the second external environmental conditions, the image sensor 300 can detect the first unit pixel signal and the second unit pixel signal, and can output both the first unit pixel signal and the second unit pixel signal.

[0120] When the image sensor 300 is in the third camera operation setting and the second external environment condition, the image sensor 300 can detect the first unit pixel signal, which is the signal corresponding to the first unit pixel 810. Furthermore, the image sensor 300 can detect the second unit pixel signal, which is the signal corresponding to the second unit pixel 820. The image sensor 300 can output the detected first unit pixel signal and the detected second unit pixel signal to the processor. The reason why the image sensor 300 groups and detects the signals of multiple photodiodes included in the unit pixel under the third camera operation setting and the second external environment condition may focus on reducing the power consumption of the electronic device, since image resolution may be meaningless in low-light environments.

[0121] Under third camera operating settings and second external environmental conditions, image sensor 300 may not generate AF information. This is likely because as long as the AF information generated in preview mode is used, there is no need to generate AF information separately in photo mode.

[0122] In the following text, reference will be made to Figure 10 and Figure 11 The output signal of the image sensor is described. Configurations identical to those in the above embodiments can be indicated by the same reference numerals, and their description may be omitted.

[0123] Figure 10 This is a diagram illustrating the first case 1010 and the second case 1040 of the output signal of the image sensor according to an embodiment. Figure 11 Figure 1100 illustrates a method for calculating the parallax of an image sensor according to an embodiment.

[0124] refer to Figure 10The image sensor 300 outputs a first output signal 1011 or a second output signal 1021 to the processor 120. First, the case where the image sensor 300 outputs the first output signal 1011 will be described. The first output signal 1011 can be a signal for outputting a single frame. Under the conditions of a first camera operation setting and a second external environmental condition, or under the conditions of a second camera operation setting and a first external environmental condition, the first output signal 1011 can be a signal that allows the image sensor 300 to output a single frame.

[0125] The image sensor 300 may, after transmitting all image signals including partial signals 1012, 1015, and 1018 of a single frame, not transmit all horizontal focus information (horizontal Y) including partial signals 1013, 1016, and 1019, and all vertical focus information (vertical Y) including partial signals 1014, 1017, and 1020, but instead transmit signals alternately, such as partial signals 1012 of the image signal, partial signals 1013 of the horizontal focus information, partial signals 1014 of the vertical focus information, partial signals 1015 of the image signal, partial signals 1016 of the horizontal focus information, and partial signals 1017 of the vertical focus information. As described above, the horizontal focus information may include first AF information and second AF information. Furthermore, the vertical focus information may include third AF information and fourth AF information.

[0126] Each of the signals 1012 to 1020 in a single frame can be divided into a virtual channel (VC) and data type (DT) of a separate signal specification (e.g., Mobile Industrial Processor Interface (MIPI)) and can be sent to the processor. Examples of VC and DT for each signal are shown in Table 2 below.

[0127] Table 2

[0128] Virtual Channel (VC) Data Type (DT) Image signal 0 0x12 Horizontal Focused Information (Horizontal Y) 1 0x12 Vertical focus information (vertical Y) 2 0x12 Processing parallax information (vertical parallax) 3 0x12

[0129] The vertical parallax information (vertical parallax) will be described later in Table 2.

[0130] The following describes the case where the image sensor 300 outputs a second output signal 1021. The second output signal 1021 can be a signal for outputting a single frame. Under the conditions of the first camera operation setting and the second external environmental conditions, or under the conditions of the second camera operation setting and the first external environmental conditions, the second output signal 1021 can be a signal that allows the image sensor 300 to output a single frame.

[0131] The image sensor 300 can alternately transmit signals, such as a portion of the image signal 1022, a portion of the horizontal focus information signal 1023, a portion of the vertical parallax information signal 1024 (vertical parallax), a portion of the image signal 1025, a portion of the horizontal focus information signal 1026, and a portion of the vertical parallax information signal 1027.

[0132] In the following text, reference will be made to Figure 10 and Figure 11 The parallax information is described in detail. Configurations identical to those in the above embodiments can be denoted by the same reference numerals, and their description may be omitted.

[0133] The image sensor 300 can form the left signal image 1120 by synthesizing the first vertical region signal 816 and the third vertical region signal 826. That is, the image sensor 300 can form the left signal image 1120 based on the first AF information.

[0134] Furthermore, the image sensor 230 can form the right signal image 1121 by synthesizing the second vertical region signal 817 and the fourth vertical region signal 827. That is, the image sensor 300 can form the right signal image 1121 based on the second AF information.

[0135] The disparity calculation unit 702 of the image sensor 230 can calculate horizontal disparity information (horizontal disparity), which is the disparity between the left signal image (including partial signals 1013, 1016, or 1019) and the right signal image (including partial signals 1013, 1016, or 1019). Horizontal disparity can be the distance between the center line c1 of the left signal image (including partial signals 1013, 1016, or 1019) and the center line c2 of the right signal image (including partial signals 1013, 1016, or 1019). A larger horizontal disparity may indicate a greater degree of defocusing in the image captured by the image sensor 300. When the center line c1 of the left signal image, which includes partial signals 1013, 1016, or 1019, completely overlaps with the center line c2 of the right signal image, which also includes partial signals 1013, 1016, or 1019, the horizontal parallax 1130 is 0. This may mean that the image sensor 300 is in focus. Similarly, the parallax calculation unit 702 of the image sensor 230 can calculate the vertical parallax information (vertical parallax) including partial signals 1024, 1027, or 1030, which is the parallax between the upper signal image, which includes partial signals 1014, 1017, or 1020, and the lower signal image, which includes partial signals 1014, 1017, or 1020.

[0136] Back Figure 10 The image sensor 300 can output vertical parallax information (vertical parallax) including partial signals 1024, 1027, or 1030 to the processor, instead of vertical focus information (vertical Y) including partial signals 1014, 1017, or 1020.

[0137] The following will refer to Figure 12 A detailed description of an embodiment in which the pixel array of an image sensor includes a 3x3 photodiode array as the unit pixel.

[0138] Figure 12 Figure 1200 illustrates the unit pixels included in the pixel array of an image sensor according to an embodiment. The operation of the image sensor is the same as in the embodiments described above; therefore, the definition of the vertical region signal and AF information will only be described when the unit pixels include a 3x3 photodiode array.

[0139] refer to Figure 12 Each of the multiple unit pixels includes 3x3 photodiodes. For example, the first unit pixel 1210 includes a first photodiode 1211, a second photodiode 1212, a third photodiode 1213, a fourth photodiode 1214, a fifth photodiode 1215, a sixth photodiode 1216, a seventh photodiode 1217, an eighth photodiode 1218, and a ninth photodiode 1219 arranged to overlap with the first microlens 1231. The description of the first unit pixel 1210 can also be applied to the second unit pixel 1220.

[0140] The first vertical region signal of the first unit pixel 1210 can be represented by the signals detected in the first photodiode 1211, the second photodiode 1212, the third photodiode 1213, the fourth photodiode 1214, the fifth photodiode 1215, and the sixth photodiode 1216. The second vertical region of the first unit pixel 1210 may include the fourth photodiode 1214, the fifth photodiode 1215, the sixth photodiode 1216, the seventh photodiode 1217, the eighth photodiode 1218, and the ninth photodiode 1219.

[0141] The third vertical region of the second unit pixel 1220 may include the tenth photodiode 1221, the eleventh photodiode 1222, the twelfth photodiode 1223, the thirteenth photodiode 1224, the fourteenth photodiode 1225, and the fifteenth photodiode 1226. The fourth vertical region of the second unit pixel 1220 may include the thirteenth photodiode 1224, the fourteenth photodiode 1225, the fifteenth photodiode 1226, the sixteenth photodiode 1227, the seventeenth photodiode 1228, and the eighteenth photodiode 1229.

[0142] The first AF information can be formed based on the first vertical region signal of the first unit pixel 1210 and the third vertical region signal of the second unit pixel 1220. The second AF information can be formed based on the second vertical region signal of the first unit pixel 1210 and the fourth vertical region signal of the second unit pixel 1220.

[0143] A unit pixel is not limited to 2x2 or 3x3 photodiodes. For example, an image sensor may include nxn photodiodes per unit pixel.

[0144] According to embodiments of this disclosure, an electronic device may include an image sensor comprising a first unit pixel and a second unit pixel. The first unit pixel includes a first microlens facing each other and a plurality of first photodiodes, wherein a first color filter is inserted between the plurality of first photodiodes. The second unit pixel includes a second microlens facing each other and a plurality of second photodiodes, wherein a second color filter is inserted between the plurality of second photodiodes. The device also includes a camera module comprising the image sensor and a processor operatively connected to the image sensor. The first unit pixel includes a first photodiode, a second photodiode, a third photodiode, and a fourth photodiode arranged in a square shape such that the horizontal number of photodiodes is equal to the vertical number of photodiodes. The second unit pixel includes a fifth photodiode, a sixth photodiode, a seventh photodiode, and an eighth photodiode arranged in a square shape such that the horizontal number of photodiodes is equal to the vertical number of photodiodes. The image sensor can identify the camera module's operating settings and external environmental conditions. When it is identified that the operating setting is preview mode and the external environmental condition is a high-illuminance environment, the image sensor identifies a first region signal corresponding to the signals of the first photodiode and the second photodiode, which are connected in series and included in a first unit pixel. The image sensor also identifies a second region signal corresponding to the signals of the fifth photodiode and the sixth spot diode, which are included in the second unit pixel and correspond to the position of the first photodiode and the sixth spot diode, respectively. The image sensor can form first AF information based on the first region signal and the second region signal.

[0145] When the operation setting is identified as preview mode and the external environment is a high-illuminance environment, the image sensor can identify a third region signal corresponding to the signals of the third photodiode and the fourth photodiode, which are connected in series and included in the first unit pixel, and a fourth region signal corresponding to the signals of the seventh photodiode and the eighth photodiode in the second unit pixel. The third region signal and the fourth region signal can be used to form second AF information, and the formed first AF information and the formed second AF information can be output to the processor.

[0146] The image sensor can output an image signal of a preview image to the processor. This image signal may include a signal obtained by synthesizing a first region signal and a second region signal, as well as a signal obtained by synthesizing a third region signal and a fourth region signal.

[0147] When the operation setting is identified as preview mode and the external environmental conditions are low-light conditions, the image sensor can form first AF information based on the first pixel signal of the first photodiode, the second pixel signal of the second photodiode, the fifth pixel signal of the fifth photodiode, and the sixth pixel signal of the sixth photodiode; it can form second AF information based on the third pixel signal of the third photodiode, the fourth pixel signal of the fourth photodiode, the seventh pixel signal of the seventh photodiode, and the eighth pixel signal of the eighth photodiode; it can form third AF information based on the first pixel signal of the first photodiode, the third pixel signal of the third photodiode, the fifth pixel signal of the fifth photodiode, and the seventh pixel signal of the seventh photodiode; it can form fourth AF information based on the second pixel signal of the second photodiode, the fourth pixel signal of the fourth photodiode, the sixth pixel signal of the sixth photodiode, and the eighth pixel signal of the eighth photodiode; the formed first AF information and the formed second AF information can be output to the processor; and the formed third AF information and the formed fourth AF information can be output to the processor.

[0148] The image sensor outputs an image signal of a preview image to the processor. This image signal may include signals obtained by synthesizing a first pixel signal, a second pixel signal, a third pixel signal, and a fourth pixel signal, as well as signals obtained by synthesizing a fifth pixel signal, a sixth pixel signal, a seventh pixel signal, and an eighth pixel signal.

[0149] When the operating setting is identified as video mode and the external environmental conditions are high illumination, the image sensor can identify the first pixel signal of the first photodiode, the second pixel signal of the second photodiode, the third pixel signal of the third photodiode, the fourth pixel signal of the fourth photodiode, the fifth pixel signal of the fifth photodiode, the sixth pixel signal of the sixth photodiode, the seventh pixel signal of the seventh photodiode, and the eighth pixel signal of the eighth photodiode; it can form a Bayer pattern image by applying a re-mosaic algorithm to the first, second, third, fourth, fifth, sixth, seventh, and eighth pixel signals; and it can output the Bayer pattern image as an image signal to the processor.

[0150] The image sensor can form first AF information based on first pixel signals, second pixel signals, fifth pixel signals, and sixth pixel signals; it can form second AF information based on third pixel signals, fourth pixel signals, seventh pixel signals, and eighth pixel signals; it can form third AF information based on first pixel signals, third pixel signals, fifth pixel signals, and seventh pixel signals; it can form fourth AF information based on second pixel signals, fourth pixel signals, sixth pixel signals, and eighth pixel signals; it can output the formed first AF information and the formed second AF information to the processor; and it can output the formed third AF information and the formed fourth AF information to the processor.

[0151] When the operation setting is identified as video mode and the external environmental conditions are low-light environment, the image sensor can identify a first region signal corresponding to the signals of the first photodiode and the second photodiode, identify a second region signal corresponding to the signals of the fifth photodiode and the sixth photodiode, form first AF information based on the first region signal and the second region signal, identify a third region signal corresponding to the signals of the third photodiode and the fourth photodiode, identify a fourth region signal corresponding to the signals of the seventh photodiode and the eighth photodiode, form second AF information based on the third region signal and the fourth region signal, and output the formed first AF information and the formed second AF information to the processor.

[0152] The image sensor can output image signals of the video captured by the camera module to the processor. These image signals may include signals obtained by synthesizing signals from a first region and a second region, as well as signals obtained by synthesizing signals from a third region and a fourth region.

[0153] When the operating setting is determined to be in camera mode and the external environmental conditions are high-light conditions, the image sensor can identify the first pixel signal of the first photodiode, the second pixel signal of the second photodiode, the third pixel signal of the third photodiode, the fourth pixel signal of the fourth photodiode, the fifth pixel signal of the fifth photodiode, the sixth pixel signal of the sixth photodiode, the seventh pixel signal of the seventh photodiode, and the eighth pixel signal of the eighth photodiode. It can then apply a re-mosaic algorithm to the first, second, third, fourth, fifth, sixth, seventh, and eighth pixel signals to form a Bayer pattern image, and output this Bayer pattern image as an image signal to the processor.

[0154] When the operating setting is set to photo mode and the external environmental conditions are low-light conditions, the image sensor can identify the first unit pixel signal, which is the signal of the first photodiode, the second photodiode, the third photodiode, and the fourth photodiode; it can also identify the second unit pixel signal, which is the signal of the fifth photodiode, the sixth photodiode, the seventh photodiode, and the eighth photodiode; and it can output the image signal including the first unit pixel signal and the second unit pixel signal to the processor.

[0155] According to embodiments of this disclosure, an operating method for an electronic device is provided. The electronic device includes an image sensor comprising a first unit pixel and a second unit pixel. The first unit pixel includes a first microlens and a plurality of photodiodes arranged in a square shape such that the horizontal number of photodiodes is equal to the vertical number of photodiodes. The second unit pixel includes a second microlens facing each other and a plurality of photodiodes arranged in a square shape such that the horizontal number of photodiodes is the same as the vertical number of photodiodes. The method also includes a camera module comprising the image sensor and a processor operably connected to the image sensor. The method may include: identifying operating settings of the camera module and external environmental conditions by the image sensor; and, upon identifying the operating settings... When the operation setting is preview mode and the external environment is a high-light environment, or when the operation setting is identified as video mode and the external environment is a low-light environment, the system identifies a first region signal corresponding to the signals of the first photodiode and the second photodiode, wherein the first photodiode and the second photodiode are connected in series and included in a first unit pixel; identifies a second region signal corresponding to the signals of the fifth photodiode and the sixth photodiode, wherein the fifth photodiode corresponds to the position of the first photodiode and the sixth photodiode corresponds to the position of the second photodiode, wherein the fifth photodiode and the sixth photodiode are included in a second unit pixel; and forms first AF information based on the first region signal and the second region signal.

[0156] When the operation setting is identified as preview mode and the external environment is a high-light environment, or when the operation setting is identified as video mode and the external environment is a low-light environment, the method may further include: identifying a third region signal corresponding to the signals of a third photodiode and a fourth photodiode, the third and fourth photodiodes being connected in series and included in a first unit pixel by an image sensor; identifying a fourth region signal corresponding to the signals of a seventh photodiode and an eighth photodiode, the seventh and eighth photodiodes being included in a second unit pixel by an image sensor; forming second AF information by an image sensor based on the third and fourth region signals; and outputting the formed first AF information and the formed second AF information to a processor by an image sensor.

[0157] The method may further include outputting an image signal of a preview image to a processor from an image sensor. The image signal may include a signal obtained by synthesizing a first region signal and a second region signal, as well as a signal obtained by synthesizing a third region signal and a fourth region signal.

[0158] When the operation setting is identified as preview mode and the external environment is a low-light environment, or when the operation setting is identified as video mode and the external environment is a high-light environment, the method may further include forming first AF information based on the first pixel signal of the first photodiode, the second pixel signal of the second photodiode, the fifth pixel signal of the fifth photodiode, and the sixth pixel signal of the sixth photodiode; forming second AF information based on the third pixel signal of the third photodiode, the fourth pixel signal of the fourth photodiode, the seventh pixel signal of the seventh photodiode, and the eighth pixel signal of the eighth photodiode; forming third AF information based on the first pixel signal of the first photodiode, the third pixel signal of the third photodiode, the fifth pixel signal of the fifth photodiode, and the seventh pixel signal of the seventh photodiode; forming fourth AF information based on the second pixel signal of the second photodiode, the fourth pixel signal of the fourth photodiode, the sixth pixel signal of the sixth photodiode, and the eighth pixel signal of the eighth photodiode; outputting the formed first AF information and the formed second AF information to the processor; and outputting the formed third AF information and the formed fourth AF information to the processor.

[0159] When the operating setting is detected as preview mode and the external environmental conditions are low-light conditions, the image sensor can output an image signal of the preview image to the processor. The image signal may include signals obtained by synthesizing a first pixel signal, a second pixel signal, a third pixel signal, and a fourth pixel signal, as well as signals obtained by synthesizing a fifth pixel signal, a sixth pixel signal, a seventh pixel signal, and an eighth pixel signal.

[0160] When it is identified that the operation setting is video mode and the external environment is a high-light environment, the method may further include applying a re-mosaic algorithm to the first pixel signal, the second pixel signal, the third pixel signal, the fourth pixel signal, the fifth pixel signal, the sixth pixel signal, the seventh pixel signal, and the eighth pixel signal to form a Bayer pattern image, and outputting the Bayer pattern image as an image signal to the processor.

[0161] When it is determined that the operation setting is photo mode and the external environmental conditions are high-light conditions, the method may further include identifying the first pixel signal of the first photodiode, the second pixel signal of the second photodiode, the third pixel signal of the third photodiode, the fourth pixel signal of the fourth photodiode, the fifth pixel signal of the fifth photodiode, the sixth pixel signal of the sixth photodiode, the seventh pixel signal of the seventh photodiode, and the eighth pixel signal of the eighth photodiode; forming a Bayer pattern image by applying a re-mosaic algorithm to the first pixel signal, the second pixel signal, the third pixel signal, the fourth pixel signal, the fifth pixel signal, the sixth pixel signal, the seventh pixel signal, and the eighth pixel signal; and outputting the Bayer pattern image as an image signal to the processor.

[0162] When it is determined that the operation setting is photo mode and the external environmental conditions are low-light environment, the method may further include identifying a first unit pixel signal, wherein the first unit pixel signal is a signal of a first photodiode, a second photodiode, a third photodiode, and a fourth photodiode; identifying a second unit pixel signal, wherein the second unit pixel signal is a signal of a fifth photodiode, a sixth photodiode, a seventh photodiode, and an eighth photodiode; and outputting an image signal including the first unit pixel signal and the second unit pixel signal to a processor.

[0163] It should be understood that the various embodiments of this disclosure and the terminology used in them are not intended to limit the technical features to the specific embodiments disclosed herein; rather, this disclosure should be construed as covering various modifications, equivalents, or alternatives to the embodiments of this disclosure. In the description of the drawings, similar or related components may be represented by similar reference numerals. As used herein, the singular form of a word corresponding to an item may include one or more items unless the context clearly indicates otherwise. In this disclosure, each of the expressions “A or B,” “at least one of A and B,” “at least one of A or B,” “A, B, or C,” “one or more of A, B, and C,” or “one or more of A, B, or C” may include any and all combinations of one or more of the associated listed items. Expressions such as “first,” “second,” “first,” or “second” may be used only for the purpose of distinguishing one component from other components, and not to limit the corresponding component in other respects (e.g., in importance or order). It should be understood that if an element (e.g., the first element) is referred to as “coupled to another element (e.g., the second element),” “coupled to another element (e.g., the second element),” “connected to another element (e.g., the second element),” or “connected to another element (e.g., the second element)”, whether or not the terms “operationally” or “communicatively” are used, it means that the element can be coupled to another element directly (e.g., wired), wirelessly, or via a third element.

[0164] As used in this disclosure, the term "module" can include a unit implemented in hardware, software, or firmware, and is used interchangeably with the terms "logic," "logic block," "component," and "circuit." A "module" can be the smallest unit of an integrated component, or a component thereof. A "module" can be the smallest unit or a component thereof for performing one or more functions. A "module" can include an application-specific integrated circuit (ASIC).

[0165] Various embodiments of this disclosure can be implemented by software (e.g., program 140) including instructions stored in a machine-readable storage medium (e.g., internal memory 136 or external memory 138) readable by the machine (e.g., electronic device 101). For example, a processor (e.g., processor 120) of the machine (e.g., electronic device 101) can invoke instructions from the machine-readable storage medium and execute the invoked instructions. This means that the machine can perform at least one function based on at least one invoked instruction. One or more instructions may include code generated by a compiler or executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, the term "non-transitory" as used herein means that the storage medium is tangible but does not include signals (e.g., electromagnetic waves). The term "non-transitory" does not distinguish between cases where data is permanently stored in the storage medium and cases where data is temporarily stored in the storage medium.

[0166] The methods according to the various embodiments disclosed in this disclosure can be provided as part of a computer program product. The computer program product can be traded as a product between a seller and a buyer. The computer program product can be distributed in the form of a machine-readable storage medium (e.g., a compact disk read-only memory (CD-ROM)) or through an app store (e.g., the Play Store). TM This can be done directly online (e.g., by downloading or uploading) or between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or generated in a machine-readable storage medium (such as the memory of a manufacturer's server, an app store's server, or a relay server).

[0167] Each of the components described above (e.g., a module or program) may include one or more entities. According to various embodiments, at least one or more of the components or operations described above may be omitted, or one or more components or operations may be added. Additionally or alternatively, some components (e.g., modules or programs) may be integrated into a single component. In this case, the integrated component can perform the same or similar functions performed by each corresponding component prior to integration. According to various embodiments, operations performed by modules, programs, or other components may be performed sequentially, in parallel, repeatedly, or heuristically, or at least some operations may be performed in a different order, omitted, or additional operations may be added.

[0168] According to the embodiments disclosed in this specification, high-resolution images can be achieved by applying AF information and image sensor output differently depending on camera operating settings and external environmental conditions.

[0169] In addition, it can provide a variety of effects that can be understood directly or indirectly through the instruction manual.

[0170] Although this disclosure has been specifically shown and described with reference to particular embodiments thereof, those skilled in the art will understand that various changes in form and detail may be made to this disclosure without departing from the spirit and scope of the disclosure as defined by the appended claims and their equivalents.

Claims

1. An electronic device, comprising: An image sensor includes a first unit pixel and a second unit pixel. The first unit pixel includes a first microlens and a first to a fourth photodiode facing the first microlens, wherein a first color filter is inserted between the first microlens and the first to the fourth photodiodes. The second unit pixel includes a second microlens and a fifth to an eighth photodiode facing the second microlens, wherein a second color filter is inserted between the second microlens and the fifth to the eighth photodiodes. Camera module, including image sensor; and The processor is operatively connected to the image sensor. The first to fourth photodiodes are arranged in a square shape, such that the number of horizontal photodiodes is equal to the number of vertical photodiodes. The fifth to eighth photodiodes are arranged in a square shape, such that the number of horizontal photodiodes is equal to the number of vertical photodiodes. Within the corresponding square shape, the position of the fifth photodiode corresponds to the position of the first photodiode, the position of the sixth photodiode corresponds to the position of the second photodiode, the position of the seventh photodiode corresponds to the position of the third photodiode, and the position of the eighth photodiode corresponds to the position of the fourth photodiode. The image sensor identifies the operating mode of the camera module and the external environmental conditions of the camera module. Specifically, when the operating mode is identified as preview mode and the external environmental condition is a high-illuminance environment, where the high-illuminance indicator brightness value is not less than a specific threshold, the image sensor is configured as follows: A first region signal corresponding to the first photodiode and the second photodiode is obtained, wherein the first photodiode and the second photodiode are connected in series. A second region signal corresponding to the third and fourth photodiodes is obtained, wherein the third and fourth photodiodes are connected in series. Obtain the third region signal corresponding to the fifth and sixth photodiodes, which are connected in series. The signal for the fourth region, corresponding to the seventh and eighth photodiodes, is obtained. The seventh and eighth photodiodes are connected in series. First autofocus (AF) information is generated by synthesizing signals from a first region and a third region, and second AF information is generated by synthesizing signals from a second region and a fourth region. The first composite signal is generated by summing the signals from the first region and the second region. The second composite signal is generated by summing the signals from the third region and the fourth region. A first image signal is generated based on the first synthesized signal and the second synthesized signal to create a preview image, and The generated first AF information, the generated second AF information, and the first image signal are output to the processor.

2. The electronic device according to claim 1, wherein, When the operating mode is identified as preview mode and the external environmental conditions are low-light conditions, where low-light indicates a brightness value less than a specific threshold, the image sensor is configured to: The third AF information is generated based on the first pixel signal of the first photodiode, the second pixel signal of the second photodiode, the fifth pixel signal of the fifth photodiode, and the sixth pixel signal of the sixth photodiode. The fourth AF information is generated based on the third pixel signal of the third photodiode, the fourth pixel signal of the fourth photodiode, the seventh pixel signal of the seventh photodiode, and the eighth pixel signal of the eighth photodiode. The fifth AF information is generated based on the first pixel signal of the first photodiode, the third pixel signal of the third photodiode, the fifth pixel signal of the fifth photodiode, and the seventh pixel signal of the seventh photodiode. The sixth AF information is generated based on the second pixel signal of the second photodiode, the fourth pixel signal of the fourth photodiode, the sixth pixel signal of the sixth photodiode, and the eighth pixel signal of the eighth photodiode. The third composite signal is generated by summing the first, second, third, and fourth pixel signals. The fourth composite signal is generated by summing the signals of the fifth, sixth, seventh, and eighth pixels. A second image signal is generated based on the third and fourth synthesized signals to create a preview image, and The generated third AF information, the generated fourth AF information, the generated fifth AF information, the generated sixth AF information, and the second image signal are output to the processor.

3. The electronic device according to claim 1, wherein, When the operating mode is identified as video mode and the external environmental conditions are high-light conditions, the image sensor is configured as follows: Obtain the first pixel signal of the first photodiode, the second pixel signal of the second photodiode, the third pixel signal of the third photodiode, the fourth pixel signal of the fourth photodiode, the fifth pixel signal of the fifth photodiode, the sixth pixel signal of the sixth photodiode, the seventh pixel signal of the seventh photodiode, and the eighth pixel signal of the eighth photodiode; A Bayer pattern image is generated by applying a re-mosaic algorithm to the first, second, third, fourth, fifth, sixth, seventh, and eighth pixel signals; and The Bayer pattern image is output as an image signal to the processor.

4. The electronic device according to claim 3, wherein, The image sensor is configured as follows: The seventh AF information is generated based on the first pixel signal, the second pixel signal, the fifth pixel signal, and the sixth pixel signal; The eighth AF information is generated based on the third pixel signal, the fourth pixel signal, the seventh pixel signal, and the eighth pixel signal; The ninth AF information is generated based on the first pixel signal, the third pixel signal, the fifth pixel signal, and the seventh pixel signal; The tenth AF information is generated based on the second pixel signal, the fourth pixel signal, the sixth pixel signal, and the eighth pixel signal; The generated seventh AF information, eighth AF information, ninth AF information, and tenth AF information are output to the processor.

5. The electronic device according to claim 1, wherein, When the operating mode is identified as video mode and the external environmental conditions are low-light conditions, wherein the low-light indicator brightness value is less than the specific threshold, the image sensor is further configured to: Eleventh AF information is generated based on signals from the first and second regions. The twelfth AF information is generated based on the signals from the third and fourth regions, and The generated eleventh AF information and the generated twelfth AF information are output to the processor.

6. The electronic device according to claim 5, wherein, The image sensor is also configured to: Generate a third image signal from the video captured by the camera module; The third image signal of the video captured by the camera module is output to the processor, and The third image signal includes a first composite signal and a second composite signal.

7. The electronic device according to claim 1, wherein, When the operating mode is identified as photographic mode and the external environmental conditions are high-light conditions, the image sensor is configured as follows: Obtain the first pixel signal of the first photodiode, the second pixel signal of the second photodiode, the third pixel signal of the third photodiode, the fourth pixel signal of the fourth photodiode, the fifth pixel signal of the fifth photodiode, the sixth pixel signal of the sixth photodiode, the seventh pixel signal of the seventh photodiode, and the eighth pixel signal of the eighth photodiode; A Bayer pattern image is generated by applying a re-mosaic algorithm to the first, second, third, fourth, fifth, sixth, seventh, and eighth pixel signals; and The Bayer pattern image is output as an image signal to the processor.

8. The electronic device according to claim 1, wherein, When the operating mode is identified as photo mode and the external environmental conditions are low-light conditions, where low-light indicates a brightness value less than a specific threshold, the image sensor is configured to: Obtain the first unit pixel signal, which is the signal of the first photodiode, the second photodiode, the third photodiode, and the fourth photodiode; Obtain the second unit pixel signal, and the signals from the fifth, sixth, seventh, and eighth photodiodes of the second unit pixel signal; and The image signal, including the first unit pixel signal and the second unit pixel signal, is output to the processor.

9. An operating method of an electronic device, the electronic device comprising an image sensor, the image sensor comprising a first unit pixel and a second unit pixel, the first unit pixel comprising a first microlens and a first to a fourth photodiode, wherein the first microlens faces the first to the fourth photodiodes and the first to the fourth photodiodes are arranged in a square shape such that the horizontal number of photodiodes is equal to the vertical number of photodiodes, the second unit pixel comprising a second microlens and a fifth to an eighth photodiode, wherein the second microlens faces the fifth to the eighth photodiodes and the fifth to the eighth photodiodes are arranged in a square shape such that the horizontal number of photodiodes is equal to the vertical number of photodiodes, wherein... In the corresponding square shape, the position of the fifth photodiode corresponds to the position of the first photodiode, the position of the sixth photodiode corresponds to the position of the second photodiode, the position of the seventh photodiode corresponds to the position of the third photodiode, and the position of the eighth photodiode corresponds to the position of the fourth photodiode; including a camera module with an image sensor; The method includes a processor operably connected to an image sensor, and the method further includes: The image sensor identifies the operating mode of the camera module and external environmental conditions; and When the operating mode is identified as preview mode and the external environment is a high-illuminance environment, the high-illuminance indicator brightness value is not less than a specific threshold. The image sensor obtains a first region signal corresponding to the first photodiode and the second photodiode, wherein the first photodiode and the second photodiode are connected in series with each other and included in the first unit pixel; The image sensor obtains a second region signal corresponding to the third photodiode and the fourth photodiode, which are connected in series with each other and included in the first unit pixel. The image sensor obtains a third region signal corresponding to the fifth and sixth photodiodes, wherein the fifth and sixth photodiodes are connected in series and included in the second unit pixel; and The image sensor obtains a fourth region signal corresponding to the seventh photodiode and the eighth photodiode, wherein the seventh photodiode and the eighth photodiode are connected in series with each other and included in the second unit pixel; The image sensor generates first autofocus (AF) information by synthesizing signals from a first region and a third region. The image sensor generates second AF information by synthesizing signals from the second and fourth regions. The image sensor generates a first composite signal by summing the signals from the first region and the second region. The image sensor generates a second synthesized signal by summing the signals from the third region and the fourth region. The first image signal generated by the image sensor based on the first synthesized signal and the second synthesized signal to create a preview image, and The image sensor outputs the generated first AF information, the generated second AF information, and the first image signal to the processor.

10. The method according to claim 9, wherein, When the operation mode is identified as preview mode and the external environmental conditions are low-light conditions, or when the operation mode is identified as video mode and the external environmental conditions are high-light conditions, the method further includes: The third AF information is generated by the image sensor based on the first pixel signal of the first photodiode, the second pixel signal of the second photodiode, the fifth pixel signal of the fifth photodiode, and the sixth pixel signal of the sixth photodiode; The fourth AF information is generated by the image sensor based on the third pixel signal of the third photodiode, the fourth pixel signal of the fourth photodiode, the seventh pixel signal of the seventh photodiode, and the eighth pixel signal of the eighth photodiode; The image sensor generates the fifth AF information based on the first pixel signal of the first photodiode, the third pixel signal of the third photodiode, the fifth pixel signal of the fifth photodiode, and the seventh pixel signal of the seventh photodiode. The image sensor generates the sixth AF information based on the second pixel signal of the second photodiode, the fourth pixel signal of the fourth photodiode, the sixth pixel signal of the sixth photodiode, and the eighth pixel signal of the eighth photodiode; The third composite signal is generated by the image sensor by summing the first pixel signal, the second pixel signal, the third pixel signal, and the fourth pixel signal. The fourth composite signal is generated by the image sensor by summing the signals of the fifth, sixth, seventh, and eighth pixels. A second image signal generated by an image sensor based on a third and fourth synthesized signal to create a preview image, and The image sensor outputs the generated third and fourth AF information to the processor; and The image sensor outputs the generated fifth AF information, the generated sixth AF information, and the second image signal to the processor.

Images