Camera assembly and driving method therefor, and electronic device and driving method therefor

Abstract

Embodiments of the present application relate to the technical field of electronics, and provide a camera assembly and a driving method therefor, and an electronic device and a driving method therefor, for use in providing an optimization scheme of integrating a proximity light sensor in an electronic device. The camera assembly comprises a camera module and an invisible light source, and the detection of invisible light is completed by the camera module. The camera module comprises an image sensor, and the image sensor is used for outputting a control signal; the invisible light source is used for emitting invisible light in response to the control signal; the image sensor is used for acquiring, in response to the control signal, first visible light information on the basis of visible light entering a first area; the image sensor is further used for acquiring, in response to the control signal, ambient light information on the basis of ambient light entering a second area. The camera assembly has both a photographing function and the detection function of the proximity light sensor.

Description

Camera assembly and driving method thereof, electronic device and driving method thereof

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on August 18, 2023, with application number 202311052768.9 and application name “Camera assembly and driving method thereof, electronic device and driving method thereof”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of electronic technology, and in particular to a camera assembly and a driving method thereof, an electronic device and a driving method thereof. Background Art

[0003] In recent years, optoelectronic technology has been increasingly used in various fields, including light sensors. Proximity light sensors are a common type of photoelectric sensor with a wide range of applications.

[0004] For example, a proximity sensor can be used to detect the call state to reduce accidental operation of the electronic device by the ear or hand in such scenarios. A proximity sensor can be used to detect the screen-off (swing) state to enable the user to control the electronic device without touching the electronic device with their hands. A proximity sensor can also be used to detect the storage state (in a pocket or bag) to activate the anti-accidental touch function.

[0005] However, how to make an electronic device include a proximity light sensor without affecting the performance of the electronic device and the proximity light sensor has become a difficult problem that troubles those skilled in the art.

[0006] Summary of the Invention

[0007] Embodiments of the present application provide a camera assembly and a driving method thereof, an electronic device and a driving method thereof, for providing an optimized solution for integrating a proximity light sensor in an electronic device.

[0008] To achieve the above objectives, this application adopts the following technical solutions:

[0009] In a first aspect of an embodiment of the present application, a camera assembly is provided, which has both a camera function and a proximity light sensor detection function. The camera assembly includes a camera module and an invisible light source, and the invisible light detection is performed by the camera module. The camera module includes a structural member, a filter layer, an image sensor, and a substrate. The structural member is cylindrical and is arranged to form an enclosed space. One end of the structural member is a light inlet for the camera assembly, and the other end of the structural member is buckled onto the substrate. The filter layer and the image sensor are located within the enclosed space. The light inlet is used to allow ambient light incident on the camera module to enter the enclosed space. The filter layer is located between the image sensor and the light inlet. The filter layer is used to transmit visible light in the ambient light and block invisible light in the ambient light. The image sensor includes a first area and a second area. The projection of the filter layer on the image sensor overlaps with the first area. The first area is used to receive visible light, and the second area is used to receive ambient light. The image sensor is used to output a control signal. The invisible light source is located outside the enclosed space and is used to emit invisible light in response to the control signal. The image sensor is used to obtain first visible light information based on visible light in the first ambient light incident on the first area in response to the control signal. The image sensor is also used to obtain ambient light information based on second ambient light incident on the second area in response to the control signal. The ambient light information includes second visible light information and invisible light information.

[0010] The camera assembly provided by the embodiment of the present application includes a camera module. The first area of ​​the image sensor can obtain visible light information in the ambient light, allowing the camera assembly to function normally as a camera. On this basis, the camera assembly also includes an invisible light source. The invisible light emitted by the invisible light source is reflected by an object, mixed with the ambient light, and then enters the image sensor of the camera module through the light inlet of the camera module. After being exposed by the second area of ​​the image sensor, ambient light information is generated. The ambient light information includes invisible light information corresponding to the reflected invisible light, allowing the camera assembly to function as a proximity light sensor. Moreover, the image sensor is arranged in an enclosed space, and the invisible light source is arranged outside the enclosed space. The invisible light source and the image sensor are separated by a structural member. This can achieve optical isolation between the light receiver and the light source, prevent light emitted by the invisible light source from crosstalking to the area where the image sensor is located, and ensure the detection effect of the image sensor. Therefore, the camera assembly can achieve the same effect as a camera and a proximity light sensor that are independently provided. On this basis, the light inlet of the camera module serves as the light inlet area for invisible light, eliminating the need to set up a separate light inlet required for the proximity light sensor. That is to say, the camera assembly provided in the embodiment of the present application has the functions of a camera and a proximity light sensor integrated inside, but only one light inlet is needed to receive light from the outside. When the camera assembly is applied to an electronic device, there is no need to increase the holes required for the incidence of invisible light, and the number of camera holes in the screen stack in the electronic device can be reduced. Therefore, even if the camera hole in the screen stack is made to pass through the entire screen stack in order to improve the transmittance of the camera hole and enhance the detection effect of invisible light, the reliability of the screen stack can still be improved, the display visual effect and screen-to-body ratio can be enhanced, and the internal space of the electronic device can be saved. In addition, the invisible light source emits invisible light, and the image sensor obtains visible light information and ambient light information, all in response to the same control signal, so that the delay of invisible light detection is low.

[0011] In one possible implementation, the control signal includes a timing signal that can be used to control the camera assembly to periodically detect whether an object is approaching the electronic device including the camera assembly, thereby enabling timely status adjustments to be made to the electronic device.

[0012] In one possible implementation, the image sensor further includes a third region, with the first region located within the third region and the second region located within the third region and outside the first region. The third region is the area formed on the image sensor by light entering the camera module through the light inlet. This provides a method for the image sensor to implement invisible light exposure, making it feasible for the image sensor to have both invisible light exposure and other functions.

[0013] In one possible implementation, an image sensor includes multiple first photosensitive cells, multiple second photosensitive cells, and a receiving circuit. The multiple first photosensitive cells are located in a first region and are used for exposure to visible light. The multiple second photosensitive cells are located in a second region and are used for exposure to ambient light. Both the multiple first photosensitive cells and the second photosensitive cells are coupled to the receiving circuit. Using the same receiving circuit to receive and process exposure information generated by the first and second photosensitive cells can simplify the structure of the image sensor.

[0014] In one possible implementation, the filter layer is further configured to transmit a second ambient light. By configuring the properties of the fourth and fifth regions of the filter layer to match the image sensor design, the overall camera assembly can maintain the size of the camera module, integrating the proximity sensor functionality without changing the spatial layout of the camera module.

[0015] In a possible implementation, the filter layer further includes an isolation region, which is located between the fourth region and the fifth region. By providing the isolation region, interference between visible light and invisible light can be isolated.

[0016] In one possible implementation, the camera assembly further includes a light guide, through which the invisible light emitted by the invisible light source exits the camera assembly. Providing the light guide allows more light information emitted by the invisible light source to be directed to the light exit area, thereby improving the utilization rate of the light information.

[0017] In one possible implementation, the camera assembly further includes a light guide, which includes a light outlet portion that surrounds at least a portion of the light inlet. This allows the invisible light outlet and the camera module's light inlet to correspond to the same camera aperture on the electronic device, reducing the number of camera apertures on the electronic device.

[0018] In one possible implementation, the invisible light source is disposed on a substrate; the structural member includes a light source accommodating area, which is spaced apart from the surrounding space, and the invisible light source is located within the light source accommodating area. By providing a light source accommodating area for accommodating the invisible light source, more invisible light emitted by the invisible light source can be directed to the light output area, thereby improving the utilization rate of optical information.

[0019] In one possible implementation, the invisible light source is disposed on a substrate; the invisible light source is located outside the structural member. This design allows for a compact structural member and a lightweight camera assembly. Furthermore, the location of the invisible light source outside the structural member eliminates the need for a light source accommodation area within the structural member, simplifying the structural member and reducing manufacturing costs.

[0020] A second aspect of the embodiments of the present application provides a driving method for driving the camera assembly according to any one of the first aspects, the driving method comprising: an image sensor outputting a control signal; an invisible light source emitting invisible light in response to the control signal; the image sensor acquiring first visible light information based on visible light in first ambient light incident on a first region in response to the control signal; and the image sensor further acquiring ambient light information based on second ambient light incident on a second region in response to the control signal. The beneficial effects of the driving method provided in the embodiments of the present application are the same as those of the camera assembly and are not further described here.

[0021] In a possible implementation, the control signal includes a timing signal.

[0022] According to a third aspect of an embodiment of the present application, an electronic device is provided, comprising a camera assembly and a system-on-chip; the system-on-chip is coupled to an image sensor of the camera assembly; the camera assembly comprises any one of the camera assemblies of the first aspect; the system-on-chip is used to control the image sensor to output a control signal, and is also used to receive ambient light information output by the image sensor, and determine whether there is an object approaching the electronic device based on the ambient light information.

[0023] The electronic device provided in the embodiment of the present application includes the camera assembly of the first aspect, and its beneficial effects are the same as those of the camera assembly, which will not be repeated here.

[0024] In one possible implementation, during a call: the image sensor is configured to obtain first visible light information based on visible light within the first ambient light incident on the first area in response to a control signal; the image sensor is further configured to obtain ambient light information based on second ambient light incident on the second area in response to a control signal while the invisible light source emits invisible light in response to the control signal; and the system-on-chip is configured to determine whether an object is approaching the electronic device based on the first visible light information and the invisible light information within the ambient light information. By determining whether an object is approaching the electronic device, scenarios such as placing the electronic device to one's ear for a call, where close contact without display manipulation is not required, can be identified. This can help the electronic device minimize accidental manipulation of the display by the ear or hand in such scenarios, thereby improving power efficiency.

[0025] In one possible implementation, during the screen-off wake-up process, the image sensor is configured to, in response to a control signal, obtain first visible light information based on visible light within the first ambient light incident on the first area. The image sensor is also configured to, in response to a control signal, obtain ambient light information based on second ambient light incident on the second area while the invisible light source emits invisible light in response to the control signal. The system-on-chip is configured to generate an image based on the first visible light information and determine whether an object is approaching the electronic device based on the invisible light information within the ambient light information. By determining whether an object is approaching the electronic device, the camera assembly is controlled to capture a person's gestures or eye contact, enabling the user to control the electronic device without touching the device with their hands.

[0026] In one possible implementation, during the storage process, the image sensor is configured to respond to a control signal and obtain first ambient light information based on third ambient light incident on the second area. The image sensor is also configured to respond to a control signal and obtain second ambient light information based on fourth ambient light incident on the second area while the invisible light source is emitting invisible light in response to the control signal. The system-on-chip is configured to determine whether an object is approaching the electronic device based on the first and second ambient light information. By determining whether an object is approaching the electronic device, the system controls whether to activate the anti-mistouch feature, thereby reducing power consumption and improving user experience.

[0027] In one possible implementation, the system-level chip is further configured to adjust the display brightness of the electronic device based on the first visible light information. By multiplexing the collected visible light information to adjust the display brightness of the electronic device, signal collection time can be reduced and the structure of the electronic device can be simplified.

[0028] In one possible implementation, the electronic device further includes a driving power supply; the driving power supply drives the invisible light source to emit invisible light in response to the control signal; and the driving power supply is disposed on a substrate of the camera assembly. This is a low-cost implementation.

[0029] In one possible implementation, the electronic device further includes a driving power supply; the driving power supply drives the invisible light source to emit invisible light in response to the control signal; and the electronic device further includes a circuit board, on which the driving power supply is disposed. This is a low-cost implementation.

[0030] In one possible implementation, the electronic device further includes a driving power supply; the driving power supply drives the invisible light source to emit invisible light in response to a control signal; and the electronic device further includes a power management module, wherein the driving power supply is integrated into the power management module. This is a low-cost implementation.

[0031] A fourth aspect of an embodiment of the present application provides a driving method for an electronic device, which is used to drive the electronic device of any one of the third aspects. The driving method includes: a system-level chip controls an image sensor to output a control signal; a camera component outputs ambient light information in response to the control signal; and the system-level chip determines whether there is an object approaching the electronic device based on the ambient light information.

[0032] The beneficial effects of the driving method of the electronic device provided in the embodiment of the present application are the same as the beneficial effects of the electronic device, and will not be repeated here.

[0033] In one possible implementation, the camera assembly outputs first visible light information and ambient light information in response to a control signal, including: during a call: the image sensor responds to the control signal to obtain the first visible light information based on the visible light in the first ambient light incident on the first area; when the invisible light source emits invisible light in response to the control signal, the image sensor responds to the control signal to obtain the ambient light information based on the ambient light incident on the second area; the system-level chip determines whether there is an object approaching the electronic device based on the first visible light information and the ambient light information.

[0034] In one possible implementation, the camera component outputs first visible light information and ambient light information in response to a control signal, including: during the screen-off wake-up process: the image sensor responds to the control signal to obtain the first visible light information based on the visible light in the first ambient light incident on the first area; during the invisible light source emitting invisible light in response to the control signal, the image sensor also responds to the control signal to obtain the ambient light information based on the second ambient light incident on the second area; the system-level chip is used to generate an image based on the first visible light information, and determine whether there is an object approaching the electronic device based on the invisible light information in the ambient light information.

[0035] In one possible implementation, the camera assembly outputs first visible light information and ambient light information in response to a control signal, including: during the storage process: the image sensor responds to the control signal to obtain the first ambient light information based on the third ambient light incident on the second area; when the invisible light source emits invisible light in response to the control signal, the image sensor also responds to the control signal to obtain the second ambient light information based on the fourth ambient light incident on the second area; the system-level chip is used to determine whether there is an object approaching the electronic device based on the first ambient light information and the second ambient light information.

[0036] In a possible implementation, the driving method further includes: the system-on-chip adjusting the display brightness of the electronic device in response to the first visible light information.

[0037] In a fifth aspect of the embodiments of the present application, a computer-readable medium is provided, which stores a computer program. When the computer program runs on an electronic device, the electronic device executes a driving method as described in any one of the second aspect or any one of the fourth aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] FIG1 is an appearance diagram of an electronic device provided in an embodiment of the present application;

[0039] FIG2 is a cross-sectional view taken along the line A1-A2 in FIG1 ;

[0040] FIG3 is an exploded view of an electronic device according to an embodiment of the present application;

[0041] FIG4 is a schematic diagram of the principle of a proximity light sensor provided in an embodiment of the present application;

[0042] FIG5 is a schematic diagram of the appearance of an electronic device according to an embodiment of the present application;

[0043] FIG6 is a cross-sectional view of an electronic device according to an embodiment of the present application;

[0044] FIG7 is a schematic structural diagram of a camera assembly and a screen stack provided in an embodiment of the present application;

[0045] FIG8A is an exploded view of a camera assembly provided in an embodiment of the present application;

[0046] FIG8B is an assembly diagram of a camera assembly provided in an embodiment of the present application;

[0047] FIG8C is an assembly diagram of another camera assembly provided in an embodiment of the present application;

[0048] 9-11 are plan views of an image sensor provided in an embodiment of the present application;

[0049] 12 and 13 are plan views of a filter layer provided in an embodiment of the present application;

[0050] FIG14 is a schematic structural diagram of a light guide member provided in an embodiment of the present application;

[0051] 15 and 16 are schematic diagrams of the topological structures of an image sensor and a system-on-chip provided in an embodiment of the present application;

[0052] 17-19 are driving timing diagrams of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0053] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments.

[0054] Hereinafter, the terms "second," "first," etc., are used for descriptive convenience only and should not be construed as indicating or implying relative importance or implicitly specifying the number of the technical features being referred to. Thus, a feature qualified as "second," "first," etc. may explicitly or implicitly include one or more of such features. In the description of this application, unless otherwise specified, "plurality" means two or more.

[0055] In addition, in the embodiments of the present application, directional terms such as "up", "down", "left", and "right" may be defined including but not limited to the orientation relative to the schematic placement of the components in the drawings. It should be understood that these directional terms may be relative concepts, which are used for relative descriptions and clarifications, and may change accordingly according to changes in the orientation of the components in the drawings.

[0056] In the embodiments of this application, unless otherwise specified or limited, the term "connection" should be understood in a broad sense. For example, "connection" can mean fixed connection, detachable connection, or integration; it can mean direct connection or indirect connection through an intermediate medium. In addition, the term "coupling" can mean direct electrical connection or indirect electrical connection through an intermediate medium. The term "contact" can mean direct contact or indirect contact through an intermediate medium.

[0057] In the embodiments of the present application, "and / or" describes the relationship between associated objects, indicating that three possible relationships exist. For example, "A and / or B" can represent: A exists alone, A and B exist simultaneously, and B exists alone. A and B can be singular or plural. The character " / " generally indicates that the associated objects are in an "or" relationship.

[0058] An embodiment of the present application provides an electronic device. The electronic device is, for example, a consumer electronic product or a home electronic product with a camera function. Among them, consumer electronic products include mobile phones, tablet computers, laptop computers, personal digital assistants (PDAs), smart wearable products (for example, smart watches, smart bracelets), virtual reality (VR) electronic devices, augmented reality (AR) electronic devices, drones, etc. Home electronic products include smart door locks, etc. The embodiment of the present application does not impose any special restrictions on the specific form of the above-mentioned electronic devices.

[0059] Figure 1 is an appearance diagram of an electronic device provided by an embodiment of the present application. Figure 2 is a cross-sectional view taken along line A1-A2 in Figure 1 .

[0060] As shown in Figure 1, electronic device 1 includes a cover glass (CG) and a housing 11. The cover glass and housing 11 are aligned to form a storage space, and the components of electronic device 1 that complete the display are arranged in the storage space. The cover glass CG is a transparent structure, for example, made of glass, and has high light transmittance.

[0061] In some embodiments, as shown in FIG2 , the structure disposed within the accommodation space of the electronic device 1 includes a screen stack, which includes a display panel 12, a polarizer (POL), an optically clear adhesive (OCA), a back plate (BP), and a heat dissipation film (super clean foam, SCF).

[0062] Display 12 is, for example, an organic light emitting diode (OLED) display. Display 12 is used for display highlighting and may also incorporate touch functionality. A polarizer (POL) and an optically transparent adhesive (OCA) are sequentially disposed on the light-emitting side of display 12. A backplane (BP) and a heat dissipation film (SCF) are sequentially disposed on the backlight side of display 12. As shown in Figures 1 and 2 , the screen stack includes a camera aperture, and a cover plate (CG) is disposed on the light-emitting side of the screen stack, covering the camera aperture.

[0063] In some embodiments, the electronic device 1 further includes a front camera assembly 20, which is disposed in the accommodation space. The lens of the front camera assembly 20 extends into the camera hole to collect light in front of the electronic device 1 through the camera hole to achieve shooting.

[0064] FIG3 is an exploded diagram of an electronic device according to an embodiment of the present application.

[0065] For example, as shown in FIG3 , the front camera assembly 20 is disposed below the screen stack, and at least a portion of the front camera assembly 20 (eg, the lens) extends into the camera hole.

[0066] In some embodiments, the electronic device 1 further includes a rear camera assembly, which includes at least one camera module, such as a standard camera module, a telephoto camera module, a wide-angle camera module, an ultra-telephoto camera module, and an ultra-wide-angle camera module. Accordingly, a rear camera hole is provided on the housing 11, through which the rear camera assembly collects light from behind the electronic device 1 to enable photography.

[0067] In some embodiments, the electronic device 1 further includes components such as a printed circuit board (PCB), a system-on-chip (SOC), a processor, a memory, and a battery, and the system-on-chip, the processor, and the memory are fixed on the circuit board. The display screen 12, the front camera assembly 20, and the rear camera assembly are electrically connected to the processor. The memory is used to store computer program code. The computer program code includes computer instructions. The processor is used to call computer instructions to enable the electronic device 1 to perform corresponding operations, for example, to enable the display screen 12 to display a target image, to enable the front camera assembly and the rear camera assembly to capture a target image, etc. The battery is electrically connected to the circuit board for powering the electronic device 1. In some embodiments, the electronic device 1 may further include one or more functional modules such as an antenna module, a mobile communication module, a sensor module, a motor, a microphone module, a speaker module, etc., and these functional modules can be electrically connected to the processor to transmit signals.

[0068] In recent years, optoelectronic technology has been increasingly used in various fields, including light sensors. Proximity light sensors are a common type of photoelectric sensor with a wide range of applications.

[0069] For example, in the first application scenario (during a call), when a user uses electronic device 1 to make a call, electronic device 1 is placed close to the ear, and the user cannot see display screen 12. If the display screen 12 of electronic device 1 is always on during the call, the waste of power will be very serious. A proximity light sensor is provided in electronic device 1. The proximity light sensor can identify scenarios where close contact with the display screen 12 is not required, such as when the electronic device 1 is placed close to the ear for a call, so as to prompt electronic device 1 to reduce accidental operation of the display screen 12 by the ear or hand in such scenarios, thereby improving power utilization.

[0070] In the second application scenario (during the screen swinging process), when it is determined by proximity light that the user is within a certain range in front of the electronic device 1, the camera assembly 20 is used to capture the person's gestures or eyes, allowing the user to control the electronic device 1 without touching the electronic device 1 with his hands.

[0071] In the third application scenario (stored state), pocket mode is activated when the proximity light sensor is blocked and the device is in a dark environment. In pocket mode, the anti-accidental touch function is activated and power consumption is reduced to improve battery utilization.

[0072] Based on this, in some embodiments, the electronic device 1 further includes a proximity light sensor. Below, a schematic description of the configuration of the proximity light sensor in the electronic device 1 is given.

[0073] FIG4 is a schematic diagram showing the principle of a proximity light sensor provided in an embodiment of the present application.

[0074] As shown in Figure 4, the proximity sensor works by sensing objects through infrared reflection. It consists of an infrared light transmitter and an infrared light receiver. Infrared light emitted by the transmitter is reflected by an approaching object and reaches the receiver. The receiver then determines the object's distance from the proximity sensor based on the intensity of the received infrared light, thus enabling it to sense the object's distance.

[0075] FIG5 is a schematic diagram of the appearance of an electronic device according to an embodiment of the present application.

[0076] In some embodiments, as shown in Figure 5 , the electronic device 1 further includes an infrared light emitting hole and an infrared light receiving hole. These holes are located near the camera hole. Infrared light emitted by the infrared light emitter exits the electronic device 1 through the infrared light emitting hole, and reflected infrared light enters the infrared light receiver through the infrared light receiving hole. Similar to the camera hole shown in Figure 2 , to minimize the impact on infrared light transmission, the infrared light emitting hole and the infrared light receiving hole extend through the screen stack, leaving only the topmost cover plate CG exposed.

[0077] By providing an infrared light emitting hole and an infrared light receiving hole to provide a light path for the proximity sensor, the proximity sensor function can be realized. However, the holes will reduce the reliability of the screen laminate, making the screen laminate more susceptible to damage in scenarios such as drops and squeezes.

[0078] FIG6 is a cross-sectional view of an electronic device according to an embodiment of the present application.

[0079] In other embodiments, as shown in FIG6 , the camera hole, infrared light emitting hole, and infrared light receiving hole only penetrate the film layers of the screen stack located below the display screen 12, such as the back plate BP and the heat dissipation film SCF. FIG6 only illustrates the infrared light emitting hole.

[0080] Placing the front-facing camera assembly and proximity light sensor (e.g., infrared light emitter and infrared light receiver) below the display screen 12 can improve the reliability and aesthetic refinement of the display screen 12. However, the propagation of infrared light is affected by the display screen 12 and the films above it. In particular, as display screen 12 technology advances, the density of pixel circuits in the display screen 12 will gradually increase, squeezing out the area of ​​the originally light-transmitting portion and reducing the screen's transmittance. This makes placing the proximity light sensor below the display screen 12 increasingly unfeasible.

[0081] Based on this, an embodiment of the present application provides a camera component that integrates the hardware structure and control logic of the proximity light sensor into the camera component, which can not only realize the functions of the proximity light sensor and the original functions of the camera at the same time, but also reduce the number of openings in the display screen 12.

[0082] FIG7 is a schematic structural diagram of a camera assembly and screen stack provided in an embodiment of the present application.

[0083] In some embodiments, as shown in FIG7 , the camera assembly 20 includes a camera module 30 and an invisible light source 40 , which is integrated into the camera module 30 . The camera module 30 includes a substrate 31 , which is used to mount electronic components. The camera module 30 also includes electronic components such as an image sensor (CMOS image sensor, CIS) 32 . The image sensor 32 and the invisible light source 40 are both mounted on the substrate 31 . The image sensor 32 can be recessed into the substrate 31 , for example, by providing a groove on the surface of the substrate 31 to accommodate the image sensor 32 .

[0084] The camera module 30 also includes a structural member 33, which is cylindrical and encloses a surrounding space 331. Along the direction of the optical axis of the camera module 30, the opposite ends of the structural member 33 are both open. The first end of the structural member 33 is the light inlet a of the camera assembly 20. When the camera module 30 is applied to the electronic device 1, the first end of the structural member 33 extends into the camera hole of the electronic device 1. The second end of the structural member 33 is buckled on the substrate 31 to form a closed space. The image sensor 32 is located in the surrounding space 331, and the invisible light source 40 is located outside the surrounding space 331. The invisible light source 40 is used to send invisible light. The structural member 33 isolates the image sensor 32 from the invisible light source 40 so that the invisible light sent by the invisible light source 40 will not directly irradiate the image sensor 32.

[0085] The invisible light source 40 may be, for example, an infrared light source, an ultraviolet light source, or a far-infrared light source, etc. For example, the invisible light source 40 includes a vertical-cavity surface-emitting laser (VCSEL).

[0086] In some embodiments, the periphery of the light inlet a serves as a light exit area for the invisible light emitted by the invisible light source 40. After the invisible light is emitted through the light exit area, the invisible light reflected by the object enters the enclosed space 331 of the camera module 30 through the light inlet a. Visible light entering the camera module 30 also enters the enclosed space 331 through the light inlet a.

[0087] The invisible light exit area may be formed around the periphery of the light inlet a, or may be formed as a portion of the periphery of the light inlet a. The invisible light exit area may be a continuous area or may include multiple discontinuous areas, which is not limited in the present embodiment.

[0088] In some embodiments, as shown in FIG. 7 , the camera module 30 further includes a filter layer 34 (the filter layer 34 may also be other types of optical elements) and a lens 35 .

[0089] The filter layer 34 and the lens 35 are arranged in the surrounding space 331. Along the direction of the optical axis of the camera module 30, the filter layer 34 is located between the image sensor 32 and the light entrance a, and the lens 35 is located on the side of the filter layer 34 away from the image sensor 32.

[0090] In some embodiments, the filter layer 34 and the lens 35 are fixed to the structural member 33. The embodiment shown in FIG7 is merely a schematic representation of the relative positional relationship between the various structural elements in the camera module 30, and does not limit the specific connection method between the various structural elements, the specific position setting, or the structural form of the various structural elements.

[0091] FIG8A is an exploded view of a camera assembly provided in an embodiment of the present application, and FIG8B and FIG8C are assembly views of a camera assembly provided in an embodiment of the present application.

[0092] In some embodiments, as shown in FIG8A , the substrate 31 is coupled to a flexible printed circuit (FPC). Pins are provided on the flexible printed circuit FPC. The substrate 31 is coupled to a circuit board of the electronic device 1 through the flexible printed circuit FPC.

[0093] Regarding the structure of the structural member 33 , for example, the structural member 33 may be an integrated structure, or the structural member 33 may be formed by connecting two or more structures.

[0094] In some embodiments, as shown in FIG8A , the structural member 33 includes a first structure 33A and a second structure 33B. The first structure 33A surrounds the first enclosed space, and the second structure 33B surrounds the second enclosed space. The first structure 33A and the second structure 33B can be fixed together, for example, by adhesive bonding.

[0095] For example, the first enclosed space is a cylindrical structure for accommodating and fixing the lens 35, and the second enclosed space is a frame-shaped base structure for accommodating the image sensor 32 and fixing the filter layer 34. Of course, the second enclosed space can also only accommodate the filter layer 34.

[0096] In some embodiments, as shown in FIG7 , the invisible light source 40 is disposed on the substrate 31, and a light source accommodating area 332 is separately formed on the structural member 33. The light source accommodating area 332 is spaced apart from the surrounding space 331, and the invisible light source 40 is accommodated within the light source accommodating area 332. Then, as shown in FIG8B , after the structural member 33 is engaged with the substrate 31, the lens 35, the filter layer 34, the image sensor 32, and the invisible light source 40 are all covered by the structural member 33.

[0097] By providing the light source accommodating area 332 for accommodating the invisible light source 40 , more invisible light emitted by the invisible light source 40 can be transmitted to the light emitting area, thereby improving the utilization rate of light information.

[0098] In other embodiments, as shown in FIG. 8C , the invisible light source 40 is disposed on the substrate 31 , and the invisible light source 40 is fixed to the outside of the structural member 33 .

[0099] Then, the vertical projection of the structural member 33 on the substrate 31 covers part of the area of ​​the substrate 31. The structural member 33 is fastened to the substrate 31, accommodating the image sensor 32 inside the structural member 33, and the invisible light source 40 is located outside the structural member 33.

[0100] This design allows the structural member 33 to be compact, resulting in a lightweight camera assembly 20. Furthermore, the invisible light source 40 is located outside the structural member 33, eliminating the need for a light source accommodation area 332 on the structural member 33. This simplifies the structure of the structural member 33 and reduces manufacturing costs.

[0101] On this basis, in the embodiment of the present application, the image sensor 32 can be exposed to invisible light, and the image sensor 32 can also be exposed to visible light. Therefore, the filter layer 34 needs to have an area that can transmit invisible light, and also needs to have an area that can only transmit visible light.

[0102] 9-11 are plan views of an image sensor provided in an embodiment of the present application.

[0103] As shown in FIG9 , the image sensor 32 includes a first area 322 and a second area 323. The projection of the filter layer 34 on the image sensor 32 overlaps with the first area 322. For example, the first area 322 is used to receive visible light, and the second area 323 is used to receive ambient light, which includes visible light and invisible light.

[0104] Its effective area is the third area 321, and the third area 321 is the area within the larger solid box in Figure 9. The light inlet a of the camera module 30 is circular. When light enters the camera module 30, a circular light projection area 324 is also formed. The area within the dotted circle in Figure 9 is the light projection area 324 on the image sensor 32. The area where the light projection area 324 and the third area 321 intersect is the image generation area on the image sensor 32. Since the captured image or video is rectangular, a rectangular imaging effective area needs to be formed within the image generation area on the image sensor 32. This application defines the imaging effective area as the first area 322. As shown in Figure 9, the first area 322 is the area within the larger rectangular box within the third area 321. The area within the imaging effective area and outside the first area 322 is an additional area, that is, light can be projected into this area, but this area is not used for imaging of the camera module 30. This application defines this additional area as the second area 323.

[0105] In summary, the image sensor 32 has a third area 321, a first area 322, and a second area 323. The first area 322 is located inside the third area 321, and the second area 323 is located inside the third area 321 and outside the first area 322. The first area 322 is the exposure area for visible light, that is, the imaging area of ​​the camera module 30, and the second area 323 is the exposure area for invisible light.

[0106] In some embodiments, as shown in FIG9 , the second region 323 is located outside the first region 322 and surrounds the first region 322. As shown in FIG9 , the second region 323 is disposed on all four sides of the first region 322.

[0107] In some other embodiments, as shown in FIG. 10 , the second region 323 is located outside the first region 322 and on two opposite sides of the first region 322 .

[0108] For example, the image sensor 32 includes photosensitive units arranged in an array, and the second region 323 is located on both sides of the first region 322 along the column direction of the photosensitive units.

[0109] In some other embodiments, as shown in FIG. 11 , the second region 323 is located on one side of the first region 322 .

[0110] For example, the image sensor 32 includes photosensitive units arranged in an array, and the second region 323 is located on one side of the first region 322 along the column direction of the photosensitive units.

[0111] In some embodiments, as shown in FIG. 9 , the image processor ISP further includes a spacer 325 , which is located outside the first area 322 and between the first area 322 and the second area 323 .

[0112] In some embodiments, the image processor ISP includes multiple photosensitive units, which are arrayed in the third region 321 of the image sensor 32. A first photosensitive unit located in the first region 322 of the multiple photosensitive units serves as a visible light collection unit for exposing visible light. A second photosensitive unit located in the second region 323 of the multiple photosensitive units serves as an ambient light collection unit for exposing ambient light. The remaining photosensitive units in the multiple photosensitive units serve as redundant photosensitive units.

[0113] This is equivalent to utilizing some redundant units as ambient light collection units, which does not increase the cost and size of the camera assembly 20 and enables it to have the function of an infrared light receiver.

[0114] 12 and 13 are planar schematic diagrams of a filter layer provided in an embodiment of the present application.

[0115] In some embodiments, the filter layer 34 is rectangular and has an outer edge 340. Similarly, the dotted circular area in Figure 12 represents an incident light projection area 344 on the filter layer 34. The intersection of the incident light projection area 344 and the outer edge 340 represents an effective light transmission area. Because the captured image or video is rectangular, a rectangular imaging light transmission area must be formed within the effective light transmission area on the filter layer 34. This application defines this imaging light transmission area as a fourth area 341. Fourth area 341 is configured to transmit visible light from the ambient light and block invisible light from the ambient light.

[0116] In some embodiments, the area within the effective light-transmitting area and outside the fourth area 341 is an additional area. This area allows ambient light to pass through, but this portion of the ambient light is not used for imaging. This application defines the additional area on the filter layer 34 as a fifth area 342. The fifth area 342 is located outside the fourth area 341.

[0117] The fourth area 341 is arranged corresponding to the first area 322, and the projection of the filter layer 34 on the image sensor 32 overlaps with the first area 322. The fourth area 341 is used to transmit visible light and cut off invisible light in the ambient light. The fifth area 342 is located outside the fourth area 341. The fifth area 342 is arranged corresponding to the second area 323. The fifth area 342 is used to transmit visible light and invisible light in the ambient light.

[0118] For example, the fifth area 342 is arranged corresponding to the second area 323 , and the ambient light incident through the fifth area 342 can illuminate the second area 323 of the image sensor 32 , but the pattern of the fifth area 342 is not limited to the same as the pattern of the second area 323 .

[0119] As shown in Figure 7 , along the optical axis of the camera module 30, the fourth region 341 of the filter layer 34 corresponds to the first region 322 of the image sensor 32, and the fifth region 342 of the filter layer 34 corresponds to the second region 323 of the image sensor 32. "Correspondingly disposed" here should be understood as meaning that both regions correspond to each other along the optical path. Their shapes can be identical, but this does not necessarily mean they have the same size. For example, the fourth region 341 of the filter layer 34 can be smaller than the first region 322 of the image sensor 32. Their shapes can also differ. For example, as shown in Figure 11 , the second region 323 is located to one side of the first region 322. Then, as shown in Figure 13 , the fifth region 342 is also located to one side of the fourth region 341. However, the outline of the fifth region 342 differs from that of the second region 323. For example, the outline of the fifth region 342 can be rectangular to facilitate processing of the fourth and fifth regions 341 and 342.

[0120] In some embodiments, as shown in FIG12 , the filter layer 34 further includes an isolation region 343 located between the fourth region 341 and the fifth region 342 . The isolation region 343 is used to block light crosstalk between the fourth region 341 and the fifth region 342 .

[0121] For example, the filter layer 34 includes a transparent substrate, an invisible light blocking film, an invisible light transmitting film, and a light shielding film, all of which are disposed on the substrate. The invisible light blocking film is located in the fourth region 341, the invisible light transmitting film is located in the fifth region 342, and the light shielding film is located in the isolation region 343. Of course, the invisible light transmitting film may not be disposed in the fifth region 342. Alternatively, the filter layer 34 may not include the fifth region.

[0122] The material of the carrier includes glass, resin, etc., the material of the invisible light blocking film includes tin oxide, titanium oxide, the material of the invisible light transmitting film includes organic material, and the material of the light shielding film includes reflective material or opaque material.

[0123] In some embodiments, referring to FIG. 7 , the camera assembly 20 further includes a light guide 50 , and the invisible light emitted by the invisible light source 40 is emitted out of the camera assembly 20 through the light guide 50 .

[0124] For example, the first end of the light guide 50 receives the invisible light emitted by the invisible light source 40, and the second end of the light guide 50 emits the invisible light emitted by the invisible light source 40. The invisible light emitted by the invisible light source 40 is transmitted from the first end to the second end. The second end of the light guide 50 can be located, for example, at the outer circle of the light inlet a.

[0125] For example, the invisible light emitted by the invisible light source 40 is guided through the light guide 50 to the vicinity of the light inlet a, emitted from the electronic device 1 through the camera aperture, projected onto the detection target, and then reflected by the detection target before entering the camera aperture. After passing through the lens 35, the invisible light is projected onto the fifth region 342 of the filter layer 34. Because the fifth region 342 is transparent or partially transparent to the invisible light, the invisible light passes through the fifth region 342 of the filter layer 34 and is projected onto the second region 323 of the image sensor 32. Therefore, the image sensor 32 is able to receive the invisible light and perform exposure processing on the invisible light to realize the detection function of the proximity light sensor, determining whether the detection target is approaching or moving away from the electronic device 1.

[0126] In the embodiment of the present application, the camera module 30 captures a target scene through the camera aperture. Light from the target scene passes through the camera aperture, sequentially through the lens 35 and the fourth region 341 of the filter layer 34, and is projected onto the first region 322 of the image sensor 32, allowing the image sensor 32 to capture image information. The invisible light source 40 emits invisible light, which is then guided through the light guide 50 and emitted to the outside world through the cover BG. The invisible light is reflected off an object, passes through the lens 35 and the fifth region 342 of the filter layer 34, and is projected onto the second region 323 of the image sensor 32, allowing the image sensor 32 to capture invisible light information.

[0127] This solution sets the properties of the fourth area 341 and the fifth area 342 of the filter layer 34 to match the solution of setting the first area 322 and the second area 323 of the image sensor 32, so that the overall camera assembly 20 can maintain the size of the camera module 30 and integrate the function of the proximity light sensor without changing the spatial layout of the camera module 30.

[0128] FIG14 is a schematic structural diagram of a light guide provided in an embodiment of the present application.

[0129] In some embodiments, as shown in FIG. 14 , the light guide 50 includes a light exit portion 51 , which is a portion of the light guide 50 located in a light exit area of ​​the invisible light emitted by the invisible light source 40 .

[0130] For example, the light emitting portion 51 is disposed around at least a portion of the structural member 33. In the embodiment shown in FIG14 , the light emitting portion 51 can be in the form of a closed ring. For example, the light emitting portion 51 can be in the form of a circular ring, a polygonal ring structure, and the like. By designing the light emitting portion 51 as a closed ring, the present application transforms the point light source at the light entrance position of the light guide 50 into a surface light source at the light exit position, thereby more clearly illuminating the detection target.

[0131] The light emitting portion 51 is in the optical window, and the light emitting portion 51 can completely surround the portion of the structural component 33 located in the camera hole, so that the light of the invisible light source 40 forms a ring-shaped light emitting surface at the camera hole position, and can emit light in all directions (360 degrees) from the periphery of the light inlet a position of the camera module, so that the infrared light emitted by the invisible light source 40 can enter the interior of the structural component 33 more, thereby improving the utilization rate of the invisible light source 40.

[0132] For example, the light emitting portion 51 may also be in the shape of a ring, a semi-ring, an arc, etc. with an opening.

[0133] In some embodiments, the light guide 50 includes a light incident surface 52 , a transmission section 53 , and a light emitting surface 54 .

[0134] For example, the transmission section 53 is an elongated rod-shaped structure, and the cross-section of the transmission section 53 can be circular, square, triangular, polygonal, irregular, etc. The light incident surface 52 is one end surface of the rod-shaped transmission section 53, and is the end surface of the transmission section 53 facing the invisible light source 40. The light exit portion 51 is connected to the end of the transmission section 53 away from the invisible light source 40. The light exit surface 54 is the end surface of the light exit portion 51 and is the surface facing the space outside the cover plate BG.

[0135] The light guide 50 includes, for example, a light-transmitting inner core and a light-impermeable layer wrapped around the inner core. The inner core is made of, for example, glass or resin, and the light-impermeable layer is made of, for example, reflective material or opaque material.

[0136] Based on the structure of the camera assembly 20 described above, how the image sensor 32 realizes exposure of visible light and ambient light respectively will be described below.

[0137] In some embodiments, the image sensor 32 is configured to output a control signal, and the invisible light source 40 is configured to emit invisible light in response to the control signal. After the invisible light is emitted, the image sensor 32 can determine whether an object is approaching the image sensor 32 by collecting the intensity of the reflected invisible light.

[0138] In some embodiments, the image sensor 32 is configured to respond to a control signal and obtain first visible light information based on visible light in the first ambient light incident on the first area 322. The obtained visible light information may be visible light noise information or visible light image information.

[0139] During the driving process of the camera assembly 20 , the image sensor 32 outputs a control signal, and the invisible light source 40 emits invisible light in response to the control signal.

[0140] The image sensor 32 is further configured to respond to the control signal and obtain ambient light information based on the second ambient light incident on the second area 323. The ambient light information includes second visible light information and invisible light information.

[0141] The time when the image sensor 32 acquires visible light information and the time when the image sensor 32 acquires ambient light information may or may not be the same. For example, when the invisible light source 40 is not emitting invisible light, the image sensor 32 responds to the control signal and acquires first visible light information based on visible light in the first ambient light incident on the first area 322. While the invisible light source 40 is emitting invisible light, the image sensor 32 responds to the control signal and acquires ambient light information based on ambient light incident on the second area 323. The ambient light information includes second visible light information and invisible light information.

[0142] Based on this, the invisible light information acquired by the image sensor 32 includes reflected invisible light information. The system-on-chip (SOC) can determine whether an object is approaching the electronic device based on the reflected invisible light information. The first visible light information acquired by the image sensor 32 can be used as information for generating an image or removing noise from the ambient light information.

[0143] In the embodiment of the present application, “close” may refer to, for example, whether there is an object within a preset distance range.

[0144] The camera assembly 20 provided in the embodiment of the present application includes a camera module 30. The first area 322 of the image sensor 32 can obtain visible light information in the ambient light, allowing the camera assembly 20 to function normally as a camera. On this basis, the camera assembly 20 also includes an invisible light source 40. The invisible light emitted by the invisible light source 40 is reflected by an object, mixed with the ambient light, and then enters the image sensor 32 of the camera module 30 through the light inlet a of the camera module 30. After being exposed by the second area 323 of the image sensor 32, second visible light information and invisible light information are generated. The invisible light information includes the reflected invisible light information corresponding to the reflected invisible light, allowing the camera assembly 20 to function as a proximity light sensor. Moreover, the image sensor 32 is disposed within the enclosing space 331, and the invisible light source 40 is disposed outside the enclosing space 331. The invisible light source 40 and the image sensor 32 are separated by a structural member 33, which can achieve optical isolation between the light receiver and the light source, prevent the light emitted by the invisible light source from crosstalking to the area where the image sensor 32 is located, and can ensure the detection effect of the image sensor 32. Therefore, the camera assembly 20 can achieve the same effect as independently setting up a camera and a proximity light sensor. On this basis, the light inlet a of the camera module 30 serves as the light entrance area for invisible light, and there is no need to set up a light inlet required for a proximity light sensor separately. That is to say, the camera assembly 20 provided in the embodiment of the present application has the functions of a camera and a proximity light sensor integrated inside, but only one light inlet a is required to receive light from the outside. When the camera assembly 20 is applied to the electronic device 1, there is no need to increase the holes required for the incidence of invisible light, and the number of camera holes in the screen stack in the electronic device 1 can be reduced. Then, even if the camera hole in the screen stack is made to pass through the entire screen stack in order to improve the transmittance of the camera hole and enhance the detection effect of invisible light, the reliability of the screen stack can still be improved, the display visual effect and screen-to-body ratio can be improved, and the internal space of the electronic device 1 can also be saved. In addition, the invisible light source 40 emits invisible light, and the image sensor 32 obtains visible light information and ambient light information, all in response to the same control signal, so that the delay of invisible light detection is low.

[0145] 15 and 16 are schematic diagrams of the topological structures of an image sensor and a system-on-chip provided in an embodiment of the present application.

[0146] In some embodiments, as shown in FIG. 15 , the image sensor 32 includes a timing circuit 326 , a plurality of photosensitive units 327 arranged in an array, and a receiving circuit.

[0147] For example, the plurality of photosensitive units 327 include a plurality of first photosensitive units and a plurality of second photosensitive units. The plurality of photosensitive units 327 are arranged in an array in the third region 321 of the image sensor 32. The plurality of first photosensitive units are located in the first region 322 as visible light collection units for collecting visible light. The plurality of second photosensitive units are located in the second region 323 as ambient light collection units for collecting ambient light. The photosensitive units 327 include, for example, photodiodes (PDs). The plurality of photosensitive units 327 are all coupled to a receiving circuit. The electrical signals generated by the exposure of the first photosensitive units are processed by the receiving circuit, and the electrical signals generated by the exposure of the second photosensitive units are also processed by the receiving circuit.

[0148] The timing circuit 326 is used to control the plurality of first photosensitive units (visible light collection units) and the plurality of second photosensitive units (ambient light collection units) and to generate electrical signals by exposing the received light.

[0149] In some embodiments, the receiving circuit includes an analog-to-digital converter (ADC) and an image signal processing (ISP).

[0150] An analog-to-digital converter (ADC) is coupled to the plurality of first photosensitive units and the plurality of second photosensitive units and is configured to convert an electrical signal into a digital signal. An image processor (ISP) is configured to process the digital signal and output the second visible light information and the invisible light information. The image processor (ISP) processes the digital signal, for example, to eliminate noise, correct wide-angle distortion of digital photos, improve image contrast, and remove red-eye. Image processors (ISPs) known in related art are applicable to the embodiments of the present application.

[0151] In the embodiment of the present application, the electrical signals generated by the plurality of first photosensitive units and the electrical signals generated by the plurality of second photosensitive units are both processed by a set of digital-to-analog converters ADC and image processors ISP, which can simplify the structure of the image sensor 32 .

[0152] In some embodiments, the control signal includes a timing signal.

[0153] The timing signal can be used to control the camera assembly 20 to periodically detect whether there is an object approaching the electronic device 1 including the camera assembly 20, so that the status of the electronic device 1 can be adjusted in time.

[0154] Illustratively, the timing circuit 326 is used to output a control signal.

[0155] In some embodiments, the timing signal is, for example, a strobe signal. The strobe signal can be used to control the activation of a flash in the camera assembly 20. Of course, the flash in the camera assembly 20 can also be directly controlled by the SOC. The signal originally used to control the flash in the camera assembly 20 can be used as the control signal in this application, eliminating the need to add a separate circuit for outputting the control signal, thereby minimizing modifications to the image sensor 32.

[0156] In some embodiments, the timing circuit 326 may be integrated into the image processor ISP.

[0157] Then, the controlled signal of the driving power supply 70 can be controlled by the image processor ISP in the image sensor 32. Reusing the image processor ISP can save board area.

[0158] In some embodiments, the image sensor 32 further includes a first logic control circuit 328 , which is coupled to a mode control terminal 36 disposed on the substrate 31 .

[0159] The mode control terminal 36 is used to receive a mode signal sent by the system-on-chip (SOC). The first logic control circuit 328 is used to receive the mode signal from the mode control terminal 36 and output configuration parameter 1 to the timing circuit 326, thereby controlling the timing circuit 326 to output a timing signal (control signal). The first logic control circuit 328 combines the mode signal and the timing signal to control the timing circuit 326 to output a control signal to control the exposure of the visible light collection unit and / or the ambient light collection unit, thereby generating a digital signal.

[0160] That is, the exposure of the visible light collection unit and the ambient light collection unit is controlled by the mode signal.

[0161] Regarding the transmission of the mode signal and the processing of ambient light information, in some embodiments, as shown in FIG15 , the electronic device 1 further includes a system-on-chip (SOC), which is coupled to the mode control terminal 36 of the camera assembly 20 and the image sensor 32. The coupling interface between the SOC and the image sensor 32 is, for example, a mobile industry processor interface (MIPI).

[0162] The system-on-chip (SOC) is used to control the image sensor 32 to output a control signal. The system-on-chip (SOC) is also used to receive the first visible light information and ambient light information output by the image sensor 32 and determine whether an object is approaching the electronic device 1 based on the invisible light information.

[0163] For example, the system-on-chip (SOC) is used to send a mode signal to the mode control terminal 36 , and the first logic control circuit 328 is used to receive the mode signal from the mode control terminal 36 , output configuration parameter 1 to the timing circuit 326 , and control the timing circuit 326 to output a control signal.

[0164] In some embodiments, the system-on-chip (SOC) includes a digital signal processing circuit 61 and an invisible light information processing circuit 62 .

[0165] The digital signal processing circuit 61 is coupled to the image sensor 32 and is used to receive the digital signal output by the image sensor 32. For example, the digital signal processing circuit 61 is coupled to the image processor ISP.

[0166] The invisible light information processing circuit 62 is coupled to the digital signal processing circuit 61 and is used to receive the signal output by the digital signal processing circuit 61 , process the received signal, and output distance data to determine whether there is an object approaching the electronic device 1 .

[0167] In some embodiments, the system-on-chip SOC also includes a visible light information processing circuit 63, which is coupled to the digital signal processing circuit 61 and is used to receive the signal output by the digital signal processing circuit 61, process the received signal, and output image data to complete the image acquisition function of the camera module 30.

[0168] In some embodiments, please continue to refer to Figure 15. The camera assembly 20 also includes a driving power supply 70. The driving power supply 70 and the invisible light source 40 are coupled in series between the power supply voltage terminal AVDD and the reference ground voltage terminal GND. The invisible light source 40 is used to emit invisible light under the drive of the driving power supply 70.

[0169] For example, the camera assembly 20 further includes a second logic control circuit 37, which is coupled to the mode control terminal 36. The second logic control circuit 37 is configured to receive a mode signal and a timing signal, and control the driving power supply 70 to drive the invisible light source 40 to emit invisible light under the control of the mode signal and the timing signal.

[0170] That is, the invisible light source 40 emits invisible light, which is also controlled by the mode signal.

[0171] In some embodiments, as shown in FIG. 15 , the driving power source 70 is disposed on the substrate 31 .

[0172] Optionally, the second logic control circuit 37 is provided on the substrate 31 .

[0173] In other embodiments, as shown in FIG. 16 , the driving power supply 70 is disposed in a power management unit (PMU) of the electronic device 1 .

[0174] Optionally, the second logic control circuit 37 is provided in a power management module PMU. In some other embodiments, the driving power supply 70 is provided on a circuit board of the electronic device 1 .

[0175] Optionally, the second logic control circuit 37 is arranged on a circuit board of the electronic device 1 .

[0176] Of course, the embodiment of the present application does not limit the location of the driving power supply 70, and the above is only an illustration.

[0177] Based on this, the driving method of the electronic device 1 provided in the embodiment of the present application includes:

[0178] S1: The system-on-chip (SOC) controls the image sensor 32 to output a control signal.

[0179] For example, the system-on-chip (SOC) outputs a mode signal to the mode control terminal 36 , and the first logic control circuit 328 outputs configuration parameter 1 of the corresponding mode to the timing circuit 326 according to the mode signal of the mode control terminal 36 , so as to control the timing circuit 326 to output a control signal.

[0180] S2: The camera assembly 20 outputs first visible light information and ambient light information in response to the control signal.

[0181] In some embodiments, step S2 includes:

[0182] S21: The invisible light source 40 emits invisible light in response to the control signal.

[0183] The second logic control circuit 37 receives the mode signal and the control signal, and under the control of the mode signal and the control signal, controls the driving power supply 70 to drive the invisible light source 40 to emit invisible light.

[0184] S22: The image sensor 32 exposes the received visible light to generate first visible light information and the image sensor 32 exposes the received ambient light to generate ambient light information.

[0185] For example, the first logic control circuit 328 combines the mode signal and the control signal to control the timing circuit 326 to output the control signal. Under the control of the control signal, the visible light acquisition unit and / or the ambient light acquisition unit are exposed to light and generate a visible photoelectric signal and an ambient photoelectric signal. The analog-to-digital converter (ADC) converts the visible photoelectric signal and the ambient photoelectric signal into a visible light digital signal and an ambient light digital signal. The image processor (ISP) processes the visible light digital signal and the ambient light digital signal and outputs first visible light information and ambient light information.

[0186] S3: The system-on-chip (SOC) generates distance data based on the invisible light information to determine whether an object is approaching the electronic device 1. It also generates image data based on the visible light information to form an image.

[0187] Below, the camera assembly 20 and electronic device 1 and their driving methods provided in the embodiments of the present application are described with several examples in combination with driving timing.

[0188] Example 1

[0189] FIG17 is a driving timing diagram of an electronic device provided in an embodiment of the present application.

[0190] In some embodiments, as shown in Figure 17, the system-on-chip (SOC) is used to send a first mode signal M1 to the mode control terminal 36. The first mode signal M1 is used to indicate that the electronic device 1 is in a call process.

[0191] Then, when the invisible light source 40 does not emit invisible light, the image sensor 32 is configured to respond to the control signal and obtain first visible light information based on the visible light in the first ambient light incident on the first area 322. The first visible light information is used as visible light noise information.

[0192] The image sensor 32 is further configured to obtain ambient light information based on the second ambient light incident on the second area 323 in response to the control signal while the invisible light source 40 is emitting invisible light in response to the control signal. The ambient light information in this case includes invisible light information and second visible light information. The invisible light information includes invisible light noise information and reflected invisible light information. The second visible light information is visible light noise information.

[0193] The system-on-chip (SOC) is used to determine whether an object is approaching the electronic device 1 according to the first visible light information and the ambient light information.

[0194] For example, the system-on-chip (SOC) removes the visible light noise information from the ambient light information according to the visible light noise information, and determines whether there is an object approaching the electronic device 1 according to the invisible light noise information and the reflected invisible light information.

[0195] In some embodiments, the first logic control circuit 328 is configured to receive a first mode signal M1 from the mode control terminal 36 and determine the operating mode of the electronic device 1 based on the first mode signal M1. For example, the first mode signal M1 indicates that both the invisible light unit and the visible light unit of the electronic device 1 are exposed and the electronic device 1 is in a visible light collection + ambient light collection mode.

[0196] After the first mode signal M1 is determined, the first logic control circuit 328 is configured to output first configuration parameters corresponding to the first mode signal M1 to the timing circuit 326. Under the control of the first configuration parameters, the timing circuit 326 is configured to output a first timing signal strobe1, which includes a first valid pulse A1 and a second valid pulse A2.

[0197] For example, as shown in FIG17 , a high-level signal in the first timing signal strobe1 is a valid pulse. Alternatively, for example, a low-level signal in the first timing signal strobe1 is a valid pulse. Both application modes are applicable to the embodiments of the present application.

[0198] In addition, there is a gap between the first effective pulse A1 and the second effective pulse A2. As shown in FIG17 , within an image frame, the first effective pulse A1 may precede the second effective pulse A2. Alternatively, the second effective pulse A2 may precede the first effective pulse A1.

[0199] In some embodiments, the first logic control circuit 328 is further used to control the timing circuit 326 to output a first exposure control signal S1 during the period t1 corresponding to the first effective pulse A1 . The first exposure control signal S1 is used to control the exposure of the image sensor 32 and generate a digital signal.

[0200] It should be noted that the timing circuit 326 outputs the first exposure control signal S1 during the period t1 corresponding to the first active pulse A1. Therefore, the timing circuit 326 can output the first exposure control signal S1 at the start of the first active pulse A1 (when the low level changes to a high level), or it can output the first exposure control signal S1 within a certain time range before or after the start of the first active pulse A1, as long as the first active pulse A1 is used as the timing reference.

[0201] For example, during a corresponding time period t1 corresponding to the first effective pulse A1, the timing circuit 326 outputs a first exposure control signal S1. The first exposure control signal S1, for example, includes synchronous exposure information. The first exposure control signal S1 is used to control the exposure of the first photosensitive unit in the visible light acquisition unit (e.g., synchronous exposure or line-by-line exposure), thereby converting the visible light into a visible photoelectric signal. Correspondingly, the analog-to-digital converter ADC is used to convert the visible photoelectric signal into a visible light digital signal under the control of the first exposure control signal S1. The first exposure control signal S1, for example, includes a sampling signal. The image processor ISP is used to process the received visible light digital signal to generate visible light information.

[0202] Subsequently, the second logic control circuit 37 is used to receive the first mode signal M1 and the first timing signal strobe1 , and under the control of the second effective pulse A2 , control the driving power supply 70 to respond to the control signal and drive the invisible light source 40 to emit invisible light.

[0203] The invisible light emitted by the invisible light source 40 exits the electronic device 1, is reflected by an object, and then enters the ambient light collection unit. The first logic control circuit 328 is used to control the timing circuit 326 to output a second exposure control signal S2 during the time period t2 corresponding to the second effective pulse A2. The second exposure control signal S2, for example, includes synchronous exposure information. The second exposure control signal S2 is used to control the exposure of the second photosensitive unit in the ambient light collection unit (for example, synchronous exposure or line-by-line exposure) to convert the ambient light into an ambient photoelectric signal. The analog-to-digital converter ADC is used to convert the ambient photoelectric signal into an ambient light digital signal under the control of the second exposure control signal S2. The second exposure control signal S2, for example, includes a sampling signal. The image processor ISP is used to process the received ambient light digital signal to generate ambient light information.

[0204] Then, within an image frame, the image sensor 32 outputs visible light noise information and ambient light information, and the digital signal processing circuit 61 is coupled to the image sensor 32 of the camera assembly 20 to receive the visible light noise information and ambient light information.

[0205] Of course, one effective pulse may also be used to control the timing circuit 326 to output the first exposure control signal S1 and control the invisible light source 40 to emit invisible light. In the embodiment of the present application, two effective pulses are used as an example for illustration.

[0206] The digital signal processing circuit 61 is coupled to the image sensor 32 and is used to process the received visible light noise information and ambient light information and transmit them to the invisible light information processing circuit 62. The invisible light information processing circuit 62 processes the received signal to generate distance data, thereby determining the distance between the object and the electronic device 1.

[0207] For example, the digital signal processing circuit 61 converts the intensity of the received visible light noise information and ambient light information, and transmits the intensity information of the ambient light information and the intensity information of the visible light noise information to the invisible light information processing circuit 62. The invisible light information processing circuit 62 removes the interference of the visible light intensity and compares it with the set light intensity to obtain the distance data.

[0208] Based on this, the driving method of the electronic device 1 provided in the embodiment of the present application includes:

[0209] S10 : The system-on-chip (SOC) controls the image sensor 32 to output a control signal.

[0210] S20: In response to the control signal, the image sensor 32 acquires first visible light information based on the visible light in the first ambient light incident on the first area 322. The visible light information at this time serves as visible light noise information.

[0211] For example, the first logic control circuit 328 receives the first mode signal M1, outputs the first configuration parameters in the corresponding mode to the timing circuit 326 according to the first mode signal M1, and controls the timing circuit 326 to output the first timing signal strobe1, and the first timing signal strobe1 includes a first valid pulse A1 and a second valid pulse A2.

[0212] After receiving the first mode signal M1, the first logic control circuit 328 detects that the first valid pulse A1 of the first timing signal strobe1 corresponds to time period t1 and controls the timing circuit 326 to output the first exposure control signal S1. Under the control of the first exposure control signal S1, the visible light acquisition unit performs exposure, generating a visible photoelectric signal. Under the control of the first exposure control signal S1, the analog-to-digital converter ADC converts the visible photoelectric signal into a visible light digital signal. The image processor ISP processes the visible light digital signal and outputs first visible light information.

[0213] S30 : During the process of the invisible light source 40 emitting the invisible light in response to the control signal, the image sensor 32 acquires ambient light information according to the second ambient light incident on the second area 323 in response to the control signal.

[0214] It should be noted that the invisible light source 40 may start emitting invisible light earlier than the image sensor 32 acquires ambient light information. The invisible light source 40 may stop emitting invisible light earlier or later than the image sensor 32 stops acquiring ambient light information. FIG17 is merely illustrative and does not constitute a limitation.

[0215] The second logic control circuit 37 receives the first mode signal M1 and the first timing signal strobe1. Under the control of the first mode signal M1, it is learned that the driving power supply 70 should be controlled to drive the invisible light source 40 to emit invisible light under the control of the second valid pulse A2 of the first timing signal strobe1. The invisible light is reflected back to the camera assembly 20 by the object.

[0216] After receiving the first mode signal M1, the first logic control circuit 328 detects that the second valid pulse A2 of the first timing signal strobe1 corresponds to time period t2 and controls the timing circuit 326 to output the second exposure control signal S2. Under the control of the second exposure control signal S2, the ambient light acquisition unit performs exposure, generating an ambient photoelectric signal. Under the control of the second exposure control signal S2, the analog-to-digital converter ADC converts the ambient photoelectric signal into an ambient light digital signal. The image processor ISP processes the ambient light digital signal and outputs ambient light information.

[0217] S40 : The system-on-chip (SOC) determines whether there is an object approaching the electronic device 1 according to the first visible light information and the ambient light information.

[0218] For example, the digital signal processing circuit 61 receives the first visible light information and ambient light information sent by the image sensor 32 in the camera assembly 20, processes the received first visible light information and ambient light information, and transmits them to the invisible light information processing circuit 62. The invisible light information processing circuit 62 processes the received signal and generates distance data to determine whether there is an object approaching the electronic device 1.

[0219] In this example, invisible light can be collected in a relatively short time, improving the user experience. Furthermore, visible light information, which serves as background light, is also collected simultaneously. After processing, the interference of the environment on the invisible light information can be reduced.

[0220] In some embodiments, the system-on-chip (SOC) is further configured to adjust the display brightness of the electronic device 1 according to the visible light information.

[0221] Then, the driving method of the electronic device 1 further includes: the system-on-chip (SOC) adjusting the display brightness of the electronic device 1 according to the visible light information.

[0222] This is equivalent to multiplexing visible light noise information as reference information for adjusting display brightness, which can reduce signal acquisition brightness and simplify the structure of the electronic device 1.

[0223] Example 2

[0224] FIG18 is a driving timing diagram of an electronic device provided in an embodiment of the present application.

[0225] In some embodiments, as shown in FIG18 , the first logic control circuit 328 is configured to receive a second mode signal M2 from the mode control terminal 36 , where the second mode signal M2 is configured to indicate that the electronic device 1 is in the process of waking up from a screen-off state.

[0226] Then, the image sensor 32 is used to respond to the control signal and obtain first visible light information based on the visible light in the first ambient light incident on the first area 322. The first visible light information at this time serves as visible light image information.

[0227] The image sensor 32 is further configured to obtain ambient light information based on the second ambient light incident on the second area 323 in response to the control signal while the invisible light source 40 is emitting invisible light in response to the control signal. The ambient light information in this case includes second visible light information and invisible light information. The invisible light information includes invisible light noise information and reflected invisible light information, with the second visible light information being visible light noise information.

[0228] The system-on-chip (SOC) is used to generate an image according to the first visible light information and determine whether an object is approaching the electronic device 1 according to the invisible light information.

[0229] For example, the system-on-chip (SOC) converts visible light noise information and invisible light noise information based on visible light image information, removes the visible light noise information and invisible light noise information from the ambient light information, and determines whether there is an object approaching the electronic device 1 based on the reflected invisible light information.

[0230] In some embodiments, the first logic control circuit 328 is configured to receive a second mode signal M2 from the mode control terminal 36 and determine the operating mode of the electronic device 1 based on the second mode signal M2. For example, the second mode signal M2 indicates that both the invisible light unit and the visible light unit of the electronic device 1 are exposed, indicating that the electronic device 1 is in a mode of collecting visible light and collecting ambient light. This is used, for example, in a swing scenario. Swinging involves capturing a user's gestures or eye contact through the camera module 30, enabling the user to control the electronic device 1 without touching the electronic device 1 with their hands.

[0231] After the second mode signal M2 is determined, the first logic control circuit 328 outputs the second configuration parameter corresponding to the second mode signal M2 to the timing circuit 326. Under the control of the second configuration parameter, the timing circuit 326 outputs the second timing signal strobe2, which includes the third valid pulse A3.

[0232] In a scenario where both visible light and ambient light need to be exposed at the same time, the second timing signal strobe2 responsible for timing control can control both the ambient light collection unit and the visible light collection unit to be exposed through a third effective pulse A3.

[0233] Second logic control circuit 37 is configured to receive second mode signal M2 and second timing signal strobe2 and, under control of third valid pulse A3, control driving power supply 70 to drive invisible light source 40 to emit invisible light. Invisible light emitted by invisible light source 40 exits electronic device 1, is reflected by an object, and then enters the ambient light collection unit.

[0234] The first logic control circuit 328 is used to control the timing circuit 326 to output the third exposure control signal S3 during the period t3 corresponding to the third effective pulse A3. The third exposure control signal S3 is used to control the exposure of the image sensor 32 and generate a digital signal.

[0235] For example, during a corresponding time period t3 corresponding to the third effective pulse A3, the timing circuit 326 outputs a third exposure control signal S3, and the second photosensitive unit in the ambient light collection unit is configured to be exposed (e.g., synchronously or row-by-row) under the control of the third exposure control signal S3 to generate an ambient photoelectric signal. The first photosensitive unit in the visible light collection unit is configured to be exposed (e.g., row-by-row) under the control of the third exposure control signal S3 to generate a visible photoelectric signal.

[0236] The order in which the second photosensitive cells in the ambient light collection unit and the first photosensitive cells in the visible light collection unit are exposed is related to the division of the second area 323 and the first area 322. For example, the first few rows of photosensitive cells 327 are ambient light collection cells, while the following photosensitive cells 327 are ambient light collection cells. When exposure is performed according to the third exposure control signal S3, the ambient light signal is generated first, followed by the visible light signal.

[0237] The analog-to-digital converter (ADC) is configured to convert the ambient photoelectric signal into an ambient light digital signal and the visible photoelectric signal into a visible light digital signal under the control of the third exposure control signal S3. The image processor (ISP) is configured to process the received visible light digital signal and ambient light digital signal to generate first visible light information and ambient light information.

[0238] Then, within an image frame, the image sensor 32 outputs ambient light information and first visible light information, and the digital signal processing circuit 61 is coupled to the image sensor 32 of the camera assembly 20 to receive the ambient light information and the first visible light information.

[0239] The digital signal processing circuit 61 is used to separate and process the received ambient light information and the first visible light information, transmit the ambient light information to the invisible light information processing circuit 62 , and transmit the first visible light information to the visible light information processing circuit 63 .

[0240] The invisible light information processing circuit 62 is coupled to the digital signal processing circuit 61 and is configured to process the received ambient light information and generate distance data.

[0241] The visible light information processing circuit 63 is coupled to the digital signal processing circuit 61 and is configured to process the received first visible light information to generate image data.

[0242] In this mode, noise information can be calculated from the swing automatic exposure (AE) information.

[0243] Based on this, the driving method of the electronic device 1 provided in the embodiment of the present application includes:

[0244] S10 : The system-on-chip (SOC) controls the image sensor 32 to output a control signal.

[0245] S20: In response to the control signal, the image sensor 32 captures first visible light information from visible light in the first ambient light incident on the first area 322. This first visible light information serves as visible light image information. Furthermore, while the invisible light source 40 is emitting invisible light in response to the control signal, the image sensor 32 captures ambient light information from the second ambient light incident on the second area 323 in response to the control signal. This ambient light information includes second visible light information and invisible light information. The invisible light information includes invisible light noise information and reflected invisible light information, with the second visible light information serving as visible light noise information.

[0246] For example, the first logic control circuit 328 receives the second mode signal M2, outputs the second configuration parameter of the corresponding mode to the timing circuit 326 according to the second mode signal M2, and controls the timing circuit 326 to output the second timing signal strobe2, which includes the third valid pulse A3.

[0247] The second logic control circuit 37 receives the second mode signal M2 and the second timing signal strobe2. Under the control of the second mode signal M2, it is learned that the driving power supply 70 should be controlled to drive the invisible light source 40 to emit invisible light under the control of the third valid pulse A3 of the second timing signal strobe2. The invisible light is reflected back to the camera assembly 20 by the object.

[0248] After receiving the second mode signal M2, the first logic control circuit 328 detects that the third valid pulse A3 of the second timing signal strobe2 corresponds to time period t3 and controls the timing circuit 326 to output the third exposure control signal S3. Under the control of the third exposure control signal S3, the ambient light acquisition unit performs exposure to generate an ambient photoelectric signal. Under the control of the third exposure control signal S3, the visible light acquisition unit performs exposure to generate a visible photoelectric signal. Under the control of the third exposure control signal S3, the analog-to-digital converter ADC converts the ambient photoelectric signal into an ambient light digital signal and the visible photoelectric signal into a visible light digital signal. The image processor ISP processes the ambient light digital signal and outputs ambient light information, and processes the visible light digital signal and outputs first visible light information.

[0249] S30 : The system-on-chip (SOC) generates an image according to the first visible light information, and determines whether there is an object approaching the electronic device 1 according to the invisible light information.

[0250] For example, the digital signal processing circuit 61 receives ambient light information and first visible light information sent by the image sensor 32 in the camera assembly 20, processes the received ambient light information and first visible light information, and transmits the ambient light information to the invisible light information processing circuit 62. The invisible light information processing circuit 62 processes the received signal to generate distance data. The visible light information is transmitted to the visible light information processing circuit 63, which processes the received signal to generate image data.

[0251] In this example, both ambient light and visible light acquisition are based on the same configuration parameters, eliminating the need for camera assembly 20 to switch parameters, thus reducing the latency associated with these switching operations. Invisible light information is extracted from the entire signal output by image sensor 32, enabling both visible light image acquisition and ambient light acquisition to be completed in a shorter timeframe, improving the user experience.

[0252] Example 3

[0253] FIG19 is a driving timing diagram of an electronic device provided in an embodiment of the present application.

[0254] In some embodiments, as shown in Figure 19, the first logic control circuit 328 is used to receive a third mode signal M3 from the mode control terminal 36. The third mode signal M3 is used to indicate that the electronic device 1 is in the storage process.

[0255] Then, when the invisible light source 40 is not emitting invisible light, the image sensor 32 is configured to respond to the control signal and obtain first ambient light information based on the third ambient light incident on the second area 323. The first ambient light information in this case includes third visible light information and third invisible light information, where the third visible light information is visible light noise information, and the third invisible light information is invisible light noise information.

[0256] The image sensor 32 is further configured to obtain second ambient light information based on the fourth ambient light incident on the second area 323 in response to the control signal while the invisible light source 40 is emitting invisible light in response to the control signal. The second ambient light information in this case includes fourth visible light information and fourth invisible light information, where the fourth visible light information is visible light noise information, and the fourth invisible light information includes invisible light noise information and reflected invisible light information.

[0257] The system-on-chip (SOC) is configured to determine whether an object is approaching the electronic device 1 according to the first ambient light information and the second ambient light information.

[0258] For example, the system-on-chip (SOC) removes visible light noise information and invisible light noise information from the second ambient light information according to the third visible light information and the third invisible light information, and determines whether an object is approaching the electronic device 1 according to the reflected invisible light information.

[0259] In some embodiments, the first logic control circuit 328 is configured to receive a third mode signal M3 from the mode control terminal 36 and determine the operating mode of the electronic device 1 based on the third mode signal M3. For example, the third mode signal M3 indicates that only the ambient light collection unit of the electronic device 1 is exposed, and the electronic device 1 is in a single ambient light collection mode. For example, if the user places the electronic device 1 in a storage object (such as a pocket or bag), the swing image detection is no longer required, and the camera assembly 20 can only perform proximity light detection.

[0260] After the third mode signal M3 is determined, the first logic control circuit 328 outputs a third configuration parameter corresponding to the third mode signal M3 to the timing circuit 326. Under the control of the third configuration parameter, the timing circuit 326 outputs a third timing signal strobe3, which includes a fourth valid pulse A4 and a fifth valid pulse A5.

[0261] There is a gap between the fourth effective pulse A4 and the fifth effective pulse A5. As shown in FIG19 , within an image frame, the fourth effective pulse A4 may precede the fifth effective pulse A5. Alternatively, the fifth effective pulse A5 may precede the fourth effective pulse A4.

[0262] The first logic control circuit 328 is further used to control the timing circuit 326 to output a fourth exposure control signal S4 during the period t4 corresponding to the fourth effective pulse A4. The fourth exposure control signal S4 is used to control the exposure of the image sensor 32 and generate a digital signal.

[0263] For example, during time period t4 corresponding to the fourth effective pulse A4, the timing circuit 326 outputs a fourth exposure control signal S4. The fourth exposure control signal S4, for example, includes synchronous exposure information. The fourth exposure control signal S4 is used to control the exposure of the second photosensitive unit in the ambient light acquisition unit (e.g., synchronous exposure or line-by-line exposure), thereby converting the first ambient light into a first ambient photoelectric signal. Correspondingly, the analog-to-digital converter ADC is used to convert the first ambient photoelectric signal into a first ambient light digital signal under the control of the fourth exposure control signal S4. The fourth exposure control signal S4, for example, includes a sampling signal. The image processor ISP is used to process the received first ambient light digital signal to generate first ambient light information.

[0264] Subsequently, the second logic control circuit 37 is used to receive the third mode signal M3 and the third timing signal strobe3 , and under the control of the fifth effective pulse A5 , control the driving power supply 70 to drive the invisible light source 40 to emit invisible light.

[0265] The invisible light emitted by the invisible light source 40 exits the electronic device 1, is reflected by an object, and then enters the ambient light collection unit. The first logic control circuit 328 is used to control the timing circuit 326 to output a fifth exposure control signal S5 during the time period t5 corresponding to the fifth effective pulse A5. The fifth exposure control signal S5, for example, includes synchronous exposure information. The fifth exposure control signal S5 is used to control the exposure of the second photosensitive unit in the ambient light collection unit (for example, synchronous exposure or line-by-line exposure), converting the second ambient light into a second ambient photoelectric signal. The analog-to-digital converter ADC is used to convert the second ambient photoelectric signal into a second ambient light digital signal under the control of the fifth exposure control signal S5. The fifth exposure control signal S5, for example, includes a sampling signal. The image processor ISP is used to process the received second ambient light digital signal to generate second ambient light information.

[0266] Then, within an image frame, the image sensor 32 outputs the first ambient light information and the second ambient light information, and the digital signal processing circuit 61 is coupled to the image sensor 32 of the camera assembly 20 to receive the first ambient light information and the second ambient light information.

[0267] The digital signal processing circuit 61 is used to process the received first ambient light information and the second ambient light information and transmit them to the invisible light information processing circuit 62. The invisible light information processing circuit 62 processes the received signals to generate distance data, thereby determining the distance between the object and the electronic device 1.

[0268] For example, the digital signal processing circuit 61 converts the intensity of the received first ambient light information and the second ambient light information, and transmits the first ambient light information and the second ambient light information to the invisible light information processing circuit 62. The invisible light information processing circuit 62 removes the interference of the intensity of the first ambient light information and compares it with the set light intensity to obtain distance data.

[0269] Based on this, the driving method of the electronic device 1 provided in the embodiment of the present application includes:

[0270] S10 : The system-on-chip (SOC) controls the image sensor 32 to output a control signal.

[0271] S20: When the invisible light source 40 is not emitting invisible light, the image sensor 32 responds to the control signal and obtains first ambient light information based on the third ambient light incident on the second area 323. The first ambient light information in this case includes third visible light information and third invisible light information. The third visible light information is visible light noise information, and the third invisible light information is invisible light noise information.

[0272] For example, the first logic control circuit 328 receives the third mode signal M3, outputs the third configuration parameter of the corresponding mode to the timing circuit 326 according to the third mode signal M3, and controls the timing circuit 326 to output the third timing signal strobe3, and the third timing signal strobe3 includes the fourth valid pulse A4 and the fifth valid pulse A5.

[0273] After receiving the third mode signal M3, the first logic control circuit 328 detects that the fourth valid pulse A4 of the third timing signal strobe3 corresponds to time period t4 and controls the timing circuit 326 to output the fourth exposure control signal S4. Under the control of the fourth exposure control signal S4, the visible light acquisition unit performs exposure, generating a first ambient photoelectric signal. Under the control of the fourth exposure control signal S4, the analog-to-digital converter ADC converts the first ambient photoelectric signal into a first ambient light digital signal. The image processor ISP processes the first ambient light digital signal and outputs first ambient light information.

[0274] S30: While the invisible light source 40 is emitting invisible light in response to the control signal, the image sensor 32 obtains second ambient light information based on the fourth ambient light incident on the second area 323 in response to the control signal. The second ambient light information in this case includes fourth visible light information and fourth invisible light information. The fourth visible light information is visible light noise information, and the fourth invisible light information includes invisible light noise information and reflected invisible light information.

[0275] For example, the second logic control circuit 37 receives the third mode signal M3 and the third timing signal strobe3. Under the control of the third mode signal M3, it is learned that the driving power supply 70 should be controlled to drive the invisible light source 40 to emit invisible light under the control of the fifth valid pulse A5 of the third timing signal strobe3, and the invisible light is reflected back to the camera assembly 20 by the object.

[0276] After receiving the third mode signal M3, the first logic control circuit 328 detects that the fifth valid pulse A5 of the third timing signal strobe3 corresponds to time period t5. It then controls the timing circuit 326 to output the fifth exposure control signal S5. Under the control of the fifth exposure control signal S5, the ambient light acquisition unit performs exposure, generating a second ambient photoelectric signal. Under the control of the fifth exposure control signal S5, the analog-to-digital converter ADC converts the second ambient photoelectric signal into a second ambient light digital signal. The image processor ISP processes the second ambient light digital signal and outputs second ambient light information.

[0277] S40 : The system-on-chip (SOC) determines whether there is an object approaching the electronic device 1 according to the first ambient light information and the second ambient light information.

[0278] For example, the digital signal processing circuit 61 receives the first ambient light information and the second ambient light information sent by the image sensor 32 in the camera assembly 20, processes the received first ambient light information and the second ambient light information, and transmits them to the invisible light information processing circuit 62. The invisible light information processing circuit 62 processes the received signal and generates distance data.

[0279] In the embodiment of the present application, the first ambient light information and the second ambient light information are both exposed by the ambient light collection unit, and the visible light collection unit does not need to be exposed, which can reduce the number of driven photosensitive units 327 and save power consumption.

[0280] The present application also provides a computer-readable medium storing a computer program. When the computer program is executed on an electronic device 1, the electronic device executes the aforementioned method for driving a camera assembly or the aforementioned method for driving an electronic device. The present application also provides a computer program product containing instructions. When the computer program product is executed on an electronic device 1, the electronic device 1 executes the aforementioned method for driving a camera assembly or the aforementioned method for driving an electronic device.

[0281] The computer-readable medium may be a read-only memory (ROM) or other type of static storage device that can store static information and instructions, a random access memory (RAM) or other type of dynamic storage device that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory may exist independently and be connected to the processor via a communication bus. The memory may also be integrated with the processor.

[0282] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware, or any combination thereof. When implemented using a software program, all or part of the embodiments may be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer-executable instructions are loaded and executed on a computer, the processes or functions described in the embodiments of the present application are generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transferred from one computer-readable storage medium to another computer-readable storage medium.

[0283] The above is only a specific embodiment of the present application, but the scope of protection of this application is not limited to this. Any changes or substitutions within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A camera assembly, characterized in that: include: A camera module, including structural parts, a filter layer, an image sensor and a substrate; The structural member is cylindrical and is arranged to form an enclosed space, one end of the structural member is a light inlet of the camera assembly, and the other end of the structural member is buckled on the substrate, and the filter layer and the image sensor are located in the enclosed space; the light inlet is used to allow the ambient light incident on the camera module to enter the enclosed space; The filter layer is located between the image sensor and the light entrance, and is used to transmit the visible light in the ambient light and cut off the invisible light in the ambient light; The image sensor comprises a first area and a second area, and the projection of the filter layer on the image sensor overlaps with the first area; The image sensor is used to output a control signal; an invisible light source, located outside the enclosed space; the invisible light source is used to emit invisible light in response to the control signal; The image sensor is used for acquiring first visible light information according to visible light in the first ambient light incident into the first area in response to the control signal; The image sensor is further configured to obtain ambient light information in response to the control signal according to the second ambient light incident into the second area, where the ambient light information includes second visible light information and invisible light information.

2. The camera assembly according to claim 1, characterized in that: The control signal includes a timing signal.

3. The camera assembly according to claim 1 or 2, characterized in that: The image sensor further has a third area, the first area is located inside the third area, and the second area is located within the third area and outside the first area; The third area is an area formed on the image sensor by the light entering the camera module through the light entrance.

4. The camera assembly according to claim 3, characterized in that: The image sensor includes a plurality of first photosensitive units, a plurality of second photosensitive units and a receiving circuit; The plurality of first photosensitive units are located in the first area and are used for exposure to the visible light; the plurality of second photosensitive units are located in the second area and are used for exposure to the ambient light; The plurality of first photosensitive units and the second photosensitive unit are both coupled to the receiving circuit.

5. The camera assembly according to any one of claims 1 to 4, characterized in that: The filter layer is also used for transmitting the second ambient light.

6. The camera assembly according to any one of claims 1 to 5, characterized in that: The camera assembly further includes a light guide, and the invisible light emitted by the invisible light source is emitted out of the camera assembly through the light guide.

7. The camera assembly according to claim 6, characterized in that: The light guide member includes a light emitting portion, and the light emitting portion surrounds at least a portion of the light incident port.

8. The camera assembly according to any one of claims 1 to 7, characterized in that: The invisible light source is arranged on the substrate; The structural member comprises a light source accommodating area, the light source accommodating area is spaced apart from the surrounding space, and the invisible light source is located in the light source accommodating area; or, The invisible light source is located outside the structural component.

9. A driving method for driving the camera assembly according to any one of claims 1 to 8, characterized in that: The driving method comprises: The image sensor outputs a control signal; The invisible light source emits invisible light in response to the control signal; The image sensor acquires first visible light information according to visible light in the first ambient light incident on the first area in response to the control signal; The image sensor also acquires ambient light information according to the second ambient light incident on the second area in response to the control signal.

10. The driving method according to claim 9, characterized in that: The control signal includes a timing signal.

11. An electronic device, characterized in that: It comprises a camera assembly and a system-level chip; the system-level chip is coupled to the image sensor of the camera assembly; the camera assembly comprises the camera assembly according to any one of claims 1 to 8; The system-level chip is used to control the image sensor to output a control signal, and is also used to receive first visible light information and ambient light information output by the image sensor, and determine whether there is an object approaching the electronic device according to invisible light information in the ambient light information.

12. The electronic device according to claim 11, characterized in that: During a call: The image sensor is used for acquiring first visible light information according to visible light in first ambient light incident into the first area in response to the control signal; The image sensor is further used to obtain ambient light information according to the second ambient light incident on the second area in response to the control signal during the process in which the invisible light source emits the invisible light in response to the control signal; The system-level chip is used to determine whether there is an object approaching the electronic device according to the first visible light information and the invisible light information in the ambient light information.

13. The electronic device according to claim 11 or 12, characterized in that: During the screen-off wake-up process: The image sensor is used for acquiring first visible light information according to visible light in first ambient light incident into the first area in response to the control signal; The image sensor is further used to obtain ambient light information according to the second ambient light incident on the second area in response to the control signal during the process in which the invisible light source emits the invisible light in response to the control signal; The system-level chip is used to generate an image according to the first visible light information, and to determine whether there is an object approaching the electronic device according to the invisible light information in the ambient light information.

14. The electronic device according to any one of claims 11 to 13, characterized in that: During the collection process: The image sensor is used for acquiring the first ambient light information according to the third ambient light incident into the second area in response to the control signal; The image sensor is further used for acquiring second ambient light information according to fourth ambient light incident on the second area in response to the control signal during the process in which the invisible light source emits the invisible light in response to the control signal; The system-level chip is used to determine whether there is an object approaching the electronic device according to the first ambient light information and the second ambient light information.

15. The electronic device according to claim 12, characterized in that: The system-level chip is also used to adjust the display brightness of the electronic device according to the first visible light information.

16. The electronic device according to any one of claims 11 to 15, characterized in that: The electronic device further comprises a driving power supply; the driving power supply drives the invisible light source to emit invisible light in response to the control signal; The driving power source is arranged on a substrate of the camera assembly; or, The electronic device further comprises a circuit board, and the driving power supply is arranged on the circuit board; or, The electronic device further comprises a power management module, and the driving power supply is integrated in the power management module.

17. A method for driving an electronic device, used for driving the electronic device according to any one of claims 11 to 16, characterized in that: The driving method comprises: The system-level chip controls the image sensor to output a control signal; The camera assembly outputs first visible light information and ambient light information in response to the control signal; The system-level chip determines whether there is an object approaching the electronic device according to the ambient light information.

18. The driving method according to claim 17, characterized in that: The camera assembly outputs first visible light information and ambient light information in response to the control signal, including: During a call: The image sensor acquires first visible light information according to visible light in the first ambient light incident on the first area in response to the control signal; During the process in which the invisible light source emits the invisible light in response to the control signal, the image sensor acquires the ambient light information according to the ambient light incident on the second area in response to the control signal; The system-level chip determines whether there is an object approaching the electronic device according to the first visible light information and the ambient light information.

19. The driving method according to claim 17 or 18, characterized in that: The camera assembly outputs first visible light information and ambient light information in response to the control signal, including: During the screen-off wake-up process: The image sensor acquires first visible light information according to visible light in the first ambient light incident on the first area in response to the control signal; In the process where the invisible light source emits the invisible light in response to the control signal, the image sensor also acquires ambient light information according to the second ambient light incident on the second area in response to the control signal; The system-level chip is used to generate an image according to the first visible light information, and to determine whether there is an object approaching the electronic device according to the invisible light information in the ambient light information.

20. The driving method according to any one of claims 17 to 19, characterized in that: The camera assembly outputs first visible light information and ambient light information in response to the control signal, including: During the collection process: The image sensor acquires the first ambient light information according to the third ambient light incident on the second area in response to the control signal; In the process where the invisible light source emits the invisible light in response to the control signal, the image sensor also acquires second ambient light information according to fourth ambient light incident on the second area in response to the control signal; The system-level chip is used to determine whether there is an object approaching the electronic device according to the first ambient light information and the second ambient light information.

21. The driving method according to claim 18, characterized in that: The driving method further includes: the system-level chip adjusting the display brightness of the electronic device in response to the first visible light information.

22. A computer readable medium, characterized in that The computer-readable medium stores a computer program, and when the computer program is executed on an electronic device, the electronic device executes the driving method according to any one of claims 9, 10, or 17-21.

Images