Camera assembly and driving method thereof, electronic equipment and driving method thereof

Abstract

The embodiment of the invention provides a camera assembly and a driving method thereof, and electronic equipment and a driving method thereof, relates to the technical field of electronics, and is used for providing an optimization scheme of integrating a proximity light sensor in the electronic equipment. The camera assembly comprises a camera module and an invisible light source, and detection of invisible light is completed by the camera module. The camera module comprises an image sensor, and the image sensor is used for outputting a control signal; the invisible light source is used for emitting invisible light in response to the control signal; the image sensor is used for responding to the control signal and acquiring first visible light information according to the visible light entering the first area; the image sensor is further used for responding to the control signal and obtaining environment light information according to the environment light emitted into the second area. The camera assembly has a camera shooting function and a detection function of the proximity light sensor.

Description

Technical Field

[0001] The present application relates to the field of electronic technology, and in particular to a camera assembly and a driving method thereof, an electronic device and a driving method thereof. Background Art

[0002] In recent years, optoelectronic technology has been increasingly used in various fields, including optical sensors. Proximity light sensors are a common type of photoelectric sensor, and their application scenarios are also very wide.

[0003] For example, the proximity light sensor can be used to detect the call state to reduce the possibility of accidental operation of the electronic device by the ear or hand in such a scenario. The proximity light sensor can be used to detect the screen-off wake-up (swing) state to enable the user to control the electronic device without touching the electronic device with their hands. The proximity light sensor can be used to detect the storage state (put into a pocket or bag) to activate the anti-mistouch function, etc.

[0004] However, how to make an electronic device include a proximity light sensor without affecting the performance of the electronic device and the proximity light sensor has become a difficult problem that troubles those skilled in the art. Summary of the invention

[0005] The embodiments of the present application provide a camera assembly and a driving method thereof, an electronic device and a driving method thereof, which are used to provide an optimization solution for integrating a proximity light sensor in an electronic device.

[0006] In order to achieve the above objectives, this application adopts the following technical solutions:

[0007] In a first aspect of the embodiments of the present application, a camera assembly is provided, which has both a camera function and a detection function of a proximity light sensor. The camera assembly includes a camera module and an invisible light source, and the detection of the invisible light is performed by the camera module. The camera module includes a structural member, a filter layer, an image sensor and a substrate; the structural member is cylindrical and is arranged to form an enclosed space, one end of the structural member is a light inlet of the camera assembly, the other end of the structural member is buckled on the substrate, and the filter layer and the image sensor are located in the enclosed space; the light inlet is used to allow ambient light to enter the enclosed space through ambient light incident on the camera module; the filter layer is located between the image sensor and the light inlet, and the filter layer is used to transmit visible light in the ambient light and cut off invisible light in the ambient light; the image sensor includes a first area and a second area, the projection of the filter layer on the image sensor overlaps with the first area, the first area is used to receive visible light, and the second area is used to receive ambient light; the image sensor is used to output a control signal; the invisible light source is located outside the enclosed space, and is used to emit invisible light in response to the control signal; the image sensor is used to obtain first visible light information according to visible light in the first ambient light incident on the first area in response to the control signal; the image sensor is also used to obtain ambient light information according to the second ambient light incident on the second area in response to the control signal, and the ambient light information includes second visible light information and invisible light information.

[0008] The camera assembly provided by the embodiment of the present application includes a camera module, and the first area of ​​the image sensor can obtain visible light information in the ambient light, so that the camera assembly can normally realize the function of the camera. On this basis, the camera assembly also includes an invisible light source, and the invisible light emitted by the invisible light source is reflected by the object, mixed in the ambient light, and enters the image sensor of the camera module through the light inlet of the camera module, and generates ambient light information after being exposed by the second area of ​​the image sensor. The ambient light information includes the invisible light information corresponding to the invisible light reflected back, so that the camera assembly can realize the function of the proximity light sensor. Moreover, the image sensor is arranged in the surrounding space, and the invisible light source is arranged outside the surrounding space. The invisible light source and the image sensor are separated by a structural member, which can realize the light isolation between the light receiver and the light source, avoid the light crosstalk emitted by the invisible light source to the area where the image sensor is located, and can ensure the detection effect of the image sensor. Therefore, the camera assembly can achieve the same effect as independently setting a camera and a proximity light sensor. On this basis, the light inlet of the camera module is used as the light inlet area of ​​the invisible light, and there is no need to set the light inlet required for the proximity light sensor separately. That is to say, the camera assembly provided in the embodiment of the present application has the functions of a camera and a proximity light sensor integrated inside, but only one light inlet is required to receive light from the outside. When the camera assembly is applied to an electronic device, there is no need to increase the holes required for the incidence of invisible light, and the number of camera holes in the screen stack in the electronic device can be reduced. Therefore, even if the camera hole in the screen stack runs through the entire screen stack in order to improve the transmittance of the camera hole and enhance the detection effect of invisible light, the reliability of the screen stack can still be improved, the display visual effect and screen-to-body ratio can be improved, and the internal space of the electronic device can be saved. In addition, the invisible light source emits invisible light, and the image sensor obtains visible light information and ambient light information, all in response to the same control signal, so that the delay of invisible light detection is low.

[0009] In a possible implementation, the control signal includes a timing signal. The timing signal can be used to control the camera assembly to periodically detect whether an object is approaching the electronic device including the camera assembly, so that the state of the electronic device can be adjusted in time.

[0010] In a possible implementation, the image sensor further has a third area, the first area is located inside the third area, and the second area is located inside the third area and outside the first area; the third area is an area formed on the image sensor by the light entering the camera module through the light inlet. A method for the image sensor to realize invisible light exposure is provided, so that the image sensor has the exposure function of invisible light and is feasible.

[0011] In a possible implementation, the image sensor includes a plurality of first photosensitive units, a plurality of second photosensitive units, and a receiving circuit; the plurality of first photosensitive units are located in a first area and are used for exposure to visible light; the plurality of second photosensitive units are located in a second area and are used for exposure to ambient light; the plurality of first photosensitive units and the second photosensitive units are coupled to the receiving circuit. The same set of receiving circuits is used to receive and process the exposure information generated by the first photosensitive units and the second photosensitive units, so that the structure of the image sensor can be simplified.

[0012] In a possible implementation, the filter layer is also used to transmit the second ambient light. By setting the properties of the fourth area and the fifth area of ​​the filter layer to match the scheme on the image sensor, the overall camera assembly can maintain the size of the camera module and integrate the function of the proximity light sensor without changing the spatial layout of the camera module.

[0013] In a possible implementation, the filter layer further includes an isolation region, and the isolation region is located between the fourth region and the fifth region. By providing the isolation region, interference between visible light and invisible light can be isolated.

[0014] In a possible implementation, the camera assembly further includes a light guide, and the invisible light emitted by the invisible light source is emitted out of the camera assembly through the light guide. By providing the light guide, more light information emitted by the invisible light source can be transmitted to the light exit area, which can improve the utilization rate of the light information.

[0015] In a possible implementation, the camera assembly further includes a light guide, the light guide includes a light outlet, and the light outlet surrounds at least a portion of the light inlet. In this way, the light outlet for invisible light and the light inlet of the camera module can correspond to the same camera hole on the electronic device, which can reduce the number of camera holes on the electronic device.

[0016] In a possible implementation, the invisible light source is disposed on the substrate; the structural member includes a light source accommodating area, the light source accommodating area is spaced apart from the surrounding space, and the invisible light source is located in the light source accommodating area. By providing a light source accommodating area for accommodating the invisible light source, more invisible light emitted by the invisible light source can be conducted to the light emitting area, thereby improving the utilization rate of light information.

[0017] In a possible implementation, the invisible light source is disposed on the substrate; the invisible light source is located outside the structural member. Such a design can make the structural member have the advantage of small size, and the camera assembly has the advantage of light weight. Moreover, the invisible light source is located outside the structural member, and there is no need to set a light source accommodation area on the structural member, so that the structure of the structural member is simplified, which has the advantage of low manufacturing cost.

[0018] The second aspect of the embodiment of the present application provides a driving method for driving the camera assembly of any one of the first aspects, the driving method comprising: the image sensor outputs a control signal; the invisible light source emits invisible light in response to the control signal; the image sensor responds to the control signal and obtains first visible light information according to visible light in the first ambient light incident on the first area; the image sensor also responds to the control signal and obtains ambient light information according to the second ambient light incident on the second area. The beneficial effects of the driving method provided in the embodiment of the present application are the same as the beneficial effects of the camera assembly, and will not be repeated here.

[0019] In a possible implementation manner, the control signal includes a timing signal.

[0020] According to a third aspect of an embodiment of the present application, an electronic device is provided, comprising a camera assembly and a system-level chip; the system-level chip is coupled to an image sensor of the camera assembly; the camera assembly comprises the camera assembly of any one of the first aspects; the system-level chip is used to control the image sensor to output a control signal, and is also used to receive ambient light information output by the image sensor, and determine whether there is an object approaching the electronic device based on the ambient light information.

[0021] The electronic device provided in the embodiment of the present application includes the camera assembly of the first aspect, and its beneficial effects are the same as the beneficial effects of the camera assembly, which will not be repeated here.

[0022] In a possible implementation, during a call: the image sensor is used to respond to a control signal and obtain first visible light information based on visible light in the first ambient light emitted into the first area; the image sensor is also used to respond to a control signal and obtain ambient light information based on the second ambient light emitted into the second area during the process of the invisible light source emitting invisible light in response to the control signal; the system-level chip is used to determine whether there is an object approaching the electronic device based on the first visible light information and the invisible light information in the ambient light information. By determining whether there is an object approaching the electronic device, it is possible to identify scenarios where the electronic device is placed next to the ear for a call and close contact without operating the display screen, so as to prompt the electronic device to reduce the misoperation of the display screen by the ear or hand in such scenarios, so as to improve the utilization of power.

[0023] In a possible implementation, during the screen-off wake-up process: the image sensor is used to respond to the control signal and obtain first visible light information according to the visible light in the first ambient light emitted into the first area; the image sensor is also used to respond to the control signal and obtain ambient light information according to the second ambient light emitted into the second area during the process of the invisible light source emitting invisible light in response to the control signal; the system-level chip is used to generate an image according to the first visible light information and determine whether there is an object approaching the electronic device according to the invisible light information in the ambient light information. By determining whether there is an object approaching the electronic device, the camera component is controlled to capture a person's gestures or eyes, so that the user can control the electronic device without touching the electronic device with his hands.

[0024] In a possible implementation, during the storage process: the image sensor is used to respond to the control signal and obtain the first ambient light information according to the third ambient light incident on the second area; the image sensor is also used to respond to the control signal and obtain the second ambient light information according to the fourth ambient light incident on the second area during the process of the invisible light source emitting invisible light in response to the control signal; the system-level chip is used to determine whether there is an object approaching the electronic device according to the first ambient light information and the second ambient light information. By determining whether there is an object approaching the electronic device, whether to start the anti-false touch function is controlled to reduce power consumption and experience effect.

[0025] In a possible implementation, the system-level chip is further used to adjust the display brightness of the electronic device according to the first visible light information. By multiplexing the collected visible light information to adjust the display brightness of the electronic device, the signal collection brightness can be reduced and the structure of the electronic device can be simplified.

[0026] In a possible implementation, the electronic device further includes a driving power supply; the driving power supply drives the invisible light source to emit invisible light in response to the control signal; and the driving power supply is disposed on a substrate of the camera assembly. This is a low-cost implementation.

[0027] In a possible implementation, the electronic device further includes a driving power supply; the driving power supply drives the invisible light source to emit invisible light in response to the control signal; the electronic device further includes a circuit board, and the driving power supply is disposed on the circuit board. This is a low-cost implementation.

[0028] In a possible implementation, the electronic device further includes a driving power supply; the driving power supply drives the invisible light source to emit invisible light in response to the control signal; the electronic device further includes a power management module, and the driving power supply is integrated in the power management module. This is a low-cost implementation.

[0029] According to a fourth aspect of an embodiment of the present application, a driving method of an electronic device is provided, which is used to drive the electronic device of any one of the third aspects. The driving method comprises: a system-level chip controls an image sensor to output a control signal; a camera component outputs ambient light information in response to the control signal; and the system-level chip determines whether an object is approaching the electronic device based on the ambient light information.

[0030] The beneficial effects of the driving method of the electronic device provided in the embodiment of the present application are the same as the beneficial effects of the electronic device, which will not be repeated here.

[0031] In one possible implementation, the camera component outputs first visible light information and ambient light information in response to a control signal, including: during a call: the image sensor responds to the control signal to obtain first visible light information based on visible light in the first ambient light incident on the first area; when the invisible light source emits invisible light in response to the control signal, the image sensor responds to the control signal to obtain ambient light information based on the ambient light incident on the second area; the system-level chip determines whether there is an object approaching the electronic device based on the first visible light information and the ambient light information.

[0032] In one possible implementation, the camera component outputs first visible light information and ambient light information in response to a control signal, including: during the screen-off wake-up process: the image sensor responds to the control signal to obtain the first visible light information based on the visible light in the first ambient light emitted into the first area; during the invisible light source emitting invisible light in response to the control signal, the image sensor also responds to the control signal to obtain the ambient light information based on the second ambient light emitted into the second area; the system-level chip is used to generate an image based on the first visible light information, and determine whether there is an object approaching the electronic device based on the invisible light information in the ambient light information.

[0033] In one possible implementation, the camera component outputs first visible light information and ambient light information in response to a control signal, including: during the storage process: the image sensor responds to the control signal to obtain the first ambient light information based on the third ambient light emitted into the second area; when the invisible light source emits invisible light in response to the control signal, the image sensor also responds to the control signal to obtain the second ambient light information based on the fourth ambient light emitted into the second area; the system-level chip is used to determine whether there is an object approaching the electronic device based on the first ambient light information and the second ambient light information.

[0034] In a possible implementation, the driving method further includes: the system-level chip adjusts the display brightness of the electronic device in response to the first visible light information.

[0035] According to a fifth aspect of the embodiments of the present application, a computer-readable medium is provided, which stores a computer program. When the computer program runs on an electronic device, the electronic device executes a driving method as described in any one of the second aspect or any one of the fourth aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Figure 1 An appearance diagram of an electronic device provided in an embodiment of the present application;

[0037] Figure 2 for Figure 1 A cross-sectional view along the A1-A2 direction;

[0038] Figure 3 An exploded diagram of an electronic device illustrated in an embodiment of the present application;

[0039] Figure 4 A schematic diagram of the principle of a proximity light sensor provided in an embodiment of the present application;

[0040] Figure 5 A schematic diagram of the appearance of an electronic device according to an embodiment of the present application;

[0041] Figure 6 A cross-sectional view of an electronic device according to an embodiment of the present application;

[0042] Figure 7 A schematic diagram of the structure of a camera assembly and a screen stack provided in an embodiment of the present application;

[0043] Fig. 8A An exploded view of a camera assembly provided in an embodiment of the present application;

[0044] Figure 8B An assembly diagram of a camera assembly provided in an embodiment of the present application;

[0045] Figure 8C An assembly diagram of another camera assembly provided in an embodiment of the present application;

[0046] Figure 9-11 A plan view of an image sensor provided in an embodiment of the present application;

[0047] Fig.12 and Fig.13 A schematic plan view of a filter layer provided in an embodiment of the present application;

[0048] Fig.14 A schematic structural diagram of a light guide provided in an embodiment of the present application;

[0049] Fig.15 and Fig.16A schematic diagram of the topological structure of an image sensor and a system-on-chip provided in an embodiment of the present application;

[0050] Figure 17-Figure 19 A driving timing diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0051] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all of the embodiments.

[0052] In the following, the terms "second", "first", etc. are used only for convenience of description and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "second", "first", etc. may explicitly or implicitly include one or more of the feature. In the description of this application, unless otherwise specified, "plurality" means two or more.

[0053] In addition, in the embodiments of the present application, directional terms such as "up", "down", "left" and "right" may be defined including but not limited to the orientation relative to the schematic placement of the components in the drawings. It should be understood that these directional terms may be relative concepts, which are used for relative description and clarification, and may change accordingly according to changes in the orientation of the components in the drawings.

[0054] In the embodiments of the present application, unless otherwise clearly specified and limited, the term "connection" should be understood in a broad sense. For example, "connection" can be a fixed connection, a detachable connection, or an integral connection; it can be directly connected or indirectly connected through an intermediate medium. In addition, the term "coupled" can be a direct electrical connection or an indirect electrical connection through an intermediate medium. The term "contact" can be a direct contact or an indirect contact through an intermediate medium.

[0055] In the embodiments of the present application, "and / or" describes the association relationship of the associated objects, indicating that there may be three relationships. For example, A and / or B may represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B may be singular or plural. The character " / " generally indicates that the associated objects are in an "or" relationship.

[0056] An electronic device is provided in an embodiment of the present application. The electronic device is, for example, a consumer electronic product with a camera function, or a home electronic product. Among them, consumer electronic products include mobile phones, tablet computers, laptop computers, personal digital assistants (PDAs), smart wearable products (e.g., smart watches, smart bracelets), virtual reality (VR) electronic devices, augmented reality (AR) electronic devices, drones, etc. Home electronic products include smart door locks, etc. The embodiments of the present application do not impose any special restrictions on the specific forms of the above-mentioned electronic devices.

[0057] Figure 1 This is an appearance diagram of an electronic device provided in an embodiment of the present application. Figure 2 for Figure 1 Cross-sectional view along A1-A2 direction.

[0058] like Figure 1 As shown, the electronic device 1 includes a cover glass (CG) and a housing 11. The cover glass CG and the housing 11 are combined to form a receiving space, and the components of the electronic device 1 that complete the display are arranged in the receiving space. The cover glass CG is a transparent structure, for example, the cover glass CG has a high light transmittance.

[0059] In some embodiments, Figure 2 As shown, the structure arranged in the accommodating space of the electronic device 1 includes a screen stack, which includes a display screen (panel) 12, a polarizer (POL), an optically clear adhesive (OCA), a back plate (BP), and a heat dissipation film (super clean foam, SCF).

[0060] The display screen 12 is, for example, an organic light emitting diode (OLED) display screen. The display screen 12 is used for display highlighting. A touch function may also be integrated in the display screen 12. The polarizer POL and the optical transparent adhesive OCA are sequentially arranged on the light emitting side of the display screen 12. The back plate BP and the heat dissipation film SCF are sequentially arranged on the backlight side of the display screen 12. Figure 1 and Figure 2 As shown, the screen stack includes a camera hole, and the cover plate CG is arranged on the light-emitting side of the screen stack, and the cover plate CG covers the camera hole.

[0061] In some embodiments, the electronic device 1 also includes a front camera assembly 20, which is disposed in the accommodating space. The lens of the front camera assembly 20 extends into the camera hole to collect light in front of the electronic device 1 through the camera hole to achieve shooting.

[0062] Figure 3 An exploded diagram of an electronic device according to an embodiment of the present application.

[0063] For example, Figure 3 As shown, the front camera assembly 20 is disposed below the screen stack, and at least a portion of the front camera assembly 20 (eg, the lens) extends into the camera hole.

[0064] In some embodiments, the electronic device 1 further includes a rear camera assembly, which includes at least one camera module, for example, a standard camera module, a telephoto camera module, a wide-angle camera module, an ultra-telephoto camera module, and an ultra-wide-angle camera module. Correspondingly, a rear camera hole is provided on the housing 11, and the rear camera assembly collects light from the rear of the electronic device 1 through the rear camera hole to achieve shooting.

[0065] In some embodiments, the electronic device 1 further includes components such as a printed circuit board (PCB), a system on chip (SOC), a processor, a memory, a battery, etc., and the system on chip, the processor, and the memory are fixed on the circuit board. The display screen 12, the front camera assembly 20, and the rear camera assembly are electrically connected to the processor. The memory is used to store computer program codes. The computer program code includes computer instructions. The processor is used to call computer instructions to enable the electronic device 1 to perform corresponding operations, for example, to enable the display screen 12 to display a target image, to enable the front camera assembly and the rear camera assembly to capture a target image, etc. The battery is electrically connected to the circuit board for powering the electronic device 1. In some embodiments, the electronic device 1 may also include one or more of functional modules such as an antenna module, a mobile communication module, a sensor module, a motor, a microphone module, a speaker module, etc., and these functional modules may be electrically connected to the processor to transmit signals.

[0066] In recent years, optoelectronic technology has been increasingly used in various fields, including optical sensors. Proximity light sensors are a common type of photoelectric sensor, and their application scenarios are also very wide.

[0067] For example, in the first application scenario (during a call), when the user uses the electronic device 1 to make a call, the electronic device 1 will be close to the ear, and the user cannot see the display screen 12. If the display screen 12 of the electronic device 1 is always on during the call, the waste of electricity will be very serious. A proximity light sensor is set in the electronic device 1, and the proximity light sensor can identify the scene where the electronic device 1 is placed next to the ear for a call and there is no need to operate the display screen 12 at a close distance, so as to prompt the electronic device 1 to reduce the misoperation of the ear or hand on the display screen 12 in such a scene, so as to improve the utilization rate of electricity.

[0068] In the second application scenario (during the screen swing), when it is determined by proximity light that the user is within a certain range in front of the electronic device 1, the camera assembly 20 captures the person's gestures or eyes, allowing the user to control the electronic device 1 without touching the electronic device 1 with his hands.

[0069] In the third application scenario (storage state), the pocket mode is activated by blocking the proximity light sensor and being in a dark environment. In the pocket mode, the false touch prevention function is activated and the power consumption is reduced to improve the utilization rate of power.

[0070] Based on this, in some embodiments, the electronic device 1 further includes a proximity light sensor. The following is a schematic description of the configuration of the proximity light sensor in the electronic device 1.

[0071] Figure 4 A schematic diagram of the principle of a proximity light sensor provided in an embodiment of the present application.

[0072] like Figure 4 As shown in the figure, the principle of the proximity light sensor is to sense objects through infrared reflection. The proximity light sensor includes an infrared light transmitter and an infrared light receiver. First, the infrared light emitted by the infrared light transmitter is reflected by the approaching object to the infrared light receiver. The infrared light receiver determines the distance of the approaching object from the proximity light sensor based on the intensity of the received infrared light, thereby realizing the function of sensing the distance of the object.

[0073] Figure 5 The present invention is a schematic diagram of the appearance of an electronic device according to an embodiment of the present application.

[0074] In some embodiments, Figure 5 As shown, the electronic device 1 also includes an infrared light emitting hole and an infrared light receiving hole, which are located near the camera hole. The infrared light emitted by the infrared light emitter is emitted from the electronic device 1 through the infrared light emitting hole, and the reflected infrared light is emitted into the infrared light receiver through the infrared light receiving hole. Figure 2The camera holes shown are the same. In order to reduce the impact on the infrared light transmission effect, the infrared light emitting hole and the infrared light receiving hole will pass through the screen stack, leaving only the top cover CG.

[0075] By setting an infrared light emitting hole and an infrared light receiving hole to provide a light path for the proximity light sensor, the function of the proximity light sensor can be realized. However, since the holes will reduce the reliability of the screen stacking, the screen stacking will be easily damaged in scenes such as falling and squeezing.

[0076] Figure 6 A cross-sectional view of an electronic device according to an embodiment of the present application.

[0077] In other embodiments, Figure 6 As shown, the camera hole, the infrared light emitting hole and the infrared light receiving hole only penetrate the film layer located below the display screen 12 in the screen stack, such as the back plate BP and the heat dissipation film SCF. Figure 6 Only the infrared light emitting hole is shown.

[0078] Placing the front camera assembly and the proximity light sensor (such as an infrared light transmitter and an infrared light receiver) below the display screen 12 can improve the reliability and appearance refinement of the display screen 12. However, the propagation of infrared light will be affected by the display screen 12 and the film layer above it. In particular, with the development of the display screen 12 technology, the density of the pixel circuit in the display screen 12 will gradually increase, squeezing out the area ratio of the original light-transmitting part, reducing the screen transmittance, and making the solution of placing the proximity light sensor below the display screen 12 increasingly unfeasible.

[0079] Based on this, an embodiment of the present application provides a camera component that integrates the hardware structure and control logic of the proximity light sensor into the camera component, which can not only realize the functions of the proximity light sensor and the original functions of the camera at the same time, but also reduce the number of openings in the display screen 12.

[0080] Figure 7 A schematic structural diagram of a camera assembly and screen stack provided in an embodiment of the present application.

[0081] In some embodiments, Figure 7 As shown, the camera assembly 20 includes a camera module 30 and an invisible light source 40, and the invisible light source 40 is integrated in the camera module 30. The camera module 30 includes a substrate 31, and the substrate 31 is used to set electronic devices. The camera module 30 also includes electronic devices such as an image sensor (CMOS image sensor, CIS) 32, and the image sensor 32 and the invisible light source 40 are both arranged on the substrate 31. The image sensor 32 can be sunk into the substrate 31, for example, a groove is set on the surface of the substrate 31, and the image sensor 32 is accommodated in the groove.

[0082] The camera module 30 also includes a structural member 33, which is cylindrical and encloses a surrounding space 331. Along the direction of the optical axis of the camera module 30, the opposite ends of the structural member 33 are both open. The first end of the structural member 33 is the light inlet a of the camera assembly 20. When the camera module 30 is applied to the electronic device 1, the first end of the structural member 33 extends into the camera hole of the electronic device 1. The second end of the structural member 33 is buckled on the substrate 31 to form a closed space. The image sensor 32 is located in the surrounding space 331, and the invisible light source 40 is located outside the surrounding space 331. The invisible light source 40 is used to send invisible light. The structural member 33 isolates the image sensor 32 from the invisible light source 40, so that the invisible light sent by the invisible light source 40 will not directly irradiate the image sensor 32.

[0083] The invisible light source 40 may be, for example, an infrared light source, an ultraviolet light source, or a far-infrared light source, etc. For example, the invisible light source 40 includes a vertical-cavity surface-emitting laser (VCSEL).

[0084] In some embodiments, the periphery of the light inlet a is a light exit area for the invisible light emitted by the invisible light source 40. After the invisible light is emitted through the light exit area, the invisible light reflected by the object is emitted into the surrounding space 331 of the camera module 30 through the light inlet a. The visible light emitted into the camera module 30 also enters the surrounding space 331 through the light inlet a.

[0085] The invisible light exit area may be a continuous area or include multiple discontinuous areas, which is not limited in the present embodiment.

[0086] In some embodiments, Figure 7 As shown, the camera module 30 also includes a filter layer 34 (the filter layer 34 may also be other types of optical elements) and a lens 35.

[0087] The filter layer 34 and the lens 35 are arranged in the surrounding space 331 . Along the direction of the optical axis of the camera module 30 , the filter layer 34 is located between the image sensor 32 and the light entrance a, and the lens 35 is located on the side of the filter layer 34 away from the image sensor 32 .

[0088] In some embodiments, the filter layer 34 and the lens 35 are fixed to the structural member 33 . Figure 7The illustrated embodiment merely schematically shows the relative positional relationship between the various structural elements in the camera module 30 , and does not limit the specific connection method and specific position setting between the various structural elements, nor does it limit the structural form of the various structural elements.

[0089] Fig. 8A An exploded view of a camera assembly provided in an embodiment of the present application, Figure 8B and Figure 8C An assembly diagram of a camera assembly provided in an embodiment of the present application.

[0090] In some embodiments, Fig. 8A As shown, the substrate 31 is coupled to a flexible printed circuit (FPC), pins are provided on the flexible printed circuit FPC, and the substrate 31 is coupled to a circuit board of the electronic device 1 through the flexible printed circuit FPC.

[0091] Regarding the structure of the structural member 33 , for example, the structural member 33 may be an integrated structure, or the structural member 33 may be formed by connecting two or more structures.

[0092] In some embodiments, Fig. 8A As shown, the structural member 33 includes a first structural body 33A and a second structural body 33B. The first structural body 33A surrounds to form a first surrounding space, and the second structural body 33B surrounds to form a second surrounding space. The first structural body 33A and the second structural body 33B can be fixed by adhesive, for example.

[0093] For example, the first enclosed space is a cylindrical structure for accommodating and fixing the lens 35, and the second enclosed space is a frame-shaped base structure for accommodating the image sensor 32 and fixing the filter layer 34. Of course, the second enclosed space can also only accommodate the filter layer 34.

[0094] In some embodiments, Figure 7 As shown, the invisible light source 40 is disposed on the substrate 31, and a light source accommodating area 332 is separately formed on the structural member 33. The light source accommodating area 332 is spaced apart from the surrounding space 331, and the invisible light source 40 is accommodated in the light source accommodating area 332. Then, as Figure 8B As shown, after the structural member 33 is buckled with the substrate 31 , the lens 35 , the filter layer 34 , the image sensor 32 , and the invisible light source 40 are all covered by the structural member 33 .

[0095] By providing the light source accommodating area 332 for accommodating the invisible light source 40 , more invisible light emitted by the invisible light source 40 can be transmitted to the light emitting area, thereby improving the utilization rate of light information.

[0096] In other embodiments, Figure 8CAs shown, the invisible light source 40 is disposed on the substrate 31 , and the invisible light source 40 is fixed on the outer side of the structural member 33 .

[0097] Then, the vertical projection of the structural member 33 on the substrate 31 covers a part of the area of ​​the substrate 31. The structural member 33 is buckled on the substrate 31, and the image sensor 32 is accommodated inside the structural member 33. The invisible light source 40 is located outside the structural member 33.

[0098] Such a design can make the structural member 33 have the advantage of small size, and make the camera assembly 20 have the advantage of light weight. In addition, the invisible light source 40 is located at the periphery of the structural member 33, and there is no need to set a light source accommodating area 332 on the structural member 33, so that the structure of the structural member 33 is simplified, which has the advantage of low manufacturing cost.

[0099] On this basis, in the embodiment of the present application, the image sensor 32 can be exposed to invisible light, and the image sensor 32 can also be exposed to visible light. Then, the filter layer 34 needs to have an area that can transmit invisible light, and the filter layer 34 also needs to have an area that can only transmit visible light.

[0100] Figure 9-11 A plan view of an image sensor provided in an embodiment of the present application.

[0101] like Fig. 9 As shown, for the image sensor 32, the image sensor 32 includes a first area 322 and a second area 323, and the projection of the filter layer 34 on the image sensor 32 overlaps with the first area 322. For example, the first area 322 is used to receive visible light, and the second area 323 is used to receive ambient light, and the ambient light includes visible light and invisible light.

[0102] Its effective area is the third area 321, and the third area 321 is Fig. 9 The light entrance a of the camera module 30 is circular, and when light enters the camera module 30, a circular light entrance projection area 324 is formed. Fig. 9 The area within the dotted circle is the incident light projection area 324 on the image sensor 32. The area where the incident light projection area 324 and the third area 321 intersect is the image generation area on the image sensor 32. Since the captured image or video is rectangular, a rectangular imaging effective area needs to be formed within the image generation area on the image sensor 32. This application defines the imaging effective area as the first area 322, such as Fig. 9As shown, the first area 322 is the area within the larger rectangular frame within the third area 321. The area within the imaging effective area and outside the first area 322 is an additional area, that is, light can be projected into this area, but this area is not used for imaging of the camera module 30. This application defines this additional area as the second area 323.

[0103] In summary, the image sensor 32 has a third area 321, a first area 322, and a second area 323. The first area 322 is located inside the third area 321, and the second area 323 is located inside the third area 321 and outside the first area 322. The first area 322 is an exposure area for visible light, that is, an imaging area of ​​the camera module 30, and the second area 323 is an exposure area for invisible light.

[0104] In some embodiments, Fig. 9 As shown, the second area 323 is located outside the first area 322 and surrounds the first area 322. Fig. 9 In the embodiment, the second area 323 is disposed on four sides of the first area 322 .

[0105] In other embodiments, Fig.10 As shown, the second area 323 is located at the periphery of the first area 322 and at two opposite sides of the first area 322 .

[0106] For example, the image sensor 32 includes photosensitive units arranged in an array, and the second area 323 is located on both sides of the first area 322 along the column direction of the photosensitive units.

[0107] In some other embodiments, Fig.11 As shown, the second area 323 is located on one side of the first area 322 .

[0108] For example, the image sensor 32 includes photosensitive units arranged in an array, and the second area 323 is located on one side of the first area 322 along the column direction of the photosensitive units.

[0109] In some embodiments, Fig. 9 As shown, the image processor ISP further includes a spacer area 325 , which is located at the periphery of the first area 322 and between the first area 322 and the second area 323 .

[0110] In some embodiments, the image processor ISP includes a plurality of photosensitive units, and the plurality of photosensitive units are arrayed in the third area 321 of the image sensor 32. The first photosensitive unit located in the first area 322 of the plurality of photosensitive units is used as a visible light collection unit for exposing visible light. The second photosensitive unit located in the second area 323 of the plurality of photosensitive units is used as an ambient light collection unit for exposing ambient light. The remaining photosensitive units of the plurality of photosensitive units are used as redundant photosensitive units.

[0111] This is equivalent to utilizing some redundant units as ambient light collection units, which does not increase the cost and size of the camera assembly 20 and enables it to have the function of an infrared light receiver.

[0112] Fig.12 and Fig.13 A schematic plan view of a filter layer provided in an embodiment of the present application.

[0113] In some embodiments, filter layer 34 is rectangular and has an outer edge 340. Similarly, Fig.12 The dotted circular area is the incident light projection area 344 on the filter layer 34, and the area where the incident light projection area 344 and the outer edge 340 intersect is the effective light transmission area. Since the captured image or video is rectangular, a rectangular imaging light transmission area needs to be formed in the effective light transmission area on the filter layer 34, and the present application defines this imaging light transmission area as the fourth area 341. The fourth area 341 is used to transmit visible light in the ambient light and cut off invisible light in the ambient light.

[0114] In some embodiments, the area within the effective light transmission area and outside the fourth area 341 is an additional area, that is, ambient light can pass through this area, but this part of the ambient light is not used for imaging. The present application defines the additional area on the filter layer 34 as a fifth area 342. The fifth area 342 is located outside the fourth area 341.

[0115] The fourth area 341 is arranged corresponding to the first area 322, the projection of the filter layer 34 on the image sensor 32 overlaps with the first area 322, the fourth area 341 is used to transmit visible light and cut off invisible light in the ambient light, the fifth area 342 is located at the periphery of the fourth area 341, the fifth area 342 is arranged corresponding to the second area 323, and the fifth area 342 is used to transmit visible light and invisible light in the ambient light.

[0116] For example, the fifth area 342 is arranged corresponding to the second area 323 , and the ambient light incident through the fifth area 342 can illuminate the second area 323 of the image sensor 32 , but it is not limited to that the pattern of the fifth area 342 is the same as the pattern of the second area 323 .

[0117] like Figure 7As shown, in the optical axis direction of the camera module 30, the fourth area 341 of the filter layer 34 is arranged correspondingly to the first area 322 of the image sensor 32, and the fifth area 342 of the filter layer 34 is arranged correspondingly to the second area 323 of the image sensor 32. The "corresponding arrangement" mentioned here can be understood as that the two correspond to each other on the optical path. Their shapes can be the same, but it does not mean that their sizes are the same. For example, the size of the fourth area 341 of the filter layer 34 can be smaller than the size of the first area 322 of the image sensor 32. Their shapes can also be different, for example, Fig.11 As shown, the second area 323 is located on one side of the first area 322. Then, Fig.13 As shown, the fifth region 342 is also located on one side of the fourth region 341. However, the region outline of the fifth region 342 is different from the region outline of the second region 323. The outline of the fifth region 342 may be a rectangle, for example, to facilitate processing of the fourth region 341 and the fifth region 342.

[0118] In some embodiments, Fig.12 As shown, the filter layer 34 further includes an isolation region 343, and the isolation region 343 is located between the fourth region 341 and the fifth region 342. The isolation region 343 is used to block the light crosstalk between the fourth region 341 and the fifth region 342.

[0119] For example, the filter layer 34 includes a transparent carrier, an invisible light blocking film, an invisible light transmitting film, and a light shielding film, and the invisible light blocking film, the invisible light transmitting film, and the light shielding film are arranged on the carrier. The invisible light blocking film is located in the fourth area 341, the invisible light transmitting film is located in the fifth area 342, and the light shielding film is located in the isolation area 343. Of course, the fifth area 342 may not be provided with an invisible light transmitting film. Or the filter layer 34 does not include the fifth area.

[0120] The material of the carrier includes glass, resin, etc., the material of the invisible light blocking film includes tin oxide and titanium oxide, the material of the invisible light transmitting film includes organic material, and the material of the shading film includes reflective material or opaque material.

[0121] In some embodiments, please refer to Figure 7 The camera assembly 20 further includes a light guide 50 , and the invisible light emitted by the invisible light source 40 is emitted out of the camera assembly 20 through the light guide 50 .

[0122] For example, the first end of the light guide 50 receives the invisible light emitted by the invisible light source 40, and the second end of the light guide 50 emits the invisible light emitted by the invisible light source 40. The invisible light emitted by the invisible light source 40 is transmitted to the second end via the first end. The second end of the light guide 50 can be located, for example, at the outer circle of the light inlet a.

[0123] For example, the invisible light emitted by the invisible light source 40 is conducted to the vicinity of the light inlet a through the light guide 50, and is emitted from the electronic device 1 through the camera hole and projected to the detection target, and enters the camera hole after being reflected by the detection target. After passing through the lens 35, the invisible light is projected onto the fifth area 342 of the filter layer 34. Since the fifth area 342 can transmit the invisible light or partially transmit the invisible light, the invisible light passes through the fifth area 342 of the filter layer 34 and is projected onto the second area 323 of the image sensor 32. Therefore, the image sensor 32 can receive the invisible light and perform exposure processing on the invisible light to realize the detection function of the proximity light sensor and determine whether the detection target is close or far away from the electronic device 1.

[0124] In the embodiment of the present application, the camera module 30 collects the target scene through the camera hole, and the light of the target scene passes through the camera hole, sequentially passes through the lens 35 and the fourth area 341 of the filter layer 34, and is projected on the first area 322 of the image sensor 32, so that the image sensor 32 collects image information. The invisible light source 40 emits invisible light, which is guided out through the light guide 50 and emitted to the outside through the cover plate BG. The invisible light is reflected back by the object, passes through the lens 35 and the fifth area 342 of the filter layer 34, and is projected on the second area 323 of the image sensor 32, so that the image sensor 32 collects invisible light information.

[0125] This solution sets the properties of the fourth area 341 and the fifth area 342 of the filter layer 34 to match the scheme of setting the first area 322 and the second area 323 of the image sensor 32, so that the overall camera assembly 20 can maintain the size of the camera module 30 and integrate the function of the proximity light sensor without changing the spatial layout of the camera module 30.

[0126] Fig.14 A schematic structural diagram of a light guide provided in an embodiment of the present application.

[0127] In some embodiments, Fig.14 As shown, the light guide 50 includes a light emitting portion 51 , which is a portion of the light guide 50 located in a light emitting area of ​​the invisible light emitted by the invisible light source 40 .

[0128] For example, the light emitting portion 51 is disposed around at least a portion of the structural member 33 . Fig.14 In the illustrated embodiment, the light emitting portion 51 may be in a closed ring shape. For example, the light emitting portion 51 may be in a circular ring shape, a polygonal ring structure, etc. The present application designs the light emitting portion 51 as a closed ring shape, thereby converting the point light source at the light incident position of the light guide 50 into a surface light source at the light exit position, thereby being able to illuminate the detection target more clearly.

[0129] The light emitting portion 51 is in the optical window, and the light emitting portion 51 can completely surround the portion of the structural component 33 located in the camera hole, so that the light of the invisible light source 40 forms an annular light emitting surface at the camera hole position, and can emit light in all directions (360 degrees) from the periphery of the light inlet a position of the camera module, so that more infrared light emitted by the invisible light source 40 can enter the interior of the structural component 33, thereby improving the utilization rate of the invisible light source 40.

[0130] For example, the light emitting portion 51 may also be in the shape of a ring, a semi-ring, an arc, etc. with an opening.

[0131] In some embodiments, the light guide 50 includes a light incident surface 52 , a transmission section 53 , and a light emitting surface 54 .

[0132] For example, the transmission section 53 is an elongated rod-shaped structure, and the cross section of the transmission section 53 can be circular, square, triangular, polygonal, irregular, etc. The light incident surface 52 is an end surface of the transmission section 53 of the rod-shaped structure, and is the end surface of the transmission section 53 facing the invisible light source 40. The light exit portion 51 is connected to the end of the transmission section 53 away from the invisible light source 40, and the light exit surface 54 is the end surface of the light exit portion 51, and is the surface facing the external space of the cover plate BG.

[0133] The light guide 50 includes, for example, a light-transmitting inner core and a light-impermeable layer wrapped around the inner core. The material of the inner core includes, for example, glass or resin, and the material of the light-impermeable layer includes, for example, a reflective material or an opaque material.

[0134] Based on the structure of the camera assembly 20 described above, how the image sensor 32 realizes exposure of visible light and ambient light respectively will be described below.

[0135] In some embodiments, the image sensor 32 is used to output a control signal, and the invisible light source 40 is used to emit invisible light in response to the control signal. After the invisible light is emitted, the image sensor 32 can determine whether there is an object approaching the image sensor 32 by collecting the intensity of the reflected invisible light.

[0136] In some embodiments, the image sensor 32 is used to respond to the control signal and obtain first visible light information according to the visible light in the first ambient light incident on the first area 322. The obtained visible light information may be visible light noise information or visible light image information.

[0137] During the driving process of the camera assembly 20 , the image sensor 32 outputs a control signal, and the invisible light source 40 emits invisible light in response to the control signal.

[0138] The image sensor 32 is further configured to respond to the control signal and obtain ambient light information according to the second ambient light incident on the second area 323. The ambient light information includes second visible light information and invisible light information.

[0139] The moment when the image sensor 32 acquires the visible light information and the moment when the image sensor 32 acquires the ambient light information may be at the same moment or at different moments. For example, when the invisible light source 40 does not emit invisible light, the image sensor 32 responds to the control signal and acquires the first visible light information according to the visible light in the first ambient light incident on the first area 322. When the invisible light source 40 emits invisible light, the image sensor 32 responds to the control signal and acquires the ambient light information according to the ambient light incident on the second area 323. The ambient light information includes the second visible light information and the invisible light information.

[0140] Based on this, the invisible light information acquired by the image sensor 32 includes the reflected invisible light information, and the system-on-chip SOC can determine whether there is an object approaching the electronic device based on the reflected invisible light information. The first visible light information acquired by the image sensor 32 can be used as information for generating an image or removing noise from the ambient light information.

[0141] In the embodiment of the present application, “close” may refer to, for example, whether there is an object within a preset distance range.

[0142] The camera assembly 20 provided in the embodiment of the present application includes a camera module 30, and the first area 322 of the image sensor 32 can obtain visible light information in the ambient light, so that the camera assembly 20 can normally realize the function of the camera. On this basis, the camera assembly 20 also includes an invisible light source 40. The invisible light emitted by the invisible light source 40 is reflected by an object, mixed in the ambient light, and enters the image sensor 32 of the camera module 30 through the light inlet a of the camera module 30. After being exposed by the second area 323 of the image sensor 32, second visible light information and invisible light information are generated. The invisible light information includes the reflected invisible light information corresponding to the reflected invisible light, so that the camera assembly 20 can realize the function of the proximity light sensor. Moreover, the image sensor 32 is arranged in the surrounding space 331, and the invisible light source 40 is arranged outside the surrounding space 331. The invisible light source 40 and the image sensor 32 are separated by the structural member 33, which can realize the light isolation between the light receiver and the light source, avoid the light crosstalk emitted by the invisible light source to the area where the image sensor 32 is located, and can ensure the detection effect of the image sensor 32. Therefore, the camera assembly 20 can achieve the same effect as independently setting up a camera and a proximity light sensor. On this basis, the light inlet a of the camera module 30 is used as the light entrance area for invisible light, and there is no need to set up the light inlet required for the proximity light sensor separately. That is to say, the camera assembly 20 provided in the embodiment of the present application has the functions of a camera and a proximity light sensor integrated inside, but only one light inlet a is required to receive light externally. When the camera assembly 20 is applied to the electronic device 1, there is no need to increase the holes required for the incidence of invisible light, and the number of camera holes in the screen stack in the electronic device 1 can be reduced. Then, even if the camera hole in the screen stack runs through the entire screen stack in order to improve the transmittance of the camera hole and enhance the detection effect of invisible light, the reliability of the screen stack can still be improved, the display visual effect and the screen-to-body ratio can be improved, and the internal space of the electronic device 1 can be saved. In addition, the invisible light source 40 emits invisible light, and the image sensor 32 obtains visible light information and ambient light information, all in response to the same control signal, so that the delay of invisible light detection is low.

[0143] Fig.15 and Fig.16 A schematic diagram of the topological structure of an image sensor and a system-on-chip provided in an embodiment of the present application.

[0144] In some embodiments, Fig.15 As shown, the image sensor 32 includes a timing circuit 326, a plurality of photosensitive units 327 arranged in an array, and a receiving circuit.

[0145] For example, the plurality of photosensitive units 327 include a plurality of first photosensitive units and a plurality of second photosensitive units, and the plurality of photosensitive units 327 are arrayed in the third area 321 of the image sensor 32, and the plurality of first photosensitive units are located in the first area 322 as visible light collection units for collecting visible light. The plurality of second photosensitive units are located in the second area 323 as ambient light collection units for collecting ambient light. The photosensitive units 327 include, for example, photodiodes (PDs). The plurality of photosensitive units 327 are all coupled to a receiving circuit, and the electrical signals generated by the first photosensitive units when exposed are processed by the receiving circuit, and the electrical signals generated by the second photosensitive units when exposed are also processed by the receiving circuit.

[0146] The timing circuit 326 is used to control the plurality of first photosensitive units (visible light collection units) and the plurality of second photosensitive units (ambient light collection units) and to generate electrical signals by exposing the received light.

[0147] In some embodiments, the receiving circuit includes an analog-to-digital converter ADC and an image signal processing (ISP).

[0148] The analog-to-digital converter ADC is coupled to the plurality of first photosensitive units and the plurality of second photosensitive units, and is used to convert the electrical signal into a digital signal. The image processor ISP is used to process the digital signal and output the second visible light information and the invisible light information. The image processor ISP processes the digital signal, for example, including noise elimination, wide-angle distortion correction of digital photos, image contrast improvement, and red-eye elimination processing. The image processor ISP in the related art is applicable to the embodiments of the present application.

[0149] In the embodiment of the present application, the electrical signals generated by the multiple first photosensitive units and the electrical signals generated by the multiple second photosensitive units are both processed by a set of digital-to-analog converters ADC and image processors ISP, which can simplify the structure of the image sensor 32.

[0150] In some embodiments, the control signal includes a timing signal.

[0151] The timing signal can be used to control the camera assembly 20 to periodically detect whether an object is approaching the electronic device 1 including the camera assembly 20, so that the status of the electronic device 1 can be adjusted in time.

[0152] Illustratively, the timing circuit 326 is used to output a control signal.

[0153] In some embodiments, the timing signal is, for example, a strobe signal. The strobe signal can be used to control whether the flash in the camera assembly 20 is turned on or off. Of course, the flash in the camera assembly 20 can also be directly controlled by the SOC. The signal originally used to control the flash in the camera assembly 20 can be used as the control signal in the present application, without the need to separately add a circuit for outputting the control signal, thereby reducing the changes to the image sensor 32.

[0154] In some embodiments, the timing circuit 326 may be integrated into the image processor ISP.

[0155] Then, the controlled signal of the driving power source 70 can be controlled by the image processor ISP in the image sensor 32. Multiplexing the image processor ISP can save board area.

[0156] In some embodiments, the image sensor 32 further includes a first logic control circuit 328 , and the first logic control circuit 328 is coupled to a mode control terminal 36 disposed on the substrate 31 .

[0157] The mode control terminal 36 is used to receive the mode signal sent by the system-on-chip SOC, and the first logic control circuit 328 is used to receive the mode signal of the mode control terminal 36, output the configuration parameter 1 to the timing circuit 326, and control the timing circuit 326 to output the timing signal (control signal). The first logic control circuit 328 combines the mode signal and the timing signal to control the timing circuit 326 to output the control signal to control the exposure of the visible light collection unit and / or the ambient light collection unit to generate a digital signal.

[0158] That is to say, the exposure of the visible light collection unit and the ambient light collection unit is controlled by the mode signal.

[0159] Regarding the sending of the mode signal and the processing of the ambient light information, in some embodiments, as Fig.15 As shown, the electronic device 1 further includes a system-on-chip SOC, which is coupled to the mode control terminal 36 of the camera assembly 20 and the image sensor 32. The coupling interface between the system-on-chip SOC and the image sensor 32 is, for example, a mobile industry processor interface (MIPI).

[0160] The system-on-chip SOC is used to control the image sensor 32 to output a control signal. The system-on-chip SOC is also used to receive the first visible light information and ambient light information output by the image sensor 32 and determine whether an object is close to the electronic device 1 according to the invisible light information.

[0161] For example, the system-on-chip SOC is used to send a mode signal to the mode control terminal 36, and the first logic control circuit 328 is used to receive the mode signal from the mode control terminal 36, output configuration parameter 1 to the timing circuit 326, and control the timing circuit 326 to output a control signal.

[0162] In some embodiments, the system-on-chip (SOC) includes a digital signal processing circuit 61 and an invisible light information processing circuit 62 .

[0163] The digital signal processing circuit 61 is coupled to the image sensor 32 and is used to receive the digital signal output by the image sensor 32. For example, the digital signal processing circuit 61 is coupled to the image processor ISP.

[0164] The invisible light information processing circuit 62 is coupled to the digital signal processing circuit 61 , and is used to receive the signal output by the digital signal processing circuit 61 , process the received signal, and output distance data to determine whether there is an object approaching the electronic device 1 .

[0165] In some embodiments, the system-on-chip SOC also includes a visible light information processing circuit 63, which is coupled to the digital signal processing circuit 61 and is used to receive the signal output by the digital signal processing circuit 61, and after processing the received signal, output image data to complete the image acquisition function of the camera module 30.

[0166] In some embodiments, please refer to Fig.15 The camera assembly 20 also includes a driving power supply 70, which is coupled in series with the invisible light source 40 between the power supply voltage terminal AVDD and the reference ground voltage terminal GND. The invisible light source 40 is used to emit invisible light under the drive of the driving power supply 70.

[0167] For example, the camera assembly 20 further includes a second logic control circuit 37, which is coupled to the mode control terminal 36. The second logic control circuit 37 is used to receive the mode signal and the timing signal, and under the control of the mode signal and the timing signal, control the driving power supply 70 to drive the invisible light source 40 to emit invisible light.

[0168] That is, the invisible light source 40 emits invisible light, which is also controlled by the mode signal.

[0169] In some embodiments, Fig.15 As shown, the driving power source 70 is disposed on the substrate 31 .

[0170] Optionally, the second logic control circuit 37 is disposed on the substrate 31 .

[0171] In other embodiments, Fig.16As shown, the driving power supply 70 is arranged in a power management unit (PMU) of the electronic device 1 .

[0172] Optionally, the second logic control circuit 37 is disposed in a power management module PMU. In some other embodiments, the driving power supply 70 is disposed on a circuit board of the electronic device 1 .

[0173] Optionally, the second logic control circuit 37 is arranged on a circuit board of the electronic device 1 .

[0174] Of course, the embodiment of the present application does not limit the location of the driving power supply 70, and the above is only an illustration.

[0175] Based on this, the driving method of the electronic device 1 provided in the embodiment of the present application includes:

[0176] S1: The system-on-chip SOC controls the image sensor 32 to output a control signal.

[0177] For example, the system-on-chip SOC outputs a mode signal to the mode control terminal 36 , and the first logic control circuit 328 outputs configuration parameter 1 of the corresponding mode to the timing circuit 326 according to the mode signal of the mode control terminal 36 , so as to control the timing circuit 326 to output a control signal.

[0178] S2: The camera assembly 20 outputs first visible light information and ambient light information in response to the control signal.

[0179] In some embodiments, step S2 includes:

[0180] S21: The invisible light source 40 emits invisible light in response to the control signal.

[0181] The second logic control circuit 37 receives the mode signal and the control signal, and under the control of the mode signal and the control signal, controls the driving power supply 70 to drive the invisible light source 40 to emit invisible light.

[0182] S22: The image sensor 32 exposes the received visible light to generate first visible light information. The image sensor 32 exposes the received ambient light to generate ambient light information.

[0183] For example, the first logic control circuit 328 combines the mode signal and the control signal to control the timing circuit 326 to output the control signal. The visible light acquisition unit and / or the ambient light acquisition unit are exposed under the control of the control signal and generate a visible photoelectric signal and an ambient photoelectric signal. The analog-to-digital converter ADC converts the visible photoelectric signal and the ambient photoelectric signal into a visible light digital signal and an ambient light digital signal; the image processor ISP processes the visible light digital signal and the ambient light digital signal and outputs the first visible light information and the ambient light information.

[0184] S3: The system-on-chip SOC generates distance data according to the invisible light information to determine whether an object is approaching the electronic device 1. It generates image data according to the visible light information to form an image.

[0185] Below, the camera assembly 20, the electronic device 1 and the driving method thereof provided in the embodiment of the present application are described with reference to several examples and in combination with the driving timing.

[0186] Example 1

[0187] Fig.17 A driving timing diagram of an electronic device provided in an embodiment of the present application.

[0188] In some embodiments, Fig.17 As shown, the system-on-chip SOC is used to send a first mode signal M1 to the mode control terminal 36. The first mode signal M1 is used to indicate that the electronic device 1 is in a call process.

[0189] Then, when the invisible light source 40 does not emit invisible light, the image sensor 32 is used to respond to the control signal and obtain first visible light information according to the visible light in the first ambient light incident on the first area 322. The first visible light information at this time is used as visible light noise information.

[0190] The image sensor 32 is also used for obtaining ambient light information in response to the control signal according to the second ambient light incident on the second area 323 during the process of the invisible light source 40 emitting invisible light in response to the control signal. The ambient light information at this time includes invisible light information and second visible light information, the invisible light information includes invisible light noise information and reflected invisible light information, and the second visible light information is visible light noise information.

[0191] The system-on-chip SOC is used to determine whether there is an object approaching the electronic device 1 according to the first visible light information and the ambient light information.

[0192] For example, the system-on-chip SOC removes the visible light noise information from the ambient light information according to the visible light noise information, and determines whether there is an object approaching the electronic device 1 according to the invisible light noise information and the reflected invisible light information.

[0193] In some embodiments, the first logic control circuit 328 is used to receive the first mode signal M1 of the mode control terminal 36, and determine the working mode of the electronic device 1 according to the first mode signal M1. For example, the first mode signal M1 indicates that both the invisible light unit and the visible light unit of the electronic device 1 are exposed, and is in the visible light collection + ambient light collection mode.

[0194] After the first mode signal M1 is determined, the first logic control circuit 328 is used to output the first configuration parameter corresponding to the first mode signal M1 to the timing circuit 326. The timing circuit 326 is used to output the first timing signal strobe1 under the control of the first configuration parameter, and the first timing signal strobe1 includes a first valid pulse A1 and a second valid pulse A2.

[0195] For example, Fig.17 As shown, the high level signal in the first timing signal strobe1 is a valid pulse. Alternatively, for example, the low level signal in the first timing signal strobe1 is a valid pulse. Both application modes are applicable to the embodiments of the present application.

[0196] In addition, there is a gap between the first effective pulse A1 and the second effective pulse A2. Fig.17 As shown, in one image frame, the first effective pulse A1 may be in front and the second effective pulse A2 may be behind. Alternatively, the second effective pulse A2 may be in front and the first effective pulse A1 may be behind.

[0197] In some embodiments, the first logic control circuit 328 is further used to control the timing circuit 326 to output a first exposure control signal S1 during the period t1 corresponding to the first effective pulse A1 , and the first exposure control signal S1 is used to control the exposure of the image sensor 32 and generate a digital signal.

[0198] It should be noted that the timing circuit 326 outputs the first exposure control signal S1 during the time period t1 corresponding to the first effective pulse A1. Therefore, the timing circuit 326 can output the first exposure control signal S1 at the start time of the first effective pulse A1 (the time when the low level changes to the high level), or can output the first exposure control signal S1 within a certain time range before and after the start time of the first effective pulse A1, as long as the first effective pulse A1 is used as a time reference.

[0199] For example, in the corresponding time period t1 corresponding to the first effective pulse A1, the timing circuit 326 outputs the first exposure control signal S1, the first exposure control signal S1, for example, includes synchronous exposure information, and the first exposure control signal S1 is used to control the exposure of the first photosensitive unit in the visible light acquisition unit (for example, synchronous exposure or line-by-line exposure), and convert the visible light into a visible photoelectric signal. Correspondingly, the analog-to-digital converter ADC is used to convert the visible photoelectric signal into a visible light digital signal under the control of the first exposure control signal S1, and the first exposure control signal S1, for example, includes a sampling signal. The image processor ISP is used to process the received visible light digital signal to generate visible light information.

[0200] Subsequently, the second logic control circuit 37 is used to receive the first mode signal M1 and the first timing signal strobe1, and under the control of the second effective pulse A2, controls the driving power supply 70 to respond to the control signal and drive the invisible light source 40 to emit invisible light.

[0201] The invisible light emitted by the invisible light source 40 exits the electronic device 1, is reflected by an object, and then enters the ambient light collection unit. The first logic control circuit 328 is used to control the timing circuit 326 to output the second exposure control signal S2 in the time period t2 corresponding to the second effective pulse A2. The second exposure control signal S2, for example, includes synchronous exposure information. The second exposure control signal S2 is used to control the exposure of the second photosensitive unit in the ambient light collection unit (for example, synchronous exposure or line-by-line exposure) to convert the ambient light into an ambient photoelectric signal. The analog-to-digital converter ADC is used to convert the ambient photoelectric signal into an ambient light digital signal under the control of the second exposure control signal S2. The second exposure control signal S2, for example, includes a sampling signal. The image processor ISP is used to process the received ambient light digital signal to generate ambient light information.

[0202] Then, within an image frame, the image sensor 32 outputs visible light noise information and ambient light information, and the digital signal processing circuit 61 is coupled to the image sensor 32 of the camera assembly 20 to receive the visible light noise information and ambient light information.

[0203] Of course, one effective pulse may also be used to control the timing circuit 326 to output the first exposure control signal S1 and control the invisible light source 40 to emit invisible light. In the embodiment of the present application, two effective pulses are used as an example for illustration.

[0204] The digital signal processing circuit 61 is coupled to the image sensor 32, and is used to process the received visible light noise information and ambient light information and transmit them to the invisible light information processing circuit 62. The invisible light information processing circuit 62 processes the received signal to generate distance data, thereby determining the distance between the object and the electronic device 1.

[0205] For example, the digital signal processing circuit 61 converts the intensity of the received visible light noise information and ambient light information, and transmits the intensity information of the ambient light information and the intensity information of the visible light noise information to the invisible light information processing circuit 62. The invisible light information processing circuit 62 removes the interference of the visible light intensity and compares it with the set light intensity to obtain the distance data.

[0206] Based on this, the driving method of the electronic device 1 provided in the embodiment of the present application includes:

[0207] S10: The system-on-chip SOC controls the image sensor 32 to output a control signal.

[0208] S20: The image sensor 32 responds to the control signal and acquires first visible light information according to the visible light in the first ambient light incident on the first area 322. The visible light information at this time is used as visible light noise information.

[0209] For example, the first logic control circuit 328 receives the first mode signal M1, outputs the first configuration parameter in the corresponding mode to the timing circuit 326 according to the first mode signal M1, and controls the timing circuit 326 to output the first timing signal strobe1, and the first timing signal strobe1 includes a first valid pulse A1 and a second valid pulse A2.

[0210] After receiving the first mode signal M1, the first logic control circuit 328 knows that the first effective pulse A1 of the first timing signal strobe1 corresponds to the time period t1, and controls the timing circuit 326 to output the first exposure control signal S1. The visible light acquisition unit is exposed under the control of the first exposure control signal S1 to generate a visible photoelectric signal. The analog-to-digital converter ADC converts the visible photoelectric signal into a visible light digital signal under the control of the first exposure control signal S1. The image processor ISP processes the visible light digital signal and outputs the first visible light information.

[0211] S30 : when the invisible light source 40 emits the invisible light in response to the control signal, the image sensor 32 acquires the ambient light information according to the second ambient light incident on the second area 323 in response to the control signal.

[0212] It should be noted that the start time of the invisible light source 40 emitting invisible light may be earlier than the time when the image sensor 32 acquires ambient light information. The end time of the invisible light source 40 emitting invisible light may be earlier or later than the time when the image sensor 32 stops acquiring ambient light information. Fig.17 This is only an illustration and is not intended to be limiting.

[0213] The second logic control circuit 37 receives the first mode signal M1 and the first timing signal strobe1. Under the control of the first mode signal M1, it is learned that the driving power supply 70 should be controlled under the control of the second valid pulse A2 of the first timing signal strobe1 to drive the invisible light source 40 to emit invisible light, and the invisible light is reflected back to the camera assembly 20 through the object.

[0214] After receiving the first mode signal M1, the first logic control circuit 328 knows that the second effective pulse A2 of the first timing signal strobe1 corresponds to the time period t2 to control the timing circuit 326 to output the second exposure control signal S2. The ambient light acquisition unit is exposed under the control of the second exposure control signal S2 to generate an ambient photoelectric signal. The analog-to-digital converter ADC converts the ambient photoelectric signal into an ambient light digital signal under the control of the second exposure control signal S2. The image processor ISP processes the ambient light digital signal and outputs ambient light information.

[0215] S40 : The system-on-chip SOC determines whether there is an object approaching the electronic device 1 according to the first visible light information and the ambient light information.

[0216] For example, the digital signal processing circuit 61 receives the first visible light information and ambient light information sent by the image sensor 32 in the camera assembly 20, processes the received first visible light information and ambient light information, and transmits them to the invisible light information processing circuit 62. The invisible light information processing circuit 62 processes the received signal and generates distance data to determine whether there is an object approaching the electronic device 1.

[0217] In this example, invisible light can be collected in a relatively short time, improving the user experience. In addition, visible light information as background light is also collected synchronously, and after processing, the interference of the environment on the invisible light information can be reduced.

[0218] In some embodiments, the system-on-chip SOC is also used to adjust the display brightness of the electronic device 1 according to the visible light information.

[0219] Then, the driving method of the electronic device 1 further includes: the system-on-chip SOC adjusts the display brightness of the electronic device 1 according to the visible light information.

[0220] This is equivalent to multiplexing visible light noise information as reference information for adjusting display brightness, which can reduce signal acquisition brightness and simplify the structure of the electronic device 1.

[0221] Example 2

[0222] Fig.18 A driving timing diagram of an electronic device provided in an embodiment of the present application.

[0223] In some embodiments, Fig.18 As shown, the first logic control circuit 328 is used to receive the second mode signal M2 from the mode control terminal 36, and the second mode signal M2 is used to represent that the electronic device 1 is in the process of waking up from the screen.

[0224] Then, the image sensor 32 is used to respond to the control signal and obtain first visible light information according to the visible light in the first ambient light incident on the first area 322. The first visible light information at this time is used as visible light image information.

[0225] The image sensor 32 is also used to obtain ambient light information according to the second ambient light incident on the second area 323 in response to the control signal when the invisible light source 40 emits invisible light in response to the control signal. The ambient light information at this time includes the second visible light information and the invisible light information. The invisible light information includes the invisible light noise information and the reflected invisible light information, and the second visible light information is the visible light noise information.

[0226] The system-on-chip SOC is used to generate an image according to the first visible light information, and to determine whether an object is close to the electronic device 1 according to the invisible light information.

[0227] For example, the system-on-chip SOC converts visible light noise information and invisible light noise information according to visible light image information, removes the visible light noise information and invisible light noise information from the ambient light information, and determines whether there is an object approaching the electronic device 1 according to the reflected invisible light information.

[0228] In some embodiments, the first logic control circuit 328 is used to receive the second mode signal M2 of the mode control terminal 36, and determine the working mode of the electronic device 1 according to the second mode signal M2. For example, the second mode signal M2 indicates that both the invisible light unit and the visible light unit of the electronic device 1 are exposed, and is in the visible light collection + ambient light collection mode. For example, it is applied in a swing scene. Swing refers to capturing the user's gestures or eyes through the camera module 30, so that the user can control the electronic device 1 without touching the electronic device 1 with his hands.

[0229] After the second mode signal M2 is determined, the first logic control circuit 328 outputs the second configuration parameter corresponding to the second mode signal M2 to the timing circuit 326. Under the control of the second configuration parameter, the timing circuit 326 outputs the second timing signal strobe2, which includes the third effective pulse A3.

[0230] In a scenario where both visible light and ambient light need to be exposed, the second timing signal strobe2 responsible for timing control can control both the ambient light collection unit and the visible light collection unit to be exposed through a third effective pulse A3.

[0231] The second logic control circuit 37 is used to receive the second mode signal M2 and the second timing signal strobe2, and under the control of the third effective pulse A3, control the driving power supply 70 to drive the invisible light source 40 to emit invisible light. The invisible light emitted by the invisible light source 40 is emitted from the electronic device 1, reflected by the object, and then emitted into the ambient light collection unit.

[0232] The first logic control circuit 328 is used to control the timing circuit 326 to output the third exposure control signal S3 during the period t3 corresponding to the third effective pulse A3. The third exposure control signal S3 is used to control the exposure of the image sensor 32 and generate a digital signal.

[0233] For example, in the corresponding time period t3 corresponding to the third effective pulse A3, the timing circuit 326 outputs the third exposure control signal S3, and the second photosensitive unit in the ambient light collection unit is used to expose (for example, synchronous exposure or line-by-line exposure) under the control of the third exposure control signal S3 to generate an ambient photoelectric signal. The first photosensitive unit in the visible light collection unit is used to expose (for example, line-by-line exposure) under the control of the third exposure control signal S3 to generate a visible photoelectric signal.

[0234] The exposure order of the second photosensitive unit in the ambient light collection unit and the first photosensitive unit in the visible light collection unit is related to the division method of the second area 323 and the first area 322. For example, the first few rows of photosensitive units 327 are ambient light collection units, and the following photosensitive units 327 are ambient light collection units. When exposure is performed according to the third exposure control signal S3, the ambient photoelectric signal is first exposed and then the visible photoelectric signal is generated.

[0235] The analog-to-digital converter ADC is used to convert the ambient photoelectric signal into an ambient light digital signal and convert the visible photoelectric signal into a visible light digital signal under the control of the third exposure control signal S3. The image processor ISP is used to process the received visible light digital signal and ambient light digital signal to generate first visible light information and ambient light information.

[0236] Then, within an image frame, the image sensor 32 outputs the ambient light information and the first visible light information, and the digital signal processing circuit 61 is coupled to the image sensor 32 of the camera assembly 20 to receive the ambient light information and the first visible light information.

[0237] The digital signal processing circuit 61 is used to separate and process the received ambient light information and the first visible light information, transmit the ambient light information to the invisible light information processing circuit 62 , and transmit the first visible light information to the visible light information processing circuit 63 .

[0238] The invisible light information processing circuit 62 is coupled to the digital signal processing circuit 61 and is used to process the received ambient light information and generate distance data.

[0239] The visible light information processing circuit 63 is coupled to the digital signal processing circuit 61 and is used to process the received first visible light information to generate image data.

[0240] In this mode, noise information can be calculated from the swing automatic exposure (AE) information.

[0241] Based on this, the driving method of the electronic device 1 provided in the embodiment of the present application includes:

[0242] S10: The system-on-chip SOC controls the image sensor 32 to output a control signal.

[0243] S20: The image sensor 32 obtains first visible light information by injecting visible light in the first ambient light into the first area 322 in response to the control signal. The first visible light information at this time is used as visible light image information. The image sensor 32 also obtains ambient light information according to the second ambient light injected into the second area 323 in response to the control signal when the invisible light source 40 emits invisible light in response to the control signal. The ambient light information at this time includes second visible light information and invisible light information. The invisible light information includes invisible light noise information and reflected invisible light information, and the second visible light information is visible light noise information.

[0244] For example, the first logic control circuit 328 receives the second mode signal M2, outputs the second configuration parameter of the corresponding mode to the timing circuit 326 according to the second mode signal M2, and controls the timing circuit 326 to output the second timing signal strobe2, and the second timing signal strobe2 includes the third valid pulse A3.

[0245] The second logic control circuit 37 receives the second mode signal M2 and the second timing signal strobe2. Under the control of the second mode signal M2, it is learned that the driving power supply 70 should be controlled under the control of the third valid pulse A3 of the second timing signal strobe2 to drive the invisible light source 40 to emit invisible light, and the invisible light is reflected back to the camera assembly 20 through the object.

[0246] After receiving the second mode signal M2, the first logic control circuit 328 knows that the third effective pulse A3 of the second timing signal strobe2 corresponds to the time period t3, and controls the timing circuit 326 to output the third exposure control signal S3. The ambient light acquisition unit is exposed under the control of the third exposure control signal S3 to generate an ambient photoelectric signal. The visible light acquisition unit is exposed under the control of the third exposure control signal S3 to generate a visible photoelectric signal. Under the control of the third exposure control signal S3, the analog-to-digital converter ADC converts the ambient photoelectric signal into an ambient light digital signal and converts the visible photoelectric signal into a visible light digital signal. The image processor ISP processes the ambient light digital signal and outputs the ambient light information, and processes the visible light digital signal and outputs the first visible light information.

[0247] S30: the system-on-chip SOC generates an image according to the first visible light information, and determines whether there is an object approaching the electronic device 1 according to the invisible light information.

[0248] For example, the digital signal processing circuit 61 receives the ambient light information and the first visible light information sent by the image sensor 32 in the camera assembly 20, processes the received ambient light information and the first visible light information, and transmits the ambient light information to the invisible light information processing circuit 62, which processes the received signal and generates distance data. The visible light information is transmitted to the visible light information processing circuit 63, which processes the received signal and generates image data.

[0249] In this example, both ambient light acquisition and visible light acquisition are based on the same configuration parameters, and the camera assembly 20 does not need to switch parameters, which can reduce the delay caused by switching parameters. Invisible light information is separated and extracted from the entire signal output by the image sensor 32, which can realize visible light image acquisition and ambient light acquisition in a relatively short time, thereby improving user experience.

[0250] Example 3

[0251] Fig.19 A driving timing diagram of an electronic device provided in an embodiment of the present application.

[0252] In some embodiments, Fig.19 As shown, the first logic control circuit 328 is used to receive the third mode signal M3 from the mode control terminal 36. The third mode signal M3 is used to indicate that the electronic device 1 is in the storage process.

[0253] Then, the image sensor 32 is used to obtain the first ambient light information according to the third ambient light incident on the second area 323 in response to the control signal when the invisible light source 40 does not emit invisible light. At this time, the first ambient light information includes the third visible light information and the third invisible light information, the third visible light information is the visible light noise information, and the third invisible light information is the invisible light noise information.

[0254] The image sensor 32 is also used for obtaining second ambient light information in response to the control signal according to the fourth ambient light incident on the second area 323 during the process in which the invisible light source 40 emits the invisible light in response to the control signal. The second ambient light information at this time includes fourth visible light information and fourth invisible light information, the fourth visible light information is visible light noise information, and the fourth invisible light information includes invisible light noise information and reflected invisible light information.

[0255] The system-on-chip SOC is used to determine whether there is an object approaching the electronic device 1 according to the first ambient light information and the second ambient light information.

[0256] For example, the system-on-chip SOC removes the visible light noise information and the invisible light noise information in the second ambient light information according to the third visible light information and the third invisible light information, and determines whether there is an object approaching the electronic device 1 according to the reflected invisible light information.

[0257] In some embodiments, the first logic control circuit 328 is used to receive the third mode signal M3 of the mode control terminal 36, and determine the working mode of the electronic device 1 according to the third mode signal M3. For example, the third mode signal M3 indicates that only the ambient light collection unit of the electronic device 1 is exposed, and it is in a single ambient light collection mode. For example, when the user puts the electronic device 1 into a storage object (such as a pocket or a bag), it is no longer necessary to detect the swing screen, and the camera assembly 20 can only run the proximity light detection.

[0258] After the third mode signal M3 is determined, the first logic control circuit 328 outputs the third configuration parameter corresponding to the third mode signal M3 to the timing circuit 326. Under the control of the third configuration parameter, the timing circuit 326 outputs the third timing signal strobe3, which includes the fourth effective pulse A4 and the fifth effective pulse A5.

[0259] There is a gap between the fourth effective pulse A4 and the fifth effective pulse A5. Fig.19 As shown, in one image frame, the fourth effective pulse A4 may be in front and the fifth effective pulse A5 may be behind. Alternatively, the fifth effective pulse A5 may be in front and the fourth effective pulse A4 may be behind.

[0260] The first logic control circuit 328 is further used to control the timing circuit 326 to output a fourth exposure control signal S4 during a period t4 corresponding to the fourth effective pulse A4. The fourth exposure control signal S4 is used to control the exposure of the image sensor 32 and generate a digital signal.

[0261] For example, in the period t4 corresponding to the fourth effective pulse A4, the timing circuit 326 outputs a fourth exposure control signal S4, the fourth exposure control signal S4, for example, includes synchronous exposure information, and the fourth exposure control signal S4 is used to control the exposure of the second photosensitive unit in the ambient light acquisition unit (for example, synchronous exposure or line-by-line exposure), and convert the first ambient light into a first ambient photoelectric signal. Correspondingly, the analog-to-digital converter ADC is used to convert the first ambient photoelectric signal into a first ambient light digital signal under the control of the fourth exposure control signal S4, and the fourth exposure control signal S4, for example, includes a sampling signal. The image processor ISP is used to process the received first ambient light digital signal to generate the first ambient light information.

[0262] Subsequently, the second logic control circuit 37 is used to receive the third mode signal M3 and the third timing signal strobe3, and under the control of the fifth effective pulse A5, control the driving power supply 70 to drive the invisible light source 40 to emit invisible light.

[0263] The invisible light emitted by the invisible light source 40 exits the electronic device 1, is reflected by an object, and then enters the ambient light collection unit. The first logic control circuit 328 is used to control the timing circuit 326 to output the fifth exposure control signal S5 in the time period t5 corresponding to the fifth effective pulse A5. The fifth exposure control signal S5, for example, includes synchronous exposure information. The fifth exposure control signal S5 is used to control the exposure of the second photosensitive unit in the ambient light collection unit (for example, synchronous exposure or line-by-line exposure) to convert the second ambient light into a second ambient photoelectric signal. The analog-to-digital converter ADC is used to convert the second ambient photoelectric signal into a second ambient light digital signal under the control of the fifth exposure control signal S5. The fifth exposure control signal S5, for example, includes a sampling signal. The image processor ISP is used to process the received second ambient light digital signal to generate second ambient light information.

[0264] Then, within an image frame, the image sensor 32 outputs the first ambient light information and the second ambient light information, and the digital signal processing circuit 61 is coupled to the image sensor 32 of the camera assembly 20 to receive the first ambient light information and the second ambient light information.

[0265] The digital signal processing circuit 61 is used to process the received first ambient light information and the second ambient light information and transmit them to the invisible light information processing circuit 62. The invisible light information processing circuit 62 processes the received signals to generate distance data, thereby determining the distance between the object and the electronic device 1.

[0266] For example, the digital signal processing circuit 61 converts the intensity of the received first ambient light information and the second ambient light information, and transmits the first ambient light information and the second ambient light information to the invisible light information processing circuit 62. The invisible light information processing circuit 62 removes interference from the intensity of the first ambient light information and compares it with the set light intensity to obtain distance data.

[0267] Based on this, the driving method of the electronic device 1 provided in the embodiment of the present application includes:

[0268] S10: The system-on-chip SOC controls the image sensor 32 to output a control signal.

[0269] S20: When the invisible light source 40 does not emit invisible light, the image sensor 32 responds to the control signal and obtains the first ambient light information according to the third ambient light incident on the second area 323. The first ambient light information at this time includes the third visible light information and the third invisible light information, the third visible light information is the visible light noise information, and the third invisible light information is the invisible light noise information.

[0270] For example, the first logic control circuit 328 receives the third mode signal M3, outputs the third configuration parameter of the corresponding mode to the timing circuit 326 according to the third mode signal M3, and controls the timing circuit 326 to output the third timing signal strobe3, and the third timing signal strobe3 includes the fourth valid pulse A4 and the fifth valid pulse A5.

[0271] After receiving the third mode signal M3, the first logic control circuit 328 knows that the fourth effective pulse A4 of the third timing signal strobe3 corresponds to the time period t4, and controls the timing circuit 326 to output the fourth exposure control signal S4. The visible light acquisition unit is exposed under the control of the fourth exposure control signal S4 to generate a first ambient photoelectric signal. Under the control of the fourth exposure control signal S4, the analog-to-digital converter ADC converts the first ambient photoelectric signal into a first ambient light digital signal. The image processor ISP processes the first ambient light digital signal and outputs the first ambient light information.

[0272] S30: When the invisible light source 40 emits invisible light in response to the control signal, the image sensor 32 obtains second ambient light information in response to the control signal according to the fourth ambient light incident on the second area 323. The second ambient light information at this time includes fourth visible light information and fourth invisible light information, the fourth visible light information is visible light noise information, and the fourth invisible light information includes invisible light noise information and reflected invisible light information.

[0273] For example, the second logic control circuit 37 receives the third mode signal M3 and the third timing signal strobe3. Under the control of the third mode signal M3, it is learned that the driving power supply 70 should be controlled to drive the invisible light source 40 to emit invisible light under the control of the fifth valid pulse A5 of the third timing signal strobe3, and the invisible light is reflected back to the camera assembly 20 through the object.

[0274] After receiving the third mode signal M3, the first logic control circuit 328 knows that the fifth effective pulse A5 of the third timing signal strobe3 corresponds to the time period t5, and controls the timing circuit 326 to output the fifth exposure control signal S5. The ambient light acquisition unit is exposed under the control of the fifth exposure control signal S5 to generate a second ambient photoelectric signal. Under the control of the fifth exposure control signal S5, the analog-to-digital converter ADC converts the second ambient photoelectric signal into a second ambient light digital signal. The image processor ISP processes the second ambient light digital signal and outputs the second ambient light information.

[0275] S40: The system-on-chip SOC determines whether there is an object approaching the electronic device 1 according to the first ambient light information and the second ambient light information.

[0276] For example, the digital signal processing circuit 61 receives the first ambient light information and the second ambient light information sent by the image sensor 32 in the camera assembly 20, processes the received first ambient light information and the second ambient light information, and transmits them to the invisible light information processing circuit 62, and the invisible light information processing circuit 62 processes the received signal and generates distance data.

[0277] In the embodiment of the present application, the first ambient light information and the second ambient light information are both exposed by the ambient light collection unit, and the visible light collection unit does not need to be exposed, which can reduce the number of driven photosensitive units 327 and save power consumption.

[0278] The embodiment of the present application also provides a computer-readable medium, which stores a computer program. When the computer program is executed on the electronic device 1, the electronic device executes the driving method of the camera assembly or the driving method of the electronic device. The embodiment of the present application provides a computer program product containing instructions. When the computer program product is executed on the electronic device 1, the electronic device 1 executes the driving method of the camera assembly or the driving method of the electronic device.

[0279] The computer readable medium may be a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, a random access memory (RAM) or other types of dynamic storage devices that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory may exist independently and be connected to the processor via a communication bus. The memory may also be integrated with the processor.

[0280] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using a software program, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer execution instruction is loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instruction can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium.

[0281] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A camera assembly, characterized in that: include: A camera module, including structural parts, a filter layer, an image sensor and a substrate; The structural member is cylindrical and is arranged to form an enclosed space, one end of the structural member is a light inlet of the camera assembly, and the other end of the structural member is buckled on the substrate, and the filter layer and the image sensor are located in the enclosed space; the light inlet is used to allow the ambient light incident on the camera module to enter the enclosed space; The filter layer is located between the image sensor and the light entrance, and is used to transmit the visible light in the ambient light and cut off the invisible light in the ambient light; The image sensor comprises a first area and a second area, and the projection of the filter layer on the image sensor overlaps with the first area; The image sensor is used to output a control signal; an invisible light source, located outside the enclosed space; the invisible light source is used to emit invisible light in response to the control signal; The image sensor is used for acquiring first visible light information according to visible light in the first ambient light incident into the first area in response to the control signal; The image sensor is further configured to obtain ambient light information in response to the control signal according to the second ambient light incident into the second area, where the ambient light information includes second visible light information and invisible light information.

2. The camera assembly according to claim 1, characterized in that: The control signal includes a timing signal.

3. The camera assembly according to claim 1 or 2, characterized in that: The image sensor further has a third area, the first area is located inside the third area, and the second area is located within the third area and outside the first area; The third area is an area formed on the image sensor by the light entering the camera module through the light entrance.

4. The camera assembly according to claim 3, characterized in that: The image sensor includes a plurality of first photosensitive units, a plurality of second photosensitive units and a receiving circuit; The plurality of first photosensitive units are located in the first area and are used for exposure to the visible light; the plurality of second photosensitive units are located in the second area and are used for exposure to the ambient light; The plurality of first photosensitive units and the second photosensitive unit are both coupled to the receiving circuit.

5. The camera assembly according to any one of claims 1 to 4, characterized in that: The filter layer is also used for transmitting the second ambient light.

6. The camera assembly according to any one of claims 1 to 5, characterized in that: The camera assembly further includes a light guide, and the invisible light emitted by the invisible light source is emitted out of the camera assembly through the light guide.

7. The camera assembly according to claim 6, characterized in that: The light guide member includes a light emitting portion, and the light emitting portion surrounds at least a portion of the light incident port.

8. The camera assembly according to any one of claims 1 to 7, characterized in that: The invisible light source is arranged on the substrate; The structural member comprises a light source accommodating area, the light source accommodating area is spaced apart from the surrounding space, and the invisible light source is located in the light source accommodating area; or, The invisible light source is located outside the structural component.

9. A driving method for driving the camera assembly according to any one of claims 1 to 8, characterized in that: The driving method comprises: The image sensor outputs a control signal; The invisible light source emits invisible light in response to the control signal; The image sensor acquires first visible light information according to visible light in the first ambient light incident on the first area in response to the control signal; The image sensor also acquires ambient light information according to the second ambient light incident on the second area in response to the control signal.

10. The driving method according to claim 9, characterized in that: The control signal includes a timing signal.

11. An electronic device, characterized in that: It comprises a camera assembly and a system-level chip; the system-level chip is coupled to the image sensor of the camera assembly; the camera assembly comprises the camera assembly according to any one of claims 1 to 8; The system-level chip is used to control the image sensor to output a control signal, and is also used to receive first visible light information and ambient light information output by the image sensor, and determine whether there is an object approaching the electronic device according to invisible light information in the ambient light information.

12. The electronic device according to claim 11, characterized in that: During a call: The image sensor is used for acquiring first visible light information according to visible light in first ambient light incident into the first area in response to the control signal; The image sensor is further used to obtain ambient light information according to the second ambient light incident on the second area in response to the control signal during the process in which the invisible light source emits the invisible light in response to the control signal; The system-level chip is used to determine whether there is an object approaching the electronic device according to the first visible light information and the invisible light information in the ambient light information.

13. The electronic device according to claim 11 or 12, characterized in that: During the screen-off wake-up process: The image sensor is used for acquiring first visible light information according to visible light in first ambient light incident into the first area in response to the control signal; The image sensor is further used to obtain ambient light information according to the second ambient light incident on the second area in response to the control signal during the process in which the invisible light source emits the invisible light in response to the control signal; The system-level chip is used to generate an image according to the first visible light information, and to determine whether there is an object approaching the electronic device according to the invisible light information in the ambient light information.

14. The electronic device according to any one of claims 11 to 13, characterized in that: During the collection process: The image sensor is used for acquiring the first ambient light information according to the third ambient light incident into the second area in response to the control signal; The image sensor is further used for acquiring second ambient light information according to fourth ambient light incident on the second area in response to the control signal during the process in which the invisible light source emits the invisible light in response to the control signal; The system-level chip is used to determine whether there is an object approaching the electronic device according to the first ambient light information and the second ambient light information.

15. The electronic device according to claim 12, characterized in that: The system-level chip is also used to adjust the display brightness of the electronic device according to the first visible light information.

16. The electronic device according to any one of claims 11 to 15, characterized in that: The electronic device further comprises a driving power supply; the driving power supply drives the invisible light source to emit invisible light in response to the control signal; The driving power source is arranged on a substrate of the camera assembly; or, The electronic device further comprises a circuit board, and the driving power supply is arranged on the circuit board; or, The electronic device further comprises a power management module, and the driving power supply is integrated in the power management module.

17. A method for driving an electronic device, used for driving the electronic device according to any one of claims 11 to 16, characterized in that: The driving method comprises: The system-level chip controls the image sensor to output a control signal; The camera assembly outputs first visible light information and ambient light information in response to the control signal; The system-level chip determines whether there is an object approaching the electronic device according to the ambient light information.

18. The driving method according to claim 17, characterized in that: The camera assembly outputs first visible light information and ambient light information in response to the control signal, including: During a call: The image sensor acquires first visible light information according to visible light in the first ambient light incident on the first area in response to the control signal; During the process in which the invisible light source emits the invisible light in response to the control signal, the image sensor acquires the ambient light information according to the ambient light incident on the second area in response to the control signal; The system-level chip determines whether there is an object approaching the electronic device according to the first visible light information and the ambient light information.

19. The driving method according to claim 17 or 18, characterized in that: The camera assembly outputs first visible light information and ambient light information in response to the control signal, including: During the screen-off wake-up process: The image sensor acquires first visible light information according to visible light in the first ambient light incident on the first area in response to the control signal; In the process where the invisible light source emits the invisible light in response to the control signal, the image sensor also acquires ambient light information according to the second ambient light incident on the second area in response to the control signal; The system-level chip is used to generate an image according to the first visible light information, and to determine whether there is an object approaching the electronic device according to the invisible light information in the ambient light information.

20. The driving method according to any one of claims 17 to 19, characterized in that: The camera assembly outputs first visible light information and ambient light information in response to the control signal, including: During the collection process: The image sensor acquires the first ambient light information according to the third ambient light incident on the second area in response to the control signal; In the process where the invisible light source emits the invisible light in response to the control signal, the image sensor also acquires second ambient light information according to fourth ambient light incident on the second area in response to the control signal; The system-level chip is used to determine whether there is an object approaching the electronic device according to the first ambient light information and the second ambient light information.

21. The driving method according to claim 18, characterized in that: The driving method further includes: the system-level chip adjusting the display brightness of the electronic device in response to the first visible light information.

22. A computer readable medium, characterized in that The computer-readable medium stores a computer program, and when the computer program is executed on an electronic device, the electronic device executes the driving method according to any one of claims 9, 10, or 17-21.

Images