Camera assembly and driving method thereof, electronic device and driving method thereof

Abstract

Embodiments of the present application provide a camera assembly and a driving method thereof, and an electronic device and a driving method thereof, and relate to the technical field of electronics, and are used for providing an optimization scheme of integrating a proximity light sensor in an electronic device. The camera assembly comprises a camera module and an invisible light source, and the detection of invisible light is completed by the camera module. The camera module comprises an image sensor, the image sensor is used for outputting a control signal; the invisible light source is used for emitting invisible light in response to the control signal; the image sensor is used for acquiring first visible light information according to visible light incident into a first region in response to the control signal; and the image sensor is further used for acquiring ambient light information according to ambient light incident into a second region in response to the control signal. The camera assembly has both the camera function and the detection function of the proximity light sensor.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of electronics, and particularly relates to a camera assembly and a driving method thereof, and an electronic device and a driving method thereof. BACKGROUND

[0002] In recent years, photoelectric technology is applied more and more widely in various fields, including optical sensors. A proximity light sensor is a common photoelectric sensor, and its application scenarios are also very wide.

[0003] For example, a call state can be detected by the proximity light sensor to reduce the misoperation of the ear or hand on the electronic device in this scenario. A screen-off swing state can be detected by the proximity light sensor to realize the control of the electronic device by the user without touching the electronic device. A storage (into a pocket or bag) state can be detected by the proximity light sensor to start the anti-mis-touch function, etc.

[0004] However, how to make the electronic device include the proximity light sensor without affecting the performance of the electronic device and the proximity light sensor becomes a difficult problem for those skilled in the art. SUMMARY

[0005] Embodiments of the present application provide a camera assembly and a driving method thereof, and an electronic device and a driving method thereof, to provide an optimization scheme for integrating a proximity light sensor in an electronic device.

[0006] To achieve the above object, the present application adopts the following technical scheme:

[0007] In a first aspect, the present application provides a camera assembly having both a camera function and a proximity light sensor detection function. The camera assembly comprises a camera module and an invisible light source. The detection of the invisible light is completed by the camera module. The camera module comprises a structural member, a filter layer, an image sensor, and a substrate. The structural member is in a cylindrical shape and surrounds a surrounding space. One end of the structural member is an entrance of the camera assembly, and the other end of the structural member is buckled on the substrate. The filter layer and the image sensor are located in the surrounding space. The entrance is used to pass through the ambient light entering the camera module, so that the ambient light enters the surrounding space. The filter layer is located between the image sensor and the entrance. The filter layer is used to transmit the visible light in the ambient light and cut off the invisible light in the ambient light. The image sensor comprises a first region and a second region. The projection of the filter layer on the image sensor overlaps the first region. The first region is used to receive the visible light, and the second region is used to receive the ambient light. The image sensor is used to output a control signal. The invisible light source is located outside the surrounding space and is used to emit invisible light in response to the control signal. The image sensor is used to obtain first visible light information according to the visible light in the first ambient light entering the first region in response to the control signal. The image sensor is also used to obtain ambient light information according to the second ambient light entering the second region in response to the control signal. The ambient light information comprises second visible light information and invisible light information.

[0008] The camera assembly provided in the embodiments of the present application comprises a camera module. The first area of the image sensor can acquire visible light information in ambient light, so that the camera assembly can normally realize the function of the camera. On this basis, the camera assembly further comprises a non-visible light source. The non-visible light emitted by the non-visible light source is reflected by an object, and then is mixed in the ambient light and enters the image sensor of the camera module through the light inlet of the camera module. After being exposed by the second area of the image sensor, ambient light information is generated, which includes non-visible light information corresponding to the reflected non-visible light. Therefore, the camera assembly can realize the function of a proximity light sensor. Moreover, the image sensor is arranged in an enclosed space, and the non-visible light source is arranged outside the enclosed space. The non-visible light source and the image sensor are separated by a structural member, so that light isolation between the light receiver and the light source can be realized, and the light interference from the non-visible light source to the area where the image sensor is located can be avoided, thereby ensuring the detection effect of the image sensor. Therefore, the camera assembly can achieve the same effect as the camera and the proximity light sensor arranged independently. On this basis, the light inlet of the camera module serves as the light inlet area of the non-visible light, and a light inlet required by the proximity light sensor does not need to be arranged separately. That is, the camera assembly provided in the embodiments of the present application integrates the functions of the camera and the proximity light sensor internally, but only one light inlet is required for external light reception. When the camera assembly is applied to an electronic device, a hole required for non-visible light incidence does not need to be increased, and the number of camera holes in the screen stack of the electronic device can be reduced. Therefore, even if the camera hole penetrates through the entire screen stack in order to improve the transmittance of the camera hole and improve the detection effect of the non-visible light, the reliability of the screen stack can still be improved, the display visual effect and the screen ratio can be improved, and the internal space of the electronic device can be saved. In addition, the non-visible light emitted by the non-visible light source and the visible light information and the ambient light information acquired by the image sensor are all in response to the same control signal, so that the time delay of non-visible light detection is low.

[0009] In a possible implementation, the control signal comprises a timing signal. The timing signal can be used to control the camera assembly to periodically detect whether an object approaches the electronic device comprising the camera assembly, so that the state of the electronic device can be adjusted in time.

[0010] In a possible implementation, the image sensor further has a third area, the first area is located in the third area, and the second area is located in the third area and surrounds the first area. The third area is an area formed by light entering the camera module through the light inlet and being projected on the image sensor. The manner in which the image sensor realizes non-visible light exposure is provided, so that the image sensor has the non-visible light exposure function and is implementable.

[0011] In a possible implementation, the image sensor comprises a plurality of first light-sensitive units, a plurality of second light-sensitive units, and a receiving circuit; the plurality of first light-sensitive units are located in a first region and are used for exposure to visible light; the plurality of second light-sensitive units are located in a second region and are used for exposure to ambient light; the plurality of first light-sensitive units and the plurality of second light-sensitive units are coupled to the receiving circuit. The same receiving circuit is used to receive and process exposure information generated by the first light-sensitive units and the second light-sensitive units, which can simplify the structure of the image sensor.

[0012] In a possible implementation, the filter layer is further used for transmitting the second ambient light. By setting the properties of the fourth region and the fifth region of the filter layer, the scheme on the image sensor is matched, so that the overall camera assembly can maintain the size of the camera module and integrate the function of the proximity light sensor without changing the spatial layout of the camera module.

[0013] In a possible implementation, the filter layer further comprises an isolation region located between the fourth region and the fifth region. By setting the isolation region, the interference between the visible light and the invisible light can be isolated.

[0014] In a possible implementation, the camera assembly further comprises a light guide member, and the invisible light emitted by the invisible light source is emitted out of the camera assembly through the light guide member. By setting the light guide member, more light information emitted by the invisible light source can be conducted to the light emitting region, and the utilization rate of the light information can be improved.

[0015] In a possible implementation, the camera assembly further comprises a light guide member, and the light guide member comprises a light emitting portion surrounding at least part of the light inlet. In this way, the light outlet of the invisible light and the light inlet of the camera module can correspond to the same camera hole on the electronic device, and the number of camera holes on the electronic device can be reduced.

[0016] In a possible implementation, the invisible light source is arranged on the substrate; the structural member comprises a light source accommodating region, and the light source accommodating region is arranged apart from the surrounding space, and the invisible light source is located in the light source accommodating region. By setting the light source accommodating region for accommodating the invisible light source, more invisible light emitted by the invisible light source can be conducted to the light emitting region, and the utilization rate of the light information can be improved.

[0017] In a possible implementation, the invisible light source is arranged on the substrate; and the invisible light source is located outside the structural member. Such a design can make the structural member have the advantage of small size, so that the camera assembly has the advantage of light weight. Moreover, the invisible light source is located at the periphery of the structural member, and the light source accommodating region does not need to be arranged on the structural member, so that the structure of the structural member is simplified, and the manufacturing cost is low.

[0018] A second aspect of the embodiments of the present application provides a driving method for driving the camera assembly according to any one of the first aspects, the driving method comprising: an image sensor outputting a control signal; an invisible light source emitting invisible light in response to the control signal; the image sensor acquiring first visible light information based on visible light in first ambient light incident on a first region in response to the control signal; and the image sensor further acquiring ambient light information based on second ambient light incident on a second region in response to the control signal. The beneficial effects of the driving method provided in the embodiments of the present application are the same as those of the camera assembly and are not further described here.

[0019] In a possible implementation, the control signal includes a timing signal.

[0020] According to a third aspect of an embodiment of the present application, an electronic device is provided, comprising a camera assembly and a system-on-chip; the system-on-chip is coupled to an image sensor of the camera assembly; the camera assembly comprises any one of the camera assemblies of the first aspect; the system-on-chip is used to control the image sensor to output a control signal, and is also used to receive ambient light information output by the image sensor, and determine whether there is an object approaching the electronic device based on the ambient light information.

[0021] The electronic device provided in the embodiment of the present application includes the camera assembly of the first aspect, and its beneficial effects are the same as those of the camera assembly, which will not be repeated here.

[0022] In one possible implementation, during a call: the image sensor is configured to obtain first visible light information based on visible light within the first ambient light incident on the first area in response to a control signal; the image sensor is further configured to obtain ambient light information based on second ambient light incident on the second area in response to a control signal while the invisible light source emits invisible light in response to the control signal; and the system-on-chip is configured to determine whether an object is approaching the electronic device based on the first visible light information and the invisible light information within the ambient light information. By determining whether an object is approaching the electronic device, scenarios such as placing the electronic device to one's ear for a call, where close contact without display manipulation is not required, can be identified. This can help the electronic device minimize accidental manipulation of the display by the ear or hand in such scenarios, thereby improving power efficiency.

[0023] In a possible implementation, during the screen-off wake-up process: the image sensor is configured to acquire first visible light information according to visible light in the first ambient light incident on the first region in response to the control signal; the image sensor is further configured to acquire ambient light information according to the second ambient light incident on the second region in response to the control signal during the process in which the invisible light source emits invisible light in response to the control signal; and the system chip is configured to generate an image according to the first visible light information, and determine whether an object is close to the electronic device according to invisible light information in the ambient light information. By determining whether an object is close to the electronic device, whether the camera assembly captures a human gesture or a gaze is controlled, so that the user can control the electronic device without touching the electronic device by hand.

[0024] In a possible implementation, during the storage process: the image sensor is configured to acquire first ambient light information according to third ambient light incident on the second region in response to the control signal; the image sensor is further configured to acquire second ambient light information according to fourth ambient light incident on the second region in response to the control signal during the process in which the invisible light source emits invisible light in response to the control signal; and the system chip is configured to determine whether an object is close to the electronic device according to the first ambient light information and the second ambient light information. By determining whether an object is close to the electronic device, whether the anti-mistouch function is started to reduce power consumption and experience effect is controlled.

[0025] In a possible implementation, the system chip is further configured to adjust display brightness of the electronic device according to the first visible light information. By multiplexing the collected visible light information to adjust the display brightness of the electronic device, the signal acquisition brightness can be reduced, and the structure of the electronic device can be simplified.

[0026] In a possible implementation, the electronic device further includes a driving power supply; the driving power supply is configured to drive the invisible light source to emit invisible light in response to the control signal; and the driving power supply is arranged on the substrate of the camera assembly. This is a low-cost implementation.

[0027] In a possible implementation, the electronic device further includes a driving power supply; the driving power supply is configured to drive the invisible light source to emit invisible light in response to the control signal; and the electronic device further includes a circuit board, and the driving power supply is arranged on the circuit board. This is a low-cost implementation.

[0028] In a possible implementation, the electronic device further includes a driving power supply; the driving power supply is configured to drive the invisible light source to emit invisible light in response to the control signal; and the electronic device further includes a power management module, and the driving power supply is integrated in the power management module. This is a low-cost implementation.

[0029] In a fourth aspect, the embodiments of the present application provide a driving method of an electronic device, which is used for driving the electronic device of any one of the third aspect, and the driving method comprises: a system chip controls an image sensor to output a control signal; a camera assembly outputs ambient light information in response to the control signal; and the system chip determines whether an object is close to the electronic device according to the ambient light information.

[0030] The driving method of the electronic device provided by the embodiments of the present application has the same beneficial effects as the electronic device, which will not be described here again.

[0031] In a possible implementation, the camera assembly outputs the first visible light information and the ambient light information in response to the control signal, which comprises: during a call process: the image sensor acquires the first visible light information according to visible light in first ambient light entering the first area in response to the control signal; during a process in which the invisible light source emits invisible light in response to the control signal, the image sensor acquires the ambient light information according to ambient light entering the second area in response to the control signal; and the system chip determines whether an object is close to the electronic device according to the first visible light information and the ambient light information.

[0032] In a possible implementation, the camera assembly outputs the first visible light information and the ambient light information in response to the control signal, which comprises: during a screen-off wake-up process: the image sensor acquires the first visible light information according to visible light in first ambient light entering the first area in response to the control signal; during a process in which the invisible light source emits invisible light in response to the control signal, the image sensor acquires the ambient light information according to second ambient light entering the second area in response to the control signal; and the system chip is configured to generate an image according to the first visible light information, and determine whether an object is close to the electronic device according to invisible light information in the ambient light information.

[0033] In a possible implementation, the camera assembly outputs the first visible light information and the ambient light information in response to the control signal, which comprises: during a storage process: the image sensor acquires the first ambient light information according to third ambient light entering the second area in response to the control signal; during a process in which the invisible light source emits invisible light in response to the control signal, the image sensor acquires the second ambient light information according to fourth ambient light entering the second area in response to the control signal; and the system chip is configured to determine whether an object is close to the electronic device according to the first ambient light information and the second ambient light information.

[0034] In a possible implementation, the driving method further comprises: the system chip adjusts display brightness of the electronic device in response to the first visible light information.

[0035] In a fifth aspect, the present application provides a computer readable medium, which stores a computer program. When the computer program is run on an electronic device, the electronic device executes the driving method according to any one of the second aspect or any one of the fourth aspect. BRIEF DESCRIPTION OF DRAWINGS

[0036] Figure 1 An appearance of an electronic device according to an embodiment of the present application;

[0037] Figure 2 An exploded view of an electronic device according to an embodiment of the present application; Figure 1 A sectional view along A1-A2;

[0038] Figure 3 An exploded view of an electronic device according to an embodiment of the present application;

[0039] Figure 4 A schematic diagram of a proximity light sensor according to an embodiment of the present application;

[0040] Figure 5 An appearance of an electronic device according to an embodiment of the present application;

[0041] Figure 6 A sectional view of an electronic device according to an embodiment of the present application;

[0042] Figure 7 A structural schematic diagram of a camera assembly and a screen stack according to an embodiment of the present application;

[0043] Figure 8A An exploded view of a camera assembly according to an embodiment of the present application;

[0044] Figure 8B An assembly diagram of a camera assembly according to an embodiment of the present application;

[0045] Figure 8C An assembly diagram of another camera assembly according to an embodiment of the present application;

[0046] Figures 9-11 A plan view of an image sensor according to an embodiment of the present application;

[0047] Figure 12 A plan view of an image sensor according to an embodiment of the present application; Figure 13

[0048] A structural schematic diagram of a light guide according to an embodiment of the present application; Figure 14

[0049] A structural schematic diagram of a light guide according to an embodiment of the present application; Figure 15 Figure 16 ​A topological structure diagram of an image sensor and a system on chip is provided for an embodiment of the present application.

[0050] Figures 17-19 A driving timing diagram of an electronic device is provided for an embodiment of the present application. DETAILED DESCRIPTION

[0051] The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, but not all of the embodiments of the present application.

[0052] Hereinafter, the terms "second", "first", and the like are only used for description convenience, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined with "second", "first", and the like can explicitly or implicitly include one or more of the features. In the description of the present application, unless otherwise specified, the meaning of "a plurality of" is two or more.

[0053] In addition, in the embodiments of the present application, the orientation terms such as "upper", "lower", "left", "right", and the like can include but are not limited to the orientation defined by the relative placement of the components in the drawings. It should be understood that these directional terms can be relative concepts, which are used for relative description and clarification, and can be changed accordingly according to the change of the placement of the components in the drawings.

[0054] In the embodiments of the present application, unless otherwise explicitly specified and limited, the term "connection" should be understood in a broad sense, for example, "connection" can be fixed connection, or detachable connection, or integral; can be directly connected, or indirectly connected through an intermediate medium. In addition, the term "coupling" can be direct electrical connection, or indirect electrical connection through an intermediate medium. The term "contact" can be direct contact, or indirect contact through an intermediate medium.

[0055] In the embodiments of the present application, "and / or" describes the association relationship of the associated objects, which means that there can be three kinds of relationships, for example, A and / or B, which can represent the following three cases: A exists alone, A and B exist together, and B exists alone, where A and B can be singular or plural. The character " / " generally represents an "or" relationship between the associated objects before and after it.

[0056] Embodiments of the present application provide an electronic device. The electronic device is, for example, a consumer electronic product with a camera function, a household electronic product. The consumer electronic product is, for example, a mobile phone, a pad, a notebook computer, a personal digital assistant (PDA), a smart wearable product (for example, a smart watch, a smart bracelet), a virtual reality (VR) electronic device, an augmented reality (AR) electronic device, a drone, and the like. The household electronic product is, for example, a smart door lock, and the like. Embodiments of the present application do not specially limit the specific form of the above electronic device.

[0057] Figure 1 An appearance view of an electronic device provided by embodiments of the present application is shown. Figure 2 As shown in Figure 1 A sectional view along A1-A2.

[0058] As shown in Figure 1 The electronic device 1 includes a cover glass (CG) and a housing 11, the cover glass CG and the housing 11 are coupled to form an accommodation space, and the components of the electronic device 1 for display are arranged in the accommodation space. The cover glass CG is a transparent structure, for example, the cover glass CG is glass, and the cover glass has a high light transmittance.

[0059] In some embodiments, as shown in Figure 2 The structure arranged in the accommodation space in the electronic device 1 includes a screen stack, and the screen stack includes a display panel 12, a polarizer (POL), an optically clear adhesive (OCA), a back plate (BP), and a super clean foam (SCF).

[0060] The display panel 12 is, for example, an organic light emitting diode (OLED) display panel, and the display panel 12 is used for display highlighting. The display panel 12 can also integrate a touch function. The polarizer POL and the optically clear adhesive OCA are arranged on the light-emitting side of the display panel 12 in sequence, and the back plate BP and the super clean foam SCF are arranged on the back light side of the display panel 12 in sequence. Figure 1 and Figure 2 The screen stack includes a camera hole, the cover glass CG is arranged on the light-emitting side of the screen stack, and the cover glass CG covers the camera hole.

[0061] In some embodiments, the electronic device 1 further comprises a front camera assembly 20, the front camera assembly 20 is arranged in the accommodation space, and a lens of the front camera assembly 20 protrudes into the camera hole to collect light in front of the electronic device 1 through the camera hole to realize shooting.

[0062] Figure 3 An exploded view of an electronic device according to an embodiment of the present application.

[0063] As shown in the figure, Figure 3 The front camera assembly 20 is arranged below the screen stack, and at least part (for example, the lens) of the front camera assembly 20 protrudes into the camera hole.

[0064] In some embodiments, the electronic device 1 further comprises a rear camera assembly, the rear camera assembly comprises at least one camera module, for example, can comprise one or more of a standard camera module, a long-focus camera module, a wide-angle camera module, an ultra-long-focus camera module, and an ultra-wide-angle camera module. Correspondingly, the shell 11 is provided with a rear camera hole, and the rear camera assembly collects light behind the electronic device 1 through the rear camera hole to realize shooting.

[0065] In some embodiments, the electronic device 1 further comprises a printed circuit board (PCB), a system on chip (SOC), a processor, a memory, a battery and the like. The system on chip, the processor and the memory are fixed on the printed circuit board. The display screen 12, the front camera assembly 20 and the rear camera assembly are electrically connected to the processor. The memory is used to store computer program codes. The computer program codes comprise computer instructions. The processor is used to call the computer instructions to make the electronic device 1 perform corresponding operations, for example, to make the display screen 12 display a target image, to make the front camera assembly and the rear camera assembly collect the target image, and the like. The battery is electrically connected to the printed circuit board and is used to supply power to the electronic device 1. In some embodiments, the electronic device 1 can further comprise one or more of an antenna module, a mobile communication module, a sensor module, a motor, a microphone module, a loudspeaker module and the like. These functional modules can be electrically connected to the processor to transmit signals.

[0066] In recent years, optoelectronic technology has been increasingly widely applied in various fields, including light sensors. A proximity light sensor is a common optoelectronic sensor, and its application scenarios are also very wide.

[0067] For example, in the first application scenario (during a call), when the user uses the electronic device 1 to make a call, the electronic device 1 is close to the ear, and the user cannot see the display screen 12. If the display screen 12 of the electronic device 1 is always in a bright screen state during the call, the waste of power will be very serious. The proximity light sensor is arranged in the electronic device 1, and the proximity light sensor can identify the scenario of placing the electronic device 1 close to the ear to make a call and other close contact scenarios that do not need to operate the display screen 12, to prompt the electronic device 1 to reduce the misoperation of the ear or the hand on the display screen 12 in this scenario, so as to improve the utilization rate of power.

[0068] In the second application scenario (during a screen-off swing), when the user is within a certain range in front of the electronic device 1, the gesture or the eye contact of the user is captured by the camera assembly 20, so that the user can control the electronic device 1 without touching the electronic device 1 by hand.

[0069] In the third application scenario (storage state), when the proximity light sensor is blocked and in a dark environment, the pocket mode is started. In the pocket mode, the anti-misoperation function is started and the power consumption is reduced, so as to improve the utilization rate of power.

[0070] Based on this, in some embodiments, the electronic device 1 further includes a proximity light sensor. Next, the arrangement of the proximity light sensor in the electronic device 1 is schematically described.

[0071] Figure 4 A principle diagram of the proximity light sensor provided by the embodiments of the present application is shown.

[0072] As shown in Figure 4 , the principle of the proximity light sensor is to perceive an object by infrared reflection. The proximity light sensor includes an infrared light emitter and an infrared light receiver. First, the infrared light emitted by the infrared light emitter is reflected to the infrared light receiver via a proximity object. The infrared light receiver judges the distance between the proximity object and the proximity light sensor according to the received infrared light intensity, and thus the function of perceiving the distance of the object can be realized.

[0073] Figure 5 An appearance diagram of an electronic device according to the embodiments of the present application is shown.

[0074] In some embodiments, as shown in Figure 5 , the electronic device 1 further includes an infrared light emitting hole and an infrared light receiving hole. The infrared light emitting hole and the infrared light receiving hole are located near the camera hole. The infrared light emitted by the infrared light emitter is emitted out of the electronic device 1 through the infrared light emitting hole, and the reflected infrared light is emitted into the infrared light receiver through the infrared light receiving hole. Compared with Figure 2The camera hole and the infrared light emitting hole and the infrared light receiving hole are shown to be the same, in order to reduce the influence on the transmission effect of infrared light, the infrared light emitting hole and the infrared light receiving hole penetrate through the screen stack, only the top cover plate CG is left.

[0075] By setting the infrared light emitting hole and the infrared light receiving hole, the light path is provided for the proximity light sensor, and the function of the proximity light sensor can be realized. However, the hole will reduce the reliability of the screen stack, and the screen stack is easy to be damaged in the scene of falling, extrusion and the like.

[0076] Figure 6 A cross-sectional view of an electronic device according to an embodiment of the present application is shown.

[0077] In other embodiments, as shown in Figure 6 The camera hole, the infrared light emitting hole and the infrared light receiving hole only penetrate through the film layer below the display screen 12 in the screen stack, such as the back plate BP and the heat dissipation film SCF. Figure 6 Only the infrared light emitting hole is shown in the figure.

[0078] The front camera assembly and the proximity light sensor (such as the infrared light emitter and the infrared light receiver) are arranged below the display screen 12, which can improve the reliability and appearance of the display screen 12. However, the propagation of infrared light will be affected by the display screen 12 and the film layer above it. Especially with the development of display screen 12 technology, the density of pixel circuit in display screen 12 will gradually increase, occupying the area proportion of the originally light-transmitting part, reducing the screen transmittance, resulting in that the scheme of placing the proximity light sensor below the display screen 12 is becoming more and more unfeasible.

[0079] Based on this, the embodiments of the present application provide a camera assembly, which integrates the hardware structure and control logic of the proximity light sensor in the camera assembly, which can realize the function of the proximity light sensor and the original function of the camera at the same time, and reduce the number of openings of the display screen 12.

[0080] Figure 7 A structure diagram of a camera assembly and a screen stack provided by an embodiment of the present application is shown.

[0081] In some embodiments, as shown in Figure 7 The camera assembly 20 includes a camera module 30 and a non-visible light source 40, and the non-visible light source 40 is integrated in the camera module 30. The camera module 30 includes a substrate 31 for arranging electronic devices. The camera module 30 further includes an image sensor (CIS) 32 and other electronic devices, and the image sensor 32 and the non-visible light source 40 are arranged on the substrate 31. The image sensor 32 can be sunken into the substrate 31, for example, a recess is arranged on the surface of the substrate 31, and the recess accommodates the image sensor 32.

[0082] The camera module 30 further includes a structure 33 which is in a cylindrical shape and encloses a surrounding space 331. In the direction of the optical axis of the camera module 30, both ends of the structure 33 are open. The first end of the structure 33 is the light inlet a of the camera assembly 20, and when the camera module 30 is applied to the electronic device 1, the first end of the structure 33 extends into the camera hole of the electronic device 1. The second end of the structure 33 is buckled on the substrate 31 to form a closed space. The image sensor 32 is located in the surrounding space 331, and the invisible light source 40 is located outside the surrounding space 331, and the invisible light source 40 is used to send invisible light. The structure 33 isolates the image sensor 32 from the invisible light source 40, so that the invisible light sent by the invisible light source 40 cannot directly irradiate on the image sensor 32.

[0083] The invisible light source 40 may, for example, be an infrared light source, an ultraviolet light source, or a far-infrared light source, etc. In an example, the invisible light source 40 includes a vertical-cavity surface-emitting laser (VCSEL).

[0084] In some embodiments, the periphery of the light inlet a is the light outlet area of the invisible light sent by the invisible light source 40. After the invisible light is emitted through the light outlet area, the invisible light reflected by the object is incident into the surrounding space 331 of the camera module 30 through the light inlet a. The visible light incident into the camera module 30 also enters the surrounding space 331 through the light inlet a.

[0085] In some embodiments, the periphery of the light inlet a is the light outlet area of the invisible light sent by the invisible light source 40. After the invisible light is emitted through the light outlet area, the invisible light reflected by the object is incident into the surrounding space 331 of the camera module 30 through the light inlet a. The visible light incident into the camera module 30 also enters the surrounding space 331 through the light inlet a.

[0086] In some embodiments, as shown in FIG. 2, the camera module 30 further includes a filter layer 34 (the filter layer 34 can also be other types of optical elements) and a lens 35. Figure 7

[0087] The filter layer 34 and the lens 35 are arranged in the surrounding space 331. In the direction of the optical axis of the camera module 30, the filter layer 34 is located between the image sensor 32 and the light inlet a, and the lens 35 is located on the side of the filter layer 34 away from the image sensor 32.

[0088] In some embodiments, the filter layer 34 and the lens 35 are fixed to the structure 33. Figure 7 ​The shown embodiment only schematically represents the relative position relationship between the structural elements in the camera module 30, and does not limit the specific connection manner between the structural elements, the specific position setting, and the structure form of the structural elements.

[0089] Figure 8A An exploded view of a camera assembly provided by an embodiment of the present application, Figure 8B and Figure 8C An assembly view of a camera assembly provided by an embodiment of the present application.

[0090] In some embodiments, as shown in Figure 8A , the substrate 31 is coupled with a flexible printed circuit (FPC) provided with pins, and the substrate 31 is coupled with the circuit board of the electronic device 1 through the flexible printed circuit FPC.

[0091] As to the structure of the structural member 33, for example, the structural member 33 can be an integrated structure, or the structural member 33 can be formed by two or more structures connected.

[0092] In some embodiments, as shown in Figure 8A , the structural member 33 includes a first structure 33A and a second structure 33B, the first structure 33A forms a first surrounding space, and the second structure 33B forms a second surrounding space. The first structure 33A and the second structure 33B can be fixed by, for example, adhesive.

[0093] For example, the first surrounding space is a cylindrical structure for accommodating and fixing the lens 35, and the second surrounding space is a frame-shaped base structure for accommodating the image sensor 32 and fixing the filter layer 34. Of course, the second surrounding space can only accommodate the filter layer 34.

[0094] In some embodiments, as shown in Figure 7 , the invisible light source 40 is arranged on the substrate 31, and a light source accommodating area 332 is separately formed on the structural member 33, the light source accommodating area 332 is arranged separately from the surrounding space 331, and the invisible light source 40 is accommodated in the light source accommodating area 332. Then, as shown in Figure 8B , after the structural member 33 is buckled with the substrate 31, the lens 35, the filter layer 34, the image sensor 32, and the invisible light source 40 are all covered by the structural member 33.

[0095] By arranging the light source accommodating area 332 for accommodating the invisible light source 40, more invisible light emitted by the invisible light source 40 can be conducted to the light emitting area, and the utilization rate of light information can be improved.

[0096] In other embodiments, as shown in Figure 8CAs shown, the non-visible light source 40 is disposed on the substrate 31, and the non-visible light source 40 is fixed on the outer side of the structural member 33.

[0097] Therefore, the vertical projection of the structural member 33 on the substrate 31 covers part of the area of the substrate 31. The structural member 33 is buckled on the substrate 31, and the image sensor 32 is accommodated in the inside of the structural member 33, and the non-visible light source 40 is located at the periphery of the structural member 33.

[0098] Such a design can make the structural member 33 have the advantage of small size, so that the camera assembly 20 has the advantage of light weight. Moreover, the non-visible light source 40 is located at the periphery of the structural member 33, and there is no need to set a light source accommodating area 332 on the structural member 33, so that the structure of the structural member 33 is simple, and has the advantage of low manufacturing cost.

[0099] On this basis, in the embodiment of the present application, the image sensor 32 can be exposed to non-visible light, and the image sensor 32 can also be exposed to visible light. Therefore, the light filtering layer 34 needs an area that can transmit non-visible light, and the light filtering layer 34 also needs an area that can only transmit visible light.

[0100] Figures 9-11 A plan view of an image sensor is provided in the embodiment of the present application.

[0101] As shown, Figure 9 For the image sensor 32, the image sensor 32 includes a first area 322 and a second area 323, and the projection of the light filtering layer 34 on the image sensor 32 overlaps the first area 322. For example, the first area 322 is used to receive visible light, and the second area 323 is used to receive ambient light, which includes visible light and non-visible light.

[0102] The effective area thereof is a third area 321, which is an area in a larger solid square in Figure 9 The light entrance a of the camera module 30 is circular, and the light entering the camera module 30 will also form a circular light entrance projection area 324, Figure 9 The area in the dotted circle in the figure is the light entrance projection area 324 on the image sensor 32. The intersection of the light entrance projection area 324 and the third area 321 is an image generation area on the image sensor 32. Since the captured image or video is rectangular, a rectangular imaging effective area needs to be formed in the image generation area on the image sensor 32, and the present application defines the imaging effective area as the first area 322, as shown in Figure 9As shown, the first region 322 is a region within a larger rectangular box within the third region 321. The region within the imaging effective area and outside the first region 322 is an extra region, i.e. light can be projected on this region, but this region is not used for imaging by the camera module 30. The present application defines this extra region as the second region 323.

[0103] In general, the image sensor 32 has the third region 321, the first region 322 and the second region 323, the first region 322 is inside the third region 321, and the second region 323 is inside the third region 321 and outside the first region 322. The first region 322 is an exposure region for visible light, i.e. an imaging region of the camera module 30, and the second region 323 is an exposure region for invisible light.

[0104] In some embodiments, as shown in FIG. 3A, the second region 323 is outside the first region 322 and surrounds the first region 322. Figure 9 As shown in FIG. 3B, the second region 323 is outside the first region 322 and is on two opposite sides of the first region 322. Figure 9 As shown in FIG. 3C, the second region 323 is outside the first region 322 and is on one side of the first region 322.

[0105] In some embodiments, as shown in FIG. 3A, the second region 323 is outside the first region 322 and surrounds the first region 322. Figure 10 As shown in FIG. 3B, the second region 323 is outside the first region 322 and is on two opposite sides of the first region 322.

[0106] For example, the image sensor 32 includes an array of light-sensitive cells, and the second region 323 is on two opposite sides of the first region 322 along the column direction of the light-sensitive cells.

[0107] In some embodiments, as shown in FIG. 3A, the second region 323 is outside the first region 322 and surrounds the first region 322. Figure 11 As shown in FIG. 3B, the second region 323 is outside the first region 322 and is on two opposite sides of the first region 322.

[0108] For example, the image sensor 32 includes an array of light-sensitive cells, and the second region 323 is on one side of the first region 322 along the column direction of the light-sensitive cells.

[0109] In some embodiments, as shown in FIG. 3A, the second region 323 is outside the first region 322 and surrounds the first region 322. Figure 9 As shown in FIG. 3B, the second region 323 is outside the first region 322 and is on two opposite sides of the first region 322.

[0110] In some embodiments, the image processor ISP includes a plurality of light sensitive units arranged in the third region 321 of the image sensor 32. The first light sensitive units of the plurality of light sensitive units in the first region 322 are used as the visible light collection units for exposure to visible light. The second light sensitive units of the plurality of light sensitive units in the second region 323 are used as the ambient light collection units for exposure to ambient light. The remaining light sensitive units of the plurality of light sensitive units are used as the redundant light sensitive units.

[0111] The partial redundant units are used as the ambient light collection units, without increasing the cost and size of the camera assembly 20, and the camera assembly 20 has the function of the infrared light receiver.

[0112] Figure 12 And Figure 13 A plan view of the filter layer according to an embodiment of the present application.

[0113] In some embodiments, the filter layer 34 is rectangular and has an outer edge 340. Similarly, Figure 12 The dotted circular region in FIG. 4 is the light entry projection region 344 on the filter layer 34. The intersection of the light entry projection region 344 and the outer edge 340 is the effective light transmission region. Since the captured image or video is rectangular, a rectangular imaging light transmission area needs to be formed in the effective light transmission region on the filter layer 34. The present application defines this imaging light transmission area as the fourth region 341. The fourth region 341 is used to transmit the visible light in the ambient light and cut off the non-visible light in the ambient light.

[0114] In some embodiments, the region in the effective light transmission region and outside the fourth region 341 is an extra region, i.e., the ambient light can pass through this region, but this part of the ambient light is not used for imaging. The present application defines the extra region on the filter layer 34 as the fifth region 342. The fifth region 342 is located outside the fourth region 341.

[0115] The fourth region 341 is arranged correspondingly to the first region 322. The projection of the filter layer 34 on the image sensor 32 overlaps the first region 322. The fourth region 341 is used to transmit the visible light and cut off the non-visible light in the ambient light. The fifth region 342 is located outside the fourth region 341. The fifth region 342 is arranged correspondingly to the second region 323. The fifth region 342 is used to transmit the visible light and non-visible light in the ambient light.

[0116] For example, the fifth region 342 is arranged correspondingly to the second region 323. The ambient light that enters through the fifth region 342 can irradiate the second region 323 of the image sensor 32, but it is not limited to that the pattern of the fifth region 342 is the same as the pattern of the second region 323.

[0117] For example, the fifth region 342 is arranged correspondingly to the second region 323. The ambient light that enters through the fifth region 342 can irradiate the second region 323 of the image sensor 32, but it is not limited to that the pattern of the fifth region 342 is the same as the pattern of the second region 323. Figure 7As shown, in the direction of the optical axis of the camera module 30, the fourth region 341 of the filter layer 34 is arranged corresponding to the first region 322 of the image sensor 32, and the fifth region 342 of the filter layer 34 is arranged corresponding to the second region 323 of the image sensor 32. The "corresponding arrangement" here can be understood as corresponding in the optical path. Their shapes can be the same, but it does not mean that their sizes are the same. For example, the size of the fourth region 341 of the filter layer 34 can be smaller than the size of the first region 322 of the image sensor 32. Their shapes can also be different, for example, as shown in the following figure. Figure 11 As shown, the second region 323 is located on one side of the first region 322. Then, as shown in the following figure, Figure 13 As shown, the fifth region 342 is also located on one side of the fourth region 341. But the area profile of the fifth region 342 is not the same as that of the second region 323. The profile of the fifth region 342 can be rectangular, for example, to facilitate the processing of the fourth region 341 and the fifth region 342.

[0118] In some embodiments, as shown in the following figure, Figure 12 As shown, the filter layer 34 further includes an isolation region 343 located between the fourth region 341 and the fifth region 342. The isolation region 343 is used to block the light crosstalk between the fourth region 341 and the fifth region 342.

[0119] For example, the filter layer 34 includes a transparent carrier plate, an invisible light blocking film, an invisible light transmitting film, and a light shielding film, which are arranged on the carrier plate. The invisible light blocking film is located in the fourth region 341, the invisible light transmitting film is located in the fifth region 342, and the light shielding film is located in the isolation region 343. Of course, the fifth region 342 can also not be provided with an invisible light transmitting film. Or the filter layer 34 does not include the fifth region.

[0120] The material of the carrier plate includes glass, resin, etc., the material of the invisible light blocking film includes tin oxide, titanium oxide, the material of the invisible light transmitting film includes organic material, and the material of the light shielding film includes reflective material or light-proof material.

[0121] In some embodiments, please refer to Figure 7 The camera assembly 20 further includes a light guide 50. The invisible light emitted by the invisible light source 40 is emitted out of the camera assembly 20 through the light guide 50.

[0122] For example, the first end of the light guide 50 receives the invisible light emitted by the invisible light source 40, and the second end of the light guide 50 emits the invisible light emitted by the invisible light source 40. The invisible light emitted by the invisible light source 40 is transmitted from the first end to the second end. The second end of the light guide 50 can be located, for example, at the outer circle of the light inlet a.

[0123] For example, the invisible light emitted by the invisible light source 40 is conducted to the vicinity of the light inlet a through the light guide 50 and is emitted from the camera hole of the electronic device 1 and projected to the detection target and enters the camera hole after being reflected by the detection target. After the invisible light passes through the lens 35, it is projected on the fifth region 342 of the light filter layer 34. Since the fifth region 342 can transmit or partially transmit the invisible light, the invisible light passes through the fifth region 342 of the light filter layer 34 and is projected on the second region 323 of the image sensor 32. Therefore, the image sensor 32 can receive the invisible light and perform exposure processing on the invisible light to realize the detection function of the proximity light sensor and determine whether the state of the detection target relative to the electronic device 1 is approaching or moving away.

[0124] In the embodiment of the present application, the camera module 30 collects the target scene through the camera hole, and the light of the target scene passes through the camera hole, the lens 35 and the fourth region 341 of the light filter layer 34 in turn, and is projected on the first region 322 of the image sensor 32, so that the image sensor 32 collects image information. The invisible light source 40 emits invisible light, which is guided out through the light guide 50 and is emitted to the outside through the cover plate BG. The invisible light is reflected back by the object, passes through the lens 35 and the fifth region 342 of the light filter layer 34, and is projected on the second region 323 of the image sensor 32, so that the image sensor 32 collects invisible light information.

[0125] The present application sets the properties of the fourth region 341 and the fifth region 342 of the light filter layer 34 and matches the first region 322 and the second region 323 of the image sensor 32, so that the overall camera assembly 20 can maintain the size of the camera module 30 and integrate the function of the proximity light sensor without changing the spatial layout of the camera module 30.

[0126] Figure 14 A structural schematic diagram of a light guide provided in an embodiment of the present application is shown.

[0127] In some embodiments, as shown in Figure 14 For example, the light guide 50 includes a light emitting portion 51, which is a portion of the light guide 50 located in the light emitting area of the invisible light emitted by the invisible light source 40.

[0128] For example, the light emitting portion 51 surrounds at least part of the structural member 33. Figure 14 In the embodiment shown, the light emitting portion 51 can be a closed ring. For example, the light emitting portion 51 can be a circular ring, a polygonal ring structure, etc. The present application designs the light emitting portion 51 as a closed ring, changes the point light source at the light inlet position of the light guide 50 into a surface light source at the light emitting position, and can more clearly illuminate the detection target.

[0129] The light emitting part 51 is in the optical window, and the light emitting part 51 can fully surround the part of the structural member 33 located in the camera hole, so that the light of the invisible light source 40 forms a ring-shaped light emitting surface at the camera hole position, and the infrared light emitted by the invisible light source 40 can be emitted from the periphery of the light inlet a position of the camera module in all directions (360 degrees), so that more infrared light emitted by the invisible light source 40 enters the inside of the structural member 33, and the utilization rate of the invisible light source 40 is improved.

[0130] For example, the light emitting part 51 can also be an annular shape with an opening, a semi-annular shape, an arc shape, etc.

[0131] In some embodiments, the light guide member 50 includes a light inlet surface 52, a transmission section 53, and a light outlet surface 54.

[0132] For example, the transmission section 53 is in an elongated rod shape, and the cross section of the transmission section 53 can be circular, square, triangular, polygonal, irregular, etc. The light inlet surface 52 is one end surface of the rod-shaped transmission section 53, and is the end surface of the transmission section 53 facing the invisible light source 40. The light emitting part 51 is connected to one end of the transmission section 53 away from the invisible light source 40, and the light outlet surface 54 is the end surface of the light emitting part 51 and is the surface facing the outside space of the cover plate BG.

[0133] For example, the light guide member 50 includes a light-transmitting inner core and a non-light-transmitting layer wrapped around the outer periphery of the inner core. The material of the inner core includes glass or resin, for example, and the material of the non-light-transmitting layer includes a light-reflecting material or an opaque material, for example.

[0134] Based on the structure of the camera assembly 20 described above, the following describes how the image sensor 32 realizes separate exposure of visible light and ambient light.

[0135] In some embodiments, the image sensor 32 is configured to output a control signal, and the invisible light source 40 is configured to emit invisible light in response to the control signal. After the invisible light is emitted, the image sensor 32 can determine whether an object is close to the image sensor 32 by collecting the light intensity of the reflected invisible light.

[0136] In some embodiments, the image sensor 32 is configured to acquire first visible light information from the visible light in the first ambient light incident on the first region 322 in response to the control signal. The visible light information acquired at this time can be visible light noise information or visible light image information.

[0137] During the driving process of the camera assembly 20, the image sensor 32 outputs a control signal, and the invisible light source 40 emits invisible light in response to the control signal.

[0138] The image sensor 32 is also configured to acquire ambient light information according to the second ambient light incident on the second region 323 in response to the control signal. The ambient light information includes second visible light information and invisible light information.

[0139] The time at which the image sensor 32 acquires the visible light information and the time at which the image sensor 32 acquires the ambient light information can be the same or different. For example, when the invisible light source 40 does not emit invisible light, the image sensor 32 acquires first visible light information according to the visible light in the first ambient light incident on the first region 322 in response to the control signal. During the emission of invisible light by the invisible light source 40, the image sensor 32 acquires ambient light information according to the ambient light incident on the second region 323 in response to the control signal. The ambient light information includes second visible light information and invisible light information.

[0140] Based on this, the invisible light information acquired by the image sensor 32 includes reflected invisible light information, and the system on chip (SOC) can determine whether an object is close to the electronic device according to the reflected invisible light information. The first visible light information acquired by the image sensor 32 can be used as information for generating an image or information for removing noise in the ambient light information.

[0141] In the embodiments of the present application, “close” may, for example, refer to whether an object is within a preset distance range.

[0142] The camera assembly 20 provided in the embodiments of the present application includes the camera module 30, and the first area 322 of the image sensor 32 can acquire visible light information in ambient light, so that the camera assembly 20 can normally realize the function of the camera. On this basis, the camera assembly 20 further includes the invisible light source 40, and the invisible light emitted by the invisible light source 40 is reflected by an object, is mixed in ambient light, is incident on the image sensor 32 of the camera module 30 through the light inlet a of the camera module 30, is exposed through the second area 323 of the image sensor 32, and generates second visible light information and invisible light information. The invisible light information includes reflected invisible light information corresponding to the reflected invisible light, so that the camera assembly 20 can realize the function of the proximity light sensor. Moreover, the image sensor 32 is arranged in the surrounding space 331, the invisible light source 40 is arranged outside the surrounding space 331, the invisible light source 40 and the image sensor 32 are separated by the structural member 33, light isolation between the light receiver and the light source can be realized, light interference from the invisible light source to the area where the image sensor 32 is located is avoided, and the detection effect of the image sensor 32 can be ensured. Therefore, the camera assembly 20 can achieve the same effect as the camera and the proximity light sensor arranged independently. On this basis, the light inlet a of the camera module 30 serves as a light inlet area of invisible light, and a light inlet required by the proximity light sensor does not need to be arranged separately. That is, the camera assembly 20 provided in the embodiments of the present application integrates the functions of the camera and the proximity light sensor internally, but only one light inlet a is required for external light reception. When the camera assembly 20 is applied to the electronic device 1, a hole required for invisible light incidence does not need to be increased, and the number of camera holes in the screen stack of the electronic device 1 can be reduced. Then, even if the camera hole penetrates through the entire screen stack in order to improve the transmittance of the camera hole and improve the detection effect of the invisible light, the reliability of the screen stack can still be improved, the display visual effect and the screen ratio can be improved, the internal space of the electronic device 1 can be saved, and the like. In addition, the invisible light source 40 emits invisible light, and the image sensor 32 acquires visible light information and ambient light information, which are all in response to the same control signal, so that the time delay of invisible light detection is low.

[0143] Figure 15 and Figure 16 A topological structure schematic diagram of an image sensor and a system on chip provided in the embodiments of the present application.

[0144] In some embodiments, as shown in Figure 15 The image sensor 32 includes a timing circuit 326, a plurality of light-sensitive units 327 arranged in an array, and a receiving circuit.

[0145] In an example, the plurality of light sensitive units 327 includes a plurality of first light sensitive units and a plurality of second light sensitive units, the plurality of light sensitive units 327 are arranged in an array in the third region 321 of the image sensor 32, the plurality of first light sensitive units are located in the first region 322 as visible light collection units for collecting visible light. The plurality of second light sensitive units are located in the second region 323 as ambient light collection units for collecting ambient light. The light sensitive unit 327 includes, for example, a photodiode (PD). The plurality of light sensitive units 327 are coupled to a receiving circuit, the electrical signal generated by the exposure of the first light sensitive unit is processed by the receiving circuit, and the electrical signal generated by the exposure of the second light sensitive unit is also processed by the receiving circuit.

[0146] The timing circuit 326 is configured to control the plurality of first light sensitive units (visible light collection units) and the plurality of second light sensitive units (ambient light collection units) and exposure of the received light to generate electrical signals.

[0147] In some embodiments, the receiving circuit includes an analog-to-digital converter (ADC) and an image signal processor (ISP).

[0148] The analog-to-digital converter (ADC) is coupled to the plurality of first light sensitive units and the plurality of second light sensitive units, and is configured to convert the electrical signals into digital signals. The image signal processor (ISP) is configured to process the digital signals to output the second visible light information and the invisible light information. The processing of the digital signals by the image signal processor (ISP) includes, for example, noise elimination, wide-angle distortion correction of a digital photo, image contrast improvement, red-eye elimination processing, and the like. The image signal processor (ISP) in the related art is applicable to the embodiments of the present application.

[0149] In the embodiments of the present application, the electrical signals generated by the plurality of first light sensitive units and the electrical signals generated by the plurality of second light sensitive units are processed by a set of analog-to-digital converter (ADC) and image signal processor (ISP), which can simplify the structure of the image sensor 32.

[0150] In some embodiments, the control signal includes a timing signal.

[0151] The timing signal can be used to control the camera assembly 20 to periodically detect whether an object approaches the electronic device 1 including the camera assembly 20, so that the state of the electronic device 1 can be adjusted in time.

[0152] In an example, the timing circuit 326 is configured to output the control signal.

[0153] In some embodiments, the timing signal is a strobe signal. The strobe signal can be used to control the turning on or off of a flash in the camera assembly 20. Of course, the flash in the camera assembly 20 can also be directly controlled by the SOC. The signal originally used to control the flash in the camera assembly 20 can be used as the control signal in the present application, without the need to separately add a circuit for outputting the control signal, reducing the modification to the image sensor 32.

[0154] In some embodiments, the timing circuit 326 can be integrated in the image processor ISP.

[0155] Then, the controlled signal for driving the power supply 70 can be controlled by the image processor ISP in the image sensor 32, multiplexing the image processor ISP, which can save the board area.

[0156] In some embodiments, the image sensor 32 further includes a first logic control circuit 328, which is coupled with the mode control terminal 36 disposed on the substrate 31.

[0157] The mode control terminal 36 is used to receive a mode signal sent by the system on chip SOC, and the first logic control circuit 328 is used to receive the mode signal of the mode control terminal 36, output a configuration parameter one to the timing circuit 326, and control the timing circuit 326 to output a timing signal (control signal). The first logic control circuit 328 controls the timing circuit 326 to output the control signal in combination with the mode signal and the timing signal, so as to control the exposure of the visible light acquisition unit and / or the ambient light acquisition unit to generate a digital signal.

[0158] That is, the exposure of the visible light acquisition unit and the ambient light acquisition unit is controlled by the mode signal.

[0159] Regarding the sending of the mode signal and the processing of the ambient light information, in some embodiments, as shown in Figure 15 The electronic device 1 further includes a system on chip SOC, which is coupled with the mode control terminal 36 of the camera assembly 20 and the image sensor 32. The coupling interface between the system on chip SOC and the image sensor 32 is, for example, a mobile industry processor interface (MIPI).

[0160] The system on chip SOC is used to control the image sensor 32 to output the control signal, and the system on chip SOC is also used to receive the first visible light information and the ambient light information output by the image sensor 32, and determine whether there is an object close to the electronic device 1 according to the invisible light information.

[0161] For example, the system on chip (SOC) is configured to send a mode signal to the mode control terminal 36, and the first logic control circuit 328 is configured to receive the mode signal from the mode control terminal 36 and output a configuration parameter one to the timing circuit 326 to control the timing circuit 326 to output the control signal.

[0162] In some embodiments, the system on chip (SOC) includes a digital signal processing circuit 61 and an invisible light information processing circuit 62.

[0163] The digital signal processing circuit 61 is coupled to the image sensor 32 and configured to receive a digital signal output by the image sensor 32. For example, the digital signal processing circuit 61 is coupled to the image signal processor (ISP) and configured to receive a digital signal output by the image signal processor (ISP).

[0164] The invisible light information processing circuit 62 is coupled to the digital signal processing circuit 61 and configured to receive a signal output by the digital signal processing circuit 61 and process the received signal to output distance data to determine whether an object is close to the electronic device 1.

[0165] In some embodiments, the system on chip (SOC) further includes a visible light information processing circuit 63 coupled to the digital signal processing circuit 61 and configured to receive a signal output by the digital signal processing circuit 61 and process the received signal to output image data to complete the image acquisition function of the camera module 30.

[0166] In some embodiments, please continue to refer to Figure 15 The camera assembly 20 further includes a driving power supply 70 coupled in series with the invisible light source 40 between a power supply voltage terminal AVDD and a reference ground voltage terminal GND, and the invisible light source 40 is configured to emit invisible light under the driving of the driving power supply 70.

[0167] For example, the camera assembly 20 further includes a second logic control circuit 37 coupled to the mode control terminal 36. The second logic control circuit 37 is configured to receive the mode signal and the timing signal and control the driving power supply 70 to drive the invisible light source 40 to emit invisible light under the control of the mode signal and the timing signal.

[0168] That is, the emission of invisible light by the invisible light source 40 is also controlled by the mode signal.

[0169] In some embodiments, as shown in Figure 15 The driving power supply 70 is disposed on the substrate 31.

[0170] Optionally, the second logic control circuit 37 is disposed on the substrate 31.

[0171] In other embodiments, as shown in Figure 16As shown, the driving power supply 70 is arranged in a power management unit (PMU) of the electronic device 1.

[0172] Optionally, the second logic control circuit 37 is arranged in the power management unit PMU. In yet some embodiments, the driving power supply 70 is arranged on a circuit board of the electronic device 1.

[0173] Optionally, the second logic control circuit 37 is arranged on the circuit board of the electronic device 1.

[0174] Of course, the embodiments of the present application do not limit the arrangement position of the driving power supply 70, and the above is only a schematic.

[0175] Based on this, the driving method of the electronic device 1 provided by the embodiments of the present application comprises:

[0176] S1: The system on chip SOC controls the image sensor 32 to output a control signal.

[0177] For example, the system on chip SOC outputs a mode signal to the mode control end 36, and the first logic control circuit 328 outputs configuration parameters one in the corresponding mode to the timing circuit 326 according to the mode signal of the mode control end 36, so as to control the timing circuit 326 to output the control signal.

[0178] S2: The camera assembly 20 outputs first visible light information and ambient light information in response to the control signal.

[0179] In some embodiments, the step S2 comprises:

[0180] S21: The invisible light source 40 emits invisible light in response to the control signal.

[0181] The second logic control circuit 37 receives the mode signal and the control signal, and controls the driving power supply 70 to drive the invisible light source 40 to emit invisible light under the control of the mode signal and the control signal.

[0182] S22: The image sensor 32 exposes the received visible light to generate the first visible light information, and exposes the received ambient light to generate the ambient light information.

[0183] For example, the first logic control circuit 328 controls the timing circuit 326 to output the control signal in combination with the mode signal and the control signal. The visible light acquisition unit and / or the ambient light acquisition unit are exposed under the control of the control signal, and generate visible light electrical signals and ambient light electrical signals. The analog-to-digital converter ADC converts the visible light electrical signals and the ambient light electrical signals into visible light digital signals and ambient light digital signals; the image processor ISP processes the visible light digital signals and the ambient light digital signals, and outputs the first visible light information and the ambient light information.

[0184] S3: The system on chip SOC generates distance data according to the invisible light information to determine whether there is an object close to the electronic device 1. Image data is generated according to the visible light information to form an image.

[0185] In the following, the camera assembly 20 and the electronic device 1 provided by the embodiments of the present application and the driving method thereof are described in conjunction with driving timing in several examples.

[0186] Example 1

[0187] Figure 17 A driving timing diagram of an electronic device provided by the embodiments of the present application.

[0188] In some embodiments, as shown in Figure 17 The system on chip SOC is configured to send a first mode signal M1 to the mode control end 36. The first mode signal M1 is used to represent that the electronic device 1 is in a call process.

[0189] Then, the image sensor 32 is configured to acquire first visible light information according to the visible light in the first ambient light incident on the first region 322 in response to the control signal when the invisible light source 40 does not emit invisible light. The first visible light information at this time is used as visible light noise information.

[0190] The image sensor 32 is also configured to acquire ambient light information according to the second ambient light incident on the second region 323 in response to the control signal during the process in which the invisible light source 40 emits invisible light in response to the control signal. The ambient light information at this time includes invisible light information and second visible light information. The invisible light information includes invisible light noise information and reflected invisible light information, and the second visible light information is visible light noise information.

[0191] The system on chip SOC is configured to determine whether there is an object close to the electronic device 1 according to the first visible light information and the ambient light information.

[0192] In an example, the system on chip SOC removes the visible light noise information in the ambient light information according to the visible light noise information, and determines whether there is an object close to the electronic device 1 according to the invisible light noise information and the reflected invisible light information.

[0193] In some embodiments, the first logic control circuit 328 is configured to receive the first mode signal M1 of the mode control end 36, and determine the working mode in which the electronic device 1 is located according to the first mode signal M1. For example, the first mode signal M1 represents that the invisible light unit and the visible light unit of the electronic device 1 are both exposed, and the electronic device 1 is in a visible light + ambient light collection mode.

[0194] After the first mode signal M1 is determined, the first logic control circuit 328 is configured to output a first configuration parameter corresponding to the first mode signal M1 to the timing circuit 326. The timing circuit 326 is configured to output a first timing signal strobe1 under the control of the first configuration parameter, and the first timing signal strobe1 includes a first active pulse A1 and a second active pulse A2.

[0195] As shown in the example of FIG. 6, the high level signal in the first timing signal strobe1 is the active pulse. Alternatively, as shown in the example of FIG. 7, the low level signal in the first timing signal strobe1 is the active pulse. Both application modes are applicable to the embodiments of the present application. Figure 17

[0196] In addition, there is a gap between the first active pulse A1 and the second active pulse A2. As shown in the example of FIG. 6, the first active pulse A1 is in the front and the second active pulse A2 is in the back within one image frame. Alternatively, as shown in the example of FIG. 7, the second active pulse A2 is in the front and the first active pulse A1 is in the back within one image frame. Figure 17

[0197] In some embodiments, the first logic control circuit 328 is further configured to control the timing circuit 326 to output a first exposure control signal S1 at a time period t1 corresponding to the first active pulse A1, and the first exposure control signal S1 is configured to control the image sensor 32 to expose and generate a digital signal.

[0198] It should be noted that the timing circuit 326 outputs the first exposure control signal S1 at the time period t1 corresponding to the first active pulse A1. Then, the timing circuit 326 can output the first exposure control signal S1 at the starting time of the first active pulse A1 (when the low level changes to the high level), or output the first exposure control signal S1 within a certain time range before and after the starting time of the first active pulse A1, as long as the first active pulse A1 is used as the time reference.

[0199] In the example, the timing circuit 326 outputs the first exposure control signal S1 at the time period t1 corresponding to the first active pulse A1, and the first exposure control signal S1 includes, for example, synchronization exposure information, and the first exposure control signal S1 is configured to control the first light sensitive unit in the visible light acquisition unit to expose (for example, to synchronize exposure or line-by-line exposure) and convert the visible light into a visible light electrical signal. Correspondingly, the analog-to-digital converter ADC is configured to convert the visible light electrical signal into a visible light digital signal under the control of the first exposure control signal S1, and the first exposure control signal S1 includes, for example, a sampling signal. The image signal processor ISP is configured to process the received visible light digital signal to generate visible light information.

[0200] ​​Subsequently, the second logic control circuit 37 receives the first mode signal M1 and the first timing signal strobe1, and controls the driving power supply 70 to drive the invisible light source 40 to emit invisible light in response to the control signal under the control of the second active pulse A2.

[0201] The invisible light emitted by the invisible light source 40 exits the electronic device 1, is reflected by an object, and then enters the ambient light acquisition unit. The first logic control circuit 328 controls the timing circuit 326 to output a second exposure control signal S2 corresponding to the second active pulse A2 during the time period t2, and the second exposure control signal S2 includes, for example, synchronization exposure information. The second exposure control signal S2 is used to control the second photosensitive unit in the ambient light acquisition unit to expose (for example, to synchronously expose or to row-by-row expose) and convert ambient light into an ambient light electrical signal. The analog-to-digital converter ADC is used to convert the ambient light electrical signal into an ambient light digital signal under the control of the second exposure control signal S2, and the second exposure control signal S2 includes, for example, a sampling signal. The image processor ISP is used to process the received ambient light digital signal to generate ambient light information.

[0202] Then, in an image frame, the image sensor 32 outputs visible light noise information and ambient light information, and the digital signal processing circuit 61 is coupled to the image sensor 32 of the camera assembly 20 to receive the visible light noise information and the ambient light information.

[0203] Of course, the timing circuit 326 can also be controlled by one active pulse to output the first exposure control signal S1 and to control the invisible light source 40 to emit invisible light. In the embodiments of the present application, only two active pulses are used as an example.

[0204] The digital signal processing circuit 61 is coupled to the image sensor 32 to process the received visible light noise information and ambient light information and then transmit the processed information to the invisible light information processing circuit 62. The invisible light information processing circuit 62 processes the received signal to generate distance data, so as to determine the distance between the object and the electronic device 1.

[0205] For example, the digital signal processing circuit 61 converts the intensity of the received visible light noise information and ambient light information, transmits the intensity information of the ambient light information and the intensity information of the visible light noise information to the invisible light information processing circuit 62, and the invisible light information processing circuit 62 removes the interference of the visible light intensity and compares it with the set light intensity to process the distance data.

[0206] Based on this, the driving method of the electronic device 1 provided in the embodiments of the present application includes:

[0207] S10: The system on chip (SOC) controls the image sensor 32 to output a control signal.

[0208] S20: In response to the control signal, the image sensor 32 acquires first visible light information according to visible light in the first ambient light incident on the first region 322. The visible light information at this time is taken as visible light noise information.

[0209] For example, the first logic control circuit 328 receives the first mode signal M1, and outputs the first configuration parameter in the corresponding mode to the timing circuit 326 according to the first mode signal M1, controls the timing circuit 326 to output the first timing signal strobe1, and the first timing signal strobe1 includes the first active pulse A1 and the second active pulse A2.

[0210] After the first logic control circuit 328 receives the first mode signal M1, it is known that the first active pulse A1 of the first timing signal strobe1 corresponds to the time period t1, and the timing circuit 326 is controlled to output the first exposure control signal S1. The visible light acquisition unit is exposed under the control of the first exposure control signal S1, and generates a visible light electrical signal. The analog-to-digital converter ADC converts the visible light electrical signal into a visible light digital signal under the control of the first exposure control signal S1. The image processor ISP processes the visible light digital signal and outputs the first visible light information.

[0211] S30: In the process of the invisible light source 40 emitting invisible light in response to the control signal, the image sensor 32 acquires ambient light information according to the second ambient light incident on the second region 323 in response to the control signal.

[0212] It should be noted that the starting time of the invisible light source 40 emitting invisible light can be earlier than the time when the image sensor 32 acquires ambient light information. The cutoff time of the invisible light source 40 emitting invisible light can be earlier or later than the time when the image sensor 32 stops acquiring ambient light information. Figure 17 The above is only a schematic and is not limited in any way.

[0213] The second logic control circuit 37 receives the first mode signal M1 and the first timing signal strobe1, and under the control of the first mode signal M1, it is known that the second active pulse A2 of the first timing signal strobe1 should be controlled to control the driving power supply 70 to drive the invisible light source 40 to emit invisible light, and the invisible light is reflected back to the camera assembly 20 by the object.

[0214] The first logic control circuit 328 receives the first mode signal M1, and learns that the second active pulse A2 of the first timing signal strobe1 corresponds to a time period t2 for controlling the timing circuit 326 to output a second exposure control signal S2. The ambient light acquisition unit is exposed under the control of the second exposure control signal S2, and generates an ambient light electrical signal. The analog-to-digital converter ADC converts the ambient light electrical signal into an ambient light digital signal under the control of the second exposure control signal S2. The image signal processor ISP processes the ambient light digital signal and outputs ambient light information.

[0215] S40: The system on chip SOC determines whether there is an object close to the electronic device 1 according to the first visible light information and the ambient light information.

[0216] For example, the digital signal processing circuit 61 receives the first visible light information and the ambient light information sent by the image sensor 32 in the camera assembly 20, processes the received first visible light information and ambient light information, and transmits them to the invisible light information processing circuit 62. The invisible light information processing circuit 62 processes the received signals to generate distance data to determine whether there is an object close to the electronic device 1.

[0217] In this example, invisible light acquisition can be achieved in a short time, improving user experience. In addition, visible light information as background light is also synchronously acquired, which can reduce the interference of the environment on the invisible light information after processing.

[0218] In some embodiments, the system on chip SOC is also used to adjust the display brightness of the electronic device 1 according to the visible light information.

[0219] Therefore, the driving method of the electronic device 1 further includes: the system on chip SOC adjusts the display brightness of the electronic device 1 according to the visible light information.

[0220] It is equivalent to multiplexing the visible light noise information as reference information for adjusting the display brightness, which can reduce signal acquisition brightness and simplify the structure of the electronic device 1.

[0221] Example Two

[0222] Figure 18 A driving timing diagram of an electronic device provided by an embodiment of the present application.

[0223] In some embodiments, as shown in Figure 18 The first logic control circuit 328 is used to receive a second mode signal M2 of the mode control end 36, and the second mode signal M2 is used to represent that the electronic device 1 is in the screen-off wake-up process.

[0224] Then, the image sensor 32 is configured to acquire first visible light information according to the visible light in the first ambient light incident on the first region 322 in response to the control signal. The first visible light information at this time is used as visible light image information.

[0225] The image sensor 32 is also configured to acquire ambient light information according to the second ambient light incident on the second region 323 in response to the control signal during the process in which the invisible light source 40 emits invisible light in response to the control signal. The ambient light information at this time includes second visible light information and invisible light information. The invisible light information includes invisible light noise information and reflected invisible light information, and the second visible light information is visible light noise information.

[0226] The system on chip SOC is configured to generate an image according to the first visible light information and determine whether an object is close to the electronic device 1 according to the invisible light information.

[0227] In an example, the system on chip SOC converts the visible light noise information and the invisible light noise information according to the visible light image information, removes the visible light noise information and the invisible light noise information from the ambient light information, and determines whether an object is close to the electronic device 1 according to the reflected invisible light information.

[0228] In some embodiments, the first logic control circuit 328 is configured to receive a second mode signal M2 of the mode control terminal 36 and determine the working mode of the electronic device 1 according to the second mode signal M2. For example, the second mode signal M2 represents that the electronic device 1 is in a visible light + ambient light collection mode in which the invisible light unit and the visible light unit of the electronic device 1 are both exposed. For example, it is applied in a swing scene. Swing refers to shooting the user's gestures or eye contact through the camera module 30 to realize that the user controls the electronic device 1 without touching the electronic device 1 with his hands.

[0229] After the second mode signal M2 is determined, the first logic control circuit 328 outputs a second configuration parameter corresponding to the second mode signal M2 to the timing circuit 326. The timing circuit 326 outputs a second timing signal strobe2 under the control of the second configuration parameter, and the second timing signal strobe2 includes a third active pulse A3.

[0230] In a scene in which visible light and ambient light need to be exposed at the same time, the second timing signal strobe2 responsible for timing control can control the exposure of the ambient light collection unit and the visible light collection unit through a third active pulse A3.

[0231] The second logic control circuit 37 is configured to receive the second mode signal M2 and the second timing signal strobe2, and control the driving power supply 70 to drive the invisible light source 40 to emit invisible light under the control of the third active pulse A3. The invisible light emitted by the invisible light source 40 exits the electronic device 1, is reflected by an object, and then enters the ambient light acquisition unit.

[0232] The first logic control circuit 328 is configured to control the timing circuit 326 to output a third exposure control signal S3 corresponding to the third active pulse A3.

[0233] For example, during the corresponding period t3 corresponding to the third active pulse A3, the timing circuit 326 outputs the third exposure control signal S3, and the second photosensitive unit in the ambient light acquisition unit is configured to be exposed (for example, synchronous exposure or line-by-line exposure) under the control of the third exposure control signal S3 to generate an ambient light electrical signal. The first photosensitive unit in the visible light acquisition unit is configured to be exposed (for example, line-by-line exposure) under the control of the third exposure control signal S3 to generate a visible light electrical signal.

[0234] The exposure sequence of the second photosensitive unit in the ambient light acquisition unit and the first photosensitive unit in the visible light acquisition unit is related to the division manner of the second region 323 and the first region 322. For example, the front rows of photosensitive units 327 are for the ambient light acquisition unit, and the rear photosensitive units 327 are for the ambient light acquisition unit. When exposed according to the third exposure control signal S3, the ambient light electrical signal is generated first, and then the visible light electrical signal is generated.

[0235] The analog-to-digital converter ADC is configured to convert the ambient light electrical signal into an ambient light digital signal and convert the visible light electrical signal into a visible light digital signal under the control of the third exposure control signal S3. The image processor ISP is configured to process the received visible light digital signal and ambient light digital signal to generate first visible light information and ambient light information.

[0236] Therefore, in an image frame, the image sensor 32 outputs the ambient light information and the first visible light information, and the digital signal processing circuit 61 is coupled to the image sensor 32 of the camera assembly 20 to receive the ambient light information and the first visible light information.

[0237] The digital signal processing circuit 61 is configured to separate and process the received ambient light information and first visible light information, transmit the ambient light information to the invisible light information processing circuit 62, and transmit the first visible light information to the visible light information processing circuit 63.

[0238] The invisible light information processing circuit 62 is coupled to the digital signal processing circuit 61 and is configured to process the received ambient light information to generate distance data.

[0239] The visible light information processing circuit 63 is coupled with the digital signal processing circuit 61, and is configured to process the received first visible light information to generate image data.

[0240] In this mode, the noise information can be calculated from swing automatic exposure (AE) information.

[0241] Based on this, the driving method of the electronic device 1 provided by the embodiments of the present application comprises:

[0242] S10: The system on chip (SOC) controls the image sensor 32 to output a control signal.

[0243] S20: The image sensor 32 acquires first visible light information from visible light in the first ambient light incident on the first area 322 in response to the control signal. The first visible light information at this time is visible light image information. The image sensor 32 also acquires ambient light information from the second ambient light incident on the second area 323 in response to the control signal during the process in which the invisible light source 40 emits invisible light in response to the control signal. The ambient light information at this time includes second visible light information and invisible light information. The invisible light information includes invisible light noise information and reflected invisible light information, and the second visible light information is visible light noise information.

[0244] For example, the first logic control circuit 328 receives the second mode signal M2, outputs second configuration parameters in the corresponding mode to the timing circuit 326 according to the second mode signal M2, controls the timing circuit 326 to output a second timing signal strobe2, and the second timing signal strobe2 includes a third active pulse A3.

[0245] The second logic control circuit 37 receives the second mode signal M2 and the second timing signal strobe2, and under the control of the second mode signal M2, it is learned that the driving power supply 70 should be controlled to drive the invisible light source 40 to emit invisible light under the control of the third active pulse A3 of the second timing signal strobe2, and the invisible light is reflected back to the camera assembly 20 by the object.

[0246] After the first logic control circuit 328 receives the second mode signal M2, it is known that the third active pulse A3 of the second timing signal strobe2 corresponds to the time period t3, and the timing circuit 326 outputs the third exposure control signal S3 under the control of the first logic control circuit 328. The ambient light acquisition unit is exposed under the control of the third exposure control signal S3, and generates an ambient light electrical signal. The visible light acquisition unit is exposed under the control of the third exposure control signal S3, and generates a visible light electrical signal. The analog-to-digital converter ADC converts the ambient light electrical signal into an ambient light digital signal and the visible light electrical signal into a visible light digital signal under the control of the third exposure control signal S3. The image processor ISP processes the ambient light digital signal to output ambient light information and processes the visible light digital signal to output first visible light information.

[0247] S30: The system on chip SOC generates an image according to the first visible light information and determines whether there is an object approaching the electronic device 1 according to the invisible light information.

[0248] For example, the digital signal processing circuit 61 receives the ambient light information and the first visible light information sent by the image sensor 32 in the camera assembly 20, processes the received ambient light information and the first visible light information, and transmits the ambient light information to the invisible light information processing circuit 62. The invisible light information processing circuit 62 processes the received signal to generate distance data. The visible light information is transmitted to the visible light information processing circuit 63, and the visible light information processing circuit 63 processes the received signal to generate image data.

[0249] In this example, the ambient light acquisition and the visible light acquisition are both based on the same configuration parameters, and the camera assembly 20 does not need to switch parameters, which can reduce the time delay caused by switching parameters. The invisible light information is separated and extracted from the entire signal output by the image sensor 32, and the visible light image acquisition and the ambient light acquisition can be realized in a short time, thereby improving the user experience.

[0250] Example Three

[0251] Figure 19 A driving timing diagram of an electronic device is provided in the embodiments of the present application.

[0252] In some embodiments, as shown in Figure 19 The first logic control circuit 328 is configured to receive a third mode signal M3 of the mode control terminal 36. The third mode signal M3 is used to represent that the electronic device 1 is in the storage process.

[0253] Then, the image sensor 32 is configured to acquire first ambient light information according to third ambient light incident on the second region 323 in response to the control signal when the invisible light source 40 does not emit invisible light. The first ambient light information at this time includes third visible light information and third invisible light information, the third visible light information being visible light noise information, and the third invisible light information being invisible light noise information.

[0254] The image sensor 32 is further configured to acquire second ambient light information according to fourth ambient light incident on the second region 323 in response to the control signal during the invisible light source 40 emits invisible light in response to the control signal. The second ambient light information at this time includes fourth visible light information and fourth invisible light information, the fourth visible light information being visible light noise information, and the fourth invisible light information including invisible light noise information and reflected invisible light information.

[0255] The system on chip SOC is configured to determine whether there is an object approaching the electronic device 1 according to the first ambient light information and the second ambient light information.

[0256] In an example, the system on chip SOC removes the visible light noise information and the invisible light noise information in the second ambient light information according to the third visible light information and the third invisible light information, and determines whether there is an object approaching the electronic device 1 according to the reflected invisible light information.

[0257] In some embodiments, the first logic control circuit 328 is configured to receive a third mode signal M3 of the mode control terminal 36, and determine the working mode of the electronic device 1 according to the third mode signal M3. For example, the third mode signal M3 represents that the electronic device 1 is in a separate ambient light acquisition mode in which only the ambient light acquisition unit is exposed. For example, when the user puts the electronic device 1 into a storage (such as a pocket or a bag), the swing picture no longer needs to be detected, and the camera assembly 20 can only run proximity light detection.

[0258] After the third mode signal M3 is determined, the first logic control circuit 328 outputs a third configuration parameter corresponding to the third mode signal M3 to the timing circuit 326. The timing circuit 326 outputs a third timing signal strobe3 under the control of the third configuration parameter, and the third timing signal strobe3 includes a fourth active pulse A4 and a fifth active pulse A5.

[0259] The fourth active pulse A4 and the fifth active pulse A5 have a gap therebetween. As shown in FIG. 6, in one image frame, the fourth active pulse A4 can be in front of the fifth active pulse A5. Alternatively, the fifth active pulse A5 can be in front of the fourth active pulse A4. Figure 19

[0260] ​The first logic control circuit 328 is further configured to control the timing circuit 326 to output a fourth exposure control signal S4 at a fourth active pulse A4 corresponding time period t4, the fourth exposure control signal S4 being configured to control the image sensor 32 to expose and generate a digital signal.

[0261] For example, the timing circuit 326 outputs the fourth exposure control signal S4 at the fourth active pulse A4 corresponding time period t4, the fourth exposure control signal S4 including, for example, synchronization exposure information, the fourth exposure control signal S4 being configured to control the second light sensitive unit in the ambient light acquisition unit to expose (e.g. synchronous exposure or line-by-line exposure) and convert the first ambient light into a first ambient light electrical signal. Correspondingly, the analog-to-digital converter ADC is configured to convert the first ambient light electrical signal into a first ambient light digital signal under the control of the fourth exposure control signal S4, the fourth exposure control signal S4 including, for example, a sampling signal. The image signal processor ISP is configured to process the received first ambient light digital signal to generate first ambient light information.

[0262] Subsequently, the second logic control circuit 37 is configured to receive the third mode signal M3 and the third timing signal strobe3, and control the driving power supply 70 to drive the invisible light source 40 to emit invisible light under the control of a fifth active pulse A5.

[0263] The invisible light emitted by the invisible light source 40 exits the electronic device 1, is reflected by the object and then enters the ambient light acquisition unit. The first logic control circuit 328 is configured to control the timing circuit 326 to output a fifth exposure control signal S5 at a fifth active pulse A5 corresponding time period t5, the fifth exposure control signal S5 including, for example, synchronization exposure information. The fifth exposure control signal S5 is configured to control the second light sensitive unit in the ambient light acquisition unit to expose (e.g. synchronous exposure or line-by-line exposure) and convert the second ambient light into a second ambient light electrical signal. The analog-to-digital converter ADC is configured to convert the second ambient light electrical signal into a second ambient light digital signal under the control of the fifth exposure control signal S5, the fifth exposure control signal S5 including, for example, a sampling signal. The image signal processor ISP is configured to process the received second ambient light digital signal to generate second ambient light information.

[0264] Then, in an image frame, the image sensor 32 outputs the first ambient light information and the second ambient light information, and the digital signal processing circuit 61 coupled to the image sensor 32 of the camera assembly 20 receives the first ambient light information and the second ambient light information.

[0265] The digital signal processing circuit 61 is configured to process the received first ambient light information and second ambient light information and transmit them to the invisible light information processing circuit 62, and the invisible light information processing circuit 62 processes the received signals to generate distance data, thereby determining the distance between the object and the electronic device 1.

[0266] For example, the digital signal processing circuit 61 performs intensity conversion on the received first ambient light information and second ambient light information, and transmits the first ambient light information and the second ambient light information to the invisible light information processing circuit 62. The invisible light information processing circuit 62 removes the interference of the intensity of the first ambient light information, and compares with the set light intensity to obtain distance data.

[0267] Based on this, the driving method of the electronic device 1 provided by the embodiment of the present application comprises:

[0268] S10: The system on chip (SOC) controls the image sensor 32 to output a control signal.

[0269] S20: When the invisible light source 40 does not emit invisible light, the image sensor 32 acquires first ambient light information according to the third ambient light entering the second area 323 in response to the control signal. The first ambient light information at this time includes third visible light information and third invisible light information. The third visible light information is visible light noise information, and the third invisible light information is invisible light noise information.

[0270] For example, the first logic control circuit 328 receives the third mode signal M3, and outputs the third configuration parameter in the corresponding mode to the timing circuit 326 according to the third mode signal M3, controls the timing circuit 326 to output the third timing signal strobe3, and the third timing signal strobe3 includes a fourth active pulse A4 and a fifth active pulse A5.

[0271] After the first logic control circuit 328 receives the third mode signal M3, it is known that the fourth active pulse A4 of the third timing signal strobe3 corresponds to the time period t4, and the timing circuit 326 outputs the fourth exposure control signal S4. The visible light acquisition unit is exposed under the control of the fourth exposure control signal S4, and generates the first ambient light electrical signal. The analog-to-digital converter ADC converts the first ambient light electrical signal into the first ambient light digital signal under the control of the fourth exposure control signal S4. The image processor ISP processes the first ambient light digital signal and outputs the first ambient light information.

[0272] S30: When the invisible light source 40 emits invisible light in response to the control signal, the image sensor 32 acquires second ambient light information according to the fourth ambient light entering the second area 323 in response to the control signal. The second ambient light information at this time includes fourth visible light information and fourth invisible light information. The fourth visible light information is visible light noise information, and the fourth invisible light information includes invisible light noise information and reflected invisible light information.

[0273] For example, the second logic control circuit 37 receives the third mode signal M3 and the third timing signal strobe3, and under the control of the third mode signal M3, it is learned that the driving power supply 70 should be controlled to drive the invisible light source 40 to emit invisible light under the control of the fifth active pulse A5 of the third timing signal strobe3, and the invisible light is reflected back to the camera assembly 20 by the object.

[0274] After the first logic control circuit 328 receives the third mode signal M3, it is learned that the timing circuit 326 outputs the fifth exposure control signal S5 under the control of the fifth active pulse A5 of the third timing signal strobe3 corresponding to the time period t5. The ambient light acquisition unit is exposed under the control of the fifth exposure control signal S5 to generate a second ambient light electrical signal. The analog-to-digital converter ADC converts the second ambient light electrical signal into a second ambient light digital signal under the control of the fifth exposure control signal S5. The image processor ISP processes the second ambient light digital signal and outputs second ambient light information.

[0275] S40: The system on chip SOC determines whether there is an object close to the electronic device 1 according to the first ambient light information and the second ambient light information.

[0276] For example, the digital signal processing circuit 61 receives the first ambient light information and the second ambient light information sent by the image sensor 32 in the camera assembly 20, processes the received first ambient light information and the second ambient light information, and transmits them to the invisible light information processing circuit 62. The invisible light information processing circuit 62 processes the received signal to generate distance data.

[0277] In the embodiment of the application, the first ambient light information and the second ambient light information are both exposed by the ambient light acquisition unit, and the visible light acquisition unit does not need to be exposed, which can reduce the number of driven photosensitive units 327 and save power consumption.

[0278] The embodiment of the application also provides a computer readable medium, which stores a computer program. The computer program is run on the electronic device 1, so that the electronic device executes the driving method of the camera assembly or the driving method of the electronic device described above. The embodiment of the application provides a computer program product containing instructions. When the computer program product is run on the electronic device 1, the electronic device 1 executes the driving method of the camera assembly or the driving method of the electronic device described above.

[0279] The computer readable medium can be a read-only memory (ROM) or other type of static storage device that can store static information and instructions, a random access memory (RAM) or other type of dynamic storage device that can store information and instructions, an electrically erasable programmable read-only memory (EEPROM), or any other medium that can be used to carry or store desired program codes in the form of instructions or data structures and that can be accessed by a computer, but is not limited to this. The memory can exist independently, and be connected to the processor through a communication bus. The memory can also be integrated with the processor.

[0280] In the above embodiments, all or part of the embodiments can be implemented by software, hardware, firmware or any combination thereof. When implemented by software, all or part of the embodiments can be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer executes the computer instructions, all or part of the processes or functions described in the embodiments of the present application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network or other programmable device. The computer instructions can be stored in a computer readable storage medium or transferred from one computer readable storage medium to another computer readable storage medium.

[0281] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any change or replacement within the technical scope disclosed in the present application should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A camera assembly, characterized in that: The application relates to a camera module. The camera module comprises a structure, a filter layer, an image sensor and a substrate. The structure is in a cylindrical shape and surrounds a space, one end of the structure is an entrance of the camera module, the other end of the structure is buckled on the substrate, the filter layer and the image sensor are located in the space, and the entrance is used for making ambient light enter the space by being incident on the camera module. The filter layer is located between the image sensor and the entrance, and is used for transmitting visible light in the ambient light and cutting off invisible light in the ambient light. The image sensor comprises a first area and a second area, and the projection of the filter layer on the image sensor overlaps the first area. The image sensor is used for outputting a control signal. An invisible light source is located outside the space, and is used for emitting invisible light in response to the control signal. The image sensor is used for acquiring first visible light information according to visible light in first ambient light incident on the first area in response to the control signal. The image sensor is also used for acquiring ambient light information according to second ambient light incident on the second area in response to the control signal, wherein the ambient light information comprises second visible light information and invisible light information.

2. The camera assembly of claim 1, wherein, The control signal comprises a timing signal.

3. The camera assembly of claim 1 or 2, wherein, The image sensor further comprises a third area, the first area is located in the third area, and the second area is located in the third area and is located at the periphery of the first area. The third area is an area formed by light entering the camera module through the entrance and being projected on the image sensor.

4. The camera assembly of claim 3, wherein, The image sensor comprises a plurality of first light-sensitive units, a plurality of second light-sensitive units and a receiving circuit. The plurality of first light-sensitive units are located in the first area and are used for exposing to the visible light, and the plurality of second light-sensitive units are located in the second area and are used for exposing to the ambient light. The plurality of first light-sensitive units and the second light-sensitive units are coupled with the receiving circuit.

5. The camera assembly according to any one of claims 1-4, wherein, The filter layer is also used for transmitting the second ambient light.

6. The camera assembly of any one of claims 1-5, wherein, The camera module further comprises a light guide, and the invisible light emitted by the invisible light source is emitted out of the camera module through the light guide.

7. The camera assembly of claim 6, wherein, The light guide comprises a light emitting part, and the light emitting part surrounds at least part of the entrance.

8. The camera assembly of any of claims 1-7, wherein, The invisible light source is arranged on the substrate. The structure comprises a light source accommodating area, the light source accommodating area is arranged separately from the space, and the invisible light source is located in the light source accommodating area. Alternatively, The invisible light source is located outside the structure.

9. A driving method for driving the camera assembly according to any one of claims 1-8, characterized in that, The driving method comprises the following steps. The image sensor outputs a control signal. The invisible light source emits invisible light in response to the control signal. The image sensor acquires first visible light information according to visible light in first ambient light incident on the first area in response to the control signal. The image sensor also acquires ambient light information according to second ambient light incident on the second area in response to the control signal.

10. The driving method according to claim 9, wherein The control signal comprises a timing signal.

11. An electronic device, comprising: The electronic device comprises a camera assembly and a system on chip; the system on chip is coupled with an image sensor of the camera assembly; the camera assembly comprises the camera assembly of any one of claims 1-8; The system on chip is configured to control the image sensor to output a control signal, and configured to receive first visible light information and ambient light information output by the image sensor, and determine whether an object is close to the electronic device according to invisible light information in the ambient light information.

12. The electronic device of claim 11, wherein, During a call: the image sensor is configured to obtain first visible light information according to visible light in first ambient light incident on a first region in response to the control signal; the image sensor is further configured to obtain ambient light information according to second ambient light incident on a second region in response to the control signal during emission of invisible light by an invisible light source in response to the control signal; and the system on chip is configured to determine whether an object is close to the electronic device according to the first visible light information and invisible light information in the ambient light information.

13. The electronic device of claim 11 or 12, wherein, during screen-off wake-up: the image sensor is configured to obtain first visible light information according to visible light in first ambient light incident on a first region in response to the control signal; the image sensor is further configured to obtain ambient light information according to second ambient light incident on a second region in response to the control signal during emission of invisible light by an invisible light source in response to the control signal; and the system on chip is configured to generate an image according to the first visible light information, and determine whether an object is close to the electronic device according to invisible light information in the ambient light information.

14. The electronic device of any one of claims 11-13, wherein, during storage: the image sensor is configured to obtain first ambient light information according to third ambient light incident on a second region in response to the control signal; the image sensor is further configured to obtain second ambient light information according to fourth ambient light incident on the second region in response to the control signal during emission of invisible light by an invisible light source in response to the control signal; and the system on chip is configured to determine whether an object is close to the electronic device according to the first ambient light information and the second ambient light information.

15. The electronic device of claim 12, wherein, The system on chip is further configured to adjust display brightness of the electronic device according to the first visible light information.

16. The electronic device of any of claims 11-15, wherein, The electronic device further comprises a driving power supply; the driving power supply is configured to drive the invisible light source to emit invisible light in response to a control signal; the driving power supply is disposed on a substrate of the camera assembly; or the electronic device further comprises a circuit board, and the driving power supply is disposed on the circuit board; or the electronic device further comprises a power management module, and the driving power supply is integrated in the power management module. The driving method comprises: a system on chip controls an image sensor to output a control signal; 17. A driving method of an electronic device, for driving the electronic device according to any one of claims 11 to 16, characterized by, a camera assembly outputs first visible light information and ambient light information in response to the control signal; and ​ ​ The system chip determines whether an object approaches the electronic device according to the ambient light information.

18. The driving method according to claim 17, wherein The camera assembly outputs first visible light information and ambient light information in response to the control signal, including: During the call process: The image sensor acquires first visible light information according to visible light in first ambient light entering a first region in response to the control signal; During the process that the invisible light source emits invisible light in response to the control signal, the image sensor acquires ambient light information according to ambient light entering a second region in response to the control signal; The system chip determines whether an object approaches the electronic device according to the first visible light information and the ambient light information.

19. The driving method according to claim 17 or 18, wherein The camera assembly outputs first visible light information and ambient light information in response to the control signal, including: During the screen-off wake-up process: The image sensor acquires first visible light information according to visible light in first ambient light entering a first region in response to the control signal; During the process that the invisible light source emits invisible light in response to the control signal, the image sensor acquires ambient light information according to second ambient light entering a second region in response to the control signal; The system chip is configured to generate an image according to the first visible light information and determine whether an object approaches the electronic device according to invisible light information in the ambient light information.

20. The driving method according to any one of claims 17 to 19, wherein The camera assembly outputs first visible light information and ambient light information in response to the control signal, including: During the storage process: The image sensor acquires first ambient light information according to third ambient light entering a second region in response to the control signal; During the process that the invisible light source emits invisible light in response to the control signal, the image sensor acquires second ambient light information according to fourth ambient light entering a second region in response to the control signal; The system chip is configured to determine whether an object approaches the electronic device according to the first ambient light information and the second ambient light information.

21. The driving method according to claim 18, wherein The driving method further includes that the system chip adjusts display brightness of the electronic device in response to the first visible light information.

22. A computer readable medium characterized by The computer readable medium stores a computer program, and when the computer program runs on the electronic device, the electronic device executes the driving method in any one of claims 9, 10 or 17-21.

Images