Camera module, camera control method, camera method and related device

Abstract

The invention discloses a camera shooting module, a camera shooting control method, a camera shooting method and a related device, and belongs to the technical field of camera shooting. The camera module comprises a lens, a shading disc and an image sensor, the shading disc is located on the light-emitting side of the lens, the image sensor is located on the light-emitting side of the shading disc, and the shading disc is provided with a light-transmitting area and a non-light-transmitting area; the lens is used for transmitting beams; the shading disc is used for transmitting a light beam through the light-transmitting area in a first exposure time period and shading at least part of the light beam through the non-light-transmitting area in a second exposure time period; wherein in the second exposure time period, the orthographic projection of the image sensor on the shading disc is overlapped with the non-light-transmitting area, and the size of the overlapped area is gradually increased in the second exposure time period; the image sensor is used for generating a target image based on the light beam. The camera shooting control method is used for controlling the shading disc to move so as to realize the shading, so that the dynamic range of the image sensor is reduced, and details of each area in the shooting range are clearly shot.

Description

Technical Field

[0001] This application relates to the field of camera technology, and in particular to a camera module, camera control method, camera method and related apparatus. Background Technology

[0002] In scenarios such as traffic monitoring, the presence of bright and dark areas due to the influence of traffic lights, vehicle lights, and streetlights can lead to significant differences in brightness between the two areas. If the image sensor uses the same exposure globally, it is difficult to ensure that the details of both bright and dark areas are captured simultaneously.

[0003] Related technologies employ high dynamic range imaging (HDR) to acquire images, providing more image detail. HDR technology includes single-frame HDR and multi-frame HDR. In single-frame HDR, the hardware requires different areas of the image sensor to have varying light sensitivity, resulting in different levels of exposure for different regions of the same image. The software requires the processor to perform brightness fusion on these differently exposed areas to reduce the brightness difference between bright and dark areas in the image. In multi-frame HDR, multiple frames of images with different exposure durations are continuously acquired—for example, acquiring a short-exposure frame, then a long-exposure frame, and so on—and brightness fusion is performed on these multiple frames to reduce the brightness difference between bright and dark areas in each frame.

[0004] However, single-frame HDR technology sacrifices spatial resolution and has certain hardware requirements; multi-frame HDR technology sacrifices temporal resolution, and motion blur may occur if frames with different exposure durations are not aligned in time or the frame rate is not high. Summary of the Invention

[0005] This application provides a camera module, camera control method, camera method, and related apparatus, which can reduce the brightness ratio between the initially occluded and subsequently occluded areas on an image sensor. In other words, it reduces the dynamic range of the image sensor, causing differences in exposure across different areas of the target image, thus ensuring that details in each area within the shooting range can be clearly captured. The technical solution is as follows:

[0006] In a first aspect, a camera module is provided, which includes a lens, a light-emitting disc, and an image sensor. The light-emitting disc is located on the light-emitting side of the lens, and the image sensor is located on the light-emitting side of the light-emitting disc. The light-emitting disc has a light-transmitting area and a non-light-transmitting area.

[0007] Lenses are used to transmit light beams;

[0008] The light-blocking disc is used to transmit a light beam through the light-transmitting area during a first exposure time period and to block at least part of the light beam through the light-blocking area during a second exposure time period; wherein, during the second exposure time period, the orthographic projection of the image sensor on the light-blocking disc overlaps with the light-blocking area, and the size of the overlapping area increases during the second exposure time period.

[0009] The image sensor is used to generate a target image based on the light beam transmitted through the light-transmitting area during a first exposure time period and a second exposure time period.

[0010] In other words, a light-blocking disc is incorporated into the camera module to physically obstruct the exposure of the image sensor, thereby reducing the sensor's exposure. During the first exposure period, the disc does not block the light beam, ensuring the image sensor's basic exposure. During the second exposure period, the non-transparent area of ​​the disc blocks at least a portion of the image sensor, and the size of the blocked area increases over time. This reduces the brightness ratio between the initially blocked and subsequently blocked areas on the image sensor, narrowing its dynamic range and creating differences in exposure across different areas of the target image, ensuring that details in all areas within the shooting range are clearly captured.

[0011] During the first exposure period, the orthographic projection of the image sensor on the masking disc is located within the light-transmitting area; during the second exposure period, the orthographic projection of the image sensor on the masking disc overlaps with both the light-transmitting and non-light-transmitting areas.

[0012] In this application, the image sensor includes a first photosensitive area and a second photosensitive area. The first photosensitive area corresponds to the target area in the target image, and the second photosensitive area corresponds to the non-target area in the target image. The brightness of the target area is greater than the brightness of the non-target area. In different implementations, the positional relationship between the light-blocking disc and the image sensor is different. Accordingly, during the second exposure time period, the degree of occlusion of the image sensor by the non-transparent area on the light-blocking disc is different.

[0013] In the first scenario, the second exposure time period includes the first time period and the second time period, with the first time period preceding the second time period. During the first time period, the orthographic projection of the first photosensitive area on the light-blocking disc overlaps with both the translucent and opaque areas, and the orthographic projection of the second photosensitive area on the light-blocking disc lies within the translucent area. During the second time period, the orthographic projection of the first photosensitive area on the light-blocking disc lies within the opaque area, and the orthographic projection of the second photosensitive area on the light-blocking disc overlaps with both the translucent and opaque areas.

[0014] In the second scenario, the second exposure time period includes a first time period, a second time period, and a third time period. The first time period precedes the second time period, and the second time period precedes the third time period. During the first, second, and third time periods, the orthographic projection of the first photosensitive area on the optical shield overlaps with both the translucent and opaque areas. During the first time period, the orthographic projection of the second photosensitive area on the optical shield lies within the translucent area. During the second time period, the orthographic projection of the second photosensitive area on the optical shield overlaps with both the translucent and opaque areas. During the third time period, the orthographic projection of the second photosensitive area on the optical shield lies within the opaque area.

[0015] In this design, the optical masking disc is a color wheel with a first region and a second region. The first region includes a first filter, and the second region includes a second filter. The first filter filters light with wavelengths outside the light-sensing range of the image sensor, while the second filter filters light with wavelengths within the light-sensing range. The first region is a light-transmitting region, and the second region is a light-blocking region. Alternatively, the optical masking disc may be made of a non-light-transmitting material with a physical notch. The area containing the physical notch is a light-transmitting region, and the area outside the physical notch is a light-blocking region. In other words, there are multiple design methods for achieving physical masking with the optical masking disc.

[0016] In one possible implementation, the light-blocking disc has a circular structure, and both the light-transmitting and non-light-transmitting areas are fan-shaped.

[0017] In this application, the exposure start time of the multiple rows of photosensitive elements included in the image sensor is the same. That is, the multiple rows of photosensitive elements begin exposure simultaneously.

[0018] In this case, the shutter of the image sensor is a rolling shutter; or, the shutter of the image sensor is a global shutter.

[0019] Secondly, a camera control method is provided, wherein the camera module includes a lens, a light-emitting disc, and an image sensor, the light-emitting disc being located on the light-emitting side of the lens, the image sensor being located on the light-emitting side of the light-emitting disc, and the light-emitting disc having a light-transmitting area and a light-blocking area; the method includes:

[0020] The blocking disc is controlled to move so that it transmits a light beam through a light-transmitting area during a first exposure time period and blocks at least part of the light beam through a light-blocking area during a second exposure time period. During the second exposure time period, the orthographic projection of the image sensor onto the blocking disc overlaps with the light-blocking area, and the size of the overlapping area increases during the second exposure time period. The light beam is transmitted through the lens, and the light beams transmitted through the light-transmitting area during the first and second exposure time periods are used by the image sensor to generate a target image.

[0021] In other words, a light-blocking disc is incorporated into the camera module to physically obstruct the exposure of the image sensor, thereby reducing the sensor's exposure. During the first exposure period, the disc does not block the light beam, ensuring the image sensor's basic exposure. During the second exposure period, the non-transparent area of ​​the disc blocks at least a portion of the image sensor, and the size of the blocked area increases over time. This reduces the brightness ratio between the initially blocked and subsequently blocked areas on the image sensor, narrowing its dynamic range and creating differences in exposure across different areas of the target image, ensuring that details in all areas within the shooting range are clearly captured.

[0022] In one possible implementation, the method further includes: acquiring a first image, which is an image generated by an image sensor prior to a target image; determining the brightness of a target region in the first image, wherein the first image also includes non-target regions, and the brightness of the target region is greater than the brightness of the non-target regions; and controlling the movement speed of the masking disc based on the brightness of the target region. That is, the target region is considered an overexposed region, and the movement speed of the masking disc is controlled based on the brightness of the overexposed region.

[0023] In one possible implementation, the optical mask is circular, and the movement is rotation; the movement speed of the optical mask is controlled based on the brightness of the target area, including: reducing the linear velocity of the optical mask relative to the image sensor during rotation when the brightness of the target area meets the exposure reduction condition, and / or keeping the linear velocity constant and delaying the exposure start time of the image sensor.

[0024] If the brightness of the target area meets the exposure reduction condition, it means that the brightness of the target area needs to be further reduced. Therefore, it is necessary to further reduce the exposure of the first photosensitive area (corresponding to the bright area) on the image sensor. This application provides two methods to reduce the exposure of the first photosensitive area. The first method is to reduce the linear velocity of the occlusion disc relative to the image sensor during rotation, which is equivalent to extending the occlusion time. The second method is to keep the linear velocity constant and delay the exposure start time of the image sensor, which is equivalent to advancing the occlusion timing of the image sensor and reducing the base exposure.

[0025] In one possible implementation, the exposure reduction condition includes: the brightness of the target area is higher than a first brightness threshold.

[0026] Reducing the linear velocity of the masking disc relative to the image sensor during rotation includes: reducing the angular velocity of the masking disc to reduce the linear velocity; or, reducing the distance between the masking disc and the image sensor to reduce the linear velocity, such as by vertically pulling the masking disc closer to the image sensor.

[0027] In one possible implementation, the optical mask is a circular structure and its movement is rotation; based on the brightness of the target area, the movement speed of the optical mask is controlled, including: increasing the linear velocity of the optical mask relative to the image sensor during rotation when the brightness of the target area meets the conditions for increasing exposure, and / or keeping the linear velocity constant and advancing the exposure start time of the image sensor.

[0028] If the brightness of the target area meets the conditions for increasing exposure, it indicates that the target area may be about to be underexposed, or has already been underexposed, and the brightness of the target area needs to be increased. Therefore, reverse control is required to increase the exposure of the first photosensitive area (corresponding to the bright area) on the image sensor based on the current brightness. This application provides two methods to increase the exposure of the first photosensitive area. The first method is to increase the linear velocity of the occlusion disc relative to the image sensor during rotation, which is equivalent to shortening the occlusion time. The second method is to keep the linear velocity constant and advance the exposure start time of the image sensor, which is equivalent to delaying the occlusion timing of the image sensor and increasing the basic exposure.

[0029] In one possible implementation, the conditions for increasing exposure include: the brightness of the target area is not higher than a second brightness threshold.

[0030] Increasing the linear velocity of the optical disc relative to the image sensor during rotation includes: increasing the angular velocity of the optical disc to increase the linear velocity; or increasing the distance between the optical disc and the image sensor to increase the linear velocity, such as by vertically pulling the optical disc away from the image sensor.

[0031] In one possible implementation, the linear velocity and / or exposure start time are adjusted according to an exposure adjustment ratio; after determining the brightness of the target region in the first image, the method further includes: determining the exposure adjustment ratio based on the brightness of the target region and a reference brightness. That is, the exposure adjustment ratio is dynamically determined according to real-time conditions.

[0032] Wherein, the reference brightness is the average brightness of the first image; or, the reference brightness is the brightness of the non-target area.

[0033] In one possible implementation, before determining the brightness of the target region in the first image, the method further includes: acquiring at least one second image, which is an image generated by an image sensor prior to the first image; performing brightness analysis on the at least one second image to obtain a brightness analysis result; and determining the target region in the first image based on the brightness analysis result. That is, the target region is automatically identified through brightness analysis.

[0034] In one possible implementation, the light-blocking disc has a circular structure, and the movement is rotation. The image sensor includes a first photosensitive area and a second photosensitive area. The first photosensitive area corresponds to the target area in the target image, and the second photosensitive area corresponds to the non-target area in the target image. The method further includes controlling the rotation direction of the light-blocking disc so that the orthographic projection of the first photosensitive area on the light-blocking disc overlaps with the non-transparent area earlier than the orthographic projection of the second photosensitive area on the light-blocking disc during the second exposure time period. That is, the first photosensitive area is blocked earlier, resulting in a greater reduction in the exposure of the first photosensitive area compared to the second photosensitive area.

[0035] In one possible implementation, the method further includes controlling the start time of the supplementary lighting device, which is synchronized with the exposure start time of the image sensor, the supplementary lighting device being used to provide supplementary lighting for the image sensor. For example, if the exposure start time of the image sensor is delayed or advanced, the start time of the supplementary lighting device also needs to be delayed or advanced synchronously to achieve a better supplementary lighting effect.

[0036] In this application, the method is applied to a control device, and the camera module further includes the control device, or the control device is a device other than the camera module.

[0037] Thirdly, a camera method is provided, wherein the camera module includes a lens, a light-emitting disc, and an image sensor, the light-emitting disc being located on the light-emitting side of the lens, the image sensor being located on the light-emitting side of the light-emitting disc, and the light-emitting disc having a light-transmitting area and a light-blocking area; the method includes:

[0038] The lens transmits light beams;

[0039] The light-blocking disc transmits a light beam through the light-transmitting area during the first exposure time period and blocks at least part of the light beam through the light-blocking area during the second exposure time period; wherein, during the second exposure time period, the orthographic projection of the image sensor on the light-blocking disc overlaps with the light-blocking area, and the size of the overlapping area increases during the second exposure time period.

[0040] The image sensor generates a target image based on the light beam transmitted through the light-transmitting area during the first and second exposure time periods.

[0041] Fourthly, a control device is provided, which has the function of implementing the camera control method described in the second aspect above. The control device includes one or more modules for implementing the camera control method provided in the second aspect above.

[0042] Fifthly, a control device is provided, comprising a processor and a memory, the memory storing a program for executing the camera control method provided in the second aspect, and storing data related to implementing the camera control method provided in the second aspect. The processor is configured to execute the program stored in the memory.

[0043] Optionally, the control device may further include a communication bus for establishing a connection between the processor and the memory.

[0044] In a sixth aspect, a computer-readable storage medium is provided, wherein instructions are stored therein, which, when executed on a computer, cause the computer to perform the camera control method described in the second aspect above.

[0045] In a seventh aspect, a computer program product containing instructions is provided, which, when run on a computer, causes the computer to execute the camera control method described in the second aspect above.

[0046] The technical effects achieved by the third to seventh aspects mentioned above are similar to those achieved by the corresponding technical means in the first or second aspects, and will not be repeated here. Attached Figure Description

[0047] Figure 1 This is a schematic diagram of an electronic alarm scenario provided in an embodiment of this application;

[0048] Figure 2 This is a schematic diagram of a checkpoint scenario provided in an embodiment of this application;

[0049] Figure 3 This is a schematic diagram of a camera module provided in an embodiment of this application;

[0050] Figure 4 These are schematic diagrams of three designs of the circular shielding disc provided in the embodiments of this application;

[0051] Figure 5 These are schematic diagrams of four designs for a rectangular shielding disc provided in the embodiments of this application;

[0052] Figure 6 This is a schematic diagram illustrating the positional relationship between an image sensor and a light-blocking disc, provided in an embodiment of this application.

[0053] Figure 7 This is a schematic diagram illustrating another positional relationship between the optical disc and the image sensor provided in an embodiment of this application;

[0054] Figure 8 This is another schematic diagram illustrating the positional relationship between the optical disc and the image sensor provided in this application embodiment;

[0055] Figure 9 This is another schematic diagram illustrating the positional relationship between the optical disc and the image sensor provided in this application embodiment;

[0056] Figure 10 This is another schematic diagram illustrating the positional relationship between the optical disc and the image sensor provided in this application embodiment;

[0057] Figure 11 This is another schematic diagram illustrating the positional relationship between the optical disc and the image sensor provided in this application embodiment;

[0058] Figure 12 This is another schematic diagram illustrating the positional relationship between the optical disc and the image sensor provided in this application embodiment;

[0059] Figure 13 This is another schematic diagram illustrating the positional relationship between the optical disc and the image sensor provided in this application embodiment;

[0060] Figure 14 This is another schematic diagram illustrating the positional relationship between the optical disc and the image sensor provided in this application embodiment;

[0061] Figure 15 This is a schematic diagram of the exposure time of a rolling shutter in a first mode, provided in an embodiment of this application;

[0062] Figure 16 This is a schematic diagram of the exposure time of a global shutter provided in an embodiment of this application;

[0063] Figure 17 This is a system architecture diagram involving a camera control method provided in an embodiment of this application;

[0064] Figure 18 This is a system architecture diagram involving another camera control method provided in the embodiments of this application;

[0065] Figure 19 This is a schematic diagram of the structure of a control device provided in an embodiment of this application;

[0066] Figure 20 This is a flowchart of a camera control method provided in an embodiment of this application;

[0067] Figure 21 This is a flowchart of another camera control method provided in the embodiments of this application;

[0068] Figure 22 This is a schematic diagram of a supplementary lighting start time delay provided in an embodiment of this application;

[0069] Figure 23 This is a flowchart of another camera control method provided in the embodiments of this application;

[0070] Figure 24 This is a schematic diagram of the structure of a control device provided in an embodiment of this application. Detailed Implementation

[0071] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the implementation methods of this application will be further described in detail below with reference to the accompanying drawings.

[0072] To facilitate understanding, some terms used in the embodiments of this application will be introduced first.

[0073] Shutter speed: One of the camera's exposure parameters, which controls the length of time the image sensor is exposed (also known as the exposure time). The larger the shutter speed, the longer the exposure time, the more sufficient the exposure, and the brighter the image, but it is also more likely to produce motion blur.

[0074] Gain: One of the camera's exposure parameters, it controls the amplification factor of the image sensor during analog-to-digital conversion. The higher the gain, the brighter the image, but the greater the image noise.

[0075] White balance: Used to eliminate color casts in camera images that do not match the real scene, with the aim of making white objects appear as white to the human eye in the image.

[0076] Light-emitting diode (LED) lights are supplementary lighting lights that use light-emitting diodes as their light source. An LED is a solid-state semiconductor device that converts electrical energy into visible light; it can directly convert electricity into light. Due to its significant advantages in lifespan, energy efficiency, and environmental friendliness, it is now widely used. In some industries, LED lights are commonly used to provide supplementary lighting for cameras. LEDs can operate in strobe mode or constant-on mode, and their power can be flexibly controlled to provide different light intensities. LED lights can provide high-intensity supplementary light with a large current instantaneously; this phenomenon is also known as LED strobe. Based on this, the industry uses terms like "constant-on LED," "strobe LED," and "sparkling LED."

[0077] Xenon headlights, often called gas strobe lights in some industries, are a new type of headlight containing xenon gas, also known as high-intensity discharge (HIFL) gas lamps. In one implementation, various chemical gases are filled inside an ultraviolet-resistant quartz glass tube, which are then separated under high pressure to generate a light source between two electrodes, providing stable, high-intensity illumination. Xenon headlights are widely used in automotive headlights, photographic lighting, and surveillance camera applications.

[0078] The following describes some implementation scenarios involved in the embodiments of this application.

[0079] This application's embodiments can be applied to high dynamic range (HDR) scenarios where the distribution of bright and dark areas differs but remains relatively fixed. For example, traffic monitoring scenarios are often HDR scenarios, characterized by a large brightness ratio between bright and dark areas in the image (also known as the picture). If a uniform global exposure is used, it's difficult to ensure that details in both bright and dark areas are clearly visible simultaneously. Analysis of the distribution of bright areas in these scenarios reveals that bright areas are generally located in the upper or lower half of the image.

[0080] For example, electronic police systems can capture images of the rear of vehicles and the opposite traffic lights at traffic light intersections, making it easier to monitor vehicles that run red lights.

[0081] Figure 1 This is a schematic diagram of an electronic alarm scenario provided in an embodiment of this application. See also... Figure 1 Taking a three-lane road as an example, at a traffic light intersection, in front of the stop line of the lane, there is a traffic light, and the light pole can be 6 meters (m) high. Behind the stop line are lanes 1, 2, and 3. A camera (also called a webcam) and three supplementary lights are deployed 21.5m from the stop line. The poles supporting the camera and supplementary lights can be 6m high. Each lane is 3.75m wide. Lane 1 has one supplementary light above it (let's call it supplementary light 1), and lane 3 has two supplementary lights above it (let's call them supplementary light 2 and supplementary light 3, from left to right). When supplementary light 1 is turned on, the light spot it creates on the ground is located near the stop line of lane 3; that is, supplementary light 1 is mainly used to provide supplementary lighting for lane 3. When supplementary light 2 is turned on, the light spot it creates on the ground is located near the stop line of lane 1; that is, supplementary light 2 is mainly used to provide supplementary lighting for lane 1. When supplementary light 3 is turned on, the light spot it creates on the ground is located near the stop line of lane 2; that is, supplementary light 3 is mainly used to provide supplementary lighting for lane 2. The aforementioned camera is positioned above lane 2, and the lower edge of the image generated by the camera corresponds to a position 9m from the stop line.

[0082] refer to Figure 1 It is evident that in electronic traffic enforcement scenarios, the key focus in terms of image quality is the captured license plate and traffic light effects. Especially at night, due to environmental factors, license plates are often too dark, and traffic lights appear yellowish or even whitish. In electronic traffic enforcement scenarios, the signal light area in the upper half of the image is prone to overexposure, causing the light bulb to expand and deform, and the halo to spread, affecting the imaging effect and the recognition of the signal light status.

[0083] For example, a checkpoint scenario could involve capturing images of vehicles on the road to analyze whether they have committed any traffic violations.

[0084] Figure 2 This is a schematic diagram of a checkpoint scenario provided in an embodiment of this application. See also... Figure 2Taking a two-lane road as an example, a camera and two auxiliary lights are deployed in front of the vehicle's direction of travel. The pole supporting the camera and auxiliary lights can be 6 meters high, and each lane is 3.75 meters wide. The camera can be deployed above the middle of the two lanes, and its field of view can cover all lanes. Generally, each lane requires one auxiliary light to ensure that the light spot covers the vehicle's area. The camera and multiple auxiliary lights are connected via signal cables. For example, Figure 2 The two supplementary lights are used to illuminate lane 1 and lane 2 respectively. The left supplementary light primarily illuminates lane 1, and the right supplementary light primarily illuminates lane 2. When a vehicle approaches the camera from a lane, the camera will capture an image as soon as the vehicle crosses the detection line or capture point. The supplementary light in the lane containing the vehicle will flash synchronously, and the camera will generate a clear image showing the vehicle's information, facilitating the monitoring of traffic violations. The detection line or capture point can be located 23-24 meters from the camera, and the bottom edge of the image generated by the camera corresponds to a position approximately 20 meters from the camera in the actual scene. The right supplementary light can be located 4 meters from the camera.

[0085] In checkpoint capture scenarios, the license plate in the lower half of the image is prone to overexposure, resulting in missing characters and loss of background color, which affects the imaging effect and the accuracy of intelligent license plate character recognition.

[0086] It should be understood that, Figure 1 and Figure 2 This is only used to illustrate electronic police scenarios and checkpoint scenarios, and is not intended to limit the embodiments of this application. Figure 1 and Figure 2 The distance values ​​marked in the diagram, the lanes corresponding to the multiple supplementary lights, the deployment location and number of supplementary lights, the deployment location and number of cameras, the height of the light poles, and the height of the support poles can all be flexibly set according to the actual situation.

[0087] For high dynamic range scenarios in traffic monitoring, the industry often uses single-frame HDR and multi-frame HDR technologies. These technologies rely to some extent on the HDR capabilities of the image sensor. However, the camera module and camera control method provided in this application do not rely on the HDR capabilities of the image sensor. They can adaptively suppress strong light in the bright areas of the upper or lower half of the image to ensure rich details in both bright and dark areas and improve image quality.

[0088] For example, in traffic enforcement scenarios, the camera module and camera control method provided in this application can effectively suppress overexposure of the traffic light area in the upper half of the image, reduce the brightness difference between the upper and lower parts, improve the imaging quality of the traffic lights, and preserve the details of the license plate. As another example, in checkpoint scenarios, the camera module and camera control method provided in this application can effectively suppress overexposure of the license plate area in the lower half of the image, reduce the brightness difference between the upper and lower parts, and reveal more details of the license plate.

[0089] The camera module and camera control method provided in the embodiments of this application will be described next.

[0090] This application embodiment mainly reduces the dynamic range of the image sensor by using a light-blocking disc to unevenly block light (i.e., block exposure) on the image sensor. First, the camera module provided in this application embodiment will be introduced.

[0091] Figure 3 This is a schematic diagram of a camera module provided in an embodiment of this application. See also... Figure 3 The camera module includes a lens, a light-shielding disc, and an image sensor. The light-shielding disc is located on the light-emitting side of the lens, and the image sensor is located on the light-emitting side of the light-shielding disc.

[0092] The lens is used to transmit a light beam; the light-blocking disc has a light-transmitting area (which may be referred to as the light-transmitting area) and a light-blocking area (which may be referred to as the light-blocking area). The light-blocking disc is used to transmit a light beam through the light-transmitting area during a first exposure time period and to block at least part of the light beam through the light-blocking area during a second exposure time period. In the second exposure time period, the orthographic projection of the image sensor on the light-blocking disc overlaps with the light-blocking area, and the size of the overlapping area increases during the second exposure time period. The image sensor is used to generate a target image based on the light beam transmitted through the light-transmitting area during the first and second exposure time periods.

[0093] In other words, during the first exposure time period, the light-blocking disc does not block the light beam transmitted through the lens, thus providing the first part of the image sensor with exposure. During the second exposure time period, the light-blocking disc blocks part of the light beam transmitted through the lens through the non-transparent area. Compared to not blocking the light beam during the second exposure time period, blocking the light beam can reduce the exposure during the second exposure time period.

[0094] It should be understood that, in the embodiments of this application, the exposure time of the image sensor each time includes a first exposure time period and a second exposure time period, and the duration of each exposure is equal to the duration of the first exposure time period plus the duration of the second exposure time period. Outside of the first and second exposure time periods, the image sensor does not expose itself; this time can be used by the processor or controller to receive and process the image generated by the image sensor.

[0095] In one possible implementation, during the first exposure time period, the orthographic projection of the image sensor on the masking disc is located within the light-transmitting area; during the second exposure time period, the orthographic projection of the image sensor on the masking disc overlaps with both the light-transmitting and non-light-transmitting areas.

[0096] In this embodiment, the image sensor includes a first photosensitive area and a second photosensitive area. The first photosensitive area corresponds to a target area in the target image, and the second photosensitive area corresponds to a non-target area in the target image. The brightness of the target area is greater than the brightness of the non-target area. The target area and non-target area can also be referred to as bright and dark areas, respectively. Here, "corresponding" can mean that the pixel array (also called a photosensitive element) in the first photosensitive area is used to generate pixels in the target area, and the pixel array in the second photosensitive area is used to generate pixels in the non-target area.

[0097] In some embodiments, the optical disc is as follows: Figure 3 The circular structure shown has both its translucent and opaque areas in a fan shape, with the apex of each fan located at the center of the optical disc. The circular optical disc, besides... Figure 3 Beyond the design shown, there are many other possible designs, such as Figure 4 As shown, the first design is similar Figure 3 In the second design, both the translucent and opaque areas are fan-shaped, with the apex of the fan not located at the center of the optical disc, but rather slightly to the left of the center. In the third design, the opaque area includes one fan-shaped area and multiple arc-shaped areas (three are shown in the illustration), while the translucent area is an irregular polygon. In the fourth design, the boundary between the translucent and opaque areas is a curve. In the fifth design, the boundary between the translucent and opaque areas includes a broken line and a straight line. The main difference between these five designs lies in the different ways of dividing the translucent and opaque areas. Besides the three designs mentioned above, other designs that achieve the same or similar effects as the three designs provided in this application are also within the scope of protection of this application and will not be enumerated here.

[0098] In other embodiments, the optical shielding disc has a rectangular structure as shown in Figure 5; there are also various designs for rectangular optical shielding discs. See also Figure 5In the first design, both the translucent and opaque areas are trapezoidal. In the second design, both are rectangular. In the third design, the translucent area is trapezoidal, and the opaque area is an irregular hexagon. In the fourth design, both are irregular pentagons. The main difference between these four designs lies in the way the translucent and opaque areas are divided. Besides these four designs, any other designs that achieve the same or similar effects as the four designs provided in this application are also within the scope of protection of this application and will not be enumerated here. For example, in a rectangular optical disc, the boundary between the translucent and opaque areas can also include one or more of straight lines, curves, and broken lines.

[0099] It should be understood that the shape and proportion of the light-transmitting area and the non-light-transmitting area in the embodiments of this application can be flexibly set according to the actual situation, such as not being limited to a circular structure or a rectangular structure, and the embodiments of this application do not limit this.

[0100] The following section will use different designs of masking discs to illustrate the positional relationship between the masking disc and the image sensor during the first and second exposure periods, as well as the direction of movement of the masking disc.

[0101] First, let's introduce the circular structure of the optical disc.

[0102] Figure 6 This is a schematic diagram illustrating the positional relationship between an image sensor and a light-blocking disc, provided in an embodiment of this application. See also... Figure 6 At the beginning of the first exposure time period, the image sensor begins this exposure. The positional relationship between the masking disc and the image sensor is as follows: Figure 6 As shown, the orthographic projection of the image sensor on the light-blocking disc is located to the left of the center of the disc and within the light-transmitting area, but does not touch the boundary of the light-transmitting area. During the first exposure time period, as the light-blocking disc rotates counterclockwise, the orthographic projection of the first edge of the light-transmitting area on the first plane gradually approaches the first vertex of the image sensor as time increases. The first plane is the plane where the image sensor is located. At the end of the first exposure time period, which is also the beginning of the second exposure time period, the orthographic projection of the first edge of the light-blocking disc on the first plane touches the first vertex of the image sensor. During the second exposure time period, as the light-blocking disc continues to rotate counterclockwise, the orthographic projection of the first edge of the light-blocking disc on the first plane gradually moves away from the first vertex of the image sensor and successively slides past the third and fourth vertices of the image sensor. At the end of the second exposure time period, the orthographic projection of the first edge of the light-blocking disc on the first plane touches the second vertex, thus ending the exposure. The orthographic projection of the image sensor on the light-blocking disc is now completely within the non-light-transmitting area.

[0103] During this exposure, the orthographic projection of the second edge of the masking disc onto the first plane can either never touch the image sensor, or it can just touch the first vertex at the end of the exposure, depending on the ratio of the transparent to the non-transparent area. After this exposure, the masking disc can continue to rotate counterclockwise until it rotates to the same position again. Figure 6 When the position shown is reached, the next exposure begins. Alternatively, the masking disc can be rotated clockwise until it is rotated to the position shown. Figure 6 When the position shown is reached, the next exposure will begin.

[0104] Figure 7 This is a schematic diagram illustrating the positional relationship between the optical disc and the image sensor, as provided in another embodiment of this application. Figure 7 and Figure 6 The main difference is that, Figure 7 At the beginning of the first exposure time period, the orthographic projection of the image sensor on the masking disc is located to the right of the center of the masking disc. The masking disc rotates clockwise during the first and second exposure time periods. During one exposure, the orthographic projection of the first edge of the masking disc on the first plane passes through the third vertex, the first vertex, the second vertex, and the fourth vertex of the image sensor in sequence.

[0105] Figure 8 This is a schematic diagram illustrating the positional relationship between the masking disc and the image sensor, as provided in another embodiment of this application. At the beginning of the first exposure time period, the image sensor begins its current exposure, and the positional relationship between the masking disc and the image sensor is as follows: Figure 8 As shown, the orthographic projection of the image sensor on the light-blocking disc is located below the center of the disc and within the light-transmitting area, but does not touch the boundary of the light-transmitting area. During the first exposure time period, as the light-blocking disc rotates counterclockwise, the orthographic projection of the first edge of the disc on the first plane gradually approaches the third vertex of the image sensor, where the first plane is the plane containing the image sensor. At the end of the first exposure time period, which is also the beginning of the second exposure time period, the orthographic projection of the first edge of the disc on the first plane touches the third vertex of the image sensor. During the second exposure time period, as the light-blocking disc continues to rotate counterclockwise, the orthographic projection of the first edge of the disc on the first plane gradually moves away from the third vertex of the image sensor, and successively slides past the fourth and second vertices of the image sensor. At the end of the second exposure time period, the orthographic projection of the first edge of the disc on the first plane touches the first vertex, thus ending the exposure. The orthographic projection of the image sensor on the light-blocking disc is now completely within the non-light-transmitting area.

[0106] During this exposure, the orthographic projection of the second edge of the masking disc onto the first plane can either never touch the image sensor, or it can just touch the third vertex at the end of the exposure, depending on the ratio of the transparent to the non-transparent area. After this exposure, the masking disc can continue to rotate counterclockwise until it rotates to the same position again. Figure 8 When the position shown is reached, the next exposure begins. Alternatively, the masking disc can be rotated clockwise until it is rotated to the position shown. Figure 8 When the position shown is reached, the next exposure will begin.

[0107] Based on the above description of some implementation scenarios of the embodiments of this application, Figures 6 to 7 The illustrated embodiment can be applied to scenarios where the upper half of the image is prone to overexposure. That is, during the second exposure time period, the non-transparent area of ​​the masking disc first blocks the easily overexposed upper half, and then blocks the less easily overexposed lower half. In other words, the image sensor includes a first photosensitive area and a second photosensitive area. The first photosensitive area corresponds to the target area in the target image, and the second photosensitive area corresponds to the non-target area in the target image. During the second exposure time period, the orthographic projection of the first photosensitive area onto the masking disc overlaps with the non-transparent area earlier than the orthographic projection of the second photosensitive area onto the masking disc. The first photosensitive area is located in the upper half of the image sensor, and the second photosensitive area is located in the lower half of the image sensor. Correspondingly, the target area is located in the upper half of the target image, and the non-target area is located in the lower half of the target image.

[0108] Figure 8 This embodiment can be applied to scenarios where the left half of the image is prone to overexposure. That is, during the second exposure time period, the non-transparent area of ​​the masking disc first blocks the easily overexposed left half, and then blocks the less easily overexposed right half. In other words, the image sensor includes a first photosensitive area and a second photosensitive area. The first photosensitive area corresponds to the target area in the target image, and the second photosensitive area corresponds to the non-target area in the target image. During the second exposure time period, the orthographic projection of the first photosensitive area onto the masking disc overlaps with the non-transparent area earlier than the orthographic projection of the second photosensitive area onto the masking disc. The first photosensitive area is located in the left half of the image sensor, and the second photosensitive area is located in the right half. Correspondingly, the target area is located in the left half of the target image, and the non-target area is located in the right half of the target image.

[0109] exist Figures 6 to 8In the illustrated embodiment, the second exposure time period includes a first time period and a second time period, with the first time period preceding the second time period. During the first time period, the orthographic projection of the first photosensitive area on the light-blocking disc overlaps with both the light-transmitting and opaque areas, and the orthographic projection of the second photosensitive area on the light-blocking disc lies within the light-transmitting area. During the second time period, the orthographic projection of the first photosensitive area on the light-blocking disc lies within the opaque area, and the orthographic projection of the second photosensitive area on the light-blocking disc overlaps with both the light-transmitting and opaque areas.

[0110] In one possible implementation, due to Figure 8 In the embodiment, during the second exposure time period, the non-transparent area blocks the upper half of the area before the lower half is blocked, therefore Figure 8 The embodiment can also be applied to scenarios where the upper half of the image sensor is prone to overexposure. For example, if the area prone to overexposure is located in the upper left half, based on this, the first photosensitive area is determined to be located in the upper half of the image sensor, and the second photosensitive area is located in the lower half of the image sensor. Then, in... Figure 8 In the illustrated embodiment, the second exposure time period includes a first time period, a second time period, and a third time period. The first time period precedes the second time period, and the second time period precedes the third time period. During the first, second, and third time periods, the orthographic projection of the first photosensitive area on the light-blocking disc overlaps with both the light-transmitting and opaque areas. During the first time period, the orthographic projection of the second photosensitive area on the light-blocking disc lies within the light-transmitting area. During the second time period, the orthographic projection of the second photosensitive area on the light-blocking disc overlaps with both the light-transmitting and opaque areas. During the third time period, the orthographic projection of the second photosensitive area on the light-blocking disc lies within the opaque area.

[0111] Figure 9 This is a schematic diagram illustrating the positional relationship between the masking disc and the image sensor, as provided in another embodiment of this application. At the beginning of the first exposure time period, the image sensor begins its current exposure, and the positional relationship between the masking disc and the image sensor is as follows: Figure 9As shown, the orthographic projection of the image sensor on the masking disc is located to the left of the center of the masking disc and within the light-transmitting area, but does not touch the boundary of the light-transmitting area. During the first exposure time period, as the masking disc rotates clockwise, the orthographic projection of the second edge of the masking disc on the first plane gradually approaches the second vertex of the image sensor as time increases. The first plane is the plane where the image sensor is located. At the end of the first exposure time period, which is also the beginning of the second exposure time period, the orthographic projection of the second edge of the masking disc on the first plane touches the second vertex of the image sensor. During the second exposure time period, as the masking disc continues to rotate clockwise, the orthographic projection of the second edge of the masking disc on the first plane gradually moves away from the second vertex of the image sensor and successively slides past the fourth and third vertices of the image sensor. At the end of the second exposure time period, the orthographic projection of the second edge of the masking disc on the first plane touches the first vertex, thus ending the exposure. The orthographic projection of the image sensor on the masking disc is now completely within the non-light-transmitting area.

[0112] During this exposure, the orthographic projection of the first edge of the masking disc onto the first plane can either never touch the image sensor, or it can just touch the first vertex at the end of the exposure, depending on the ratio of the transparent to the non-transparent area. After this exposure, the masking disc can continue to rotate counterclockwise until it rotates to the same position again. Figure 9 When the position shown is reached, the next exposure begins. Alternatively, the masking disc can be rotated clockwise until it is rotated to the position shown. Figure 9 When the position shown is reached, the next exposure will begin.

[0113] Figure 10 This is a schematic diagram illustrating the positional relationship between the optical disc and the image sensor, as provided in another embodiment of this application. Figure 10 and Figure 9 The main difference is that, Figure 10 At the beginning of the first exposure time period, the orthographic projection of the image sensor on the masking disc is located to the right of the center of the masking disc. The masking disc rotates counterclockwise during the first and second exposure time periods. During one exposure process, the orthographic projection of the second side of the masking disc on the first plane passes through the fourth vertex, the second vertex, the first vertex, and the third vertex of the image sensor in sequence.

[0114] Based on the above description of some implementation scenarios of the embodiments of this application, Figure 9 and Figure 10The illustrated embodiment can be applied to scenarios where the lower half of the image is prone to overexposure. That is, during the second exposure time period, the non-transparent area of ​​the masking disc first blocks the lower half of the image, which is prone to overexposure, and then blocks the upper half, which is less prone to overexposure. In other words, the image sensor includes a first photosensitive area and a second photosensitive area. The first photosensitive area corresponds to the target area in the target image, and the second photosensitive area corresponds to the non-target area in the target image. During the second exposure time period, the orthographic projection of the first photosensitive area onto the masking disc overlaps with the non-transparent area earlier than the orthographic projection of the second photosensitive area onto the masking disc. The first photosensitive area is located in the lower half of the image sensor, and the second photosensitive area is located in the upper half of the image sensor. Correspondingly, the target area is located in the lower half of the target image, and the non-target area is located in the upper half of the target image.

[0115] Furthermore, in Figure 9 and Figure 10 In the illustrated embodiment, the second exposure time period includes a first time period and a second time period, with the first time period preceding the second time period. During the first time period, the orthographic projection of the first photosensitive area on the light-blocking disc overlaps with both the light-transmitting and opaque areas, and the orthographic projection of the second photosensitive area on the light-blocking disc lies within the light-transmitting area. During the second time period, the orthographic projection of the first photosensitive area on the light-blocking disc lies within the opaque area, and the orthographic projection of the second photosensitive area on the light-blocking disc overlaps with both the light-transmitting and opaque areas.

[0116] Next, we will introduce the rectangular structure of the optical disc.

[0117] Figure 11 This is a schematic diagram illustrating the positional relationship between the optical disc and the image sensor, as provided in another embodiment of this application. Figure 11 and Figure 6 The difference is that, in Figure 11 In the center, the light-blocking disc has a rectangular structure, with both the light-transmitting and non-light-transmitting areas being trapezoidal. The boundary between these two areas is similar to... Figure 11 The first and second sides of the centrally shielded disc. Figure 11 The disc can rotate counterclockwise around a point on the dividing line (such as the center point), or it can translate along a line that is not parallel to the dividing line (such as a perpendicular line) to the lower left.

[0118] exist Figure 11In the illustrated embodiment, if the masking disc is translated, then at the beginning of the first exposure time period, the orthographic projection of the image sensor on the masking disc is located to the lower left of the center of the masking disc, and at the end of the second exposure time period, the orthographic projection of the image sensor on the masking disc is located to the upper right of the center of the masking disc. That is, the relative position of the image sensor and the center of the masking disc changes. If the masking disc moves counterclockwise, then the orthographic projection of the image sensor on the masking disc is always located to the lower left of the center of the masking disc; that is, the relative position of the image sensor and the center of the masking disc remains unchanged.

[0119] Figure 12 This is a schematic diagram illustrating the positional relationship between the optical disc and the image sensor, as provided in another embodiment of this application. Figure 12 and Figure 7 The difference is that, in Figure 12 In the center, the light-blocking disc has a rectangular structure, with both the light-transmitting and non-light-transmitting areas being trapezoidal. The boundary between these two areas is similar to... Figure 3 The first and second sides of the centrally shielded disc. Figure 12 The disc can rotate clockwise around a point on the dividing line (such as the center point), or it can translate along a line that is not parallel to the dividing line (such as a perpendicular line) to the lower right.

[0120] exist Figure 12 In the illustrated embodiment, if the masking disc moves in a translational motion, then at the beginning of the first exposure time period, the orthographic projection of the image sensor on the masking disc is located to the lower right of the center of the masking disc, and at the end of the second exposure time period, the orthographic projection of the image sensor on the masking disc is located to the upper left of the center of the masking disc. That is, the relative position of the image sensor and the center of the masking disc changes. If the masking disc moves clockwise, then the orthographic projection of the image sensor on the masking disc is always located to the lower right of the center of the masking disc; that is, the relative position of the image sensor and the center of the masking disc remains unchanged.

[0121] Based on the above description of some implementation scenarios of the embodiments of this application, similar to Figure 6 and Figure 7 Example, Figure 11 and Figure 12 The illustrated embodiment can also be applied to scenarios where the upper part of the area is easily exposed.

[0122] Figure 13 This is a schematic diagram illustrating the positional relationship between the optical disc and the image sensor, as provided in another embodiment of this application. Figure 13 and Figure 11 The difference is that, in Figure 13In the illustrated embodiment, at the beginning of the first exposure time period, the orthographic projection of the image sensor on the masking disc is located on the upper left side of the center of the masking disc. If the masking disc moves to the upper left corner, then at the end of the second exposure time period, the orthographic projection of the image sensor on the masking disc is located on the lower right side of the center of the masking disc. If the masking disc rotates clockwise, then the orthographic projection of the image sensor on the masking disc will always be located on the upper left side of the center of the masking disc.

[0123] Figure 14 This is a schematic diagram illustrating the positional relationship between the optical disc and the image sensor, as provided in another embodiment of this application. Figure 14 and Figure 12 The difference is that, in Figure 14 In the illustrated embodiment, at the beginning of the first exposure time period, the orthographic projection of the image sensor on the masking disc is located to the upper right of the center of the masking disc. If the masking disc moves to the upper right, then at the end of the second exposure time period, the orthographic projection of the image sensor on the masking disc is located to the lower left of the center of the masking disc. That is, the relative position of the image sensor and the center of the masking disc changes. If the masking disc rotates counterclockwise, then the orthographic projection of the image sensor on the masking disc remains to the upper right of the center of the masking disc. That is, the relative position of the image sensor and the center of the masking disc remains unchanged.

[0124] Based on the above description of some implementation scenarios of the embodiments of this application, similar to Figure 9 and Figure 10 Example, Figure 13 and Figure 14 The illustrated embodiment can also be applied to scenarios where the lower half of the area is easily exposed.

[0125] Apart from Figures 6 to 14 Besides the embodiments shown, the shape of the light-blocking disc, its positional relationship with the image sensor at different time periods, and the division, proportion, and shape of the light-transmitting and non-light-transmitting areas can also be designed in other ways to achieve a similar effect. These embodiments will not be enumerated further in this application. For example, the boundary line between the light-transmitting and non-light-transmitting areas can also be a curve or a broken line, rather than a straight line.

[0126] It should be understood that, Figures 6 to 14 The embodiments shown are all top-view schematic diagrams of the image sensor along the direction of beam transmission. Compared to a rectangular optical shield, a circular optical shield exhibits better stability during rotation.

[0127] It should also be understood that, in the above embodiments, the duration of one movement (rotation or translation) of the masking disc is equal to the duration between two adjacent exposure start times of the image sensor. In other embodiments, the duration of one movement of the masking disc may also be equal to P times the duration between two adjacent exposure start times, where P can be 2, 3, 5, or other values. Taking P=3 and the masking disc rotating as an example, the masking disc can rotate 3 times between two adjacent exposure start times. These embodiments can also achieve similar effects.

[0128] In the embodiments of this application, the masking optical disc can be implemented in multiple ways, and three of these implementations will be described below.

[0129] In the first implementation, the optical disc is a color wheel with a first region and a second region. The first region includes a first filter and the second region includes a second filter. The first filter is used to filter light with wavelengths outside the light-sensing range of the image sensor, and the second filter is used to filter light with wavelengths within the light-sensing range, or to filter light of all wavelengths. The first region is a light-transmitting region and the second region is a light-blocking region.

[0130] The light-sensing range of the image sensor may include the visible light range, or one or more of the visible light range, infrared light range and ultraviolet light range, or it may include other ranges. This application embodiment does not limit this.

[0131] The second implementation method is that the optical disc is a non-transparent material with a physical gap. The area where the physical gap is located is the light-transmitting area, and the area outside the physical gap is the non-transparent area.

[0132] Among them, non-transparent materials include opaque metal plates and opaque wooden boards.

[0133] The third implementation method is that the optical disc includes a lens and a filter layer located on one side of the lens. The lens has two regions, referred to as the third region and the fourth region, respectively. The third region is the light-transmitting region, and the orthogonal projection of the filter layer on the lens is located in the fourth region, which constitutes the non-light-transmitting region.

[0134] The filter layer is used to filter light with wavelengths within the photosensitive range, or to filter light of all wavelengths. Its design can be similar to the second filter mentioned above.

[0135] In this embodiment, the lens can be a plane mirror. Of course, in other embodiments, the lens can also be a convex lens, which works with the lens to converge the light beam onto the image sensor; or it can be a concave lens, which also works with the lens to converge the light beam onto the image sensor. If the lens is convex or concave, the orthographic projection of the filter layer onto the lens can be larger or smaller than the size of the non-transparent area due to light refraction, and this depends on which side of the lens the filter layer is located on. For example, if the lens is convex and the filter layer is located on the side closer to the image sensor, then the orthographic projection of the filter layer onto the lens is larger than the size of the non-transparent area; if the lens is concave and the filter layer is located on the side closer to the image sensor, then the orthographic projection of the filter layer onto the lens is smaller than the size of the non-transparent area.

[0136] The third implementation is similar in principle to the first implementation. The lens in the third implementation can also be regarded as a filtering element, which does not filter light whose wavelength is within the light-sensing range of the image sensor.

[0137] Of the three implementation methods mentioned above, compared to those with physical notches, the color wheel and lens + filter layer implementations are relatively stable during rotation because the optical disc has no physical notches; that is, they are balanced and have good stability. It should be understood that the filter layer is usually also quite lightweight, with negligible weight.

[0138] Besides the three implementation methods mentioned above, there are many other possible implementation methods for masking optical discs, which will not be listed in the embodiments of this application.

[0139] In this embodiment of the application, the exposure start time of the multiple rows of photosensitive elements included in the image sensor is the same; that is, the multiple rows of photosensitive elements begin exposure simultaneously. For example, in Figures 6 to 14 In this embodiment, at the beginning of the first exposure time period, the top row of photosensitive elements parallel to the edge from the third vertex to the first vertex on the image sensor simultaneously begins exposure. As time increases, the exposure gradually decreases along the direction from the first vertex to the second vertex. It should be understood that the aforementioned "multiple rows" refers to... Figures 6 to 14 In other words, multiple columns in the middle, Figures 6 to 14 The vertical direction in the image sensor represents the row direction, and the horizontal direction represents the column direction.

[0140] In one implementation, the image sensor uses a rolling shutter, and the rolling shutter operates in a first mode. The first mode indicates that the multiple rows of photosensitive elements in the image sensor have the same exposure start time but different exposure end times. For example, the exposure end time of the multiple rows of photosensitive elements is delayed row by row from top to bottom; that is, the first row of photosensitive elements ends exposure earliest, followed by the second row, and so on, with the last row ending exposure latest. In some embodiments, the first mode may be called a global reset mode.

[0141] Figure 15 This is a schematic diagram of the exposure time of a rolling shutter in a first mode, provided in an embodiment of this application. Figure 15 In the case of column exposure direction from left to right, with the upper half being prone to overexposure, the first row to the last row are exposed at the same time, meaning the exposure start time is the same. The first row ends the exposure earliest, and the last row ends the exposure latest. Under the effect of the masking disc, the exposure time of the first row to the last row will be reduced, and the smaller the number of rows, the greater the reduction in exposure. Figure 15 The shaded area in the image is the part that the optical disc covers. Figure 15 The main difference between (2) and (1) is that in (2), the lower half is prone to overexposure, the exposure time from the last row to the first row will be reduced, and the larger the number of rows, the more the exposure is reduced.

[0142] It should be understood that the rolling shutter in the related technology has at least two operating modes. In addition to the first mode described above, it also includes a second mode. The second mode indicates that the multiple rows of photosensitive elements included in the image sensor begin exposure sequentially from top to bottom and end exposure sequentially from top to bottom. That is, the exposure start time and exposure end time of the multiple rows of photosensitive elements are different. In some embodiments, the second mode can be referred to as the normal mode.

[0143] In another implementation, the image sensor uses a global shutter, which indicates that the exposure start time and end time are the same for all rows of photosensitive elements within the image sensor. That is, the multiple rows of photosensitive elements begin and end their exposures simultaneously.

[0144] Figure 16 This is a schematic diagram of the exposure time of a global shutter provided in an embodiment of this application. Figure 16 In example (1), taking the column exposure direction as being from left to right and the upper half being prone to overexposure, the first row to the last row start exposure simultaneously and end exposure simultaneously. However, in the embodiment of this application, due to the effect of the shielding disc, the exposure time from the first row to a certain middle row will be reduced, and the smaller the number of rows, the greater the reduction in exposure. Figure 16 The shaded area in the image is the part that the optical disc covers. Figure 16 The difference between (2) and (1) is that in (2), the lower half is prone to overexposure, and the larger the number of rows, the more the exposure is reduced.

[0145] In the above embodiments, the camera module includes a lens, a light-shielding disc, and an image sensor. To move the light-shielding disc, in some embodiments, the camera module also includes a transmission device for moving the light-shielding disc, such as rotating and / or translating. The transmission device may include a motor or other possible devices, which are not limited in this application. In still other embodiments, in addition to the lens, light-shielding disc, and image sensor, the camera module may include other components, such as a light tube, etc. Specific details can be found in related technologies, which will not be described in detail in this application.

[0146] The system architecture involved in the camera control method provided in the embodiments of this application will be described next.

[0147] Figure 17 This is a system architecture diagram related to a camera control method provided in an embodiment of this application. See also... Figure 17 The system architecture includes a camera module and a camera control device (hereinafter referred to as the control device), and a wired or wireless communication connection is established between the camera module and the control device. The camera module can be... Figures 3 to 14 Any of the camera modules described in the embodiments. This camera module is used to acquire images, such as images acquired according to the camera control method provided in the embodiments of this application. The camera module is also used to send the acquired images to a control device. The control device is used to control the movement of the optical disc in the camera module according to the camera control method provided in the embodiments of this application, such as controlling the movement of the transmission device in the camera module to drive the optical disc to move. In some embodiments, the control device is also used to perform brightness analysis or other processing on the images, which will be described in detail below.

[0148] In some embodiments, the system architecture further includes a supplementary lighting device for illuminating the image sensor during the exposure time. The control device can also establish a wired or wireless communication connection with the supplementary lighting device, and can also control the supplementary lighting time of the device, including the start and end times of the supplementary lighting. The start time of the supplementary lighting device can be synchronized with the start time of the image sensor's exposure, thus providing a good supplementary lighting effect. Alternatively, the start time of the supplementary lighting device can be later than the start time of the image sensor's exposure. The end time of the supplementary lighting device can be earlier than the end time of the exposure to prevent overexposure. Of course, in some embodiments, the end time of the supplementary lighting can be synchronized with or even later than the end time of the exposure; these settings can be flexibly configured according to actual conditions.

[0149] The supplementary lighting device may include LED lights, xenon lights or other types of lights, and this application embodiment does not limit this.

[0150] The control device may include a processor, and in some embodiments, may also include a memory and / or a communication interface. The processor may be a general-purpose central processing unit (CPU), a natural network processor (NP), a microprocessor, or one or more integrated circuits for implementing the solutions of this application, such as an application-specific integrated circuit (ASIC), a programmable logic device (PLD), or a combination thereof. The PLD may be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL), or any combination thereof.

[0151] In some embodiments, see Figure 18 The processor in the control device may include a System-on-a-Chip (SOC) and an FPGA. The SOC establishes a communication connection with the FPGA, and the FPGA establishes communication connections with the image sensor, lens, optical mask, and lighting device. The SOC is used to control the exposure of the lens, optical mask, and image sensor via the FPGA, as well as to control the lighting of the lighting device. It is also used to receive images generated by the image sensor transmitted through the FPGA.

[0152] In the embodiments of this application, the control device can be any computer device, such as a desktop computer, laptop computer, tablet computer or other terminal device, or a server, cloud server, cloud service cluster or the like.

[0153] Please refer to Figure 19 , Figure 19 This is a schematic diagram of the structure of a control device provided in an embodiment of this application. The control device can be... Figure 17 or Figure 18 The control device in the embodiment includes one or more processors 1901, a communication bus 1902, a memory 1903, and one or more communication interfaces 1904.

[0154] Processor 1901 is a general-purpose CPU, NP, microprocessor, or one or more integrated circuits for implementing the scheme of this application, such as ASIC, PLD, or a combination thereof. The PLD can be a CPLD, FPGA, GAL, or any combination thereof.

[0155] The communication bus 1902 is used to transmit information between the aforementioned components. Optionally, the communication bus 1902 may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, Figure 19 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.

[0156] The memory 1903 may be a read-only memory (ROM), random access memory (RAM), electrically erasable programmable read-only memory (EEPROM), optical disc (including compact disc read-only memory (CD-ROM), compressed optical disc, laser disc, digital versatile optical disc, Blu-ray disc, etc.), magnetic disk storage medium, or other magnetic storage device, or any other medium capable of carrying or storing desired program code in the form of instructions or data structures that can be accessed by a computer, but is not limited thereto. The memory 1903 exists independently and is connected to the processor 1901 via the communication bus 1902, or the memory 1903 is integrated with the processor 1901.

[0157] Communication interface 1904 uses any transceiver-like device for communicating with other devices or communication networks. Communication interface 1904 includes a wired communication interface, or may include a wireless communication interface. The wired communication interface may be, for example, an Ethernet interface, which can be an optical interface, an electrical interface, or a combination thereof. The wireless communication interface may be a wireless local area network (WLAN) interface, a cellular network communication interface, or a combination thereof.

[0158] In some embodiments, the control device includes multiple processors, such as Figure 19 The processors 1901 and 1905 are shown. Each of these processors is either a single-core processor or a multi-core processor. Here, a processor refers to one or more devices, circuits, and / or processing cores used to process data (such as computer program instructions).

[0159] In a specific implementation, as one embodiment, the control device further includes an output device 1906 and an input device 1907. The output device 1906 communicates with the processor 1901 and can display information in various ways. For example, the output device 1906 can be a liquid crystal display (LCD), a light-emitting diode (LED) display device, a cathode ray tube (CRT) display device, or a projector. The input device 1907 communicates with the processor 1901 and can receive user input in various ways. For example, the input device 1907 can be a mouse, keyboard, touchscreen device, or sensing device.

[0160] In some embodiments, memory 1903 is used to store program code 1910 for executing the scheme of this application, and processor 1901 is capable of executing program code 1910 stored in memory 1903. The program code includes one or more software modules, and the control device can implement the camera control method shown in the following method embodiments through processor 1901 and program code 1910 in memory 1903.

[0161] exist Figure 17 and Figure 18 In the illustrated embodiment, the control device is a device separate from the camera module. In other embodiments, the control device may also be a device within the camera module; that is, the camera module further includes the control device, for example, the control device is integrated into the camera module.

[0162] It should be understood that the device structure, system architecture, and business scenarios described in the embodiments of this application are for the purpose of more clearly illustrating the technical solutions of the embodiments of this application, and do not constitute a limitation on the technical solutions provided in the embodiments of this application. As those skilled in the art will know, with the evolution of device structure and system architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of this application are also applicable to similar technical problems.

[0163] The camera control method provided in the embodiments of this application will be described next.

[0164] The camera control method provided in this application is applied to a control device, which may be... Figure 17 or Figure 18 The control device in the embodiment. In this embodiment, the camera module includes a lens, a light-blocking disc, and an image sensor. The light-blocking disc is located on the light-emitting side of the lens, and the image sensor is located on the light-emitting side of the light-blocking disc. The light-blocking disc has a light-transmitting area and a non-light-transmitting area. This camera module can be... Figures 3 to 14 Any of the camera modules in the embodiments.

[0165] In this method, a control device controls a blocking disc to move so that the blocking disc transmits a light beam through a light-transmitting area during a first exposure time period and blocks at least a portion of the light beam through a light-blocking area during a second exposure time period. During the second exposure time period, the orthographic projection of the image sensor onto the blocking disc overlaps with the light-blocking area, and the size of the overlapping area increases during the second exposure time period. The light beam is transmitted through the lens, and the light beams transmitted through the light-transmitting area during both the first and second exposure time periods are used by the image sensor to generate the target image.

[0166] In one possible implementation, see Figure 20 The method also includes the following steps.

[0167] Step 2001: Acquire the first image, which is an image generated by the image sensor before the target image.

[0168] Step 2002: Determine the brightness of the target region in the first image. The first image also includes non-target regions, and the brightness of the target region is greater than the brightness of the non-target regions.

[0169] Step 2003: Control the movement speed of the shielding disc based on the brightness of the target area.

[0170] In other words, the control device can reasonably control the movement speed of the light-blocking disc based on the brightness of the target area, thereby controlling the amount of light blocking by the non-transparent area.

[0171] The first image may include N frames preceding the target image, or it may be an earlier historical image, such as an image acquired within a historical time period that is the same as the current time period. This application does not limit this.

[0172] In this embodiment, N is a positive integer. When N equals 1, the first image is the previous frame of the target image, meaning that the movement speed of the masking disc is adjusted in real time. When N is greater than 1, the first image includes multiple frames preceding the target image. The brightness of the target area in the first image can refer to the average brightness of the target area across these multiple frames. Based on this, the movement speed of the masking disc is adjusted every N frames.

[0173] The value of N can be flexibly set according to the actual scenario and needs. For example, in scenarios where there are relatively few changes in light sources during the day, at night, or in the environment, N can be set to a larger value, while in scenarios where there are relatively many changes in light sources in the evening, early morning, or in the environment, N can be set to a smaller value.

[0174] As discussed above, there are many designs for optical discs, each with different movement methods and / or directions. The following sections will describe the specific control methods employed by the control device for the optical disc, categorized by scenario.

[0175] First, let's introduce the case where the optical disc is circular and its movement is rotation.

[0176] In this case, see Figure 21 Step 2003 may include step 20031: when the brightness of the target area meets the exposure reduction condition, reduce the linear velocity of the shielding disc relative to the image sensor during rotation, and / or keep the linear velocity constant and delay the exposure start time of the image sensor.

[0177] If the brightness of the target area meets the condition for reducing exposure, it means that the brightness of the target area needs to be further reduced. Therefore, it is necessary to further reduce the exposure of the first photosensitive area (corresponding to the bright area) on the image sensor.

[0178] This application provides two methods to reduce the exposure of the first photosensitive area. The first method is to reduce the linear velocity of the blocking disc relative to the image sensor during rotation, which is equivalent to extending the blocking time. The second method is to keep the linear velocity constant and delay the exposure start time of the image sensor, which is equivalent to advancing the blocking timing of the image sensor and reducing the base exposure. In addition to these two methods, other possible methods can also be used to reduce the exposure of the first photosensitive area.

[0179] If the second method described above is used, the base exposure will be reduced. To ensure that the brightness of non-target areas remains constant and to prevent image quality degradation in non-target areas, in some embodiments, the control device may also increase the lens aperture and / or increase the image sensor gain while using the second method. Of course, in other embodiments, the control device may not adjust or may reduce the lens aperture and / or decrease the image sensor gain as needed.

[0180] There are at least two ways to reduce the linear velocity of the optical masking disc relative to the image sensor during rotation. The first way is to reduce the angular velocity of the optical masking disc to reduce the linear velocity. The second way is to reduce the distance between the optical masking disc and the image sensor, such as by pulling the optical masking disc perpendicularly closer to the image sensor. Besides these two methods, other possible ways can also be used to reduce the aforementioned linear velocity.

[0181] In this embodiment, the exposure reduction condition may include: the brightness of the target area is higher than a first brightness threshold, and / or the brightness ratio of the target area to the non-target area is higher than a first brightness ratio. That is, when the brightness of the target area is higher than the first brightness threshold, and / or the brightness ratio of the target area to the non-target area is higher than the first brightness ratio, the control device will further reduce the exposure of the first photosensitive area.

[0182] Taking the previous frame of the first image as the target image as an example, the control device performs brightness analysis on the previous frame in real time to determine whether the brightness of the target area of ​​the previous frame is still higher than the first brightness threshold, and / or whether the brightness ratio of the target area to the non-target area is higher than the first brightness ratio, thereby determining whether to further reduce the exposure of the first photosensitive area.

[0183] The first brightness threshold and / or the first brightness ratio can be preset values ​​or values ​​determined in real time based on multiple frames of images preceding the target image. In this application embodiment, the specific values ​​of the first brightness threshold and the first brightness ratio are not limited.

[0184] See Figure 21 Step 2003 may also include step 20032: if the brightness of the target area meets the conditions for increasing the exposure, increase the linear velocity of the shielding disc relative to the image sensor during rotation, and / or keep the linear velocity constant and advance the exposure start time of the image sensor.

[0185] If the brightness of the target area meets the conditions for increasing exposure, it means that the brightness of the target area may be about to be underexposed, or has already been underexposed. The brightness of the target area needs to be increased, so reverse control is needed to increase the exposure of the first photosensitive area (corresponding to the bright area) on the image sensor on the current basis.

[0186] This application provides two methods to increase the exposure of the first photosensitive area. The first method is to increase the linear velocity of the masking disc relative to the image sensor during rotation, which is equivalent to shortening the masking time. The second method is to keep the linear velocity constant and advance the exposure start time of the image sensor, which is equivalent to delaying the masking timing of the image sensor and increasing the base exposure. In addition to these two methods, other possible methods can also be used to increase the exposure of the first photosensitive area.

[0187] If the second method described above is used, the base exposure will be increased. To ensure that the brightness of non-target areas remains constant and to prevent image quality degradation in non-target areas, in some embodiments, the control device may also reduce the lens aperture and / or the image sensor gain while using the second method. Of course, in other embodiments, the control device may not adjust or may increase the lens aperture and / or the image sensor gain as needed.

[0188] There are at least two ways to increase the linear velocity of the optical masking disc relative to the image sensor during rotation. The first way is to increase the angular velocity of the optical masking disc to increase the linear velocity. The second way is to increase the distance between the optical masking disc and the image sensor to increase the linear velocity, such as by vertically pulling the optical masking disc away from the image sensor. Besides these two methods, other possible ways can also be used to increase the aforementioned linear velocity.

[0189] In this embodiment, the conditions for increasing exposure include: the brightness of the target area is not higher than a second brightness threshold, and / or the brightness ratio of the target area to the non-target area is lower than the second brightness ratio. That is, when the brightness of the target area is not higher than the second brightness threshold, and / or the brightness ratio of the target area to the non-target area is lower than the second brightness ratio, the control device will increase the exposure of the first photosensitive area.

[0190] Taking the previous frame of the first image as the target image as an example, the control device performs brightness analysis on the previous frame in real time to determine whether the brightness of the target area of ​​the previous frame is not higher than the second brightness threshold, and / or whether the brightness ratio of the target area to the non-target area is lower than the second brightness ratio, thereby determining whether to increase the exposure of the first photosensitive area.

[0191] The second brightness threshold and / or the second brightness ratio can be preset values ​​or values ​​determined in real time based on multiple frames of images preceding the target image. In this application embodiment, the specific values ​​of the second brightness threshold and the second brightness ratio are not limited.

[0192] In one possible implementation, the first brightness threshold is equal to the second brightness threshold, and the first brightness ratio is equal to the second brightness ratio. Based on this, the control device may gradually reduce the exposure of the first photosensitive area, and after reducing it to a certain level, increase the exposure of the first photosensitive area again based on the current level.

[0193] In another possible implementation, the first brightness threshold is greater than the second brightness threshold, and the first brightness ratio is greater than the second brightness ratio. Based on this, the control device may gradually reduce the exposure of the first photosensitive area, and after reducing it to a certain level, maintain the current exposure (i.e., maintain the current occlusion). After a period of time, if underexposure occurs due to environmental or other reasons, the exposure of the first photosensitive area will be increased again based on the current exposure.

[0194] In some embodiments, the linear velocity and / or exposure start time are adjusted according to an exposure adjustment ratio. After determining the brightness of the target area in the first image, the control device can also determine the exposure adjustment ratio based on the brightness of the target area and a reference brightness; that is, the exposure adjustment ratio is dynamically determined according to real-time conditions.

[0195] Wherein, the reference brightness is the average brightness of the first image; or, the reference brightness is the brightness of the non-target area; or, the reference brightness is a first brightness threshold.

[0196] Taking the average brightness of the first image as a reference brightness as an example, the control device can subtract the brightness of the target area from the average brightness of the first image to obtain a brightness difference. Dividing this brightness difference by the brightness of the target area yields the exposure adjustment ratio. Similarly, taking the brightness of a non-target area as a reference brightness as an example, the control device can divide the brightness of the non-target area by the brightness of the target area to obtain the exposure adjustment ratio. Again, taking the brightness of a non-target area as a reference brightness as an example, the control device can divide a first brightness threshold by the brightness of the target area to obtain the exposure adjustment ratio. The exposure adjustment ratio determined by the control device can be, for example, 50% or 40%.

[0197] In one possible implementation, the control device determines the linear velocity adjustment amount or exposure start time delay amount corresponding to the exposure adjustment ratio based on the mapping relationship between the exposure adjustment ratio and the linear velocity adjustment amount or exposure start time delay amount, and adjusts the linear velocity or exposure start time according to the determined linear velocity adjustment amount or exposure start time delay amount. This mapping relationship can be a mapping table, a mapping function, a mapping relationship implicitly represented by a neural network model, or any other possible form of mapping relationship; this application embodiment does not limit this to any particular form.

[0198] In other embodiments, the exposure adjustment ratio is a preset ratio. The control device adjusts the linear velocity and / or exposure start time according to this preset ratio. This preset ratio is equivalent to an adjustment step size; that is, the control device adjusts the linear velocity and / or exposure start time according to a certain adjustment step size. The preset ratio can be any possible ratio, and this application embodiment does not limit it.

[0199] In this embodiment, when the brightness of the target area meets the exposure reduction condition, the exposure adjustment ratio is the exposure reduction ratio; when the brightness of the target area meets the exposure increase condition, the exposure adjustment ratio is the exposure increase ratio.

[0200] In this embodiment of the application, before the control device determines the brightness of the target area in the first image, it also needs to determine where the target area is located. There are many ways to determine the location of the target area, and several of these methods will be introduced below.

[0201] In the first implementation, the control device acquires at least one second image, which is an image generated by the image sensor before the first image. The brightness of the at least one second image is analyzed to obtain a brightness analysis result, and the target area in the first image is determined based on the brightness analysis result.

[0202] In one possible implementation, the brightness analysis result may include the location coordinates of a region, which may be a region in the second image whose average brightness is greater than a first brightness threshold, and the location coordinates of this region are the location coordinates of the target region in the first image.

[0203] The second image may include M frames preceding the target image, or it may be an earlier historical image, such as an image acquired within a historical time period that is the same as the current time period. This application does not limit this.

[0204] In this embodiment, M is a positive integer. When M equals 1, the second image is the previous frame of the target image, that is, the overexposed area (i.e., bright area) in the image is determined in real time. When M is greater than 1, the second image includes multiple frames of images before the target image. Based on this, the overexposed area in the image is counted every M frames.

[0205] The value of M can be flexibly set according to the actual scenario and needs. For example, in scenarios where there are relatively few changes in light sources during the day, at night, or in the environment, M can be set to a larger value; in scenarios where there are relatively many changes in light sources in the evening, early morning, or in the environment, M can be set to a smaller value. In some embodiments, the value of M can be the same as the value of N mentioned above; in other embodiments, the value of M is different from the value of N mentioned above.

[0206] In the second implementation, after detecting a selection operation on a region in the third image, the control device uses the position coordinates of the selected region as the position coordinates of the target region in the first image. In other words, the target region is determined through manual selection.

[0207] The third image can be the second image mentioned above, or it can be any other image.

[0208] As an example, the traffic light area or license plate area can be determined as the target area by manually selecting a bounding box. Specifically, the traffic light area can be rows 150 to 200 from the top of the third image, and the license plate area can be rows 200 to 250 from the top of the third image.

[0209] In this embodiment of the application, the target area can be a rectangular area. As can be seen from the above description of the application scenario, the target area can be located in the upper half of the first image, and the size of the target area can be equal to or smaller than the size of the upper half of the image. Alternatively, the target area can be located in the lower half of the first image, and the size of the target area can be equal to or smaller than the size of the lower half of the image.

[0210] As described above, the rotation direction of the light-blocking disc varies depending on the location of the target area. Therefore, in this embodiment, the control device can further control the rotation direction of the light-blocking disc so that the orthographic projection of the first photosensitive area on the light-blocking disc overlaps with the non-transparent area earlier than the orthographic projection of the second photosensitive area on the light-blocking disc during the second exposure time period. Here, the first and second photosensitive areas are photosensitive areas on the image sensor; the first photosensitive area corresponds to the target area, and the second photosensitive area corresponds to the non-target area. The specific rotation direction of the light-blocking disc can be referred to above. Figures 6 to 14 The relevant descriptions in the embodiments will not be repeated here.

[0211] Next, we will introduce the case where the shielding disc has a rectangular structure and its movement is rotation.

[0212] See above Figures 11 to 14 As can be seen from the description of the rectangular shielding disc in the embodiment, the method by which the control device controls the rotation of the rectangular shielding disc can be similar to controlling... Figures 6 to 10 The implementation method for rotating the circular shielding disc in the embodiment is similar. The implementation method for controlling the rotation of the rectangular shielding disc will not be described in detail here. Please refer to the relevant content above for details.

[0213] Next, we will introduce the case where the optical disc is a rectangular structure and its movement is a translation.

[0214] In one possible implementation, the control device acquires a first image, which is an image generated by an image sensor before a target image, determines the brightness of a target region in the first image, the first image also includes a non-target region, the brightness of the target region is greater than the brightness of the non-target region, and controls the translation speed of the masking disc based on the brightness of the target region.

[0215] The first image here may be the same as or different from the first image mentioned above; this application does not limit this.

[0216] One way the control device controls the translation speed of the masking disc based on the brightness of the target area is as follows: when the brightness of the target area meets the condition for reducing exposure, the translation speed of the masking disc is reduced; when the brightness of the target area meets the condition for increasing exposure, the translation speed of the masking disc is increased.

[0217] The exposure reduction conditions here may be the same as or different from the exposure reduction conditions mentioned above, and this application embodiment does not limit this. The exposure increase conditions here may be the same as or different from the exposure provision conditions mentioned above, and this application embodiment does not limit this.

[0218] In this embodiment, the translation speed of the optical disc is adjusted according to the exposure adjustment ratio. Based on this, the control device can determine the exposure adjustment ratio based on the brightness of the target area and a reference brightness after determining the brightness of the target area in the first image. The specific implementation method can be the same as or different from the method for determining the exposure adjustment ratio described above, and will not be repeated here. Similarly, the method for determining the target area can also be the same as or different from the method described above, and will not be repeated here.

[0219] Wherein, the reference brightness is the average brightness of the first image; or, the reference brightness is the brightness of the non-target area; or, the reference brightness is a first brightness threshold.

[0220] In this embodiment, the control device can further control the translation direction of the light-blocking disc, so that the orthographic projection of the first photosensitive area on the light-blocking disc during the second exposure time period overlaps with the non-transparent area earlier than the orthographic projection of the second photosensitive area on the light-blocking disc. The specific translation direction of the light-blocking disc can be referred to... Figures 11 to 14 The relevant descriptions in the embodiments will not be repeated here.

[0221] The above describes the specific implementation methods for controlling various structures of optical discs. As can be seen from the above, the system architecture of this application embodiment may also include a supplementary lighting device. In one possible implementation, the control device can also control the supplementary lighting start time of the supplementary lighting device, which is synchronized with the exposure start time of the image sensor. The supplementary lighting device is used to provide supplementary lighting for the image sensor. For example, if the exposure start time of the image sensor is delayed or advanced, the control device also needs to synchronously delay or advance the supplementary lighting start time of the supplementary lighting device to achieve a better supplementary lighting effect.

[0222] In some embodiments, a similar effect can be achieved by adjusting the amount of fill light by adjusting the start time and / or total duration of the fill light device without adjusting the exposure start time of the image sensor. For example, if the brightness of the target area meets the condition for reducing exposure, the start time of the fill light can be delayed; if the brightness of the target area meets the condition for increasing exposure, the total duration of the fill light can be extended.

[0223] Figure 22 This is a schematic diagram illustrating a delayed start time for supplemental lighting provided in an embodiment of this application. Taking the lower half, which is prone to overexposure, as an example, see... Figure 22 This can delay the start time of the fill light, making the fill light start later than the start time of the exposure, thereby blocking part of the fill light with a masking disc and reducing the exposure of the lower half.

[0224] In some embodiments, in addition to controlling the movement speed and direction of the light-blocking disc, the start time and duration of the light-up device, the start time of the exposure and the shutter speed of the image sensor, the control device can also control one or more of the following: the aperture size of the lens, the gain of the image sensor, etc. For details, please refer to the relevant technology, which will not be described in detail in this application embodiment.

[0225] Next, please combine... Figure 23 The camera control method provided in the embodiments of this application will be explained and illustrated again by way of example.

[0226] Figure 23 This is a flowchart of another camera control method provided in an embodiment of this application. Taking a color wheel as an example, see [link to flowchart]. Figure 23 The control device can determine the location of the overexposed area (i.e., the target area), perform brightness statistics on the overexposed areas of the currently acquired N frames of images, determine the color wheel control decision based on the brightness statistics, and then control the color wheel based on the control decision, including controlling the rotation direction, rotation speed, and timing of shutter blocking. Next, the control device performs overall brightness statistics on the currently acquired N frames of images, determines the overall exposure control decision based on the overall brightness statistics, and performs overall exposure control based on the overall exposure control decision, including controlling the lens aperture, image sensor shutter speed and gain, and the start time of the fill light. Under the control of the color wheel and the overall exposure control, the image sensor continues to generate subsequent images. During this process, the overall image quality and the details of the overexposed areas converge towards a better direction; that is, the brightness ratio of the bright areas to the dark areas in the image gradually decreases. The control device continues to acquire the latest N frames of images generated by the image sensor and executes the next round of control based on the currently acquired N frames. Here, N can be greater than 1, meaning that the control device performs negative feedback adjustment every N frames.

[0227] In summary, in this embodiment, a light-blocking disc is incorporated into the camera module to physically obstruct the exposure of the image sensor, thereby reducing the exposure of the image sensor. Specifically, during the first exposure time period, the light-blocking disc does not block the light beam, ensuring the basic exposure of the image sensor. During the second exposure time period, the non-transparent area on the light-blocking disc obstructs at least a portion of the image sensor, and the size of the obstructed area increases with time. This reduces the brightness ratio between the initially obstructed and subsequently obstructed areas on the image sensor, effectively narrowing the dynamic range of the image sensor. This results in differences in exposure across different areas of the target image, ensuring that details in each area within the shooting range are clearly captured.

[0228] Figure 24 This is a schematic diagram of a control device provided in an embodiment of this application. The control device can be implemented by software, hardware, or a combination of both, and can be part or all of a camera device or computer device. Figure 19 The control device shown. In this embodiment, the camera module includes a lens, a light-emitting disc, and an image sensor. The light-emitting disc is located on the light-emitting side of the lens, and the image sensor is located on the light-emitting side of the light-emitting disc. The light-emitting disc has a light-transmitting area and a non-light-transmitting area. See also Figure 24 The control device includes: control module 2401.

[0229] The control module 2401 is used to control the movement of the light-blocking disc so that the light-blocking disc transmits the light beam through the light-transmitting area during the first exposure time period and blocks at least part of the light beam through the light-blocking area during the second exposure time period.

[0230] During the second exposure time period, the orthographic projection of the image sensor onto the light-blocking disc overlaps with the non-transparent area, and the size of the overlapping area increases during the second exposure time period. The aforementioned light beam is a beam transmitted through the lens, and the light beams transmitted through the transparent area during the first and second exposure time periods are used by the image sensor to generate the target image.

[0231] In one possible implementation, the control device further includes:

[0232] The first acquisition module is used to acquire a first image, which is an image generated by the image sensor before the target image;

[0233] The first determining module is used to determine the brightness of the target region in the first image, the first image also includes a non-target region, and the brightness of the target region is greater than the brightness of the non-target region;

[0234] The speed control module is used to control the movement speed of the shielding disc based on the brightness of the target area.

[0235] In one possible implementation, the optical disc is circular, and the aforementioned movement is rotation.

[0236] The speed control module is specifically used for:

[0237] If the brightness of the target area meets the exposure reduction condition, reduce the linear velocity of the masking disc relative to the image sensor during rotation, and / or keep the linear velocity constant and delay the exposure start time of the image sensor.

[0238] In one possible implementation, the exposure reduction condition includes: the brightness of the target area is higher than a first brightness threshold.

[0239] In one possible implementation, the speed control module is specifically used for:

[0240] Reduce the angular velocity of the light-blocking disc to reduce its linear velocity; or,

[0241] Reduce the distance between the optical disc and the image sensor to decrease the linear velocity.

[0242] In one possible implementation, the optical disc is a circular structure and its movement is rotation.

[0243] The speed control module is specifically used for:

[0244] If the brightness of the target area meets the conditions for increasing exposure, increase the linear velocity of the masking disc relative to the image sensor during rotation, and / or keep the linear velocity constant and advance the exposure start time of the image sensor.

[0245] In one possible implementation, the conditions for increasing exposure include: the brightness of the target area is not higher than a second brightness threshold.

[0246] In one possible implementation, the speed control module is specifically used for:

[0247] Increase the angular velocity of the optical disc to increase its linear velocity; or,

[0248] Increase the distance between the optical disc and the image sensor to improve the linear speed.

[0249] In one possible implementation, the aforementioned linear velocity and / or exposure start time are adjusted according to the exposure adjustment ratio;

[0250] The control device also includes:

[0251] The second determining module is used to determine the exposure adjustment ratio based on the brightness of the target area and the reference brightness.

[0252] In one possible implementation, the reference brightness is the average brightness of the first image; or, the reference brightness is the brightness of the non-target area.

[0253] In one possible implementation, the control device further includes:

[0254] The second acquisition module is used to acquire at least one second image, which is an image generated by the image sensor before the first image;

[0255] A brightness analysis module is used to perform brightness analysis on at least one second image and obtain brightness analysis results.

[0256] The third determining module is used to determine the target region in the first image based on the brightness analysis result.

[0257] In one possible implementation, the light-blocking disc has a circular structure, the aforementioned movement is rotation, and the image sensor includes a first photosensitive area and a second photosensitive area. The first photosensitive area corresponds to the target area in the target image, and the second photosensitive area corresponds to the non-target area in the target image.

[0258] The control device also includes:

[0259] The orientation control module is used to control the rotation direction of the light-blocking disc so that the orthographic projection of the first photosensitive area on the light-blocking disc overlaps with the non-transparent area earlier than the orthographic projection of the second photosensitive area on the light-blocking disc during the second exposure time period.

[0260] In one possible implementation, the control device further includes:

[0261] The supplementary lighting control module is used to control the start time of the supplementary lighting device, which is synchronized with the exposure start time of the image sensor. The supplementary lighting device is used to provide supplementary lighting for the image sensor.

[0262] In one possible implementation, the camera module may also include the control device, or the control device may be a device other than the camera module.

[0263] In this embodiment, a light-blocking disc is provided in the camera module. By controlling the light-blocking disc to physically block the exposure of the image sensor, the exposure of the image sensor is reduced. Specifically, during the first exposure time period, the light-blocking disc does not block the light beam, ensuring the basic exposure of the image sensor. During the second exposure time period, the non-transparent area on the light-blocking disc blocks at least a portion of the image sensor, and the size of the blocked area increases with time. This reduces the brightness ratio between the initially blocked and subsequently blocked areas on the image sensor, thus narrowing the dynamic range of the image sensor. This results in differences in exposure across different areas of the target image, ensuring that details in each area within the shooting range can be clearly captured.

[0264] It should be noted that the control device provided in the above embodiments is only illustrated by the division of the above functional modules when performing camera control. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the control device provided in the above embodiments and the camera control method embodiments belong to the same concept, and the specific implementation process can be found in the method embodiments, which will not be repeated here.

[0265] This application embodiment also provides a camera method applied to a camera module, which includes a lens, a light-blocking disc, and an image sensor. The light-blocking disc is located on the light-emitting side of the lens, and the image sensor is located on the light-emitting side of the light-blocking disc. The light-blocking disc has a light-transmitting area and a non-light-transmitting area. The camera module can be any of the camera modules described in the above embodiments. The method includes:

[0266] The lens transmits a light beam; the light-blocking disc transmits the light beam through the light-transmitting area during the first exposure time period, and blocks at least part of the light beam through the light-blocking area during the second exposure time period; wherein, during the second exposure time period, the orthographic projection of the image sensor on the light-blocking disc overlaps with the light-blocking area, and the size of the overlapping area increases during the second exposure time period; the image sensor generates a target image based on the light beam transmitted through the light-transmitting area during the first and second exposure time periods.

[0267] It should be noted that the control method provided in the above embodiments belongs to the same concept as the camera module and camera control method embodiments. For details of its specific implementation process, please refer to the method embodiments, which will not be repeated here.

[0268] This application also provides a computer-readable storage medium storing instructions that, when executed on a computer, cause the computer to perform the steps of the camera control method shown in the above-described method embodiments.

[0269] This application also provides a computer program product containing instructions that, when run on a computer, causes the computer to perform the steps of the camera control method shown in the above-described method embodiments. Alternatively, this application also provides a computer program that, when run on a computer, causes the computer to perform the steps of the camera control method shown in the above-described method embodiments.

[0270] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium accessible to a computer, or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., digital versatile disc (DVD)), or a semiconductor medium (e.g., solid state disk (SSD)). It is worth noting that the computer-readable storage medium mentioned in the embodiments of this application can be a non-volatile storage medium; in other words, it can be a non-transient storage medium.

[0271] It should be understood that "at least one" as mentioned herein refers to one or more, and "multiple" refers to two or more. In the description of the embodiments of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B; "and / or" in this document is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. In addition, in order to clearly describe the technical solutions of the embodiments of this application, the terms "first," "second," etc., are used in the embodiments of this application to distinguish identical or similar items with substantially the same function and effect. Those skilled in the art will understand that the terms "first," "second," etc., do not limit the quantity or execution order, and the terms "first," "second," etc., are not necessarily different.

[0272] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.), and signals involved in the embodiments of this application are all authorized by the user or fully authorized by all parties, and the collection, use, and processing of related data must comply with the relevant laws, regulations, and standards of the relevant countries and regions. For example, the images involved in the embodiments of this application were all obtained under full authorization.

[0273] The above descriptions are embodiments provided in this application and are not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. A camera module, characterized in that, The camera module includes a lens, a light-blocking disc, and an image sensor. The light-blocking disc is located on the light-emitting side of the lens, and the image sensor is located on the light-emitting side of the light-blocking disc. The light-blocking disc has a light-transmitting area and a non-light-transmitting area. The lens is used to transmit light beams; The light-blocking disc is used to transmit the light beam through the light-transmitting area during a first exposure time period, and to block at least part of the light beam through the non-light-transmitting area during a second exposure time period; wherein, during the second exposure time period, the orthographic projection of the image sensor on the light-blocking disc overlaps with the non-light-transmitting area, and the size of the overlapping area increases during the second exposure time period. The image sensor is used to generate a target image based on the light beam transmitted through the light-transmitting area during the first exposure time period and the second exposure time period.

2. The camera module as described in claim 1, characterized in that, During the first exposure time period, the orthographic projection of the image sensor on the light-transmitting disc is located within the light-transmitting area; During the second exposure time period, the orthographic projection of the image sensor onto the light-transmitting area overlaps with both the light-transmitting area and the non-light-transmitting area.

3. The camera module as described in claim 1 or 2, characterized in that, The image sensor includes a first photosensitive area and a second photosensitive area. The first photosensitive area corresponds to a target area in the target image, and the second photosensitive area corresponds to a non-target area in the target image. The brightness of the target area is greater than the brightness of the non-target area. The second exposure time period includes a first time period and a second time period, wherein the first time period is located before the second time period; During the first time period, the orthographic projection of the first photosensitive area on the optical disc overlaps with both the light-transmitting area and the non-light-transmitting area, and the orthographic projection of the second photosensitive area on the optical disc is located within the light-transmitting area. During the second time period, the orthographic projection of the first photosensitive area on the light-blocking disc is located within the non-transparent area, and the orthographic projection of the second photosensitive area on the light-blocking disc overlaps with both the transparent area and the non-transparent area.

4. The camera module as described in claim 1 or 2, characterized in that, The image sensor includes a first photosensitive area and a second photosensitive area. The first photosensitive area corresponds to a target area in the target image, and the second photosensitive area corresponds to a non-target area in the target image. The brightness of the target area is greater than the brightness of the non-target area. The second exposure time period includes a first time period, a second time period, and a third time period, wherein the first time period is before the second time period, and the second time period is before the third time period; During the first time period, the second time period, and the third time period, the orthogonal projection of the first photosensitive area on the optical shield overlaps with both the light-transmitting area and the non-light-transmitting area. During the first time period, the orthogonal projection of the second photosensitive area onto the optical shielding disc lies within the light-transmitting area; During the second time period, the orthographic projection of the second photosensitive area on the optical shield overlaps with both the light-transmitting area and the non-light-transmitting area. During the third time period, the orthographic projection of the second photosensitive area onto the optical disc lies within the non-transparent area.

5. The camera module as described in any one of claims 1-4, characterized in that, The optical disc is a color wheel, which has a first region and a second region. The first region includes a first filter, and the second region includes a second filter. The first filter is used to filter light with wavelengths outside the light-sensing range of the image sensor, and the second filter is used to filter light with wavelengths within the light-sensing range. The first region is the light-transmitting region, and the second region is the light-blocking region; or... The light-blocking disc is made of a non-transparent material and has a physical notch. The area where the physical notch is located is the light-transparent area, and the area outside the physical notch is the non-transparent area.

6. The camera module as described in any one of claims 1-5, characterized in that, The optical disc is circular, and both the light-transmitting area and the non-light-transmitting area are fan-shaped.

7. The camera module as described in any one of claims 1-6, characterized in that, The image sensor includes multiple rows of photosensitive elements, all of which have the same exposure start time.

8. The camera module as described in claim 7, characterized in that, The shutter of the image sensor is a rolling shutter; or, the shutter of the image sensor is a global shutter.

9. A camera control method, characterized in that, The camera module includes a lens, a light-emitting disc, and an image sensor. The light-emitting disc is located on the light-emitting side of the lens, and the image sensor is located on the light-emitting side of the light-emitting disc. The light-emitting disc has a light-transmitting area and a light-blocking area. The method includes: The optical blocking disc is controlled to move so that it transmits a light beam through the light-transmitting area during a first exposure time period and blocks at least part of the light beam through the non-light-transmitting area during a second exposure time period. During the second exposure time period, the orthographic projection of the image sensor onto the light-blocking disc overlaps with the non-transparent area, and the size of the overlapping area increases during the second exposure time period; the light beam is the light beam transmitted by the lens, and the light beam transmitted through the transparent area during the first and second exposure time periods is used by the image sensor to generate the target image.

10. The method as described in claim 9, characterized in that, The method further includes: Acquire a first image, which is an image generated by the image sensor prior to the target image; The brightness of a target region in the first image is determined, and the first image also includes a non-target region, wherein the brightness of the target region is greater than the brightness of the non-target region; The movement speed of the shielding disc is controlled based on the brightness of the target area.

11. The method as described in claim 10, characterized in that, The optical disc is circular in shape, and the motion is rotation. Controlling the movement speed of the optical disc based on the brightness of the target area includes: If the brightness of the target area meets the exposure reduction condition, reduce the linear velocity of the shielding disc relative to the image sensor during rotation, and / or keep the linear velocity constant and delay the exposure start time of the image sensor.

12. The method as described in claim 11, characterized in that, The conditions for reducing exposure include: the brightness of the target area is higher than a first brightness threshold.

13. The method as described in claim 11 or 12, characterized in that, Reducing the linear velocity of the optical disc relative to the image sensor during rotation includes: Reduce the angular velocity of the optical disc to reduce the linear velocity; or, The distance between the optical mask and the image sensor is reduced to decrease the linear velocity.

14. The method as described in claim 10, characterized in that, The optical disc is circular in shape, and the motion is rotation. Controlling the movement speed of the optical disc based on the brightness of the target area includes: If the brightness of the target area meets the conditions for increasing exposure, increase the linear velocity of the shielding disc relative to the image sensor during rotation, and / or keep the linear velocity constant and advance the exposure start time of the image sensor.

15. The method as described in claim 14, characterized in that, The conditions for increasing exposure include: the brightness of the target area is not higher than the second brightness threshold.

16. The method as described in claim 14 or 15, characterized in that, Increasing the linear velocity of the optical disc relative to the image sensor during rotation includes: Increase the angular velocity of the optical disc to increase the linear velocity; or, Increasing the distance between the optical disc and the image sensor improves the linear velocity.

17. The method according to any one of claims 11-16, characterized in that, The linear velocity and / or the exposure start time are adjusted according to the exposure adjustment ratio; After determining the brightness of the target region in the first image, the method further includes: The exposure adjustment ratio is determined based on the brightness of the target area and the reference brightness.

18. The method as described in claim 17, characterized in that, The reference brightness is the average brightness of the first image; or, the reference brightness is the brightness of the non-target area.

19. The method according to any one of claims 10-18, characterized in that, Before determining the brightness of the target region in the first image, the method further includes: Acquire at least one second image, wherein the at least one second image is an image generated by the image sensor prior to the first image; Brightness analysis is performed on the at least one second image to obtain brightness analysis results; The target region in the first image is determined based on the brightness analysis results.

20. The method according to any one of claims 10-19, characterized in that, The shielding disc has a circular structure, the movement is rotation, and the image sensor includes a first photosensitive area and a second photosensitive area. The first photosensitive area corresponds to the target area in the target image, and the second photosensitive area corresponds to the non-target area in the target image. The method further includes: The rotation direction of the light-blocking disc is controlled so that the orthographic projection of the first photosensitive area on the light-blocking disc during the second exposure time period overlaps with the non-transparent area earlier than the orthographic projection of the second photosensitive area on the light-blocking disc.

21. The method according to any one of claims 9-10, characterized in that, The method further includes: The supplementary lighting device is controlled to start its supplementary lighting time, which is synchronized with the exposure start time of the image sensor. The supplementary lighting device is used to provide supplementary lighting for the image sensor.

22. The method according to any one of claims 9-21, characterized in that, The method is applied to a control device, the camera module further includes the control device, or the control device is a device other than the camera module.

23. A camera recording method, characterized in that, The camera module includes a lens, a light-emitting disc, and an image sensor. The light-emitting disc is located on the light-emitting side of the lens, and the image sensor is located on the light-emitting side of the light-emitting disc. The light-emitting disc has a light-transmitting area and a light-blocking area. The method includes: The lens transmits a beam of light; The light-blocking disc transmits the light beam through the light-transmitting area during the first exposure time period, and blocks at least part of the light beam through the non-light-transmitting area during the second exposure time period; wherein, during the second exposure time period, the orthographic projection of the image sensor on the light-blocking disc overlaps with the non-light-transmitting area, and the size of the overlapping area increases during the second exposure time period. The image sensor generates a target image based on the light beams transmitted through the light-transmitting area during the first exposure time period and the second exposure time period.

24. A control device, characterized in that, The camera module includes a lens, a light-emitting disc, and an image sensor. The light-emitting disc is located on the light-emitting side of the lens, and the image sensor is located on the light-emitting side of the light-emitting disc. The light-emitting disc has a light-transmitting area and a light-blocking area. The device includes: The control module is used to control the movement of the light-blocking disc so that the light-blocking disc transmits the light beam through the light-transmitting area during the first exposure time period, and blocks at least part of the light beam through the non-light-transmitting area during the second exposure time period. During the second exposure time period, the orthographic projection of the image sensor onto the light-blocking disc overlaps with the non-transparent area, and the size of the overlapping area increases during the second exposure time period; the light beam is the light beam transmitted by the lens, and the light beam transmitted through the transparent area during the first and second exposure time periods is used by the image sensor to generate the target image.

25. A control device, characterized in that, The control device includes a processor and a memory; The memory is used to store computer programs; The processor is configured to execute the computer program to implement the method according to any one of claims 9-22.

26. A computer-readable storage medium, characterized in that, The storage medium stores a computer program, which, when executed by a processor, implements the method described in any one of claims 9-22.

27. A computer program product, characterized in that, The computer program product stores computer instructions, which, when executed by a processor, implement the method described in any one of claims 9-22.

Images