Underwater shooting method and device and electronic equipment
By adjusting the fill light parameters of the LED module according to the underwater environment information when shooting underwater cameras on the electronic device, the problems of insufficient light and color distortion in underwater shooting are solved, and the effect of improving the quality of images or videos is achieved.
Patent Information
- Application Number
- CN202411741318.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-29
- Publication Date
- 2025-03-04
AI Technical Summary
During underwater shooting, due to the absorption and scattering of light when propagating, the image color distortion and the signal-to-noise ratio will deteriorate, thereby reducing the quality of the image or video.
When shooting underwater on the camera of an electronic device, the fill light parameters of the LED module are determined based on the underwater environment information, and the LED module is controlled to fill light to simulate the light source effect of the water environment.
By matching the fill light source, the light energy loss can be effectively compensated, the quality of images or videos taken underwater can be improved, and the effect of shooting on water can be brought close to that of shooting on water.
Smart Images

Figure CN119562157A_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the field of photography technology, and specifically relates to an underwater shooting method, device and electronic equipment. Background Art
[0002] In recent years, camera compact modules (CCM) have become standard modules for electronic devices such as smartphones and tablets, and are important tools for obtaining visual information and creating art. Thanks to the computing power advantages of electronic devices, users' demand for electronic device images continues to increase, especially for more professional scenes such as starry sky photography and underwater photography.
[0003] Underwater photography is an important tool for artistic creation, underwater scientific research and other work, and is also an important selling point to attract consumers. At present, during underwater photography, due to the weak light underwater, electronic equipment needs to be operated under specific natural conditions, such as sunny noon, or with the help of auxiliary light sources such as flash, to ensure that the color of the captured image can be correctly restored.
[0004] However, when light propagates in water, the water medium and particles in the water will absorb and scatter the light, causing light of different wavelengths to be absorbed unevenly, resulting in color distortion of underwater images; at the same time, light energy loss and scattering will also cause the image signal-to-noise ratio to deteriorate. As a result, the quality of images or videos taken underwater by electronic devices is poor. Summary of the invention
[0005] The purpose of the embodiments of the present application is to provide an underwater shooting method, device and electronic equipment, which can improve the quality of images or videos obtained by underwater shooting of the electronic equipment.
[0006] In a first aspect, an embodiment of the present application provides an underwater shooting method, which is performed by an electronic device, wherein the electronic device includes a light-emitting diode (LED) module and a camera; the underwater shooting method includes: during the process of underwater shooting of images or videos by the camera, determining fill light parameters according to underwater environmental information; and controlling the LED module to perform fill light according to the fill light parameters.
[0007] In the second aspect, an embodiment of the present application provides an underwater shooting device, which is executed by an electronic device, and the electronic device includes an LED module and a camera; the underwater shooting device also includes: a determination module, which is used to determine the fill light parameters according to the underwater environment information during the process of underwater shooting of images or videos by the camera; and a control module, which is used to control the LED module to perform fill light according to the fill light parameters determined by the determination module.
[0008] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.
[0009] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.
[0010] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.
[0011] In an embodiment of the present application, during the process of an electronic device shooting an image or video underwater through a camera, fill light parameters of an LED module included in the electronic device are determined based on underwater environmental information, thereby controlling the LED module to perform fill light according to the fill light parameters. In this solution, since the electronic device determines the fill light parameters based on the acquired underwater environmental information to control the LED module to perform fill light for the environment during underwater shooting, the fill light source provided by the electronic device matches the environment during underwater shooting, so that the fill light source provided by the LED module can compensate for the light energy loss caused by the propagation of light in the water, thereby achieving a light source effect that simulates the water environment in the environment during underwater shooting, thereby improving the quality of images or videos obtained by underwater shooting of the electronic device. BRIEF DESCRIPTION OF THE DRAWINGS
[0012] Figure 1 is a flow chart of an underwater shooting method provided by some embodiments of the present application;
[0013] Figure 2A is a schematic diagram of an example of the arrangement position of the LED modules provided in some embodiments of the present application;
[0014] Figure 2B is a schematic diagram of an example structure of an LED module provided in some embodiments of the present application;
[0015] Figure 3A is a schematic diagram of an example of a shooting preview interface of a photo mode provided by some embodiments of the present application;
[0016] Figure 3B is a schematic diagram of an example of a shooting preview interface of an underwater shooting mode provided by some embodiments of the present application;
[0017] Figure 4Ais a schematic diagram of an example of a shooting preview interface of a photo mode provided by some embodiments of the present application;
[0018] Figure 4B is a schematic diagram of an example of a shooting preview interface of an underwater shooting mode provided by some embodiments of the present application;
[0019] Figure 5A is a schematic diagram of an example structure of an LED module provided by some embodiments of the present application;
[0020] Figure 5B is a schematic diagram of an example structure of an LED module provided by some embodiments of the present application;
[0021] Figure 5C is a schematic diagram of an example structure of an LED module provided by some embodiments of the present application;
[0022] Figure 6 is a flow chart of an underwater shooting method provided by some embodiments of the present application;
[0023] Fig. 7A is a schematic diagram of a light source control principle of an LED module provided in some embodiments of the present application;
[0024] Figure 7B is a schematic diagram of a light source control principle of an LED module provided in some embodiments of the present application;
[0025] Figure 8 is a flow chart of an underwater shooting method provided by some embodiments of the present application;
[0026] Fig. 9 is a flow chart of an underwater shooting method provided by some embodiments of the present application;
[0027] Fig.10 is a flow chart of an underwater shooting method provided by some embodiments of the present application;
[0028] Fig.11A Schematic diagram of an example of triggering an electronic device to display an adjustment control provided by some embodiments of the present application;
[0029] Fig. 11B Schematic diagram of an example of triggering an electronic device to display an adjustment control provided by some embodiments of the present application;
[0030] Fig. 12A Schematic diagram of an example of an adjustment control for display fill light parameters provided by some embodiments of the present application;
[0031] Fig. 12B Some embodiments of the present application provide a schematic diagram of an example of an adjustment control for displaying fill light parameters;
[0032] Fig.13A Some embodiments of the present application provide a schematic diagram of an example of manually adjusting the fill light parameters of an LED module;
[0033] Fig. 13B Some embodiments of the present application provide a schematic diagram of an example of manually adjusting the fill light parameters of an LED module;
[0034] Fig.14 is a schematic structural diagram of an underwater shooting device provided by some embodiments of the present application;
[0035] Fig.15 It is one of the hardware structure diagrams of an electronic device provided in some embodiments of the present application;
[0036] Fig.16 This is the second hardware structure diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0037] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.
[0038] The terms "first", "second", etc. in the specification of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are usually a class, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.
[0039] The terms "at least one (item)", "at least one of" and the like in the specification of this application refer to any one, any two or a combination of more than two of the objects contained therein. For example, at least one (item) of a, b, and c can be represented by: "a", "b", "c", "a and b", "a and c", "b and c" and "a, b and c", where a, b, c can be single or multiple. Similarly, "at least two (items)" refers to two or more, and its meaning is similar to that of "at least one (item)". The logo in this application is text, symbol, image, etc. used to indicate information, and controls or other containers can be used as carriers for displaying information, including but not limited to text logos, symbol logos, and image logos.
[0040] The following is an explanation of the professional terms involved in the embodiments of the present application:
[0041] Controls are elements in a graphical user interface that receive user input to perform corresponding processing or display related data. Controls may include but are not limited to virtual buttons, sliders, progress bars, and check boxes.
[0042] Light intensity, or illuminance for short, refers to the luminous flux of visible light received per unit area. It is a quantity used to indicate the intensity of light and the degree of illumination of the surface area of an object. The unit is usually lux (Lux or lx), where 1 lux is equal to the illuminance generated by 1 lumen of luminous flux uniformly irradiated on an area of 1 square meter.
[0043] CCM is an important tool for obtaining visual information, and is usually composed of a lens, an infrared cut filter, an image sensor, and a voice coil motor (VCM).
[0044] Among them, the image sensor is the core device of CCM. There are two types of mainstream image sensors: one is the charge-coupled device (CCD) element; the other is the complementary metal-oxide-semiconductor (CMOS) device. Similar to the film of a traditional camera, the core function of the image sensor is to sense light, that is, to convert the detected light signal into a digital signal that is easy to transmit and process.
[0045] The most widely used sensor in the industry is the CMOS Image Sensor (CIS). Compared with CCD devices, CMOS has lower cost and power consumption, and more flexible reading methods, and its market share is increasing year by year. The working mechanism of CIS is as follows: through the array of photosensitive diodes (pixels), light signals are sensed and converted into electrical signals, and then through the amplification circuit and analog-to-digital conversion (ADC) circuit, a digital signal matrix, i.e., an image, is formed, and then processed by the image signal processing (ISP) module, and finally the display screen is driven to present the image information to the human eye.
[0046] Among them, the role of the ISP module is to obtain the image preferred by the human eye. Due to the structural differences between CCM and the human eye, the sensor photosensitive signal, that is, the RAW image, needs to pass through a series of ISP modules such as the demosaic ISP module, the white balance (WB) ISP module, the color correction (CC) ISP module, and the gamma conversion ISP module to form the image preferred by the human eye. Since the human eye's perception of color is different from that of CIS, the image needs to be processed for white balance and color correction. Among them, the coefficients of WB and CC are related to the ambient spectral information and the photosensitivity characteristics of CIS.
[0047] In recent years, CCM has become a standard module for mobile phones, tablet computers and other terminal devices, and is an important tool for obtaining visual information and creating art. At the same time, thanks to the portability and computing power advantages of mobile phones and other electronic devices, consumers' demand for mobile phone imaging continues to increase. Therefore, imaging solutions have become the core competitiveness of smartphones of various brands.
[0048] On the other hand, users' expectations for images taken by electronic devices are also increasing, especially for more professional scenes such as starry sky photography and underwater photography. Among them, underwater photography is an important tool for artistic creation, underwater scientific research and other work, and it is also an important selling point to attract consumers.
[0049] However, when light propagates in water, the water medium and particles in the water will absorb and scatter the light, causing light of different wavelengths to be absorbed unevenly, resulting in color distortion of underwater images. At the same time, light energy loss and scattering will also cause the image signal-to-noise ratio to deteriorate. Therefore, defects such as blurred images, low contrast, and uneven colors have become urgent problems to be solved in the field of underwater photography. Furthermore, the image quality obtained by electronic equipment underwater is poor.
[0050] The underwater shooting method provided by the embodiment of the present application is described in detail below through specific embodiments and their application scenarios in conjunction with the accompanying drawings.
[0051] The underwater shooting method provided in the embodiment of the present application can be applied to the scenario where the user shoots underwater through an electronic device.
[0052] Scenario 1: When user 1 is diving, if user 1 wants to take a picture of coral, user 1 can find the coral and then take a picture of the coral using the camera of the electronic device to obtain the coral image. However, due to the weak light in the underwater environment, the color of the coral image taken by user 1 may be distorted, which makes it difficult for user 1 to take the desired image.
[0053] Scenario 2: When user 1 is diving, if user 1 wants to take a video of a school of fish, user 1 can find the school of fish and then use the camera of the electronic device to take the video of the school of fish. However, due to the weak light in the underwater environment, the color of the video of the school of fish taken by user 1 may be distorted, making it difficult for user 1 to take the desired video.
[0054] In the underwater shooting method, device and electronic device provided in the embodiments of the present application, in the process of the electronic device shooting images or videos underwater through the camera, the fill light parameters of the LED module included in the electronic device are determined according to the underwater environment information, so as to control the LED module to perform fill light according to the fill light parameters. In this solution, since the electronic device determines the fill light parameters based on the acquired underwater environment information to control the LED module to perform fill light for the environment during underwater shooting, the fill light source provided by the electronic device is matched with the environment during underwater shooting, so that the light energy loss caused by the propagation of light in the water can be compensated by the fill light source provided by the LED module, so as to achieve the light source effect of simulating the water environment in the environment during underwater shooting, so that the quality of the image or video obtained by the underwater shooting of the electronic device can be improved.
[0055] The underwater shooting method provided in the embodiment of the present application is performed by an underwater shooting device, which can be an electronic device, or a functional module or entity in an electronic device, and the embodiment of the present application does not limit this. The underwater shooting method provided in the embodiment of the present application will be exemplarily described below using an electronic device as an example.
[0056] The present application provides an underwater shooting method. Figure 1 FIG. 1 is a flow chart of an underwater shooting method provided by an embodiment of the present application. Figure 1 As shown, the underwater shooting method provided in the embodiment of the present application may include the following steps 201 to 202.
[0057] Step 201: When an electronic device is shooting an image or video underwater, the electronic device determines fill light parameters according to underwater environment information.
[0058] In some embodiments of the present application, an electronic device includes an LED module and a camera.
[0059] In some embodiments of the present application, the shape, size and distance between the above-mentioned LED module and the CCM can be designed according to factors such as actual stacking space, production cost, LED divergence angle, etc., and the present application does not limit this.
[0060] In some embodiments of the present application, the LED module may include: m×n LED light sources, wherein each LED light source includes three sub-light sources of different colors: red, green, and blue, wherein m and n are positive integers.
[0061] For example, the electronic device is a mobile phone. Figure 2A As shown, the mobile phone can set an LED module 11 in the area on the right side of the rear CCM 10, and the LED module 11 includes 3×3 LED light sources, such as Figure 2B As shown, the nine LED light sources included in the LED module 11 may be LED light sources 121 to 129, wherein each LED light source includes a red (R) LED sub-light source, a green (G) LED sub-light source, and a blue (B) LED sub-light source.
[0062] In some embodiments of the present application, each color LED sub-light source may have an independent current driving circuit, so that the electronic device may control the display parameters of each color LED sub-light source separately by adjusting the output power of each color light.
[0063] In some embodiments of the present application, the above-mentioned cameras may include but are not limited to at least one of the following: a main camera, a telephoto camera, a wide-angle camera, a macro camera and a depth of field camera.
[0064] In some embodiments of the present application, the underwater environment information is used to characterize the underwater environment in which the electronic device is located during underwater photography.
[0065] In some embodiments of the present application, the underwater environment information may include but is not limited to at least one of the following: illumination information of the underwater environment, light brightness information of the underwater environment, and spectrum information of the underwater environment.
[0066] It should be noted that the illumination information of the underwater environment can be understood as: the luminous flux of sunlight received per unit area in the underwater environment;
[0067] The light brightness information of the underwater environment can be understood as: the intensity or brightness of sunlight when it propagates underwater;
[0068] The spectral information of the underwater environment can be understood as the distribution of light of different wavelengths when sunlight propagates to the underwater environment. Among them, light of different wavelengths can be dispersed and split by passing through a dispersion system, such as a prism, a grating, etc. The dispersed monochromatic light is arranged in order according to the wavelength or frequency to present information.
[0069] For example, the electronic device can use a spectrometer to cause light of different wavelengths to refract or diffract to different degrees, thereby separating them in order of wavelength in space or on a detector. The electronic device can then detect and record the light intensity at each wavelength position through the detector to ultimately obtain a spectral curve.
[0070] It should be noted that the above-mentioned sunlight may include light of multiple wavelengths, and light of different wavelengths corresponds to different light colors. For example, the color of light with a wavelength of 610-730nm is red, the color of light with a wavelength of 500nm-570nm is green, and the color of light with a wavelength of 450-480nm is blue.
[0071] In some embodiments of the present application, when the electronic device displays a shooting preview interface, the electronic device may display a control for triggering the start of acquiring underwater environmental information, for example, an "underwater shooting mode" control. Then, after the electronic device receives a click input from the user on the control, it may start acquiring environmental information of the underwater environment in response to the click input.
[0072] In some embodiments of the present application, the user can start the camera application of the electronic device before entering the water, or start the camera application of the electronic device when taking pictures after entering the water. Then, the user can trigger the electronic device to enter the underwater shooting mode through input and start acquiring environmental information of the underwater environment.
[0073] Example 1, combined with scenario 1, if user 1 wants to take a picture of coral while diving, user 1 can click the "Camera" application icon in the mobile phone before entering the water to control the mobile phone to display the shooting preview interface. Then, when user 1 is in an underwater environment, Figure 3A As shown, the mobile phone can display a shooting preview interface 20 of the "photographing" mode, and the shooting preview interface 20 can display a shooting control 21, and can also display a control of the "video recording" mode and a control of the "underwater shooting mode" 22. The user 1 can click the control 22 of the "underwater shooting mode" to trigger the mobile phone to switch the shooting mode from the conventional "photographing" mode to the "underwater shooting mode", and Figure 3B As shown, a shooting preview interface 23 of the "underwater shooting mode" is displayed, and the mobile phone can start to obtain underwater environment information. In addition, a "light source control" adjustment mark 24 can be displayed in the shooting preview interface 23 of the "underwater shooting mode", and the "light source control" adjustment mark 24 can be used to adjust the fill light parameters of the fill light source that can be provided by the LED module of the mobile phone.
[0074] Example 2: In combination with scenario 2, if user 1 wants to take a video of a school of fish while diving, user 1 can click the "Camera" application icon on the phone after entering the water to control the phone to display the following video: Figure 4A The shooting preview interface 30 of the "photographing" mode is shown, and the shooting preview interface 30 may display a shooting control 31, and may also display a control of the "video recording" mode and a control of the "underwater shooting mode" 32. The user 1 can click the control 32 of the "underwater shooting mode" to trigger the mobile phone to switch the shooting mode from the conventional "photographing" mode to the "underwater shooting mode", and Figure 4B As shown, a shooting preview interface 33 of the "underwater shooting mode" is displayed, and the mobile phone can start to obtain underwater environment information. In addition, a "light source control" adjustment mark 34 can be displayed in the shooting preview interface 33 of the "underwater shooting mode", and the "light source control" adjustment mark 34 can be used to adjust the fill light parameters of the fill light source that can be provided by the LED module of the mobile phone.
[0075] In some embodiments of the present application, when the electronic device determines that the current environment is an underwater environment, the electronic device can automatically switch the shooting mode to the underwater shooting mode and obtain underwater environment information of the current underwater environment.
[0076] In some embodiments of the present application, the method for the electronic device to determine that the current environment is an underwater environment may include but is not limited to any of the following:
[0077] Method 1: When the electronic device displays a shooting preview interface and the electronic device detects that the image content displayed in the shooting preview interface includes underwater creatures, such as marine fish, corals, seaweed, etc., the electronic device can determine that the current environment is an underwater environment.
[0078] Method 2: Since the humidity of the underwater environment is different from that of the above-water environment, the electronic device can detect the ambient humidity of the current environment of the electronic device through a humidity sensor. If the detected ambient humidity reaches the humidity value range of the underwater environment, such as the ambient humidity is 100%, the electronic device can determine that the current environment is an underwater environment.
[0079] Method three, the electronic device can detect the pressure value received by the screen. If the electronic device detects that most of the touch areas in the screen of the electronic device receive the same or similar pressure value, it can be considered that the entire screen of the electronic device is squeezed by the external environment, and the electronic device can determine that the current environment is an underwater environment. For example, if the electronic device detects that 90% of the touch areas in the screen receive the same pressure value, or detects that the difference in pressure values received by 90% of the touch areas in the screen is less than 5, the electronic device can determine that the current environment is an underwater environment.
[0080] In this way, the electronic device can judge the current environment, and when it determines that the environment is an underwater environment, it automatically starts to obtain underwater environmental information of the current underwater environment, thereby reducing the manual operations that need to be performed by the user during underwater shooting, and improving the convenience of underwater shooting of electronic devices.
[0081] In some embodiments of the present application, the above-mentioned fill light parameters are light source parameters corresponding to the light source that needs to be supplemented in the underwater environment.
[0082] In some embodiments of the present application, the above-mentioned fill light parameters may include but are not limited to at least one of the following: luminous flux, illumination, brightness, color temperature, color rendering, and spectral information.
[0083] It should be noted that the above luminous flux can be understood as the luminous flux of the LED light source corresponding to the above fill light parameters, that is, the sum of the visible light emitted per second;
[0084] The above illumination can be understood as the intensity of the LED light source corresponding to the above fill light parameters and the amount of illumination on the surface area of the underwater object;
[0085] The above brightness can be understood as the luminous flux of the LED light source corresponding to the above fill light parameters per unit solid angle per unit area in a specific direction;
[0086] The above color temperature can be understood as an indicator to measure the color of the LED light source corresponding to the fill light parameters. A high color temperature means more blue light and less red light; a low color temperature means less blue light and more red light.
[0087] The above color rendering can be understood as a measure of the degree to which the LED light source corresponding to the fill light parameters presents the color of the object itself;
[0088] The above spectral information can be understood as a combination of multi-channel color lights of the light source corresponding to the fill light parameters.
[0089] In some embodiments of the present application, when the environmental information includes underwater illumination information, the electronic device can reversely determine the parameters of the light source that needs to be supplemented in the underwater environment according to the value of the underwater illumination information, thereby determining the fill light parameter. It can be understood that the fill light parameter is inversely proportional to the underwater illumination information.
[0090] In this way, the electronic device can determine the fill light parameters more conveniently based on the underwater environment information, thereby reducing the steps required for the electronic device to determine the fill light parameters and improving the convenience of determining the fill light parameters.
[0091] In some embodiments of the present application, the electronic device further includes a pressure sensor; the underwater environment information includes underwater illumination information of sunlight in the underwater environment. Exemplarily, before the step 201 of "determining fill light parameters according to the underwater environment information", the underwater shooting method provided in the embodiment of the present application further includes the following steps 301 to 303.
[0092] Step 301: The electronic device obtains a water pressure value of the electronic device through a pressure sensor.
[0093] It should be noted that the water pressure value obtained by the electronic device through the pressure sensor when the electronic device is shooting underwater may be: the pressure generated by the weight of the water above the position when shooting underwater.
[0094] In some embodiments of the present application, the water pressure value may be expressed in units of absolute atmospheric pressure, wherein the pressure expressed in units of absolute atmospheric pressure includes: the water pressure value provided by the weight of water and the atmospheric pressure value on the water surface.
[0095] It should be noted that, for every 10-meter increase in depth in an underwater environment, the water pressure value provided by the weight of the water can increase by 1 atmosphere; the above-mentioned water surface atmospheric pressure value can be 1 atmosphere.
[0096] For example, when the vertical distance between the electronic device and the water surface in an underwater environment reaches 10 meters, the water pressure value detected by the pressure sensor may be 2 absolute atmospheres, or twice the atmospheric pressure on the water surface. When the vertical distance between the electronic device and the water surface in an underwater environment reaches 20 meters, the water pressure value detected by the pressure sensor may be 3 absolute atmospheres, or three times the atmospheric pressure on the water surface.
[0097] In some embodiments of the present application, the pressure sensor may be integrated into a housing of an electronic device or inside the electronic device.
[0098] In some embodiments of the present application, when a pressure sensor is integrated inside an electronic device, the pressure sensor may be located close to the housing of the electronic device, or directly connected to the housing of the electronic device, or indirectly connected to the housing of the electronic device through other devices.
[0099] In some embodiments of the present application, the pressure sensor may be located at a position on the electronic device that is not easily accessible to a user.
[0100] Exemplarily, taking a mobile phone as an example, the area where the pressure sensor is located may include but is not limited to any of the following: the area above the volume button or the power button on the side of the mobile phone perpendicular to the screen, the top area of the mobile phone perpendicular to the screen, the bottom area of the mobile phone perpendicular to the screen, and the area corresponding to the upper half of the surface of the mobile phone parallel to the screen.
[0101] In this way, the influence of the pressure caused by the user holding the electronic device on the value detected by the pressure sensor can be reduced, so that the electronic device can more accurately obtain the water pressure value when shooting underwater.
[0102] In some embodiments of the present application, the electronic device may include at least one pressure sensor.
[0103] In some embodiments of the present application, when the electronic device includes multiple pressure sensors, the electronic device can perform numerical processing based on the pressure values respectively detected by the multiple sensors to obtain the water pressure value of the electronic device when shooting underwater.
[0104] Exemplarily, the above numerical processing may be that the electronic device obtains multiple pressure values based on multiple pressure sensors, removes abnormal values, and calculates the average value of the remaining pressure values to determine the water pressure value of the electronic device when shooting underwater.
[0105] In some embodiments of the present application, since the water pressure values detected by the pressure sensor may differ to a certain extent when the electronic device is in different water depths, the pressure sensor may continuously acquire the water pressure value to obtain an accurate water pressure value.
[0106] In this way, the pressure values provided by multiple pressure sensors can reduce the impact of pressure caused by user grip or other factors on the values detected by the pressure sensors, so that the electronic device can more accurately obtain the water pressure value in the underwater environment.
[0107] Step 302: The electronic device calculates the underwater depth value of the electronic device based on the water pressure value.
[0108] In some embodiments of the present application, the underwater depth value is the vertical distance of the position of the electronic device in the underwater environment relative to the water surface.
[0109] In some embodiments of the present application, the electronic device can calculate the underwater depth value based on the water pressure value using the following formula (1).
[0110] P=ρgh (1)
[0111] Among them, P is the water pressure value; ρ is the density of water. Usually under standard conditions, the density of water is about 1.0×10^3 kg / cubic meter; g is the acceleration of gravity, which is about 9.81 m / s on the surface of the earth; h is the underwater depth value.
[0112] It should be noted that the above formula (1) is more suitable for calculating the water pressure value of calm water, that is, the water pressure value without the influence of dynamic factors such as water flow or waves. Therefore, in the actual underwater shooting process, the water flow, waves or other dynamic factors in the underwater environment can be combined to obtain a more accurate underwater depth value.
[0113] It should be noted that information such as temperature and salinity in the underwater environment will affect the density of the water. For example, since the salinity of seawater is higher than that of freshwater in a lake, when other information in the underwater environment is the same, the density of seawater is higher than that of freshwater in a lake.
[0114] It should be noted that the density of seawater is about 1.02×10 3 -1.07×10 3 Kilograms / cubic meter.
[0115] Step 303: The electronic device calculates underwater illumination information based on the underwater depth value and the water surface illumination information.
[0116] In some embodiments of the present application, the above-mentioned water surface illumination information is the illumination information of sunlight on the water surface.
[0117] In some embodiments of the present application, since the water medium and particles in the water absorb and scatter the light respectively, the calculated value corresponding to the underwater illumination information is smaller than the value corresponding to the above-mentioned water surface illumination information.
[0118] In this way, the electronic device can directly estimate the underwater depth value through the pressure information obtained by the pressure sensor, and further estimate the underwater illumination information of the underwater environment, without going through other professional devices for detecting depth or illumination, thereby reducing the number of electronic devices used for underwater shooting and improving the convenience of electronic devices in obtaining underwater illumination information.
[0119] In some embodiments of the present application, before the above step 303, the electronic device may obtain the above water surface illumination information through the following steps A1 and A2.
[0120] Step A1: The electronic device obtains current weather information and current time information.
[0121] In some embodiments of the present application, the above-mentioned current weather information can be understood as the weather information of the above-water environment corresponding to the position and time of the electronic device in the underwater environment.
[0122] In some embodiments of the present application, the weather information may include but is not limited to at least one of the following: temperature, air pressure, ultraviolet intensity, air quality, wind speed, and cloud cover.
[0123] In some embodiments of the present application, the electronic device can obtain the above-mentioned current weather information through a weather application, or an application or component capable of obtaining weather information.
[0124] It should be noted that the current weather information obtained by the electronic device can be an accurate numerical value, for example, the current temperature is 25°C, the current temperature is 20°C; it can also be a general description, for example, sunny, cloudy, cloudy to overcast.
[0125] In some embodiments of the present application, the above-mentioned current time information may be system time information acquired by the electronic device.
[0126] It should be noted that the current time information acquired by the electronic device may be an accurate value, such as the current time 12:00, the current time 11:45; or it may be a general description, such as noon, evening.
[0127] Step A2: The electronic device determines water surface illumination information based on current weather information and current time information.
[0128] In some embodiments of the present application, the electronic device can determine the water surface illumination information based on the current weather information and the current time information through the correspondence between <weather, time, illumination> stored in the illumination data table.
[0129] In some embodiments of the present application, the above-mentioned illumination information table may be a data table jointly created by at least one electronic device based on illumination-related data detected in different weather and time.
[0130] Exemplarily, assuming that the current weather information obtained by the electronic device is that the weather is clear and the current time information is noon, the electronic device can determine that the current color temperature of the water environment is close to the D50 light source. Therefore, the electronic device can determine that the illuminance value can be 30000-300000Lux based on the data in the illuminance information table.
[0131] For example, assuming that the current weather information acquired by the electronic device is that it is cloudy and the current time information is noon, the electronic device can determine that the illumination value can be 1000-10000 Lux according to the data in the illumination information table.
[0132] For example, assuming that the current weather information obtained by the electronic device is that there are few clouds and the current time information is the sunrise or sunset time, the electronic device can determine that the illumination value can be 100-1000 Lux according to the data in the illumination information table.
[0133] It is understandable that the above-mentioned water surface illumination information may change as the position of the electronic device in the underwater environment moves in the horizontal direction or changes over time.
[0134] It should be noted that in the early morning and dusk, the water surface illumination information is usually low because the sunlight is oblique and the atmosphere has a strong scattering effect on light; at noon, the sunlight shines almost vertically on the water surface, and the water surface illumination information is higher.
[0135] In some embodiments of the present application, the above-mentioned water surface illumination information may be an accurate illumination value or a relative intensity.
[0136] In this way, the electronic device can determine the illumination information of the above-water environment based on the current weather information and the current time information obtained, and then can calculate the underwater illumination information based on the water surface illumination information to determine the loss caused by the propagation of light through water, which can further improve the accuracy of the underwater illumination information calculated later.
[0137] In some embodiments of the present application, the above-mentioned sunlight includes red light, green light and blue light; the above-mentioned water surface illumination information includes red light water surface illumination information corresponding to red light, green light water surface illumination information corresponding to green light and blue light water surface illumination information corresponding to blue light. Exemplarily, the above-mentioned step 303 can be specifically implemented by the following steps 303a to 303f.
[0138] Step 303a: The electronic device calculates the remaining light ratio value corresponding to the red light based on the underwater depth value and the attenuation coefficient of the wavelength of the red light.
[0139] Step 303b: The electronic device calculates the red light underwater illumination information corresponding to the red light based on the product of the light remaining proportion value corresponding to the red light and the red light water surface illumination information.
[0140] Step 303c: The electronic device calculates the remaining light ratio value corresponding to the green light based on the underwater depth value and the attenuation coefficient of the wavelength of the green light.
[0141] Step 303d: The electronic device calculates the underwater illumination information of the red light corresponding to the green light based on the product of the remaining proportion value of the light corresponding to the green light and the water surface illumination information of the green light.
[0142] Step 303e: The electronic device calculates the remaining light ratio value corresponding to the blue light based on the underwater depth value and the attenuation coefficient of the wavelength of the blue light.
[0143] Step 303f: The electronic device calculates the red light underwater illumination information corresponding to the blue light based on the product of the light remaining ratio value corresponding to the blue light and the blue light water surface illumination information.
[0144] It should be noted that the wavelength of red light may be 610-730nm, the wavelength of green light may be 500nm-570nm, and the wavelength of blue light may be 450-480nm.
[0145] It should be noted that the green light water surface illumination information corresponding to green light is higher than the red light water surface illumination information corresponding to red light and the blue light water surface illumination information corresponding to blue light. This is related to the relative visibility of the user's eyes to light of different wavelengths, where the relative visibility refers to the ratio of the visibility of a certain wavelength of light to the visibility of 555nm yellow-green light.
[0146] It should be noted that the above attenuation coefficient usually refers to the difficulty of certain physical quantities such as the number or energy of photons, sound waves, electrons, particles, etc. to travel through an object in a single direction. Taking light as an example, a large attenuation coefficient means that the light will quickly weaken when entering a certain substance; a small attenuation coefficient means that the light can easily penetrate a certain substance, that is, the certain substance is quite transparent.
[0147] In some embodiments of the present application, when the density of water propagating the light is different, the attenuation coefficient of the light may be different.
[0148] In some embodiments of the present application, the attenuation coefficients corresponding to light rays of different wavelengths in sunlight may be different.
[0149] For example, for typical seawater or pure water, the typical value of the attenuation coefficient corresponding to red light with a wavelength of 650 nm is 0.15 m / s. -1 The typical attenuation coefficient of green light with a wavelength of 550nm is 0.05m -1 The typical attenuation coefficient of blue light with a wavelength of 450nm is 0.02m -1 .
[0150] In some embodiments of the present application, the electronic device can calculate the remaining proportion of light corresponding to red light based on the underwater depth value and the attenuation coefficient of the wavelength of red light through the following formula (2); and calculate the remaining proportion of light corresponding to green light based on the underwater depth value and the attenuation coefficient of the wavelength of green light; and calculate the remaining proportion of light corresponding to blue light based on the underwater depth value and the attenuation coefficient of the wavelength of blue light.
[0151] K=e -k(λ)z (2)
[0152] Wherein, λ is the wavelength of the light, k(λ) is the attenuation coefficient of the wavelength of the light, z is the underwater depth value, e is the natural logarithm, and K is the remaining proportion value of the light.
[0153] For example, assuming that the underwater depth z is 5 m, then:
[0154] The remaining proportion of red light with a wavelength of 650nm is K R =e -0.15×5 ≈0.4724;
[0155] The remaining ratio of green light with a wavelength of 550nm is K G =e -0.05×5 ≈0.7788;
[0156] The remaining proportion of blue light with a wavelength of 450nm is K B e -0.02×5 ≈0.9048.
[0157] In some embodiments of the present application, in combination with the above formula (2), the electronic device can calculate the underwater illumination information corresponding to the light through the following formula (3) based on the product of the remaining proportion value of the light corresponding to the light and the water surface illumination information.
[0158] I(z,λ)=I0(λ)K=I0(λ)e -k(λ)z (3)
[0159] Among them, I is the illumination size, I0(λ) is the illumination distribution of light with a wavelength of λ in the water environment, that is, the water surface illumination information corresponding to the above light, and I(z,λ) is the illumination distribution of light with a wavelength of λ when the underwater depth value is z, that is, the underwater illumination information corresponding to the above light.
[0160] It should be noted that since the wavelength of light above water is continuous, it is difficult to quantify the illumination information of a single wavelength, so the following example will use a normalized description to represent the relationship between the water surface illumination information and the underwater illumination information corresponding to light of different wavelengths.
[0161] For example, assuming that the water surface illumination information of red light with a wavelength of 650 nm is 1, the underwater illumination information calculated and determined by the above formula (3) can be 0.4724, that is, the underwater illumination information is approximately 0.4724 times the water surface illumination information corresponding to the red light;
[0162] Assuming that the water surface illumination information of green light with a wavelength of 550nm is 1, the underwater illumination information calculated by the above formula (3) can be 0.7788, that is, the underwater illumination information is approximately 0.7788 times the water surface illumination information corresponding to the green light;
[0163] Assuming that the water surface illumination information of blue light with a wavelength of 450 nm is 1, the underwater illumination information calculated by the above formula (3) can be 0.9048, that is, the underwater illumination information is approximately 0.9048 times the water surface illumination information corresponding to the blue light.
[0164] In some embodiments of the present application, based on the above formula (3), the above light remaining ratio value can be understood as the ratio of the underwater illumination information corresponding to the light to the water surface illumination information corresponding to the light, that is,
[0165] In some embodiments of the present application, the electronic device can calculate the loss ratio of the light propagating to the underwater shooting position based on the above light remaining ratio value, that is,
[0166] For example, since the remaining ratio of red light with a wavelength of 650 nm is about 0.4727, when the red light with a wavelength of 650 nm propagates from the water surface to a position with an underwater depth of 5 m, the loss ratio of the red light is about 53%;
[0167] Since the remaining ratio of green light with a wavelength of 550nm is about 0.7788, when the green light with a wavelength of 550nm propagates from the water surface to the underwater depth of 5m, the loss ratio of the green light is about 22%;
[0168] Since the remaining ratio of blue light with a wavelength of 450nm is approximately 0.9048, the loss ratio of blue light with a wavelength of 450nm is approximately 10% when it propagates from the water surface to a position with an underwater depth of 5m.
[0169] In this way, since the electronic device can estimate the red light underwater illumination information, green light underwater illumination information and blue light underwater illumination information corresponding to the position in the underwater environment based on the acquired numerical values, the electronic device can determine the light loss in the underwater environment, thereby facilitating subsequent electronic equipment to provide a suitable fill light source for the underwater environment, and further improving the quality of images taken underwater by the electronic device.
[0170] In some embodiments of the present application, the electronic device can add the underwater illumination information corresponding to light of different wavelengths by integration or summation based on the red light underwater illumination information, the green light underwater illumination information and the blue light underwater illumination information to obtain the underwater illumination information corresponding to the sunlight.
[0171] In some embodiments of the present application, the underwater illumination information of sunlight is affected by multiple factors such as the solar altitude angle, atmospheric transparency, and cloud cover. Therefore, in actual application, the electronic device can appropriately correct and calibrate the calculated underwater illumination information in combination with changes in factors such as current weather information and current time information.
[0172] In some embodiments of the present application, in combination with the above steps 303a to 303f, the "determining fill light parameters according to underwater environment information" in the above step 201 can be specifically implemented through the following steps 201a to 201c.
[0173] Step 201a: The electronic device determines the red light fill light parameter corresponding to the red light based on the red light underwater illumination information corresponding to the red light.
[0174] Step 201b: The electronic device determines the green light fill light parameter corresponding to the green light based on the green light underwater illumination information corresponding to the green light.
[0175] Step 201c: The electronic device determines a blue light fill light parameter corresponding to the blue light based on the blue light underwater illumination information corresponding to the blue light.
[0176] In some embodiments of the present application, the electronic device may preset a set of basic red light source parameters. Then, the electronic device may adjust the basic red light source parameters based on the estimated loss ratio of the red light underwater illumination information relative to the water surface illumination information corresponding to the red light, so as to determine the above-mentioned red light fill light parameters.
[0177] In some embodiments of the present application, the red light underwater illumination information is inversely proportional to the remaining ratio value of the light corresponding to the red light and the multiple of the red light source parameter of the adjustment basis.
[0178] Exemplarily, assuming that the remaining light ratio corresponding to red light is 50%, that is, the loss ratio of red light underwater illumination information relative to the water surface illumination information corresponding to red light is 50%, the electronic device can set the fill light parameter corresponding to red light in the fill light parameter to twice the basic red light source parameter.
[0179] Similarly, the electronic device may preset a set of basic green light source parameters. Then, the electronic device may adjust the basic green light source parameters based on the estimated loss ratio of the green light underwater illumination information relative to the water surface illumination information corresponding to the green light, so as to determine the above green light fill light parameters;
[0180] The electronic device may preset a set of basic blue light source parameters. Then, the electronic device may adjust the basic blue light source parameters based on the estimated loss ratio of the blue light underwater illumination information relative to the water surface illumination information corresponding to the blue light, so as to determine the above blue light fill light parameters.
[0181] Exemplarily, assuming that the remaining light ratio corresponding to the green light is 80%, that is, the loss ratio of the green light underwater illumination information relative to the water surface illumination information corresponding to the green light is 20%, the electronic device can set the fill light parameter corresponding to the green light in the fill light parameter to 1.25 times the basic green light source parameter;
[0182] Assuming that the remaining light ratio corresponding to the blue light is 90%, that is, the loss ratio of the blue light underwater illumination information relative to the water surface illumination information corresponding to the blue light is 10%, the electronic device can set the fill light parameter corresponding to the blue light in the fill light parameter to 1.1 times the basic blue light source parameter.
[0183] In this way, the electronic device can more conveniently determine the fill light parameters corresponding to the light based on the underwater illumination information of the light, thereby reducing the steps required for the electronic device to determine the fill light parameters and improving the convenience of determining the fill light parameters.
[0184] In some embodiments of the present application, the electronic device may also determine the loss of underwater illumination information compared to above-water illumination information based on the spectral information, thereby determining the fill light parameters required to fill light for the underwater environment.
[0185] Exemplarily, when the electronic device detects that the energy of the red spectrum in the underwater environment is low based on the sum spectral information, the relative brightness of the corresponding red LED sub-light source is increased; when the electronic device detects that the brightness in the underwater environment is low based on the sum spectral information, the overall brightness of the LED light source is increased.
[0186] Step 202: The electronic device controls the LED module to perform fill light according to the fill light parameters.
[0187] In some embodiments of the present application, each LED light source in the LED module may be covered with a zoom structure, so that the electronic device can adjust the light-emitting angle of the LED module by adjusting the distance between the zoom structure and the LED light source in a direction perpendicular to the LED light source, and then supplement the underwater environment with the LED module after adjusting the light-emitting angle.
[0188] In some embodiments of the present application, the above-mentioned zoom structure may include at least one lens.
[0189] In some embodiments of the present application, when a plurality of lenses are included in the zoom structure, the distance between the plurality of lenses is fixed.
[0190] For example, take the side view of any three LED light sources in a row or a column in the LED module as an example, Figure 5A As shown, each LED light source corresponds to a zoom structure, and each zoom structure may include two lenses. Figure 5B As shown, the light-emitting angle of the LED light source when the distance between the LED light source and the zoom structure is d1 is different from the light-emitting angle of the LED light source when the distance between the LED light source and the zoom structure is d2.
[0191] In some embodiments of the present application, a light homogenizer can be provided on the outer layer of the LED light source and the zoom structure in the above-mentioned LED module so that the light of the LED light source can be evenly distributed on the entire light-emitting surface, thereby avoiding the phenomenon of uneven light intensity and achieving a uniform lighting effect.
[0192] In some embodiments of the present application, the surface of the light homogenizer may include fine edges and corners, or the light homogenizer may be controlled by an internal circuit so that the light of the LED light source can be refracted or regulated multiple times.
[0193] In some embodiments of the present application, the structural size of the light diffuser may be determined by the size of the LED module.
[0194] For example, in combination Figure 5A ,like Figure 5C As shown, a layer of light homogenizer is arranged on the right side of the LED light source and the zoom structure.
[0195] In some embodiments of the present application, the electronic device further comprises a microcontroller; the LED module comprises a red LED submodule, a green LED submodule and a blue LED submodule. Figure 1 ,like Figure 6 As shown, the above step 202 can be specifically implemented through the following step 202a.
[0196] Step 202a: The electronic device adjusts the duty ratios of the red LED submodule, the green LED submodule, and the blue LED submodule based on the microcontroller to control the LED modules for fill light.
[0197] In some embodiments of the present application, the above-mentioned red LED sub-module can be used to control all red LED sub-light sources in the LED module; for example, in combination with Figure 2B The red LED sub-module is used to control the red LED sub-light sources respectively contained in the 3×3 LED light sources.
[0198] In some embodiments of the present application, the green LED sub-module can be used to control all green LED sub-light sources in the LED module; for example, in combination with Figure 2B The green LED sub-module is used to control the green LED sub-light sources respectively contained in the 3×3 LED light sources.
[0199] In some embodiments of the present application, the above blue LED sub-module can be used to control all blue LED sub-light sources in the LED module. Figure 2B The blue LED sub-module is used to control the blue LED sub-light sources respectively contained in the 3×3 LED light sources.
[0200] In some embodiments of the present application, the electronic device can adopt pulse width modulation (PWM), that is, through the digital output of the microcontroller, the duty cycle of the red LED sub-module, the green LED sub-module and the blue LED sub-module can be adjusted respectively to control the output power of the red LED sub-module, the green LED sub-module and the blue LED sub-module, thereby controlling the LED module to perform fill light.
[0201] It should be noted that the PWM signal is a periodic digital signal consisting of a high level and a low level. In addition, in a complete cycle, the proportion of the time occupied by the high level is called the duty cycle, that is, the duty cycle = (high level time / cycle time) × 100%, such as Fig. 7A As shown, a is the high level time and b is the cycle time.
[0202] In some embodiments of the present application, for each LED submodule, the high level time corresponds to the "on" time of the LED submodule, and the low level time corresponds to the "off" time of the LED submodule. Further, the electronic device quickly turns on and off the power of each LED submodule through the microcontroller, changes the ratio of "on" and "off" of each LED submodule per unit time, thereby controlling the brightness of each LED submodule and realizing control of the LED module.
[0203] It should be noted that although the current of each LED sub-module itself changes between on and off, since the switching speed is usually above several thousand hertz, the user can actually view the average brightness of each LED sub-module, and cannot directly view the flickering of the LED module with the naked eye.
[0204] For example, Figure 7B As shown, the microcontroller can control each LED submodule separately through the PWM channel corresponding to each LED submodule. Among them, the microcontroller can control the red LED submodule through PWM channel 1; control the green LED submodule through PWM channel 2; and control the blue LED submodule through PWM channel 3. At the same time, in an underwater environment, according to the light loss ratio, the red light loss is the largest, the green light loss is in the middle, and the blue light loss is the smallest, so the duty ratios set by the microcontroller for the red LED submodule, the green LED submodule, and the blue LED submodule can be: the duty ratio corresponding to the red LED submodule> the duty ratio corresponding to the green LED submodule> the duty ratio corresponding to the blue LED submodule.
[0205] In some embodiments of the present application, the electronic device may set a maximum brightness for the LED module. Thus, the brightness of the LED module may be determined based on the PWM duty cycle and the maximum brightness.
[0206] Exemplarily, when the PWM duty cycle corresponding to the red LED sub-module is set to 70%, the red LED sub-module can output red light at 70% of the maximum brightness; when the PWM duty cycle corresponding to the green LED sub-module is set to 50%, the green LED sub-module can output green light at 50% of the maximum brightness; when the PWM duty cycle corresponding to the blue LED sub-module is set to 30%, the blue LED sub-module can output blue light at 30% of the maximum brightness.
[0207] In this way, the electronic device can more accurately control the LED module for fill light by controlling the LED sub-module, so as to simulate the light source effect of the water environment during underwater shooting, solve problems such as insufficient light and color distortion in the underwater environment, and thus improve the quality of images obtained by underwater shooting of the electronic device.
[0208] In some embodiments of the present application, the above-mentioned fill light parameter includes a light divergence angle; the above-mentioned LED module includes an LED light source and a zoom structure. Figure 1 ,like Figure 8 As shown, the above step 202 can be specifically implemented through the following step 202b.
[0209] Step 202b: The electronic device adjusts the distance between the LED light source and the zoom structure based on the field of view of the camera used to capture images, so as to provide fill light during underwater image or video shooting by the camera using the light divergence angle corresponding to the field of view after the distance adjustment.
[0210] In some embodiments of the present application, the camera used by the above-mentioned electronic device to capture images may include but is not limited to any of the following: a main camera, a telephoto camera, and a wide-angle camera.
[0211] It should be noted that the above-mentioned main camera usually has a moderate focal length and field of view, which is suitable for general shooting scenes. Its field of view range varies depending on the focal length of the lens, and is between the field of view of a wide-angle camera and the field of view of a telephoto camera. For example, the field of view of the main camera can range from 40° to 60°.
[0212] It should be noted that the telephoto camera has a long focal length and can capture distant objects and bring them closer. Its field of view is relatively narrow, usually between 20° and 40°, or even narrower. For example, for a telephoto camera with a focal length of 135mm, its field of view can be about 18°; for an ultra-telephoto lens with a focal length of 500mm, its field of view can be less than 5°.
[0213] It should be noted that the wide-angle camera has a short focal length and a wide field of view, and its field of view is usually above 60°, and the field of view of the ultra-wide-angle camera can even be greater than 120°. For example, for an ultra-wide-angle camera with a focal length of 24mm, its field of view can be about 84°; for a wide-angle camera with a focal length of 28mm, its field of view can be about 75°.
[0214] For example, when the camera used for underwater shooting of an electronic device is switched from a main camera to a wide-angle camera, the field of view angle of the camera used by the electronic device to collect images increases. Therefore, the electronic device can reduce the distance between the zoom structure and the LED light source in the LED module to increase the divergence angle of the light of the LED module, so that the LED light source can provide fill light for a wider range of environments.
[0215] In some embodiments of the present application, during underwater shooting, the user can use a third input to trigger the electronic device to adjust the shooting mode to adjust the field of view of the camera used for shooting.
[0216] In some embodiments of the present application, the third input may include but is not limited to at least one of the following: click input, sliding input, or other feasible input, which is not limited in the embodiments of the present application.
[0217] In some embodiments of the present application, the click input may be any number of click inputs. The sliding operation may be a sliding operation in any direction, such as sliding up, sliding down, sliding to the left, or sliding to the right, etc., which is not limited in some embodiments of the present application.
[0218] In some embodiments of the present application, the third input may include air gesture input.
[0219] In some embodiments of the present application, the above-mentioned air gesture refers to a gesture when the user's hand is not in contact with the electronic device or the external control device, and the distance between the user's hand and the electronic device is greater than or equal to a preset distance threshold. For example, the above-mentioned preset distance threshold can be 1 cm.
[0220] In some embodiments of the present application, the electronic device may capture the user's hand movements through a camera or sensor, and detect air gestures based on the captured hand movement data, thereby achieving control of the electronic device.
[0221] Exemplarily, the camera may be a time of flight (TOF) camera.
[0222] Exemplarily, the sensor may be a radar sensor, an infrared sensor, an ultrasonic sensor, etc. The sensor is usually arranged below a display screen of an electronic device.
[0223] In some embodiments of the present application, the third input may be a user pressing a physical key of the electronic device, a user pressing multiple physical keys of the electronic device, or a user pressing a combination of physical keys of the electronic device.
[0224] In some embodiments of the present application, the above-mentioned physical button can be: a volume up button, a volume down button, a power button or any physical button in an electronic device.
[0225] In some embodiments of the present application, the third input may be an input by a user to a physical key on the first device, an input by a user to multiple physical keys on the first device, or an input by a user to a combination of physical keys.
[0226] In this way, since the electronic device can control the light emitting angle of the LED light source based on the current shooting mode, the fill light source provided by the LED module can better meet the actual needs of the user, and further improve the quality of the image obtained by the electronic device underwater shooting.
[0227] In the underwater shooting method provided in the embodiment of the present application, since the electronic device determines the fill light parameters based on the acquired underwater environment information to control the LED module to fill light the environment during underwater shooting, the fill light source provided by the electronic device matches the environment during underwater shooting. Therefore, the fill light source provided by the LED module can compensate for the light energy loss caused by the propagation of light in the water, thereby achieving a light source effect that simulates the water environment in the environment during underwater shooting. In this way, the quality of images or videos obtained by underwater shooting by the electronic device can be improved.
[0228] In some embodiments of the present application, Figure 1 ,like Fig. 9 As shown, after the above step 202, the underwater shooting method provided in the embodiment of the present application also includes the following steps 401 to 403.
[0229] Step 401: When receiving a shooting control input, the electronic device controls a camera to shoot a first image.
[0230] In some embodiments of the present application, the above-mentioned shooting control input may include but is not limited to any of the following:
[0231] The user clicks the shooting control displayed in the preview interface, for example, Figure 3B , the user can click the shooting control 21 to trigger the electronic device to perform a shooting operation;
[0232] A user's air gesture input, for example, a user draws a circle in the air to trigger the electronic device to perform a shooting operation;
[0233] A user presses a physical button of the electronic device, for example, the user presses a "volume up button" to trigger the electronic device to perform a shooting operation;
[0234] Other possible input from the user.
[0235] In some embodiments of the present application, the first image is an image captured based on fill light from an LED module.
[0236] In some embodiments of the present application, the first image may be at least one image.
[0237] In some embodiments of the present application, the image size of the first image may be an image size set by default for the electronic device, or may be an image size manually set by a user.
[0238] In some embodiments of the present application, the first image may be an image in RAW format.
[0239] Example 3, combined with Example 1, when user 1 finds the coral he wants to photograph, the phone displays the following Figure 3B In the shooting preview interface 23 shown, when a coral image is displayed, after the mobile phone determines the fill light parameters based on the acquired underwater environment information and controls the LED module to perform fill light according to the fill light parameters, the user can click the shooting control 21 to trigger the electronic device to control the camera to capture the first image.
[0240] Step 402: The electronic device determines a first image parameter according to the underwater environment information, the fill light parameter and the quantum efficiency information of the electronic device.
[0241] In some embodiments of the present application, the above-mentioned environmental information may include but is not limited to at least one of the following: illumination information of the underwater environment, light brightness information of the underwater environment, and spectrum information of the underwater environment.
[0242] In some embodiments of the present application, the above-mentioned fill light parameters may include but are not limited to at least one of the following: luminous flux, illumination, brightness, color temperature, color rendering, and spectral information.
[0243] In some embodiments of the present application, the quantum efficiency (QE) information of the above-mentioned electronic device can be understood as a hardware parameter of the electronic device, which is an important indicator used to characterize the utilization rate of light energy in the CIS photosensitization process.
[0244] The definition of QE is: Among them, λ is the wavelength of light, N e (λ) represents the number of electrons generated by a single photodiode after being exposed to light, N ph (λ) represents the number of photons incident on a unit pixel.
[0245] In some embodiments of the present application, the higher the QE information is, the higher the conversion efficiency of the optical signal to the electrical signal is, that is, the better the photosensitivity of the sensor is.
[0246] In some embodiments of the present application, the electronic device may calculate the white balance coefficient based on the environmental information, the fill light parameter and the quantum efficiency information of the electronic device through the following formula group (4) to determine the first image parameter.
[0247]
[0248] Among them, τ is a parameter of the lens used for underwater shooting of electronic equipment; S(λ) is the spectral density of the underwater shooting environment, which can be estimated and determined by information such as the weather and time of the above-water environment and the spectral density of the underwater environment; L(λ) is the spectral density of the fill light source of the LED module; QE(λ) is the quantum efficiency corresponding to each wavelength of light, for example, QE R (λ) is the quantum efficiency corresponding to red light, QE G (λ) is the quantum efficiency corresponding to green light, QE B (λ) is the quantum efficiency of blue light; Gain is the white balance coefficient of each wavelength of light, for example, Gain R is the white balance coefficient corresponding to red light, Gain G is the white balance coefficient corresponding to green light, Gain B is the white balance coefficient corresponding to blue light.
[0249] It should be noted that in the above formula group (4), the G channel in the light is the main brightness channel, that is, the reference value, and based on the value of the G channel, the gray value gains of the R channel and the B channel relative to the G channel are calculated respectively, so as to determine the white balance coefficient corresponding to each wavelength of light.
[0250] For example, assuming that the above P R =300DN, P G =500DN, PB =400DN, where the unit DN (Digital Number) refers to the brightness value of the remote sensing image pixel, which can record the gray value of the object. R =P G / P R =500 / 300≈1.67, Gain B =P G / P B =500 / 400=1.25, Gain G =1.
[0251] In some embodiments of the present application, the algorithm for white balance processing may include: Gray World Algorithm. Assuming that the average value of the reflection of light by natural scenes is generally approximately "gray", color balance is achieved by calculating the average value of light in the three RGB channels and eliminating the influence of light in the environment.
[0252] Step 403: The electronic device performs white balance processing on the first image based on the first image parameters to obtain a second image.
[0253] In some embodiments of the present application, the electronic device may calculate the white balance coefficient Gain corresponding to the red light based on the calculated white balance coefficient Gain. R , White balance coefficient Gain corresponding to green light G White balance coefficient Gain corresponding to blue light B , respectively adjusting the white balance coefficients of the images of the three color channels of red, green and blue in the first image to obtain the second image.
[0254] It should be noted that the above white balance processing operation is performed by a white balance processing ISP module in the electronic device.
[0255] In some embodiments of the present application, the second image may be an image in RAW format.
[0256] In some embodiments of the present application, the electronic device may convert the image format of the second image in RAW format.
[0257] In some embodiments of the present application, the converted image format may include but is not limited to any of the following: JPG, JPEG, BMP, HEIF.
[0258] In some embodiments of the present application, the electronic device may display the second image on a screen, or the electronic device may store the second image in an album application.
[0259] In this way, after the electronic device controls the LED module fill light according to the environmental information of the underwater environment, the electronic device can perform image processing on the captured image to more accurately restore the color in the image, thereby further improving the quality of the image captured underwater by the electronic device.
[0260] In some embodiments of the present application, after the above step 403, the underwater shooting method provided in the embodiments of the present application also includes: the electronic device can perform corresponding image processing operations on the second image through other ISP modules to obtain a third image based on the above second image.
[0261] In some embodiments of the present application, the above-mentioned other ISP modules may include but are not limited to any of the following: a de-mosaic ISP module, a gamma transform ISP module, a color correction ISP module, an image denoising ISP module, and an image sharpening ISP module.
[0262] In some embodiments of the present application, an ISP module may correspond to an image processing method.
[0263] Exemplarily, the demosaic ISP module may correspond to a demosaic image processing method;
[0264] The gamma transform ISP module can correspond to an image processing method that uses gamma transform to adjust the contrast of an image;
[0265] The color correction ISP module can calibrate the color distribution of the image or adjust the image processing method of the color channel;
[0266] The image denoising ISP module can correspond to the image processing method of removing noise in the image through spatial domain filtering and frequency domain filtering; among them, commonly used spatial domain filters include mean filter, median filter and Gaussian filter, etc., and commonly used frequency domain filters include low-pass filter, high-pass filter, etc.;
[0267] The image sharpening ISP module can correspond to an image processing method that enhances the detailed edges and contours of objects contained in the image to highlight the color brightness values between pixels around the edges of the objects.
[0268] In this way, by performing image processing operations on the basis of the second image, the quality of the image obtained by underwater photography of the electronic device can be further improved.
[0269] In some embodiments of the present application, Figure 1 ,like Fig.10 As shown, after the above step 202, the underwater shooting method provided in the embodiment of the present application also includes the following steps 501 to 503.
[0270] Step 501: Upon receiving a video recording control input, the electronic device controls a camera to record a first video.
[0271] In some embodiments of the present application, the video recording control input may include but is not limited to any of the following:
[0272] The user long presses the shooting control displayed in the preview interface, for example, Figure 4B , the user can long press the shooting control 31 to trigger the electronic device to control the camera to record the first video;
[0273] A user's air gesture input, for example, the user draws a triangle in the air to trigger the electronic device to control the camera to record the first video;
[0274] A user presses a physical button of the electronic device, for example, the user presses a “volume up button” and a “volume down button” at the same time to trigger the electronic device to control the camera to record the first video;
[0275] Other possible input from the user.
[0276] In some embodiments of the present application, when the video recording control input is one input, the video length of the first video may be a preset time length.
[0277] Exemplarily, when the electronic device receives a video recording control input, the electronic device may start recording a video of a fixed time length, and automatically stop video recording after the fixed time length ends, thereby obtaining a first video.
[0278] In some embodiments of the present application, the above-mentioned video recording control input may include two video recording control sub-inputs, wherein one video recording control sub-input can be used to trigger the electronic device to control the camera to start recording the video, and the other video recording control sub-input can be used to trigger the electronic device to control the camera to stop recording the video.
[0279] In some embodiments of the present application, the first video is a video shot based on fill light from an LED module.
[0280] In some embodiments of the present application, the number of video frames included in the first video is determined by the duration and frame rate of the first video.
[0281] In some embodiments of the present application, the size of the video frame contained in the first video may be a size set by default by the electronic device, or may be a size manually set by the user.
[0282] Example 4, combined with Example 2, when user 1 finds the school of fish that he wants to photograph, the phone displays the following Figure 4BIn the shooting preview interface shown, when a school of fish image is displayed, after the mobile phone determines the fill light parameters based on the acquired underwater environment information and controls the LED module to perform fill light according to the fill light parameters, the user can long press the shooting control 31 to trigger the electronic device to control the camera to record the first video.
[0283] Step 502: The electronic device determines second image parameters based on the underwater environment information, the fill light parameters, and the quantum efficiency information of the electronic device.
[0284] It should be noted that the method for the electronic device to determine the second image parameters is similar to the method for the electronic device to determine the first image parameters. For details, please refer to the relevant description of the above step 402, which will not be elaborated in this application.
[0285] Step 503: The electronic device performs white balance processing on all video frames of the first video frame by frame based on the second image parameter to obtain a second video.
[0286] It should be noted that the method for the electronic device to determine the white balance parameters based on the second image parameters is similar to the method for the electronic device to determine the white balance parameters based on the first image parameters. For details, please refer to the relevant description of the above step 403, which will not be repeated in this application.
[0287] In this way, after the electronic device controls the LED module fill light according to the environmental information of the underwater environment, the electronic device can perform image processing on each video frame in the recorded video to more accurately restore the colors in the video, thereby further improving the quality of the video obtained by the electronic device underwater.
[0288] In some embodiments of the present application, after the above step 503, the underwater shooting method provided in the embodiment of the present application also includes: the electronic device can perform corresponding image processing operations on all video frames in the second video frame by frame through other ISP modules to obtain a third video based on the above second video.
[0289] It should be noted that, regarding the above-mentioned other ISP modules and corresponding image processing operations, please refer to the relevant description in the above-mentioned embodiments, and this application will not go into details here.
[0290] In this way, based on the second video, by performing image processing operations on each video frame respectively, the quality of the video obtained by underwater shooting of the electronic device can be further improved.
[0291] In some embodiments of the present application, after the above step 202, the underwater shooting method provided by the embodiment of the present application also includes the following steps 601 to 607.
[0292] Step 601: The electronic device receives a control input of an adjustment mark in a shooting preview interface of an underwater shooting mode.
[0293] In some embodiments of the present application, the above control input is used to trigger a display adjustment control of an electronic device.
[0294] In some embodiments of the present application, the above-mentioned control input may include any of the following: user's click input, sliding input, pressing input, gesture input, or other feasible input, which is not limited in the embodiments of the present application.
[0295] In some embodiments of the present application, the above-mentioned gesture input may include but is not limited to at least one of the following: click gesture, sliding gesture, drag gesture, pressure recognition gesture, long press gesture, area change gesture, double press gesture, double click gesture, specific gesture input or other possible gesture inputs. The specific gesture input form can be determined according to actual needs and is not limited to this in some embodiments.
[0296] In some embodiments of the present application, the click operation may be any number of click operations. The slide operation may be a slide operation in any direction, such as slide up, slide down, slide left or slide right, etc., which is not limited in some embodiments.
[0297] Example 5, combined with Example 1, after the mobile phone determines the fill light parameters according to the acquired underwater environment information and controls the LED module to fill light according to the fill light parameters, if the user wants to manually adjust the light source parameters of the fill light source provided by the LED module, then combined with Figure 3B ,like Fig.11A As shown, the user can press the "light source control" adjustment mark 24 on the screen, that is, the above-mentioned control input, to trigger the mobile phone to confirm the selection of the "light source control" adjustment mark 24 and subsequently display at least one adjustment control.
[0298] Example 6, combined with Example 2, after the mobile phone determines the fill light parameters according to the acquired underwater environment information and controls the LED module to perform fill light according to the fill light parameters, if the user wants to manually adjust the light source parameters of the fill light source provided by the LED module, then Figure 4B ,like Fig. 11B As shown, the user can press the "light source control" adjustment mark 34 on the screen, that is, the above-mentioned control input, to trigger the mobile phone to confirm the selection of the "light source control" adjustment mark 34 and subsequently display at least one adjustment control.
[0299] In some embodiments of the present application, the above-mentioned control input may include air gesture input.
[0300] Exemplarily, the control input may be an air click input of the adjustment mark by the user.
[0301] In this way, the user can control the first device to display at least one adjustment control through air gesture input without inputting anything on the device's touch display screen, so that even if the touch function of the electronic device's screen fails underwater, the user can control the device to perform corresponding operations.
[0302] In some embodiments of the present application, the control input includes user input on physical buttons on the electronic device.
[0303] In some embodiments of the present application, the physical buttons on the above-mentioned electronic device may be: a volume up button, a volume down button, a power button, or any physical button in the electronic device.
[0304] In some embodiments of the present application, the above-mentioned "user input on a physical key on the electronic device" may be the user input on a physical key on the electronic device, the user input on multiple physical keys on the electronic device, or the user input on a combination of physical keys.
[0305] Example 7, in combination with Example 1, the control input may include a user pressing the volume down key and a user pressing the volume up key. Figure 3B , assuming that the user wants to select the "light source control" adjustment mark 24, the user can press the volume down button of the mobile phone to make the mobile phone display a cursor to move on at least one mark displayed in the browsing interface, such as the "flash" mark in the form of lightning, the "HDR" mark, the "light source control" adjustment mark 24, the "settings" mark, etc. Then, when the cursor is displayed on the "light source control" adjustment mark 24, the user can press the volume up button of the mobile phone to trigger the mobile phone to confirm the selection of the "light source control" adjustment mark 24, thereby displaying at least one adjustment control.
[0306] Example 8, in combination with Example 2, the control input may include a user pressing the volume down key and a user long pressing the volume key. Figure 4B Assuming that the user wants to select the "light source control" adjustment mark 34, the user can press the volume down button of the mobile phone to make the mobile phone display a cursor to move on at least one mark displayed in the browsing interface, such as the "flash" mark in the form of lightning, the "HDR" mark, the "light source control" adjustment mark 34, the "settings" mark, etc. Then, when the cursor is displayed on the "light source control" adjustment mark 34, the user can press and hold the power button of the mobile phone to trigger the mobile phone to confirm the selection of the "light source control" adjustment mark 34, thereby displaying at least one adjustment control.
[0307] Step 602: The electronic device displays a light source brightness adjustment control, a light divergence angle adjustment control, a red light adjustment control, a green light adjustment control, and a blue light adjustment control in response to a control input.
[0308] In some embodiments of the present application, the electronic device may display a floating window superimposed on the preview interface to display the at least one adjustment control.
[0309] Example 7, combined with Example 5, combined with Fig.11A ,like Fig. 12A As shown, the mobile phone can display a floating window 25 in the top area of the shooting preview interface 23 to display five adjustment controls, namely, a "brightness" adjustment control 251, a "divergence angle" adjustment control 252, a red light "R" adjustment control 253, a green light "G" adjustment control 254 and a blue light "B" adjustment control 255.
[0310] Example 8, combined with Example 6, combined with Fig. 11B ,like Fig. 12B As shown, the mobile phone can display a floating window 35 in the bottom area of the shooting preview interface 33 to display five adjustment controls, namely, a "brightness" adjustment control 351, a "divergence angle" adjustment control 352, a red light "R" adjustment control 353, a green light "G" adjustment control 354 and a blue light "B" adjustment control 355.
[0311] In some embodiments of the present application, the transparency of the floating window may be set by default by the electronic device, or may be manually set in advance by the user.
[0312] It should be noted that the transparency of the above floating window can be adjusted through the system settings application.
[0313] In this way, when the transparency of the floating window is high, such as 90%, the user can view the preview content displayed in the covered part of the preview interface through the floating window, so that the user can better determine the effect he wants to adjust.
[0314] In some embodiments of the present application, the display position and display size of the above-mentioned floating window can be adjusted.
[0315] Exemplarily, if the user wants to move the display position of the floating window, the user can perform a long press input and a drag input on a blank position in the floating window to trigger the electronic device to adjust the display position of the floating window according to the track of the drag input.
[0316] Exemplarily, if the user wants to adjust the display size of the floating window, the user can perform long press input and sliding input on the boundary box of the floating window to trigger the electronic device to increase or decrease the display area of the floating window according to the direction of the sliding input.
[0317] Step 603: When receiving an adjustment input to the light source brightness adjustment control, the electronic device adjusts the light source brightness of the LED module.
[0318] Step 604: upon receiving an adjustment input to the light divergence angle adjustment control, the electronic device adjusts the light divergence angle of the LED module.
[0319] Step 605: When receiving an adjustment input to the red light adjustment control, the electronic device adjusts the relative intensity of the red light in the LED module.
[0320] Step 606: When receiving an adjustment input to the green light adjustment control, the electronic device adjusts the relative intensity of the green light in the LED module.
[0321] Step 607: When receiving an adjustment input to the blue light adjustment control, the electronic device adjusts the relative intensity of the blue light in the LED module.
[0322] In some embodiments of the present application, the adjustable range of the light source brightness of the LED module can be: 0%-100%, wherein 0% can be understood as turning off the LED module, and 100% can be understood as adjusting the light source brightness of the LED module to the highest brightness.
[0323] In some embodiments of the present application, the adjustable range of the light divergence angle of the above-mentioned LED module can be: 10°-150°.
[0324] In some embodiments of the present application, the relative intensity of the red light in the LED module may be adjustable within a range of 0%-100%, wherein 0% may be understood as the fill light source of the LED module not including red light.
[0325] In some embodiments of the present application, the relative intensity of the green light in the LED module may be adjustable within a range of 0%-100%, wherein 0% may be understood as the fill light source of the LED module not containing green light.
[0326] In some embodiments of the present application, the relative intensity of the blue light in the LED module may be adjustable within a range of 0%-100%, wherein 0% may be understood as the fill light source of the LED module not containing blue light.
[0327] It should be noted that the specific adjustable range of the light source brightness of the above-mentioned LED module, the light divergence angle of the LED module, the light divergence angle of the LED module, the relative intensity of red light in the LED module, the relative intensity of green light in the LED module, and the relative intensity of blue light in the LED module can be determined according to the hardware parameters of the LED module, and the embodiments of the present application are not limited thereto.
[0328] In some embodiments of the present application, the above-mentioned adjustment input may be a sliding input, a pressing input or other feasible input, which is not limited in some embodiments.
[0329] In some embodiments of the present application, the above-mentioned sliding operation can be a sliding operation in any direction, such as sliding up, sliding down, sliding to the left or sliding to the right, etc., which is not limited in some embodiments.
[0330] In some embodiments of the present application, the above-mentioned adjustment input includes user input on physical buttons on the electronic device.
[0331] In some embodiments of the present application, the physical buttons on the above-mentioned electronic device may be: a volume up button, a volume down button, a power button, or any physical button in the electronic device.
[0332] In some embodiments of the present application, the above-mentioned “user input on a physical key on the electronic device” may be user input on one physical key on the electronic device or user input on multiple physical keys on the electronic device.
[0333] In some embodiments of the present application, the electronic device may adjust the light source parameters corresponding to the at least one adjustment control according to the input parameters of the user's adjustment input to the at least one adjustment control.
[0334] In some embodiments of the present application, when the adjustment input is a sliding input, the input parameters of the sliding input may include but are not limited to any of the following: sliding direction, sliding trajectory.
[0335] Example 9, combined with Example 7, combined with Fig. 12A ,like Fig.13A As shown, the user can slide the movable button in the "brightness" adjustment control 251 in the floating window 25 to the right, so that the mobile phone can increase the brightness corresponding to the fill light source provided by the LED module.
[0336] Example 10, combined with Example 8, combined with Fig. 12B ,like Fig. 13B As shown, the user can slide down the movable button in the red light "R" adjustment control 353 in the floating window 33 so that the mobile phone can reduce the relative intensity of the red light in the LED module.
[0337] In some embodiments of the present application, when the above-mentioned adjustment input is a pressing input, the input parameters of the above-mentioned pressing input may include but are not limited to any of the following: pressing position, pressing intensity, and pressing time.
[0338] Example 11, combined with Example 8, combined with Fig. 12B When the user wants to adjust the brightness of the fill light source provided by the LED module, the user can press the display area corresponding to the "brightness" adjustment control so that the mobile phone can select the "brightness" adjustment control, and then the user can press the right area in the shooting preview interface 33 so that the mobile phone can increase the brightness of the fill light source provided by the LED module according to the pressing force or pressing time, or the user can press the left area in the shooting preview interface 33 so that the mobile phone can reduce the brightness of the fill light source provided by the LED module according to the pressing force or pressing time.
[0339] In some embodiments of the present application, when the above-mentioned adjustment input is an input to a physical button on an electronic device, the input parameters of the above-mentioned input may include but are not limited to any of the following: the effect corresponding to the pressed physical button, the number of presses, and the pressing time.
[0340] Example 12, combined with Example 7, combined with Fig. 12A , assuming that the mobile phone has selected the "brightness" adjustment control 251 through the user's press input. The user can press the volume up key so that the mobile phone can increase the brightness corresponding to the fill light source provided by the LED module according to the number of presses or the pressing time, or the user can press the volume down key so that the mobile phone can reduce the brightness corresponding to the fill light source provided by the LED module according to the number of presses or the pressing time.
[0341] In this way, since the user can manually adjust the light source parameters of the LED module, the user can customize the light source parameters of the fill light source of the LED module, so that the image of the underwater scene obtained by filling light shooting after adjusting the light source parameters meets the actual needs of the user, and can further improve the quality of the image obtained by underwater shooting of the electronic device.
[0342] For various scenarios to which the embodiments of the present application can be applied, combined with the various implementation schemes of the embodiments of the present application described above, specific examples are given below to illustrate the implementation process in various scenarios of the embodiments of the present application:
[0343] Example A: In the above scenario 1, when user 1 is diving, if user 1 wants to take a picture of a coral, then when user 1 finds the coral that he wants to take a picture of, the user can trigger the mobile phone to display the shooting preview interface of the "underwater shooting mode" and start to obtain underwater environmental information. Then, after the mobile phone determines the fill light parameters according to the underwater environmental information and controls the LED module to perform fill light according to the fill light parameters, if the user wants to manually adjust the light source parameters of the fill light source provided by the LED module, the user can press the "light source control" adjustment mark displayed in the shooting preview interface of the "underwater shooting mode" to trigger the mobile phone to display at least one adjustment mark, and display at least one adjustment control in the shooting preview interface of the "underwater shooting mode", such as the "brightness" adjustment control, the "divergence angle" adjustment control, the red light "R" adjustment control, the green light "G" adjustment control, and the blue light "B" adjustment control. Thus, the user can input at least one adjustment control to trigger the mobile phone to adjust the fill light parameters of the LED module according to the user's needs. Furthermore, when the fill light source provided by the LED module meets user needs, the user can click the shooting control to trigger the electronic device to control the camera to shoot the "coral" image. Then, the mobile phone can determine an image parameter based on the underwater environment information, fill light parameters and quantum efficiency information, and perform white balance processing on the captured "coral" image and perform subsequent corresponding image processing with other ISP modules based on the image parameter, thereby obtaining a processed "coral image".
[0344] Example B: In the above scenario 2, when user 1 is diving, if user 1 wants to shoot a video of a school of fish, when user 1 finds the school of fish that he wants to shoot, the user can trigger the mobile phone to display the shooting preview interface of "underwater shooting mode" and start to obtain underwater environmental information. Then, after the mobile phone determines the fill light parameters according to the underwater environmental information and controls the LED module to perform fill light according to the fill light parameters, if the user wants to manually adjust the light source parameters of the fill light source provided by the LED module, the user can press the "light source control" adjustment mark displayed in the shooting preview interface of the "underwater shooting mode" to trigger the mobile phone to display at least one adjustment mark, and display at least one adjustment control in the shooting preview interface of the "underwater shooting mode", such as "brightness" adjustment control, "divergence angle" adjustment control, red light "R" adjustment control, green light "G" adjustment control and blue light "B" adjustment control. Therefore, the user can input at least one adjustment control to trigger the mobile phone to adjust the fill light parameters of the LED module according to the user's needs. Furthermore, when the fill light source provided by the LED module meets the user's needs, the user can long press the shooting control to trigger the electronic device to control the camera to start video recording, and after receiving the user's long press input to the shooting control again, control the camera to stop video recording to obtain a video of a "school of fish". Then, the mobile phone can determine an image parameter based on the underwater environment information, fill light parameters and quantum efficiency information, and based on the image parameter, perform white balance processing on each video frame in the captured video of the "school of fish" frame by frame and perform subsequent corresponding image processing on other ISP modules to obtain the processed video of the "school of fish".
[0345] It should be noted that the above-mentioned method embodiments, or various possible implementation methods in each method embodiment, can be executed separately, or, under the premise that there is no contradiction, can also be executed in combination with each other. The specific implementation can be determined according to actual usage requirements, and the embodiments of the present application do not limit this.
[0346] It should be noted that the underwater shooting method provided in the embodiment of the present application can be executed by an underwater shooting device. In the embodiment of the present application, an underwater shooting device executing the underwater shooting method is taken as an example to illustrate the underwater shooting device provided in the embodiment of the present application.
[0347] Fig.14 A possible structural diagram of an underwater shooting device involved in an embodiment of the present application is shown. Fig.14 As shown, the underwater shooting device 80 may include: a determination module 81 and a control module 82 .
[0348] The determination module 81 is used to determine fill light parameters according to underwater environment information during the process of shooting images or videos by the camera underwater;
[0349] The control module 82 is used to control the LED module to perform fill light according to the fill light parameters determined by the determination module 81 .
[0350] In the underwater shooting device provided in the embodiment of the present application, since the underwater shooting device determines the fill light parameters based on the acquired underwater environment information to control the LED module to fill light the environment during underwater shooting, the fill light source provided by the underwater shooting device is matched with the environment during underwater shooting. Therefore, the fill light source provided by the LED module can compensate for the light energy loss caused by the propagation of light in the water, thereby achieving the light source effect of simulating the water environment in the environment during underwater shooting. In this way, the quality of the image or video obtained by underwater shooting by the underwater shooting device can be improved.
[0351] In a possible implementation, the electronic device further includes a pressure sensor; the underwater environment information includes underwater illumination information of sunlight in the underwater environment; the underwater shooting device 80 provided in the embodiment of the present application further includes: an acquisition module, which is used to acquire the water pressure value of the electronic device through the pressure sensor before the determination module 81 determines the fill light parameters according to the underwater environment information; a calculation module, which is used to calculate the underwater depth value of the electronic device underwater based on the water pressure value acquired by the acquisition module; and calculate the underwater illumination information based on the underwater depth value and the water surface illumination information, wherein the water surface illumination information is the illumination information of sunlight on the water surface.
[0352] In some embodiments of the present application, the above-mentioned sunlight includes red light, green light and blue light, and the above-mentioned water surface illumination information includes red light water surface illumination information corresponding to red light, green light water surface illumination information corresponding to green light, and blue light water surface illumination information corresponding to blue light; the above-mentioned calculation module is specifically used to: calculate the remaining proportion of light corresponding to red light based on the underwater depth value and the attenuation coefficient of the wavelength of red light; and calculate the red light underwater illumination information corresponding to red light based on the product of the remaining proportion of light corresponding to red light and the red light water surface illumination information; and, calculate the remaining proportion of light corresponding to green light based on the underwater depth value and the attenuation coefficient of the wavelength of green light; and, calculate the red light underwater illumination information corresponding to green light based on the product of the remaining proportion of light corresponding to green light and the green light water surface illumination information; and, calculate the remaining proportion of light corresponding to blue light based on the underwater depth value and the attenuation coefficient of the wavelength of blue light; and, calculate the red light underwater illumination information corresponding to blue light based on the product of the remaining proportion of light corresponding to blue light and the blue light water surface illumination information.
[0353] In some embodiments of the present application, the above-mentioned determination module 81 is specifically used to determine the red light fill light parameters corresponding to the red light based on the red light underwater illumination information corresponding to the red light; and to determine the green light fill light parameters corresponding to the green light based on the green light underwater illumination information corresponding to the green light; and, to determine the blue light fill light parameters corresponding to the blue light based on the blue light underwater illumination information corresponding to the blue light.
[0354] In some embodiments of the present application, the electronic device further includes a microcontroller; the LED module includes a red LED sub-module, a green LED sub-module and a blue LED sub-module; the control module 82 is specifically used to adjust the duty cycle of the red LED sub-module, the green LED sub-module and the blue LED sub-module respectively based on the microcontroller to control the LED module for fill light.
[0355] In some embodiments of the present application, the above-mentioned fill light parameters include a light divergence angle; the above-mentioned LED module includes an LED light source and a zoom structure; the above-mentioned control module 82 is specifically used to adjust the distance between the LED light source and the zoom structure based on the field of view angle of the camera of the electronic device for capturing images, so as to perform fill light during the process of underwater image or video shooting by the camera through the light divergence angle corresponding to the field of view angle after the distance is adjusted.
[0356] In some embodiments of the present application, the underwater shooting device 80 provided in the embodiment of the present application also includes: the above-mentioned control module 82 is also used to control the LED module to perform fill light according to the fill light parameters during the process of the camera shooting images or videos underwater, and then, upon receiving the shooting control input, control the camera to shoot a first image; the above-mentioned determination module 81 is also used to determine the first image parameters according to the underwater environment information, the fill light parameters and the quantum efficiency information of the electronic device; the processing module is used to perform white balance processing on the first image shot by the control module 82 based on the first image parameters determined by the determination module 81 to obtain a second image.
[0357] In some embodiments of the present application, the underwater shooting device 80 provided in the embodiments of the present application also includes: the above-mentioned control module 82 is also used to control the LED module to perform fill light according to the fill light parameters during the process of the camera shooting images or videos underwater, and then, upon receiving the recording control input, control the camera to record the first video; the above-mentioned determination module 81 is also used to determine the second image parameters based on the underwater environment information, the fill light parameters and the quantum efficiency information of the electronic device; the processing module is used to perform white balance processing on all video frames of the first video shot by the control module 82 frame by frame based on the second image parameters determined by the determination module 81 to obtain the second video.
[0358] In some embodiments of the present application, the underwater shooting device 80 provided in the embodiment of the present application further includes: a receiving module, which is used to receive a control input of an adjustment mark in a shooting preview interface of an underwater shooting mode after the control module 82 controls the LED module to perform fill light according to the fill light parameter during the process of underwater shooting of an image or video by the camera; a display module, which is used to display a light source brightness adjustment control, a light divergence angle adjustment control, a red light adjustment control, a green light adjustment control, and a blue light adjustment control in response to the control input received by the receiving module; an adjustment module, which is used to adjust the light source brightness of the LED module when receiving an adjustment input to the light source brightness adjustment control; and adjust the light divergence angle of the LED module when receiving an adjustment input to the light divergence angle adjustment control; and, when receiving an adjustment input to the red light adjustment control, adjust the relative intensity of red light in the LED module; and, when receiving an adjustment input to the green light adjustment control, adjust the relative intensity of green light in the LED module; and, when receiving an adjustment input to the blue light adjustment control, adjust the relative intensity of blue light in the LED module.
[0359] The underwater shooting device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc. It can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., and the embodiment of the present application does not make specific limitations.
[0360] The underwater shooting device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.
[0361] The underwater shooting device provided in the embodiment of the present application can implement each process implemented in the above method embodiment, and will not be described again here to avoid repetition.
[0362] Alternatively, if Fig.15 As shown, an embodiment of the present application further provides an electronic device 90, including a processor 91 and a memory 92, wherein the memory 92 stores programs or instructions that can be executed on the processor 91, and when the program or instructions are executed by the processor 91, the various steps of the above-mentioned underwater shooting method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, they are not described here.
[0363] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.
[0364] Fig.16 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.
[0365] The electronic device 100 includes but is not limited to: a radio frequency unit 101, a network module 102, an audio output unit 103, an input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, a processor 110 and an LED module 111 and other components.
[0366] Those skilled in the art will appreciate that the electronic device 100 may also include a power source (such as a battery) for supplying power to various components, and the power source may be logically connected to the processor 110 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.16 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.
[0367] The processor 110 is used to determine fill light parameters according to underwater environment information when the camera is shooting images or videos underwater; and control the LED module 111 to perform fill light according to the fill light parameters.
[0368] In the electronic device provided in the embodiment of the present application, since the electronic device determines the fill light parameters based on the acquired underwater environment information to control the LED module to fill light the environment during underwater shooting, the fill light source provided by the electronic device matches the environment during underwater shooting. Therefore, the fill light source provided by the LED module can compensate for the light energy loss caused by the propagation of light in the water, thereby achieving a light source effect that simulates the water environment in the environment during underwater shooting. In this way, the quality of images or videos obtained by underwater shooting of the electronic device can be improved.
[0369] Optionally, the electronic device 100 also includes a pressure sensor 1051; the above-mentioned underwater environment information includes underwater illumination information of sunlight in the underwater environment; the sensor 105 is used to obtain the water pressure value of the electronic device through the pressure sensor 1051 before determining the fill light parameters according to the underwater environment information; the processor 110 is also used to calculate the underwater depth value of the electronic device underwater based on the water pressure value; and calculate the underwater illumination information based on the underwater depth value and the water surface illumination information, the water surface illumination information being the illumination information of sunlight on the water surface.
[0370] Optionally, the above-mentioned sunlight includes red light, green light and blue light, and the above-mentioned water surface illumination information includes red light water surface illumination information corresponding to red light, green light water surface illumination information corresponding to green light and blue light water surface illumination information corresponding to blue light; the processor 110 is specifically used to: calculate the remaining proportion value of light corresponding to red light based on the underwater depth value and the attenuation coefficient of the wavelength of red light; and calculate the red light underwater illumination information corresponding to red light based on the product of the remaining proportion value of light corresponding to red light and the red light water surface illumination information; and, calculate the remaining proportion value of light corresponding to green light based on the underwater depth value and the attenuation coefficient of the wavelength of green light; and, calculate the red light underwater illumination information corresponding to green light based on the product of the remaining proportion value of light corresponding to green light and the green light water surface illumination information; and, calculate the remaining proportion value of light corresponding to blue light based on the underwater depth value and the attenuation coefficient of the wavelength of blue light; and, calculate the red light underwater illumination information corresponding to blue light based on the product of the remaining proportion value of light corresponding to blue light and the blue light water surface illumination information.
[0371] Optionally, the above-mentioned processor 110 is specifically used to determine the red light fill light parameters corresponding to the red light based on the red light underwater illumination information corresponding to the red light; and determine the green light fill light parameters corresponding to the green light based on the green light underwater illumination information corresponding to the green light; and determine the blue light fill light parameters corresponding to the blue light based on the blue light underwater illumination information corresponding to the blue light.
[0372] Optionally, the electronic device 100 further includes a microcontroller 1101; the LED module 111 includes a red LED sub-module, a green LED sub-module and a blue LED sub-module; the processor 110 is specifically used to adjust the duty cycle of the red LED sub-module, the green LED sub-module and the blue LED sub-module respectively based on the microcontroller 1101, so as to control the LED module 111 for fill light.
[0373] Optionally, the above-mentioned fill light parameters include a light divergence angle; the LED module 111 includes an LED light source and a zoom structure; the processor 110 is specifically used to adjust the distance between the LED light source and the zoom structure based on the field of view angle of a camera of the electronic device for capturing images, so as to perform fill light during the process of underwater shooting of images or videos by the camera through the light divergence angle corresponding to the field of view angle after the distance is adjusted.
[0374] Optionally, the processor 110 is also used to control the LED module 111 to perform fill light according to the fill light parameters during the process of the camera shooting images or videos underwater, and then, upon receiving a shooting control input, control the camera to shoot a first image; and determine the first image parameters according to the underwater environment information, the fill light parameters and the quantum efficiency information of the electronic device; and, based on the first image parameters, perform white balance processing on the first image to obtain a second image.
[0375] Optionally, the processor 110 is also used to control the LED module 111 to perform fill light according to the fill light parameters during underwater shooting of the camera, and then, upon receiving a video recording control input, control the camera to record a first video; and determine the second image parameters based on the underwater environment information, the fill light parameters and the quantum efficiency information of the electronic device; and, based on the second image parameters, perform white balance processing on all video frames of the first video frame by frame to obtain a second video.
[0376] Optionally, the user input unit 107 is used to control the LED module 111 to perform fill light according to the fill light parameters during the process of underwater shooting of images or videos by the camera, and then receive a control input of an adjustment mark in the shooting preview interface of the underwater shooting mode; the display unit 106 is used to display a light source brightness adjustment control, a light divergence angle adjustment control, a red light adjustment control, a green light adjustment control and a blue light adjustment control in response to the control input; the processor 110 is also used to adjust the light source brightness of the LED module 111 when receiving an adjustment input to the light source brightness adjustment control; and adjust the light divergence angle of the LED module 111 when receiving an adjustment input to the light divergence angle adjustment control; and, when receiving an adjustment input to the red light adjustment control, adjust the relative intensity of red light in the LED module 111; and, when receiving an adjustment input to the green light adjustment control, adjust the relative intensity of green light in the LED module 111; and, when receiving an adjustment input to the blue light adjustment control, adjust the relative intensity of blue light in the LED module 111.
[0377] The electronic device provided in the embodiment of the present application can implement each process implemented in the above method embodiment and can achieve the same technical effect. To avoid repetition, it will not be described here.
[0378] The beneficial effects of various implementations in this embodiment can be specifically referred to the beneficial effects of the corresponding implementations in the above method embodiment. To avoid repetition, they will not be described again here.
[0379] It should be understood that in the embodiment of the present application, the input unit 104 may include a graphics processor (Graphics Processing Unit, GPU) 1041 and a microphone 1042, and the graphics processor 1041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The sensor 105 may include a pressure sensor 1051, and the pressure sensor 1051 can detect pressure. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 107 includes a touch panel 1071 and at least one of other input devices 1072. The touch panel 1071 is also called a touch screen. The touch panel 1071 may include two parts: a touch detection device and a touch controller. Other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.
[0380] The memory 109 can be used to store software programs and various data. The memory 109 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 109 may include a volatile memory or a non-volatile memory, or the memory 109 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 109 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.
[0381] The processor 110 may include one or more processing units; the processor 110 may include a microcontroller 1101. Optionally, the processor 110 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 110.
[0382] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0383] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.
[0384] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0385] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.
[0386] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0387] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.
[0388] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.
[0389] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.
Claims
1. An underwater shooting method, performed by an electronic device, characterized in that: The electronic device comprises a light emitting diode (LED) module and a camera; the method comprises: During the process of underwater image or video shooting by the camera, fill light parameters are determined according to underwater environment information; The LED module is controlled to perform fill light according to the fill light parameters.
2. The method according to claim 1, characterized in that The electronic device further comprises a pressure sensor; the underwater environment information comprises underwater illumination information of sunlight in the underwater environment; Before determining the fill light parameters according to the underwater environment information, the method further includes: Obtaining the water pressure value of the electronic device through the pressure sensor; Calculating the underwater depth of the electronic device underwater based on the water pressure value; Based on the underwater depth value and the water surface illumination information, the underwater illumination information is calculated, and the water surface illumination information is the illumination information of the sunlight on the water surface.
3. The method according to claim 2, characterized in that The sunlight includes red light, green light and blue light, and the water surface illumination information includes red light water surface illumination information corresponding to the red light, green light water surface illumination information corresponding to the green light and blue light water surface illumination information corresponding to the blue light; The calculating the underwater illumination information based on the underwater depth value and the water surface illumination information comprises: Calculating a remaining light ratio value corresponding to the red light based on the underwater depth value and the attenuation coefficient of the wavelength of the red light; Calculating the red light underwater illumination information corresponding to the red light based on the product of the light remaining proportion value corresponding to the red light and the red light water surface illumination information; Calculating a remaining light ratio value corresponding to the green light based on the underwater depth value and the attenuation coefficient of the wavelength of the green light; Calculating the red light underwater illumination information corresponding to the green light based on the product of the remaining proportion value of the green light and the green light water surface illumination information; Calculating a remaining light ratio value corresponding to the blue light based on the underwater depth value and the attenuation coefficient of the wavelength of the blue light; Based on the product of the light remaining proportion value corresponding to the blue light and the blue light water surface illumination information, the red light underwater illumination information corresponding to the blue light is calculated.
4. The method according to claim 3, characterized in that: Determining fill light parameters according to underwater environment information includes: Determining a red light fill light parameter corresponding to the red light based on the red light underwater illumination information corresponding to the red light; Determining a green light fill light parameter corresponding to the green light based on the green light underwater illumination information corresponding to the green light; Based on the blue light underwater illumination information corresponding to the blue light, a blue light fill light parameter corresponding to the blue light is determined.
5. The method according to claim 1, characterized in that The electronic device further comprises a microcontroller; the LED module comprises a red LED submodule, a green LED submodule and a blue LED submodule; In the process of shooting an image or video underwater by the camera, controlling the LED module to perform fill light according to the fill light parameter includes: Based on the microcontroller, the duty cycles of the red LED submodule, the green LED submodule and the blue LED submodule are adjusted respectively to control the LED modules to perform fill light.
6. The method according to claim 1, characterized in that The fill light parameter includes a light divergence angle; the LED module includes an LED light source and a zoom structure; In the process of shooting an image or video underwater by the camera, controlling the LED module to perform fill light according to the fill light parameter includes: Based on the field of view angle of the camera used by the electronic device to collect images, the distance between the LED light source and the zoom structure is adjusted to provide fill light during underwater image or video shooting by the camera using the light divergence angle corresponding to the field of view angle after the distance adjustment.
7. The method according to claim 1, characterized in that In the process of shooting an image or video underwater by the camera, after controlling the LED module to perform fill light according to the fill light parameter, the method further includes: When receiving a shooting control input, controlling the camera to shoot a first image; Determining a first image parameter according to the underwater environment information, the fill light parameter, and the quantum efficiency information of the electronic device; Based on the first image parameters, white balance processing is performed on the first image to obtain a second image.
8. The method according to claim 1, characterized in that In the process of shooting an image or video underwater by the camera, after controlling the LED module to perform fill light according to the fill light parameter, the method further includes: When receiving a video recording control input, controlling the camera to record a first video; Determining a second image parameter based on the underwater environment information, the fill light parameter, and the quantum efficiency information of the electronic device; Based on the second image parameters, white balance processing is performed frame by frame on all video frames of the first video to obtain a second video.
9. The method according to claim 1, characterized in that: In the process of shooting an image or video underwater by the camera, after controlling the LED module to perform fill light according to the fill light parameter, the method further includes: Receiving control input of an adjustment mark in a shooting preview interface of an underwater shooting mode; In response to the control input, a light source brightness adjustment control, a light divergence angle adjustment control, a red light adjustment control, a green light adjustment control, and a blue light adjustment control are displayed; When receiving an adjustment input to the light source brightness adjustment control, adjusting the light source brightness of the LED module; When receiving an adjustment input to the light divergence angle adjustment control, adjusting the light divergence angle of the LED module; When receiving an adjustment input to the red light adjustment control, adjusting the relative intensity of the red light in the LED module; When receiving an adjustment input to the green light adjustment control, adjusting the relative intensity of the green light in the LED module; When an adjustment input to the blue light adjustment control is received, the relative intensity of the blue light in the LED module is adjusted.
10. An underwater shooting device, characterized in that: The underwater shooting device includes a light emitting diode (LED) module and a camera; the underwater shooting device also includes: A determination module, used to determine fill light parameters according to underwater environment information during the process of underwater image or video shooting by the camera; The control module is used to control the LED module to perform fill light according to the fill light parameters determined by the determination module.
11. The device according to claim 10, characterized in that The electronic device further includes a pressure sensor; the underwater environment information includes underwater illumination information of sunlight in the underwater environment; the underwater shooting device further includes: An acquisition module, used for acquiring the water pressure value of the electronic device through the pressure sensor before the determination module determines the fill light parameter according to the underwater environment information; A calculation module is used to calculate the underwater depth value of the electronic device underwater based on the water pressure value obtained by the acquisition module; and to calculate the underwater illumination information based on the underwater depth value and the water surface illumination information, wherein the water surface illumination information is the illumination information of the sunlight on the water surface.
12. The device according to claim 11, characterized in that The sunlight includes red light, green light and blue light, and the water surface illumination information includes red light water surface illumination information corresponding to the red light, green light water surface illumination information corresponding to the green light and blue light water surface illumination information corresponding to the blue light; The computing module is specifically used for: Calculating a remaining light ratio value corresponding to the red light based on the underwater depth value and the attenuation coefficient of the wavelength of the red light; Calculating the red light underwater illumination information corresponding to the red light based on the product of the light remaining proportion value corresponding to the red light and the red light water surface illumination information; Calculating a remaining light ratio value corresponding to the green light based on the underwater depth value and the attenuation coefficient of the wavelength of the green light; Calculating the red light underwater illumination information corresponding to the green light based on the product of the remaining proportion value of the green light and the green light water surface illumination information; Calculating a remaining light ratio value corresponding to the blue light based on the underwater depth value and the attenuation coefficient of the wavelength of the blue light; Based on the product of the light remaining proportion value corresponding to the blue light and the blue light water surface illumination information, the red light underwater illumination information corresponding to the blue light is calculated.
13. The device according to claim 12, characterized in that The determination module is specifically used for: Determining a red light fill light parameter corresponding to the red light based on the red light underwater illumination information corresponding to the red light; Determining a green light fill light parameter corresponding to the green light based on the green light underwater illumination information corresponding to the green light; Based on the blue light underwater illumination information corresponding to the blue light, a blue light fill light parameter corresponding to the blue light is determined.
14. The device according to claim 10, characterized in that The electronic device further comprises a microcontroller; the LED module comprises a red LED submodule, a green LED submodule and a blue LED submodule; The control module is specifically used to adjust the duty ratios of the red LED submodule, the green LED submodule and the blue LED submodule respectively based on the microcontroller, so as to control the LED modules to perform fill light.
15. The device according to claim 10, characterized in that The fill light parameter includes a light divergence angle; the LED module includes an LED light source and a zoom structure; The control module is specifically used to adjust the distance between the LED light source and the zoom structure based on the field of view of the camera used to capture images by the electronic device, so as to perform fill light during the process of underwater image or video shooting by the camera through the light divergence angle corresponding to the field of view after the distance adjustment.
16. The device according to claim 10, characterized in that The underwater shooting device also includes: The control module is further configured to control the camera to capture a first image after controlling the LED module to perform fill light according to the fill light parameters during the process of the camera capturing images or videos underwater, and upon receiving a capture control input; The determination module is further used to determine the first image parameter according to the underwater environment information, the fill light parameter and the quantum efficiency information of the electronic device; A processing module is used to perform white balance processing on the first image taken by the control module based on the first image parameters determined by the determination module to obtain a second image.
17. The device according to claim 10, characterized in that The underwater shooting device also includes: The control module is further configured to control the camera to record a first video after controlling the LED module to perform fill light according to the fill light parameters during the process of the camera shooting an image or video underwater, and upon receiving a video recording control input; The determination module is further used to determine a second image parameter based on the underwater environment information, the fill light parameter and the quantum efficiency information of the electronic device; A processing module is used to perform white balance processing on all video frames of the first video shot by the control module frame by frame based on the second image parameters determined by the determination module to obtain a second video.
18. The device according to claim 10, characterized in that The underwater shooting device also includes: A receiving module, configured to receive a control input of an adjustment mark in a shooting preview interface of an underwater shooting mode after the control module controls the LED module to perform fill light according to the fill light parameter during the process of the camera shooting an image or video underwater; A display module, configured to display a light source brightness adjustment control, a light divergence angle adjustment control, a red light adjustment control, a green light adjustment control, and a blue light adjustment control in response to the control input received by the receiving module; An adjustment module is used to adjust the light source brightness of the LED module upon receiving an adjustment input to the light source brightness adjustment control; and to adjust the light divergence angle of the LED module upon receiving an adjustment input to the light divergence angle adjustment control; and to adjust the relative intensity of red light in the LED module upon receiving an adjustment input to the red light adjustment control; and to adjust the relative intensity of green light in the LED module upon receiving an adjustment input to the green light adjustment control; and to adjust the relative intensity of blue light in the LED module upon receiving an adjustment input to the blue light adjustment control.
19. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the underwater shooting method according to any one of claims 1 to 9 are implemented.
Citation Information
Cited By
Fishing camera interaction method and device, fishing camera and storage medium
CN120017975A
Fishing camera interaction method, device, fishing camera and storage medium
CN120017975B