Shooting method and related equipment

Abstract

The invention discloses a shooting method and related equipment, and belongs to the technical field of terminals. The method comprises the following steps: in response to a camera starting instruction, controlling a first camera to start; under the condition that the target switching power supply is turned on, in the starting process of the first camera, the dual-correlation sampling CDS frequency of the first camera is matched with the switching frequency of the target switching power supply, so that the CDS frequency and the switching frequency of the target switching power supply are in a frequency multiplication relationship, and the target switching power supply is an interference source of the first camera. According to the invention, the CDS frequency is matched with the switching frequency of the switching noise, so that the switching noise is eliminated in the calculation process of the CDS system, and the phenomenon that black stripes appear in an image due to the switching noise of the switching power supply is improved without increasing the cost.

Description

Technical Field

[0001] This application relates to the field of terminal technology, and in particular to a shooting method and related equipment. Background Technology

[0002] Currently, electronic devices such as mobile phones and tablets are equipped with cameras, which users can trigger to capture images and record videos.

[0003] In addition to cameras, electronic devices typically house switching power supplies on their motherboards. These power supplies convert the battery voltage into the voltage required by the functional modules, such as speakers, displays, and microphones. However, when shooting with a camera, some switching power supplies can become sources of interference, affecting image quality and causing dark stripes in the image. Summary of the Invention

[0004] This application provides a shooting method and related equipment, which can solve the problem that some switching power supplies can easily cause dark stripes in images when shooting through a camera. The technical solution is as follows:

[0005] Firstly, a shooting method is provided, applied to an electronic device, the method comprising:

[0006] In response to the camera start command, the first camera is controlled to start; when the target switching power supply is already turned on, during the startup process of the first camera, the CDS frequency of the first camera is matched with the switching frequency of the target switching power supply, so that the CDS frequency and the switching frequency of the target switching power supply are in a multiple relationship, and the target switching power supply is the interference source of the first camera.

[0007] For example, the first camera is camera A, and camera A is the main camera.

[0008] Thus, by matching the CDS frequency with the switching frequency of the switching noise, the switching noise can be eliminated during CDS system calculations, thereby improving the phenomenon of black stripes in images caused by the switching noise of the power supply without increasing costs.

[0009] As an example of this application, matching the CDS frequency of the first camera with the switching frequency of the target switching power supply includes: when there is only one target switching power supply, adjusting the CDS frequency according to the switching frequency of the target switching power supply; when there are multiple target switching power supplies, adjusting the switching frequencies of the multiple target switching power supplies according to the CDS frequency.

[0010] Thus, depending on the number of target switching power supplies, the CDS frequency or the switching frequency of the target switching power supply is adjusted to match the switching frequency of the target switching power supply while minimizing the impact on the operation of the target switching frequency.

[0011] As an example of this application, when the number of target switching power supplies is one, adjusting the CDS frequency according to the switching frequency of the target switching power supply includes: when the number of target switching power supplies is one, multiplying the switching frequency of the target switching power supply by a preset value to obtain a first CDS frequency; and adjusting the CDS frequency to the first CDS frequency.

[0012] This makes the CDS frequency a multiple of the target switching power supply's switching frequency, thus eliminating switching noise during the calculation process and achieving the goal of suppressing switching noise.

[0013] As an example of this application, when there are multiple target switching power supplies, adjusting the switching frequency of the multiple target switching power supplies according to the CDS frequency includes: when there are multiple target switching power supplies, multiplying the CDS frequency value by different preset values ​​to obtain multiple target switching frequencies, all of which are within the preset switching frequency range; and adjusting the switching frequency of the multiple target switching power supplies based on the multiple target switching frequencies.

[0014] In this way, the switching frequency of each target switching power supply can be adjusted to different values ​​according to the requirements, and the switching frequency of each target switching power supply after adjustment is within the preset switching frequency range, thus ensuring the stability of the target switching power supply output.

[0015] As an example of this application: when the target switching power supply is not turned on, the first camera is controlled to output an image; if the target switching power supply is in a standby state, the target switching frequency is determined according to the current CDS frequency; and the target switching power supply is controlled to operate at the target switching frequency.

[0016] Thus, during the operation of the first camera, as long as the target switching power supply is working, the switching frequency of the target switching power supply will be matched with the CDS frequency, which can minimize the impact of switching noise on the first camera.

[0017] As an example of this application, the electronic device includes a camera driver and a switching power supply driver; when the target switching power supply is turned on, before matching the CDS frequency of the first camera with the switching frequency of the target switching power supply during the startup process of the first camera, the device further includes: the camera driver querying corresponding switching information based on the camera identifier of the first camera, the switching information being used to indicate the target switching power supply; the camera driver sending a switching power supply status query request to the switching power supply driver, the switching power supply status query request carrying the switching information; the switching power supply driver sending a switching power supply status query response to the camera driver, the switching power supply status query response carrying switching power supply status indication information, the switching power supply status indication information being used to indicate that the target switching power supply is turned on, the switching power supply status indication information being determined based on the switching information.

[0018] In this way, when the camera driver needs to determine whether the target's power supply is on, it queries the switching power supply driver, ensuring the accuracy of the query results.

[0019] Secondly, a shooting method is provided, applied to an electronic device, the method comprising:

[0020] In response to the camera start command, the first camera is controlled to start. When the target switching power supply is already turned on, during the startup process of the first camera, the switching frequency of the target switching power supply is adjusted to a preset switching frequency. The difference between the preset switching frequency and the CDS frequency of the first camera is greater than the preset difference, and the target switching power supply is the interference source of the first camera.

[0021] The preset difference can be set according to requirements. For example, the target switching power supply can be adjusted to a low frequency, or the target switching power supply can be adjusted to a high frequency.

[0022] As an example, the adjusted target switching power supply has a switching frequency within the preset switching frequency range.

[0023] Thus, by adjusting the switching frequency of the target power supply to a high or low frequency, the dark stripe effect in the image can also be reduced.

[0024] As an example of this application, the method also includes:

[0025] If the first camera is turned off, the switching frequency of the target power supply is restored to the first switching frequency; when the first camera is turned on again, the switching frequency of the target power supply is readjusted to the preset switching frequency.

[0026] Thus, based on the status of the first camera, the switching frequency of the target power supply is dynamically adjusted to suppress the impact of switching noise on the first camera in a timely manner.

[0027] In a second aspect, an electronic device is provided, the electronic device comprising: one or more processors, and a memory; the memory being coupled to the one or more processors, the memory being used to store computer program code, the computer program code including computer instructions, wherein the one or more processors invoke the computer instructions to cause the electronic device to perform the method as described in any one aspect.

[0028] Thirdly, a chip system is provided, the chip system being applied to an electronic device, the chip system including one or more processors, the one or more processors being configured to invoke computer instructions to cause the electronic device to perform the method as described in any one of the first aspects.

[0029] Fourthly, a computer-readable storage medium is provided, the computer-readable storage medium including instructions that, when executed on an electronic device, cause the electronic device to perform the method as described in any one of the first aspects.

[0030] Fifthly, a computer program product containing instructions is provided that, when run on a computer, causes the computer to perform the method described in the first aspect.

[0031] The technical effects achieved by the second, third, fourth, and fifth aspects mentioned above are similar to those achieved by the corresponding technical means in the first aspect mentioned above, and will not be repeated here. Attached Figure Description

[0032] Figure 1 This is a schematic diagram illustrating an analog power supply for powering a camera according to an exemplary embodiment;

[0033] Figure 2 This is a schematic diagram illustrating dark stripes in an image according to an exemplary embodiment;

[0034] Figure 3 This is a schematic diagram illustrating a representation of switching noise according to an exemplary embodiment;

[0035] Figure 4 This is a schematic diagram illustrating the deployment of a portion of a motherboard according to an exemplary embodiment;

[0036] Figure 5 This is a waveform diagram of a switching noise according to an exemplary embodiment;

[0037] Figure 6 This is a schematic diagram illustrating an application scenario according to an exemplary embodiment;

[0038] Figure 7This is a schematic diagram of the architecture of a software system for an electronic device according to an exemplary embodiment;

[0039] Figure 8 This is a schematic diagram illustrating the implementation flow of a shooting method according to an exemplary embodiment;

[0040] Figure 9 This is a schematic diagram illustrating the sampling of switching noise by a CDS system according to an exemplary embodiment;

[0041] Figure 10 This is a schematic flowchart illustrating a method for matching CDS frequency and switching frequency according to an exemplary embodiment;

[0042] Figure 11 This is a schematic flowchart illustrating a method for matching CDS frequency and switching frequency according to another exemplary embodiment;

[0043] Figure 12 This is a schematic diagram illustrating the implementation flow of a shooting method according to another exemplary embodiment;

[0044] Figure 13 This is a schematic diagram illustrating the degree of influence of switching noise on an image according to an exemplary embodiment;

[0045] Figure 14 This is a schematic diagram illustrating the degree of influence of switching noise on an image according to another exemplary embodiment;

[0046] Figure 15 This is a schematic diagram illustrating a sampling of low-frequency switching noise according to an exemplary embodiment;

[0047] Figure 16 This is a schematic diagram illustrating a process for adjusting the switching frequency according to an exemplary embodiment;

[0048] Figure 17 This is a schematic diagram illustrating the implementation flow of a shooting method according to another exemplary embodiment;

[0049] Figure 18 This is a schematic diagram of the structure of an electronic device according to an exemplary embodiment. Detailed Implementation

[0050] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings.

[0051] It should be understood that "multiple" as mentioned in this application refers to two or more. In the description of this application, unless otherwise stated, " / " indicates "or," for example, A / B can mean A or B; "and / or" in this document is merely a description of the relationship between related objects, indicating that three relationships can exist, for example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Furthermore, to facilitate a clear description of the technical solutions of this application, the terms "first," "second," etc., are used to distinguish identical or similar items with essentially the same function and effect. Those skilled in the art will understand that the terms "first," "second," etc., do not limit the quantity or execution order, and that "first," "second," etc., do not necessarily imply differences.

[0052] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0053] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, use and processing of the relevant data must comply with the relevant regulations and standards of the relevant countries and regions, and corresponding operation entry points are provided for users to choose to authorize or refuse.

[0054] In this application's embodiments, the "user interface (UI)" is the medium through which an application or operating system interacts and exchanges information with the user. It converts the internal form of information into a form that the user can receive. The user interface is source code written in a specific computer language such as Java or Extensible Markup Language (XML). This source code is parsed and rendered on the electronic device, ultimately presenting content that the user can recognize. A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. Typically, it can be visible interface elements such as text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets displayed on the screen of an electronic device.

[0055] Before introducing the shooting method provided in the embodiments of this application, the nouns and terms involved in the embodiments of this application will be introduced first.

[0056] 1. CMOS image sensor

[0057] A complementary metal-oxide-semiconductor (CMOS) image sensor is a device that converts light signals into electrical signals. It integrates an image acquisition unit and a signal processing unit. The image acquisition unit can realize the conversion of photoelectric signals, and the signal processing unit can process the photoelectric signals to realize the perception and processing of optical information such as color and brightness.

[0058] 2. Switching power supply

[0059] A typical switching power supply includes inductors, switching elements (such as transistors), and high-frequency transformers. The inductor works in conjunction with the switching elements and the high-frequency transformer to control the flow of current by controlling the high-frequency switching of the switching elements, thereby regulating the output voltage. In electronic devices, the function of a switching power supply is to convert the voltage output from the battery into the voltage required by the corresponding functional modules for operation.

[0060] Electronic devices typically include multiple functional modules, each performing a different function. For example, these modules might include a display module and an audio module. The display module handles the user interface, while the audio module plays audio. During operation, different functional modules usually require different voltages. To meet these voltage requirements, a corresponding switching power supply is typically configured on the motherboard of the electronic device. This power supply converts the battery voltage to the voltage needed for the corresponding functional module to operate. For instance, the switching power supply for a functional module converts the battery voltage to the voltage required for its internal operation, and the switching power supply for the audio module converts the battery voltage to the voltage required for its internal operation.

[0061] Currently, electronic devices such as mobile phones and tablets are generally equipped with cameras, which allow them to capture images and record videos. Cameras typically contain image sensors, such as CMOS image sensors. An image sensor is an image capture device that uses exposure to capture light signals (light rays) in a scene, converting these light signals into electrical signals. These electrical signals can then be processed and stored as an image.

[0062] Image sensors can capture images using a line-by-line exposure method. The image generation process mainly includes the following steps:

[0063] 1. Photoelectric conversion.

[0064] An image sensor comprises a pixel array, which includes multiple pixel units, each of which typically contains a photosensitive element (such as a photodiode). When external light shines on the pixel array of the image sensor, the photosensitive element of each pixel unit undergoes the photoelectric effect, converting the light signal into an electrical signal, that is, generating a corresponding charge within the pixel unit. The amount of this charge is proportional to the intensity of the incident light.

[0065] It should be noted that before each exposure, the image sensor in the camera can reset the photosensitive element of each pixel unit to a known starting voltage level via a reset transistor. For example, the voltage of the photosensitive element of each pixel unit is pulled up to a preset reset voltage level, such as the power supply voltage VDD, to ensure that each exposure starts from the same reference.

[0066] In one example, the power supply voltage VDD can be provided using an analog power supply. See also Figure 1The analog power supply includes AVDD and AGND, where AVDD is the operating voltage in the analog power supply, and AGND is the reference ground or zero potential point in the analog power supply. It's easy to understand that traces are deployed between AVDD and AGND and the image sensor; these traces can be called the camera's power path traces.

[0067] 2. Charge accumulation.

[0068] During exposure, the photosensitive element of each pixel unit accumulates a certain amount of charge. This charge can be stored in the potential well (or storage area) of the pixel unit, and the amount of charge accumulated is proportional to the amount of incident light received by that pixel unit. This process is generally called the integration time. The longer the integration time, the more charge accumulates, and the brighter the image.

[0069] In this context, a potential well can be understood as a capacitive element formed by the photosensitive element in a pixel unit together with the surrounding structure, used to store the charge generated by the photosensitive element.

[0070] 3. Signal reading.

[0071] After exposure, the charge of each pixel unit is read out and converted into a voltage signal. Typically, in image sensors (such as CMOS image sensors), a charge-to-voltage converter is located in or near each pixel unit. After exposure, the charge-to-voltage converter converts the charge accumulated in the corresponding pixel unit into a voltage signal. Then, the row selection logic unit can select the corresponding row pixel unit, so that the voltage signal in the row pixel unit is output to the corresponding analog signal processing unit through the signal bus of its respective column.

[0072] 4. Signal processing.

[0073] The analog signal processing unit amplifies, samples, and holds the read voltage signal.

[0074] 5. Modular-to-digital conversion.

[0075] The processed voltage signal is converted into a digital signal by an A / D converter (ADC device). These digital signals represent the raw data of the image, i.e., RAW data. RAW data contains the brightness and color information of the image and usually needs to be further processed by an image signal processing (ISP) to obtain the final image.

[0076] 6. Image reconstruction.

[0077] The ISP processes the RAW data through de-mosaicing, white balance, color correction, and sharpening to restore the true colors and details of the scene, thereby reconstructing a high-quality image.

[0078] Typically, due to differences in the manufacturing process of image sensors, some system noise exists. For example, the optical and electrical characteristics of each pixel unit may be inconsistent. For instance, the size of the photosensitive device and the doping concentration can cause variations in the voltage signal output by the pixel unit. These inconsistencies result in significant differences in the voltage signals output by different pixel units under the same lighting conditions.

[0079] System noise manifests as variations in brightness and darkness in an image, or in other words, it can cause dark stripes to appear in the final generated image, for example, see [link to example]. Figure 2 , Figure 2 This is a schematic diagram illustrating an image with dark stripes according to an exemplary embodiment.

[0080] Considering that system noise is relatively fixed under specific system and environment conditions, meaning that the system noise value does not change over time under the same operating conditions, in some examples, a correlated double sampling (CDS) system is provided in the image sensor. The CDS system samples the voltage signal once before and once after exposure at a certain CDS frequency. Then, the two sampled values ​​are subtracted, which can basically eliminate the interference of system noise, thereby improving the signal-to-noise ratio, reducing dark stripes caused by system noise, and improving the sensitivity and image quality of the image sensor.

[0081] The CDS frequency is the frequency at which the correlated double sampling operation is performed.

[0082] For example, taking correlated double sampling of pixel units in a certain row as an example, the CDS system collects the voltage signal output by the pixel unit as V1 before exposure, V1 = R + N1, where R is the system noise and N1 is other noise sampled before exposure. After exposure, the voltage signal output by the pixel unit is collected again as V2, V2 = R + N2 + S, where S is the voltage signal converted from the light signal and N2 is other noise sampled after exposure. After subtraction, (R + S + N2) - (R + N1) = S - (N2 - N1). It can be seen that the system noise R can be eliminated by sampling twice and subtracting.

[0083] However, as described above, not only system noise but also other noise exists during image imaging. When using a CDS system for signal processing, if N2 and N1 are very close, and if N2-N1 is equal to or approximately equal to 0, then the other noise can be eliminated by subtracting the two sampling results. However, when N2 and N1 differ significantly, i.e., N2-N1 is not equal to or not approximately equal to 0, then after two samplings and subtraction, other noise still exists, meaning that other noise is still superimposed on the final image information. Since the image sensor exposes line by line when capturing the image, when the difference in other noise superimposed between lines is large, for example, the noise difference between the first m lines and the middle lines (such as the (m+1)th to the (m+L)th lines, where L>1), it is easy to cause dark stripes to still appear in the final generated image.

[0084] Specifically, the analysis of other noise factors that can easily lead to dark stripes in images is as follows:

[0085] As mentioned earlier, image sensors capture images by exposure line by line. The image information of each pixel in each row of the final image is determined based on the charge within the pixel unit. In other words, the original form of the image information of each pixel in each row of the final image is charge. In the presence of noise, the charge of each pixel unit includes not only the electrical signal converted from the light signal but also the noise signal. Since the magnitude of the charge directly reflects the brightness of the image, the presence of noise, especially when the noise level is high, can easily lead to large differences in brightness between rows, resulting in the phenomenon of dark stripes.

[0086] For example, before the exposure of the i-th (i ≥ 1) row, the voltage signal sampled by the CDS system is R + N1; after the exposure of the i-th row, the voltage signal sampled by the CDS system is R + N2 + S1. See [link to relevant documentation]. Figure 3 In (a), the difference between N2 and N1 is as follows: Figure 3 As shown in 21 of (a) above, that is, after subtracting the two sampling results, other noise superimposed on the voltage signal of the i-th row pixel unit is as follows: Figure 3 As shown in section 21 of (a) above. Before the exposure of the (i+n)th row (n ≥ 1), the voltage signal sampled by the CDS system is R+N3, and after the exposure of the (i+n)th row, the voltage signal sampled by the CDS system is R+N4+S4. See [reference needed]. Figure 3 In (b), the difference between N4 and N1 is as follows: Figure 3 As shown in (b) 22, that is, after subtracting the two sampling results, other noise superimposed on the voltage signal of the pixel unit in the (i+n)th row is as follows: Figure 3As shown in section 22 of (b) in the image. The noise superimposed on the (i+n)th row is much greater than the noise superimposed on the (i)th row. As a result, the brightness of the (i+n)th row in the final generated image is much brighter than that of the (i)th row. This difference in brightness can easily manifest as dark stripes in the image.

[0087] It should be noted that the above example only uses a single row as an illustration. In general, the presence of other noise can easily lead to large differences in brightness between multiple rows. For example, the brightness difference between the first m rows and the middle rows (such as rows m+1 to m+L, where L>1) is large. The principle is similar, so dark stripes in the image are more obvious.

[0088] In one possible scenario, other noise affecting image quality includes switching noise from the power supply. Switching noise can be a source of interference for camera shooting because electronic devices contain many components. To efficiently deploy these components on the motherboard, engineers typically use a layered approach, placing each component separately on the motherboard. That is, the motherboard of an electronic device usually contains multiple circuit boards with complex wiring. In one possible case, one or more power supplies may be deployed on the layer above (or below) the camera's power path, physically very close to it. For example, see [link to example]. Figure 4 A switching power supply is deployed on the layer above the camera's power path trace, with its projection resting on the AVDD trace (or AGND trace). As mentioned earlier, the analog power supply is used to provide the reset voltage for the photosensitive element. When the switching power supply is deployed in this manner, the high-frequency alternating signal generated by the high-frequency switching action of the switching elements in the switching power supply will affect the reset voltage of the photosensitive element, thus becoming a source of interference for the camera.

[0089] The reason why switching noise can easily cause dark stripes in images is that the switching noise of a switching power supply is usually a high-frequency alternating signal, for example, see... Figure 5 , Figure 5 This is a waveform diagram illustrating the switching noise of a switching power supply according to an exemplary embodiment, such as... Figure 5 As shown in (a), the switching noise may be a sine wave, and so on. Figure 5 As shown in (b), switching noise can also be a square wave. Therefore, during signal processing using a CDS system, if the difference between the switching noise samples taken before and after each exposure is not zero, see, for example... Figure 5In (a), the CDS system samples switching noise at sampling point a before an exposure and at sampling point b after the exposure. Subtracting the two sampled values ​​reveals that the switching noise is not eliminated, i.e., it is not zero. As analyzed earlier, if the switching noise is not eliminated during the CDS system's calculation process, it can easily lead to different brightness differences between rows, resulting in black stripes in the image.

[0090] In some embodiments, to reduce switching noise, the motherboard traces are typically redeployed to avoid the power supply and camera power path traces being too close together. However, this requires modifications to the motherboard, increasing the cost of hardware improvements. In other embodiments, to reduce switching noise, filter capacitors are typically added to filter out the switching noise, but this also increases hardware costs.

[0091] Therefore, this application provides a method that is applied to scenarios where dark stripes appear in the preview screen or captured image or video due to the switching noise of the power supply during camera shooting.

[0092] For example, in some situations, when a phone opens its camera to take a photo or record video, the live preview displayed on the screen may have dark stripes, or in other words, dark stripes may appear in the preview image. Another example is when the phone's shutter button is pressed, dark stripes may appear in the image captured or the video recorded.

[0093] The following combination Figure 6 The scenarios in the example are illustrated. Figure 6 This is a schematic diagram illustrating an application scenario according to an exemplary embodiment. Here, a mobile phone is used as an example electronic device. Figure 6 As shown in (a), the phone's home screen displays a camera application icon 61. When a user wants to take a picture, they can tap the camera application icon 61. In response to the user's tap on the application icon 61, the electronic device displays... Figure 6 The interface shown in (b) is the camera application's shooting interface. This interface includes a viewfinder 62, a shooting control 63, a camera rotation control 64, an image preview control 65, and a focus option 66. The shooting control 63 triggers the electronic device to perform a shooting operation; the camera rotation control 64 triggers the electronic device to switch cameras; the image preview control 65 triggers the electronic device to display the captured image or video; and the focus option 66 can trigger the electronic device to adjust the camera's focus and switch cameras when the focus is adjusted to a certain level.

[0094] The viewfinder 62 is used to display a real-time preview image. As can be seen, in... Figure 6In the interface shown in (b), due to the presence of switching noise, the preview image displayed in the viewfinder 62 is prone to having black stripes, such as... Figure 6 As shown in (b) of the diagram, 67.

[0095] In one example, when a user wants to take a picture, they can click the capture control 63. In response to the user's click on the capture control 63, the electronic device performs a capture operation through the camera, obtaining image p1. See [link to example]. Figure 6 In step (c), the electronic device displays a preview image of picture p1 on the image preview control 65. The user can click the image preview control 65 to view the captured image p1. (See also...) Figure 6 In step (d), in response to the user's click on the image preview control 65, the electronic device displays an image display interface, which shows image p1. In one possible case, due to the influence of switching noise, black stripes may appear in the captured image p1.

[0096] The method provided in this application eliminates switching noise during CDS system calculation by matching the CDS frequency with the switching frequency of the switching noise, thereby improving the phenomenon of black stripes in the image caused by the switching noise of the switching power supply without increasing costs.

[0097] It should be noted that, Figure 6 The application scenarios described are merely illustrative and do not constitute a limitation on the embodiments of this application. The embodiments of this application can also be applied to other scenarios using cameras, such as scenarios with other shooting modes, including portrait, night scene, photo, video recording, and more. Furthermore, they can also be applied to video recording scenarios, video call scenarios, live video streaming scenarios, etc., and the embodiments of this application do not limit these applications.

[0098] It should be understood that Figure 6 The illustration shows an interface diagram of a user taking a picture in portrait mode on a mobile phone. However, the embodiments of this application are not limited to this. For example, a user can take a picture in landscape mode on a mobile phone.

[0099] It should also be noted that the embodiments of this application are only illustrated with the example of a person being photographed. In another example, the subject may also be an animal, a vehicle, a building, etc. The embodiments of this application do not limit the subject being photographed.

[0100] The above scenario uses a mobile phone as an example for illustration. In another example, the electronic device can also be other devices equipped with a camera, such as tablets, desktops, laptops, handheld computers, notebook computers, ultra-mobile personal computers (UMPCs), netbooks, etc. This application embodiment does not limit this.

[0101] The software system of the electronic device will be explained next.

[0102] See Figure 7 , Figure 7 This is a schematic diagram illustrating the architecture of a software system for an electronic device according to an exemplary embodiment. The software system of the electronic device can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application embodiment uses the layered architecture Android system as an example to exemplify the software system of the electronic device.

[0103] Figure 7 This is a block diagram of a software system for an electronic device provided in an embodiment of this application. See also... Figure 7 A layered architecture divides software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer (App layer), the application framework layer (FWK layer), the hardware abstraction layer (HAL layer), and the kernel layer.

[0104] The application layer can include a series of application packages. For example... Figure 7 As shown, the application package can include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and SMS. These applications are used for direct interaction with the user. These applications can be built into the system or are non-system applications. Furthermore, these applications may have icons and an application interface, or they may have an application interface but no icon, or they may have neither an icon nor an application interface.

[0105] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions. For example... Figure 7As shown, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, etc.

[0106] The window manager is used to manage windowed applications. It can retrieve screen size, determine the presence of a status bar, lock the screen, and capture screenshots, among other things.

[0107] Content providers are used to store and retrieve data and make that data accessible to applications. This data can include videos, images, audio, phone calls made and received, browsing history and bookmarks, phone books, etc.

[0108] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build the display interface of an application. The display interface can consist of one or more views; for example, it may include a view displaying SMS notification icons, a view displaying text, and a view displaying images.

[0109] A phone manager is used to provide communication functions for electronic devices, such as managing call status (including connection, hang-up, etc.).

[0110] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, etc.

[0111] The notification manager allows applications to display notifications in the status bar. These notifications can be used to convey informational messages and can disappear automatically after a short pause, requiring no user interaction. The notification manager can also display notifications as icons or scrolling text in the system's top status bar, such as notifications from background applications. Furthermore, the notification manager can display notifications as dialog boxes on the screen, such as text messages in the status bar, sound alerts, vibrations, and flashing indicator lights.

[0112] The Hardware Abstraction Layer (HAL) sits between the framework layer and the kernel layer, and its purpose is to abstract the hardware. The HAL hides the hardware interface details of a specific platform, providing a virtual hardware platform for the software system, making it hardware-independent and portable across multiple platforms. As an example, the HAL includes a camera control module, which can be used to control camera startup, acquire video streams, etc. For instance, the camera control module is called CameraHAL.

[0113] The kernel layer is the layer between hardware and software. It contains drivers for power supplies, displays, cameras, audio, sensors, etc. These drivers enable the corresponding hardware.

[0114] A switching power supply driver is used to control the operation of a switching power supply, such as turning it on and off, and ensuring it operates at a set switching frequency. As an example, the switching power supply driver and the camera driver can exchange data via inter-process communication.

[0115] The camera driver is used to drive the camera, such as the front / rear camera.

[0116] Display drivers, audio drivers, and sensor drivers can be used to drive displays, audio players, sensors, etc., respectively.

[0117] In the above Figure 7 Based on the electronic device shown, the imaging method provided in the embodiments of this application will now be described in detail. See also... Figure 8 , Figure 8 This is a flowchart illustrating a shooting method according to an exemplary embodiment, and is intended as an example rather than a limitation. The embodiments of this application apply this method to... Figure 7 The electronic device shown is illustrated using the example of an electronic device implemented through the interaction of multiple modules. This method may include some or all of the following:

[0118] S801. Upon receiving the startup command, the camera application begins to start.

[0119] In one example, after receiving a user's command to launch the camera app, the electronic device controls the camera app to start. For example, see [link to example]. Figure 6 In (a), the desktop interface of the electronic device provides an application icon 61 for the camera application. In response to the user's click on the application icon 61, the camera application starts.

[0120] It should be noted that this application embodiment is illustrated using a scenario where a camera application is opened and a camera is used to take a picture. In another example, it can also be applied to other scenarios where a camera is used, such as a scenario where a user triggers an electronic device to turn on the camera in an instant messaging application to conduct a video call, or a scenario where the camera is switched, etc. This application embodiment does not limit these scenarios.

[0121] S802: The camera application sends a camera start command to the camera control module. The camera start command is used to start camera A.

[0122] Optionally, the electronic device may be equipped with multiple cameras, such as a main camera, an ultra-wide-angle camera, and a telephoto camera. In this case, the camera activation command may also include a camera identifier, which uniquely identifies a camera. Based on the camera identifier, it can be determined which camera needs to be activated. For example, the camera activation command may carry a camera identifier A to identify the camera A to be activated.

[0123] Optionally, the camera activation command may carry camera mode indication information, which is used to indicate the camera mode.

[0124] As an example, a camera application can send a camera start command to the camera control module through the application framework layer. For instance, it can call a camera-related service (such as CameraService) in the application framework layer to trigger the camera service to send a camera start command to the camera control module.

[0125] S803: The camera control module sends a camera start command to the camera driver.

[0126] S804: In response to the camera start command, the camera driver controls the camera to start and determines whether the target switching power supply associated with camera A is turned on.

[0127] The target switching power supply refers to the switching power supply among all the switching power supplies of the electronic device that will affect the shooting of camera A.

[0128] When there are multiple cameras, the power supply affecting each camera may be different. For example, for the main camera, the power supplies affecting its shooting include power supply a and power supply b, while for the telephoto camera, the power supply affecting its shooting includes power supply c. Therefore, the camera driver needs to determine the target power supply affecting camera A.

[0129] In one example, the camera driver may store the correspondence between the camera identifier of each camera and the switching information of the associated power supply. A switching information is used to uniquely identify a power supply, such as the virtual ID or name of the power supply.

[0130] For example, for any one of multiple cameras, a technician can determine which one or more power supplies will affect the image capture of that camera, designate this one or more power supplies as the power supplies associated with that camera, and establish a correspondence between the camera identifier of that camera and the switching information of this one or more power supplies in the camera driver. In this way, a correspondence can be established between the camera identifiers of each camera and the switching information of the associated power supplies.

[0131] In this way, the camera driver can determine the corresponding switch information from the correspondence based on the camera identifier A in the camera startup command, and then determine the target switching power supply corresponding to the camera based on the determined switch information.

[0132] Of course, the above example assumes there are multiple cameras. In another example, there might only be one camera, i.e., only camera A is configured. In this case, the camera driver can store the correspondence between the camera identifier of camera A and the switching information of the target power supply. Alternatively, the camera driver can only record the switching information of the target power supply that affects camera A, i.e., it does not store the correspondence. After receiving the camera start command, the camera driver can directly query the switching information of the target power supply locally to determine the target power supply.

[0133] In one possible scenario, the target power supply in the electronic device that affects camera A's shooting is not activated. For example, if the target power supply is used to provide voltage to a speaker, it is not activated when the speaker is not in use. In another possible scenario, the target power supply in the electronic device that affects camera A's shooting is activated. For example, if the target power supply is used to provide voltage to the display screen, it is activated when the screen is on. It is easy to understand that if the target power supply is not activated, it will not affect camera A's shooting. However, if the target power supply is activated, its switching frequency will affect camera A's shooting. Therefore, after receiving the camera start command, the camera driver controls camera A to start. Simultaneously, during the camera A start-up process, it determines whether the target power supply is activated, thereby determining whether switching noise needs to be suppressed.

[0134] As an example, the implementation of a camera driver to determine whether the target's power supply is on can include the following methods:

[0135] In one exemplary implementation, after receiving a camera start command, the camera driver determines the on / off information of the corresponding target power supply based on the camera identifier A carried in the camera start command. Then, it sends a power supply status query request to the power supply driver, which carries the on / off information of the target power supply. Accordingly, since the power supply driver is used to drive the power supplies, it can know which power supplies are started. Therefore, the power supply driver can determine whether the corresponding target power supply is turned on based on the on / off information carried in the power supply status query request, and sends a power supply status query response back to the motherboard driver. This response carries power supply status indication information, which indicates whether the target power supply is turned on, thus enabling the power supply driver to know whether the target power supply is working.

[0136] In another exemplary implementation, the camera driver can periodically query the target switching power supply driver for its status and record the queried status. Thus, when it is necessary to determine whether the target switching power supply is turned on, the recorded status can be used for this purpose.

[0137] In another exemplary implementation, the power supply driver can also actively report the status of the target power supply. For example, when the target power supply is turned on, the power supply driver can report this to the camera driver, such as by sending a power supply on notification. This notification includes the on / off information of the target power supply, allowing the camera driver to know that the target power supply is on. When the target power supply is turned off, the power supply driver can send a power supply off notification to the camera driver. This notification includes the on / off information of the target power supply, allowing the camera driver to know that the target power supply is off. Accordingly, the camera driver can record the data reported by the power supply driver. Thus, when it is necessary to determine whether the target power supply is on, the camera driver can make the determination based on the recorded data.

[0138] In one possible scenario, the number of target switching power supplies that could affect camera A is one. In this case, the camera driver determines whether this single target switching power supply is activated.

[0139] In another possible scenario, there may be multiple target switching power supplies that affect camera A. In this case, the camera driver determines whether each of the multiple target switching power supplies is activated.

[0140] In one example, the power supply driver can report how many target power supplies are turned on. For instance, it can report the switching information of each target power supply that is turned on to the camera driver.

[0141] If the target switching power supply is already powered on, in one possible scenario, only one target switching power supply is powered on, in which case the operation proceeds to S805; in another possible scenario, multiple target switching power supplies are powered on, in which case the operation proceeds to S807. Additionally, if the target switching power supply is not powered on, the operation proceeds to S810.

[0142] S805: If the number of target switching power supplies that have been turned on is one, the camera driver determines the first CDS frequency based on the switching frequency of the target switching power supply that has been turned on.

[0143] If there is only one target switching power supply that has been activated, the camera driver can adjust the CDS frequency to match the switching frequency of the activated target switching power supply since the target switching power supply is working.

[0144] As an example, the camera driver can determine the first CDS frequency based on the switching frequency of the target power supply that has been started by multiplying the switching frequency of the target power supply that has been started by a preset value, and using the result of the multiplication as the first CDS frequency.

[0145] The preset value is an integer, and it can be set according to requirements. For example, the preset value can be set to 1 or 2, etc., but this application embodiment does not limit this.

[0146] In other words, the camera driver can adjust the CDS frequency of the CDS system to a multiple of the switching frequency of the target switching power supply that has been started.

[0147] The switching frequency of the target power supply that is already powered on can be determined from the power supply driver. For example, when the target power supply is already powered on, the camera driver can actively query the power supply driver for the switching frequency of the target power supply that is already powered on, or the power supply driver can actively report the switching frequency of the target power supply that is already powered on when reporting the power supply start notification.

[0148] Because the switching frequency of the target power supply is periodic, its period T1 can be expressed as 1 / f1, where f1 is the switching frequency of the target power supply. This means that the switching noise repeats its value every T1 time interval. Between two consecutive samples in the CDS system, if the sampling interval T2 is exactly a multiple of the period T1, then at the two sampling points, the switching noise returns to the same state, so the sampled switching noise values ​​are identical. By subtracting the two sampling results, the switching noise can be eliminated, thus minimizing the appearance of dark stripes in the image due to the influence of switching noise.

[0149] For example, suppose the first CDS frequency is fs, the switching frequency f1 is 2fs, the period T1 of the switching noise is 1 / f1, and the sampling interval T2 of the CDS system is 2T1. Since the switching noise completes a full cycle within each two sampling intervals, the value of the switching noise will repeat at each sampling point, i.e., it will be the same. Thus, after the CDS system samples twice consecutively and subtracts the samples, the switching noise in the resulting voltage signal will be 0, meaning the switching noise has been eliminated.

[0150] For example, see Figure 9 , Figure 9 This diagram illustrates a type of switching noise. The CDS system samples at the point of maximum amplitude of the switching noise each time, meaning the magnitude of the switching noise is the same in each sample. For example, before an exposure of a certain line, the voltage signal sampled by the CDS system is R+N1. After the exposure of that line, the voltage signal sampled by the CDS system is R+N2+S1, where N1 and N2 are the same. During the calculation process, after subtracting the two sampled values, the switching noise is reduced to 0, resulting in the voltage signal S1. Therefore, eliminating the switching noise during the calculation process ensures that the final image information does not include switching noise, thus solving the problem of dark stripes in the image caused by the presence of switching noise.

[0151] S806: The camera driver configures the first CDS frequency to the CDS system.

[0152] After the camera driver determines the first CDS frequency fs based on the switching frequency f1 of the target switching power supply that has been turned on, it configures the first CDS frequency fs to the CDS system so that the CDS system performs relevant double sampling operations according to the first CDS frequency fs.

[0153] When camera A is turned off, the camera driver deletes the configured first CDS frequency fs, that is, restores the original CDS frequency. The next time camera A is started, the CDS frequency can be configured again according to the above process.

[0154] S807: If there are multiple target switching power supplies that have been turned on, the camera driver determines the target switching frequency of each target switching power supply among the multiple target switching power supplies based on the current CDS frequency of the CDS system.

[0155] The target switching frequency is the subsequent switching frequency of the target switching power supply that has already been turned on.

[0156] If there are multiple target power supplies that are already turned on, it is not easy to adjust the CDS frequency based on the switching frequencies of these power supplies, since their switching frequencies may differ. In this case, the switching frequency of each target power supply can be adjusted according to the current CDS frequency of the CDS system, thereby reducing the impact of the switching noise of the target power supplies on the image captured by camera A.

[0157] In one example, the camera driver stores the current CDS frequency of the CDS system. The camera driver can multiply the current CDS frequency by a preset value, and based on the result of the multiplication, determine multiple target switching frequencies.

[0158] This means that the switching frequency of each activated target power supply can be adjusted to a multiple of the current CDS frequency. This eliminates switching noise during subsequent CDS system calculations, and the principle is the same as adjusting the CDS frequency to a multiple of the switching frequency mentioned earlier.

[0159] When determining multiple target switching frequencies, different preset values ​​can be multiplied by the current CDS frequency to obtain multiple different target switching frequencies. For example, if there are two target switching power supplies that are already turned on, two different preset values ​​can be multiplied by the current CDS frequency to obtain two different target switching frequencies, such as f2 and f3. Alternatively, the same preset value can be multiplied by the current CDS frequency, resulting in a single target switching frequency, meaning that all target switching frequencies are the same, such as f2.

[0160] As an example, when determining the target switching frequency for each target power supply based on the current CDS frequency, the camera driver can do so within a preset switching frequency range; that is, the determined target switching frequency falls within the preset switching frequency range. This preset switching frequency range is set based on the principle of not affecting the stability and quality of the target power supply's voltage output. The preset switching frequency range can be set according to requirements; for example, it can range from several hundred kHz to several megaHz.

[0161] In one possible scenario, different camera modes correspond to different CDS frequencies, and the camera driver can store the association between different camera modes and their corresponding CDS frequencies. Thus, in the implementation of adjusting the switching frequency of the target power supply based on the current CDS frequency, the camera driver determines the corresponding CDS frequency based on the camera mode indication information in the camera startup command. Then, it determines the target switching frequency based on the determined CDS frequency.

[0162] Of course, if different camera modes correspond to the same CDS frequency, the camera driver will directly determine the target switching frequency based on the current CDS frequency after receiving the camera start command.

[0163] S808: The camera driver sends the target switching frequency to the switching power supply driver.

[0164] As an example, after the camera driver determines the target switching frequency, it can send a frequency adjustment command to the power supply driver. The frequency adjustment command carries the determined target switching frequency to instruct the power supply driver to adjust the switching frequency of the target power supply to the target switching frequency.

[0165] It should be noted that this embodiment of the application illustrates the scenario where multiple target switching power supplies are already powered on. The camera driver determines the target switching frequency of each target switching power supply based on the current CDS frequency of the CDS system, and then sends the determined target switching frequency to the switching power supply driver. In another example, when multiple target switching power supplies are already powered on, the camera driver can also send the current CDS frequency to the switching power supply driver, which then determines the target switching frequency of each target switching power supply based on the current CDS frequency. The determination method can be found in S807.

[0166] S809: Switching power supply drive control adjusts the switching frequency of the target switching power supply to the target switching frequency.

[0167] As mentioned above, the switching power supply driver can be used to control the operation of the switching power supply. Therefore, after receiving the frequency adjustment command, the switching power supply driver responds to the frequency adjustment command by adjusting the current switching frequency of the switching power supply to the target switching frequency carried in the frequency adjustment command.

[0168] In one possible scenario, the frequency adjustment command carries a target switching frequency. In this case, the switching power supply driver controls multiple target switching power supplies to operate at the target switching frequency.

[0169] In another possible scenario, the frequency adjustment command may carry multiple target switching frequencies. In this case, the switching power supply driver can assign the multiple target switching frequencies to each target switching power supply, and control the multiple target switching power supplies to work at different target switching frequencies.

[0170] Optionally, the power supply driver can randomly assign multiple target switching frequencies. For example, the target power supply may include target power supply 1 and target power supply 2. The multiple target switching frequencies carried in the frequency adjustment command are f2 and f3, respectively. The power supply driver can control target power supply 1 to operate according to f2 and control target power supply 2 to operate according to f3.

[0171] Optionally, the switching power supply driver can also allocate multiple target switching frequencies according to a certain strategy, which is not limited in this embodiment.

[0172] It should be noted that the above explanation is based on the scenario where there is only one target switching power supply that is already turned on, and the camera driver adjusts the CDS frequency as an example. In another example, when there is only one target switching power supply that is already turned on, the camera driver can also determine the target switching frequency based on the current CDS frequency and send the target switching frequency to the switching power supply driver, so that the switching power supply driver adjusts the switching frequency of the one target switching power supply that is already turned on to the target switching frequency. This application embodiment does not limit this approach.

[0173] This application's embodiments are illustrated using the example of the target switching power supply being turned on, that is, as follows: Figure 10 As shown, during the startup process of camera A, it is determined whether the target switching power supply is turned on. If the target switching power supply is turned on, it is determined whether the number of turned-on target switching power supplies is greater than one. If not, that is, the number of turned-on target switching power supplies is one, the CDS frequency can be adjusted to match the switching frequency of the turned-on target switching power supply. If yes, that is, the number of turned-on target switching power supplies is multiple, the switching frequency of the turned-on target switching power supplies can be adjusted to match the current CDS frequency.

[0174] Of course, if the target switching power supply is not turned on, the drawing will be generated normally. See S810 for details.

[0175] S810: When the target switching power supply is not turned on, the camera driver controls camera A to output an image.

[0176] Before receiving a trigger operation on the shooting control 63, a preview screen is displayed. After receiving a trigger operation on the shooting control 63, the shooting operation is performed.

[0177] If the target switching power supply is not turned on, the CDS frequency is not matched with the switching frequency of the target switching power supply. In this case, the CDS system performs double correlation sampling operation according to the original CDS frequency.

[0178] Since the target power supply may be turned on during camera A's shooting process even when it is not turned on, this will still affect camera A's shooting if the switching frequency of the target power supply is not adjusted. Therefore, when the target power supply is turned on, the power supply driver can also determine whether camera A is turned on. If camera A is turned on, the switching frequency of the target power supply can be matched with the CDS frequency of camera A. For example, see... Figure 11 If the target power supply is turned on, it can be determined whether camera A is turned on. If camera A is turned on, the switching frequency of the target power supply can be adjusted to match the CDS frequency, and then the target power supply can be controlled to work according to the adjusted switching frequency; otherwise, if camera A is not turned on, the target power supply can be controlled to work according to the original switching frequency.

[0179] Next, combine Figure 12 This paper introduces the process of matching the CDS frequency on the driver side of the switching power supply with the switching frequency of the target switching power supply. For example... Figure 12 As shown, it can mainly include some or all of the following:

[0180] S1201: When the target switching power supply needs to work, the switching power supply driver sends a camera status query request to the camera driver.

[0181] As an example, when the upper layer of an electronic device needs to call a functional module whose corresponding power supply is the target power supply, the power supply driver will be triggered to control the target power supply to start. For example, if the target power supply is the power supply corresponding to the speaker, when audio needs to be played, the upper-layer application calls the relevant functional module in the HAL layer, such as the video playback module. Accordingly, the video playback module calls the power supply driver, and the power supply driver determines that the target power supply needs to work.

[0182] When it is determined that the target switching power supply needs to operate, the switching power supply driver determines whether camera A is activated. In one example, the switching power supply driver can interact with the camera driver to determine whether camera A is activated.

[0183] For example, the power supply driver can send a camera status query request to the camera driver to request whether camera A is turned on.

[0184] S1202: The camera driver sends a camera status query response to the switching power supply driver to notify the switching power supply driver whether camera A has been turned on.

[0185] It should be noted that this embodiment uses the example of a power supply driver sending a camera status query request to a camera driver to determine whether camera A has been started. In another example, other methods can also be used to determine whether camera A has been started. For example, the implementation of the power supply driver querying whether camera A is started may further include: after controlling camera A to turn on, the camera driver can report a camera-on notification to the power supply driver; and after controlling camera A to turn off, the camera driver can report a camera-off notification to the power supply driver. Accordingly, the power supply driver records the status of camera A. Thus, when it is necessary to query whether camera A is on, the determination can be made based on the recorded status.

[0186] S1203: When camera A is turned on, the switching power supply driver determines the current CDS frequency.

[0187] In one example, when the power supply driver queries the camera driver to see if camera A is turned on, if camera A is turned on, the camera driver can carry the current CDS frequency in the camera status query response, so that the power supply driver can determine the current CDS frequency.

[0188] In another example, when the camera driver reports the status of camera A to the power supply driver, if camera A is turned on, it can report the current CDS frequency. Correspondingly, the power supply driver records the CDS frequency reported by the camera driver, so that when the current CDS frequency is needed, the recorded CDS frequency can be queried.

[0189] S1204: The switching power supply driver determines the target switching frequency based on the current CDS frequency.

[0190] As an example, the specific implementation of determining the target switching frequency based on the current CDS frequency may include: multiplying the current CDS frequency by a preset value, and determining the multiplied value as the target switching frequency.

[0191] This involves adjusting the switching frequency of the target power supply to a multiple of the current CDS frequency. This eliminates switching noise during the calculation process, ensuring that the final image information does not contain switching noise, thus resolving the problem of dark stripes in the image caused by switching noise. The principle behind this can be found in section S805 above, and will not be detailed here.

[0192] As an example of this application, when there are multiple target switching power supplies, a different target switching frequency can be set for each of the multiple target switching power supplies. For instance, if there are N target switching power supplies, the current CDS frequency can be multiplied by N different preset values ​​to obtain N target switching frequencies, which are then used as the switching frequencies of the N target switching power supplies. For example, if N is 2, and the two preset values ​​are 1 and 2, the switching power supply driver multiplies the current CDS frequency by 1 and by 2, obtaining target switching frequencies of 1x and 2x CDS frequency for the two target switching power supplies, respectively.

[0193] As another example of this application, when there are multiple target switching power supplies, the same target switching frequency can also be set for each of the multiple target switching power supplies.

[0194] S1205: Switching power supply drive control adjusts the switching frequency of the target switching power supply to the target switching frequency.

[0195] It should be noted that the embodiments in this application are described using matching on the switching power supply driver side as an example. In another example, when the target switching power supply needs to be started, if camera A is already started, the switching power supply driver can also notify the camera driver to adjust the CDS frequency of the CDS system, for example, adjusting the CDS frequency of the CDS system to a multiple of the switching frequency of the target switching power supply.

[0196] In this embodiment of the application, matching the switching frequency of the target switching power supply with the CDS frequency can suppress the influence of switching noise on the image, that is, the dark stripes of the image are not sensitive to the harmonics of the CDS frequency.

[0197] For example, see Figure 13 , Figure 13 This is a schematic diagram of a set of test results. In this set of tests, the CDS frequency was set to 104.3kHz, and the selection value of the target switching power supply's switching frequency is as follows. Figure 13 The row coordinates of the bar chart are shown in the figure. Then, the influence of the target switching power supply on the dark stripes in the image captured by camera A is tested, as shown in the figure. Figure 13 The vertical axis of the bar chart is shown. From Figure 13 It is easy to see that when the switching frequency of the target switching power supply is a multiple of the CDS frequency (such as 208.6kHz and 313kHz), the switching noise has a lower impact on the dark stripes in the image.

[0198] See also Figure 14 , Figure 14This is a schematic diagram of another set of test results. In this set of tests, the CDS frequency was set to 134.2kHz, and the selection value of the target switching power supply's switching frequency is as follows. Figure 14 The row coordinates of the bar chart are shown in the figure. Then, the influence of the target switching power supply on the dark stripes in the image captured by camera A is tested, as shown in the figure. Figure 14 The vertical axis of the bar chart is shown. From Figure 14 It is easy to see that when the switching frequency of the target switching power supply is a multiple of the CDS frequency (such as 270kHz and 402kHz), the switching noise has a lower impact on the dark stripes in the image.

[0199] In addition, according to Figure 13 and Figure 14 Based on the test results, the dark stripes in the image are not only insensitive to harmonics of the CDS frequency, but also insensitive to low-frequency switching noise and high-frequency switching noise. For example, see... Figure 13 For low-frequency switching frequencies (such as 0.217kHz and 0.4kHz), the impact of dark stripes on the image is relatively low; similarly, for high-frequency switching frequencies (such as 2000kHz and 5000kHz), the impact of dark stripes on the image is also relatively low. See also... Figure 14 For low-frequency switching frequencies (such as 0.217kHz), the impact of dark stripes on the image is relatively low, and for high-frequency switching frequencies (such as 2000kHz), the impact of dark stripes on the image is also relatively low.

[0200] The reason why dark stripes in an image are not sensitive to low-frequency switching noise is that if the switching frequency is much lower than the CDS frequency, the difference in switching noise between two consecutive voltage signals obtained by the CDS system is small. After subtraction, the voltage signal may only have a switching noise of approximately 0 superimposed. This makes the brightness difference between adjacent rows small. Only after several rows apart will there be a row with a large brightness difference, but the visual effect is not obvious in the image and can be ignored.

[0201] For example, see Figure 15 If the switching frequency is as follows Figure 15 As shown in 1501, the sampling points of the CDS system are as follows: Figure 15As shown in Figure 1502, it's easy to see that the switching noise values ​​of the CDS system are the same in the first k samples. Only in the (k+1)th sample does the switching noise value differ from the previous k values, where k is a relatively large value. Therefore, during the calculation of the first k samples, subtracting two consecutive voltage signals eliminates the switching noise. Assuming the kth and (k+1)th samples are the pre-exposure and post-exposure values ​​respectively, subtracting the two values ​​will reveal switching noise, but it only affects one line of image information. Similarly, the switching noise values ​​in the k samples after the (k+1)th sample are also the same. Following this method, it may ultimately only result in uneven brightness in a few lines of the image, with relatively large intervals between these lines, making it visually insignificant. In other words, dark stripes are not sensitive to low-frequency switching noise.

[0202] The reason why dark stripes in an image are insensitive to high-frequency switching noise is that when the signal frequency is high enough, the line impedance and equivalent capacitance in the circuit form an RC low-pass filter, filtering the input high-frequency signal and reducing its amplitude. Inside the camera module, the ADC device possesses this characteristic. Therefore, when the switching noise is a high-frequency signal, the equivalent low-pass filter inside the ADC device will reduce the amplitude of the high-frequency noise. Furthermore, since the amplitude of the switching noise directly reflects the depth of the dark stripes, the dark stripe effect will be reduced or even disappear at higher switching frequencies.

[0203] Based on this, the impact of switching noise on camera A can be suppressed simply by adjusting the switching frequency of the target power supply. See, for example... Figure 16 In implementation, when the target power switch is operating, it can detect whether camera A is on. If camera A is on, the switching frequency of the target power supply is adjusted, for example, by changing the switching frequency to a low frequency or a high frequency, and then the target power supply is controlled to operate according to the adjusted switching frequency. Otherwise, if the camera is not on, the target power supply is controlled to operate according to the original switching frequency.

[0204] Next, combine Figure 17 Provide a detailed explanation. Figure 17 This is a flowchart illustrating a shooting method according to another exemplary embodiment. As an example and not a limitation, this method can be applied to... Figure 7 The electronic device shown can be implemented through the interaction of multiple modules. This method may include some or all of the following:

[0205] S1701: When the target switching power supply needs to work, the switching power supply driver queries whether camera A is started.

[0206] For its specific implementation, please refer to Figure 12 S1201 in the embodiment.

[0207] If camera A is already powered on, turning on the target power supply may affect the image capture of camera A. To minimize this impact, the power supply driver executes operation S1702. Conversely, if camera A is not powered on, turning on the target power supply will not affect the image capture of camera A. In this case, the power supply driver enters operation S1703.

[0208] S1702: When camera A is powered on, the switching power supply driver controls the target switching power supply to operate at a preset switching frequency.

[0209] The preset switching frequency can be pre-configured in the switching power supply driver as needed. In one example, the preset switching frequency is much lower than the CDS frequency, i.e., the preset switching frequency is a low frequency, such as 0.217kHz. In another example, the preset switching frequency is much higher than the CDS frequency, i.e., the preset switching frequency is a high frequency, such as 2000kHz.

[0210] As analyzed above, adjusting the switching frequency of the target power supply to a low or high frequency can reduce the impact on camera A's shooting, thereby achieving the goal of suppressing switching noise.

[0211] Optionally, if camera A is turned off, the power supply driver can adjust the switching frequency of the target power supply back to its original value. For example, when camera A is turned off, the camera driver can send a camera off notification to the power supply driver, and accordingly, the power supply driver controls the target power supply to operate at its original switching frequency.

[0212] S1703: When camera A is not turned on, the switching power supply driver controls the target switching power supply to operate at the original switching frequency.

[0213] In another possible scenario, if camera A is not started before the target switching power supply operates, the switching power supply driver controls the target switching power supply to operate according to the original switching frequency.

[0214] In one possible scenario, camera A is not started before the target switching power supply is turned on, but is turned on after the target switching power supply is turned on. At this time, since the target switching power supply is operating at the original switching frequency, the switching frequency is likely to interfere with the shooting of camera A. In order to reduce interference, the following S1704 and subsequent operations can be performed.

[0215] S1704: When a startup operation is received, the camera application starts.

[0216] S1705: The camera application sends a camera start command to the camera control module. The camera start command is used to start camera A.

[0217] S1706: The camera control module sends a camera start command to the camera driver.

[0218] For specific implementation details of S1704 to S1706, please refer to [link / reference]. Figure 8 S801 to S803 in the illustrated embodiment.

[0219] S1707: The camera driver sends a camera startup notification to the switching power supply driver.

[0220] In other words, when the camera is turned on, the camera driver can notify the power supply driver.

[0221] Optionally, when multiple cameras are configured in an electronic device, the camera startup notification may carry a camera identifier A to uniquely identify camera A, so that the switching power supply driver knows that camera A has been started.

[0222] S1708: When a camera start notification is received, the power supply driver adjusts the switching frequency of the target power supply to the preset switching frequency.

[0223] In one example, the electronic device is only equipped with camera A. When a camera activation notification is received, it is determined that the target switching power supply, which is already turned on, will become an interference source for camera A. Therefore, the switching power supply driver can adjust the switching frequency of the target switching power supply, for example, by adjusting the switching frequency of the target switching power supply to a low frequency or a high frequency.

[0224] In another example, the electronic device is equipped with multiple cameras, and the camera activation notification carries a camera identifier. If the camera identifier carried in the camera activation notification is A, it is determined that camera A has been activated. Since the activated target switching power supply will become an interference source for camera A, the switching power supply driver can adjust the switching frequency of the target switching power supply, for example, by adjusting the switching frequency of the target switching power supply to a low frequency or a high frequency.

[0225] In this embodiment, when the target switching power supply is started, camera A is also started, and the target switching power supply can be controlled to operate at a low frequency or a high frequency. When the target switching power supply is not started, camera A is not started, and the target switching power supply is controlled to operate at its original switching frequency. Subsequently, if camera A is started, the switching frequency of the target switching power supply is adjusted so that the target switching power supply operates at a low frequency or a high frequency during the operation of camera A. In this way, since the dark stripes in the image are not sensitive to low-frequency and high-frequency switching frequencies, the interference of the target switching power supply to camera A can be reduced, thereby suppressing switching noise as much as possible and reducing the appearance of dark stripes in the image.

[0226] Figure 18 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. See also... Figure 18 The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0227] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0228] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0229] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction opcode and timing signals to complete the control of fetching and executing instructions.

[0230] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from this memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0231] In some embodiments, the processor 110 may include one or more interfaces, such as an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0232] It is understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a structural limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.

[0233] The charging management module 140 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 receives charging input from the wired charger via a USB interface 130. In some wireless charging embodiments, the charging management module 140 receives wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also supply power to the electronic device 100 via the power management module 141.

[0234] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to power the processor 110, internal memory 121, external memory, display 194, camera 193, and wireless communication module 160, etc.

[0235] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.

[0236] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, so that electronic device 100 can communicate with networks and other devices through wireless communication technology.

[0237] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0238] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Mini LED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, electronic device 100 may include one or N displays 194, where N is an integer greater than 1.

[0239] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.

[0240] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's image sensor. The light signal is converted into an electrical signal, and the image sensor transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimizations on image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be integrated into the camera 193.

[0241] Camera 193 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. As an example of this application, the photosensitive element may be a CMOS phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is an integer greater than 1.

[0242] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions, such as saving music, video, and other files on the external memory card.

[0243] Internal memory 121 can be used to store computer-executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of electronic device 100 by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created by electronic device 100 during use (such as audio data, phonebook, etc.). Furthermore, internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0244] Electronic device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D and application processor.

[0245] The audio module 170 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 may be located in the processor 110, or some functional modules of the audio module 170 may be located in the processor 110.

[0246] The speaker 170A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or make hands-free calls through the speaker 170A.

[0247] The receiver 170B, also known as the "earpiece," is used to convert audio electrical signals into sound signals. When the electronic device 100 answers a telephone call or voice message, the receiver 170B can be brought close to the ear to listen to the voice.

[0248] Microphone 170C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can speak by bringing their mouth close to microphone 170C, inputting the sound signal into microphone 170C.

[0249] Touch sensor 180K, also known as a "touch panel," can be located on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a "touch display." Touch sensor 180K detects touch operations applied to or near it. Touch sensor 180K can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180K may also be located on the surface of electronic device 100, in a different position than display screen 194.

[0250] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch buttons. Electronic device 100 can receive button input and generate key signal inputs related to user settings and function control of electronic device 100.

[0251] Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or for touch vibration feedback.

[0252] Indicator 192 can be an indicator light, used to indicate charging status, power changes, or to indicate messages, missed calls, notifications, etc.

[0253] It should be understood that each step in the above method embodiments can be completed by integrated logic circuits in the processor hardware or by instructions in software form. The method steps disclosed in the embodiments of this application can be directly manifested as being executed by a hardware processor, or being executed by a combination of hardware and software modules in the processor.

[0254] This application also provides an electronic device that may include a memory, a processor, and a computer program stored in the memory, wherein the processor executes the computer program to implement the method performed by the electronic device as described in any of the above embodiments.

[0255] This application also provides a chip system including a processing circuit and an interface circuit. The interface circuit is used to receive computer instructions and transmit them to the processing circuit. The processing circuit is used to execute the computer instructions to implement the method performed by the electronic device as in any of the above embodiments.

[0256] This application also provides a chip system including at least one processor for implementing the methods executed by the electronic device in any of the above embodiments. In one possible design, the chip system further includes a memory for storing program instructions and data, the memory being located within or outside the processor.

[0257] A chip system can consist of chips or include chips and other discrete components.

[0258] Optionally, there may be one or more processors in the chip system. The processor can be implemented in hardware or software. When implemented in hardware, the processor can be a logic circuit, integrated circuit, etc. When implemented in software, the processor can be a general-purpose processor, implemented by reading software code stored in memory.

[0259] Optionally, the chip system may contain one or more memories. These memories may be integrated with the processor or disposed separately; this application does not limit this. For example, the memory may be a non-transient processor, such as a read-only memory (ROM), which may be integrated with the processor on the same chip or disposed on different chips. This application does not specifically limit the type of memory or the arrangement of the memory and processor.

[0260] For example, the chip system may be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a micro controller unit (MCU), a programmable logic device (PLD), or other integrated chips.

[0261] This application also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the method executed by the electronic device in any of the above embodiments.

[0262] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the method executed by the electronic device as described in any of the above embodiments.

[0263] The various embodiments of this application can be combined arbitrarily to achieve different technical effects.

[0264] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line, DSL) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium accessible to a computer, or a data storage device such as a server or data center that integrates one or more available media. The available media can be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., Digital Versatile Discs (DVDs)), or semiconductor media (e.g., Solid State Disks (SSDs)).

[0265] The above-described embodiments are optional embodiments provided by this application and are not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the technical scope disclosed in this application should be included within the protection scope of this application.

Claims

1. A shooting method, characterized in that, Applied to electronic devices, the method includes: In response to a camera activation command, control the activation of the first camera; When the target switching power supply is turned on, during the startup process of the first camera, the dual correlation sampling CDS frequency of the first camera is matched with the switching frequency of the target switching power supply, so that the CDS frequency and the switching frequency of the target switching power supply are in a multiple relationship, and the target switching power supply is the interference source of the first camera.

2. The method as described in claim 1, characterized in that, Matching the dual correlation sampling CDS frequency of the first camera with the switching frequency of the target switching power supply includes: When the number of target switching power supplies is one, the CDS frequency is adjusted according to the switching frequency of the target switching power supply; When there are multiple target switching power supplies, the switching frequencies of the multiple target switching power supplies are adjusted according to the CDS frequency.

3. The method as described in claim 2, characterized in that, When the number of target switching power supplies is one, adjusting the CDS frequency according to the switching frequency of the target switching power supply includes: When there is only one target switching power supply, the switching frequency of the target switching power supply is multiplied by a preset value to obtain the first CDS frequency. Adjust the CDS frequency to the first CDS frequency.

4. The method as described in claim 2, characterized in that, When there are multiple target switching power supplies, adjusting the switching frequencies of the multiple target switching power supplies according to the CDS frequency includes: When there are multiple target switching power supplies, the value of the CDS frequency is multiplied by different preset values ​​to obtain multiple target switching frequencies, all of which are within the preset switching frequency range. Based on the multiple target switching frequencies, the switching frequencies of the multiple target switching power supplies are adjusted.

5. The method according to any one of claims 1-4, characterized in that, The method further includes: When the target power supply is not turned on, control the first camera to output an image; If the target switching power supply is in a standby state, then the target switching frequency is determined based on the current CDS frequency; Control the target switching power supply to operate at the target switching frequency.

6. The method according to any one of claims 1-4, characterized in that, The electronic device includes a camera driver and a switching power supply driver; The method further includes, before matching the dual correlation sampling CDS frequency of the first camera with the switching frequency of the target switching power supply during the startup process of the first camera when the target switching power supply is already turned on: The camera driver queries the corresponding switch information based on the camera identifier of the first camera, and the switch information is used to indicate the target switching power supply; The camera driver sends a power supply status query request to the power supply driver, and the power supply status query request carries the switch information. The power supply driver sends a power supply status query response to the camera driver. The power supply status query response carries power supply status indication information, which indicates that the target power supply has been turned on. The power supply status indication information is determined based on the power supply information.

7. A shooting method, characterized in that, Applied to electronic devices, the method includes: In response to a camera activation command, control the activation of the first camera; When the target switching power supply is turned on, during the startup process of the first camera, the switching frequency of the target switching power supply is adjusted to a preset switching frequency. The difference between the preset switching frequency and the dual correlation sampling CDS frequency of the first camera is greater than the preset difference. The target switching power supply is the interference source of the first camera.

8. The method as described in claim 7, characterized in that, The method further includes: If the first camera is turned off, the switching frequency of the target power supply is restored to the first switching frequency. When the first camera is restarted, the switching frequency of the target power supply is readjusted to the preset switching frequency.

9. An electronic device, characterized in that, The electronic device includes: one or more processors, and a memory; the memory is coupled to the one or more processors, the memory being used to store computer program code, the computer program code including computer instructions, the one or more processors invoking the computer instructions to cause the electronic device to perform the method as described in any one of claims 1-6, or to perform the method as described in claim 7 or 8.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores instructions that, when executed on a computer, cause the computer to perform the method as described in any one of claims 1-6, or to perform the method as described in claim 7 or 8.

11. A computer program product containing instructions, characterized in that, When it is run on a computer, it causes the computer to perform the method as described in any one of claims 1-6, or to perform the method as described in claim 7 or 8.

Images