Photographing control method and device, and storage medium

Abstract

The present disclosure relates to a photographing control method, device and storage medium, wherein the photographing control method comprises: in response to a camera application of an electronic device receiving a photographing request, carrying exposure sequence information and identification information in the photographing request; based on the exposure sequence information and the identification information, selecting a target image frame, the target image frame being an image frame used to generate a photographing picture according to the exposure sequence information; and based on the target image frame, generating the photographing picture. The present disclosure ensures that the HDSR scene can normally perform the dynamic frame taking behavior. Moreover, the frame number of the HDSR scene frame taking is ensured to be continuous, the occurrence of the HDSR scene performance lag phenomenon caused by the late frame taking behavior is reduced, and the user photographing experience is improved.

Description

Technical Field

[0001] This disclosure relates to the field of photographic imaging, and more particularly to photographic control methods, devices, and storage media. Background Technology

[0002] With the advancement of technology, people are constantly pursuing high dynamic range and high resolution images from various mobile electronic devices.

[0003] In related technologies, for example, dynamic frame-capturing photography can use a later-capturing method to meet the scene composition standards of High Dynamic Range Super Resolution (HDSR) photography when frame numbers are consecutive. However, the later-capturing behavior causes performance stuttering in HDSR scenes. Traditional Super Resolution (SR) earlier-capturing behavior cannot meet the requirements for frame number and exposure (ev) value, and cannot effectively support dynamic frame-capturing behavior, greatly reducing performance, affecting user experience, and reducing users' reliance on electronic device photography. Summary of the Invention

[0004] To overcome the problems existing in related technologies, this disclosure provides a photo-taking control method, device, and storage medium.

[0005] According to a first aspect of the present disclosure, a photo-taking control method is provided, comprising: responding to a camera application of an electronic device receiving a photo-taking request, wherein the photo-taking request carries exposure sequence information and identification information; the exposure sequence information includes, in chronological order of the image frames requested by the photo-taking request, a first number of first exposures, a second number of second exposures, and a third number of third exposures, wherein the first exposure is greater than the second exposure, and the third exposure is greater than the first exposure; the identification information includes, in chronological order of the image frames requested by the photo-taking request, a second number of second identifiers, a third number of second identifiers, and a first number of first identifiers, wherein the first identifier is used to identify an image frame acquired in a buffer frame before the photo-taking request is received, and the second identifier is used to identify an image frame acquired in a buffer frame after the photo-taking request is received; selecting a target image frame based on the exposure sequence information and the identification information, wherein the target image frame is an image frame used to generate a photographed image according to the exposure sequence information; and generating a photographed image based on the target image frame.

[0006] In one embodiment, selecting a target image frame based on the exposure sequence information and the identification information includes: responding to the first identification, selecting a first number of image frames in reverse order from the current frame where the photo-taking request is received, and responding to the second identification, selecting a second number of image frames and a third number of image frames in sequential order from the current frame; obtaining a target image frame based on the first number of image frames, the second number of image frames, and the third number of image frames, wherein the first number of image frames in the target image frame have a first exposure, the second number of image frames have a second exposure, and the third number of image frames have a third exposure.

[0007] In one embodiment, selecting the first number of image frames in reverse order from the current frame where the photo-taking request is received includes: selecting the first number of image frames with an exposure of the first exposure value in reverse order from the current frame where the photo-taking request is received; selecting the second number of image frames and the third number of image frames sequentially from the current frame includes: modifying the exposure value of the second number of image frames to the second exposure value and modifying the exposure value of the third number of image frames to the third exposure value; selecting the second number of image frames with the second exposure value and the third number of image frames with the third exposure value sequentially from the current frame; obtaining the target image frame based on the first number of image frames, the second number of image frames, and the third number of image frames includes: sequentially determining the first number of first exposure value image frames, the second number of second exposure value image frames, and the third number of third exposure value image frames according to the time sequence of the image frames requested by the photo-taking request, to obtain the target image frame.

[0008] In one embodiment, the method further includes: adding a second number of second-exposure image frames and a third number of third-exposure image frames from the image frames requested by the photo-taking request to a cached frame queue, and modifying the identifiers of the second number of second-exposure image frames and the third number of third-exposure image frames to a first identifier.

[0009] In one embodiment, before selecting a target image frame based on the exposure sequence information and the identification information, the method further includes: determining that a first condition is met, wherein meeting the first condition includes enabling the acquisition of image frames from cached frames prior to receiving the photo-taking request to generate a photograph.

[0010] In one embodiment, before obtaining the target image frame based on the first number of image frames, the second number of image frames, and the third number of image frames, the method further includes: determining that a second condition is met, wherein the second condition includes that the frame numbers of the first number of image frames, the second number of image frames, and the third number of image frames are consecutive, and the frame-by-frame sensitivity difference ratio is less than a threshold.

[0011] According to a second aspect of the present disclosure, a photographing device is provided, comprising:

[0012] A receiving unit is configured to respond to a camera application of an electronic device receiving a photo-taking request, wherein the photo-taking request carries exposure sequence information and identification information; the exposure sequence information includes, in chronological order of the image frames requested by the photo-taking request, a first number of first exposures, a second number of second exposures, and a third number of third exposures, wherein the first exposure is greater than the second exposure, and the third exposure is greater than the first exposure; the identification information includes, in chronological order of the image frames requested by the photo-taking request, a second number of second identifiers, a third number of second identifiers, and a first number of first identifiers, wherein the first identifier is used to identify image frames acquired in buffered frames before the photo-taking request is received, and the second identifier is used to identify image frames acquired in buffered frames after the photo-taking request is received; a selection unit is configured to select a target image frame based on the exposure sequence information and the identification information, wherein the target image frame is an image frame used to generate a photographed image; and an imaging unit is configured to generate a photographed image based on the target image frame.

[0013] In one embodiment, the selection unit selects a target image frame based on the exposure sequence information and the identification information in the following manner: in response to the first identification, it selects a first number of image frames in reverse order starting from the current frame where the photo-taking request is received, and in response to the second identification, it selects a second number of image frames and a third number of image frames in sequential order starting from the current frame; based on the first number of image frames, the second number of image frames, and the third number of image frames, a target image frame is obtained, wherein the first number of image frames in the target image frame have a first exposure, the second number of image frames have a second exposure, and the third number of image frames have a third exposure.

[0014] In one embodiment, the selection unit is further configured to: select the first number of image frames in reverse order from the current frame where the photo-taking request is received, including: selecting the first number of image frames with an exposure of the first exposure value in reverse order from the current frame where the photo-taking request is received; selecting the second number of image frames and the third number of image frames in sequential order from the current frame, including: modifying the exposure value of the second number of image frames to the second exposure value, and modifying the exposure value of the third number of image frames to the third exposure value; selecting the second number of image frames with the second exposure value and the third number of image frames with the third exposure value in sequential order from the current frame; obtaining the target image frame based on the first number of image frames, the second number of image frames, and the third number of image frames, including: determining the first number of first exposure value image frames, the second number of second exposure value image frames, and the third number of third exposure value image frames in sequence according to the time sequence of the image frames requested by the photo-taking request, to obtain the target image frame.

[0015] In one embodiment, the photographing device is further configured to: add a second number of second exposure image frames and a third number of third exposure image frames from the image frames requested by the photographing request to a cache frame queue, and modify the identifiers of the second number of second exposure image frames and the third number of third exposure image frames to a first identifier.

[0016] In one embodiment, the selection unit is further configured to, before selecting a target image frame based on the exposure sequence information and the identification information, determine that a first condition is met, wherein meeting the first condition includes enabling the acquisition of image frames from cached frames prior to receiving the photo-taking request to generate a photograph.

[0017] In one embodiment, the selection unit is further configured to, before obtaining the target image frame based on the first number of image frames, the second number of image frames, and the third number of image frames: determine that a second condition is met, wherein the second condition includes that the frame numbers of the first number of image frames, the second number of image frames, and the third number of image frames are consecutive, and the frame-by-frame sensitivity difference ratio is less than a threshold.

[0018] According to a third aspect of the present disclosure, an electronic device is provided, comprising: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to execute the executable instructions to perform the photographic imaging method of the first aspect or any embodiment of the first aspect.

[0019] According to a fourth aspect of the present disclosure, a storage medium is provided, the storage medium storing instructions that, when executed by a processor of an electronic device, enable the electronic device to perform the photographic imaging method of the first aspect or any embodiment of the first aspect.

[0020] The technical solutions provided by the embodiments of this disclosure can include the following beneficial effects: Based on the photo-taking request received by the camera application of the electronic device, exposure sequence information and identification information are carried in the photo-taking request; pre-frame and post-frame capture are performed based on the exposure sequence information and identification information to ensure normal dynamic frame capture behavior in HDSR scenes. Furthermore, it can guarantee the continuity of frame numbers in HDSR scene frame capture, reducing the occurrence of HDSR scene performance stuttering caused by post-frame capture, thereby improving the user's photo-taking experience.

[0021] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0022] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.

[0023] Figure 1 This is a flowchart illustrating a photographic control method according to an exemplary embodiment.

[0024] Figure 2 This is a flowchart illustrating the selection of a target image frame according to an exemplary embodiment.

[0025] Figure 3 This is a flowchart illustrating an example of acquiring a target image frame according to an exemplary embodiment.

[0026] Figure 4 This is an example diagram illustrating a photo-taking control according to an exemplary embodiment.

[0027] Figure 5 This is a block diagram of a photographing device according to an exemplary embodiment.

[0028] Figure 6 This is a block diagram of a device for taking pictures according to an exemplary embodiment. Detailed Implementation

[0029] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure.

[0030] The dynamic frame-capturing imaging method provided in this disclosure is applied to electronic device imaging scenarios. The dynamic frame-capturing imaging method involved in this disclosure is mainly applied to HDSR scenarios combining SR and HDR. For example, it is applied to mobile phone imaging scenarios.

[0031] In related technologies, HDSR scenes mostly employ a post-frame-fetching scheme to meet the frame-fetching requirements of combining SR and HDR scenes, thereby sacrificing performance to achieve the composite effect and indirectly ensuring users' needs for high dynamic range and high resolution images. However, in a stage where image capture technology is becoming increasingly stable and fast, the negative effects of the image capture waiting time have seriously impacted the user's shooting experience, failing to effectively meet user expectations. Compared to shooting in other scenarios, the post-frame-fetching imaging scheme lags behind the image capture time, resulting in an indefinite increase in overall processing time.

[0032] Furthermore, in scenarios combining SR and HDR, the SR-based forward fetching behavior cannot meet the requirements for frame number and ev value, and cannot effectively support dynamic frame fetching behavior, which greatly reduces the shooting performance. This makes it impossible to actively optimize the time standard for capturing images to the gallery, severely reducing the user's shooting experience and decreasing the user's reliance on electronic device photography.

[0033] In view of this, this disclosure provides a photo-taking control method. Based on a photo-taking request, it obtains the frame number information obtained by clicking to take a photo. A pre-frame fetching scheme is implemented based on SR (Simultaneous Retrieval of Frames) pre-frame fetching and logically HDR (Logical Retrieval of Frames) post-frame fetching. The image frames obtained before SR and logically after HDR are sequentially stored in the frame number information obtained by clicking to take a photo. Specifically, the image frames obtained before SR are set as first identifier information, and the logically after HDR image frames are set as second identifier information. The exposure of the first identifier information is always the first exposure value, and the exposure of the second identifier information includes a second exposure value and a third exposure value. The first exposure value is greater than the second exposure value, and the third exposure value is greater than the first exposure value. The first identifier information is synthesized into a normally exposed image frame. The synthesized normally exposed image frame is combined with the second identifier information to obtain the image required by the user. The pre-frame fetching scheme can reduce performance stuttering in HDSR scenarios caused by post-frame fetching and avoid discontinuous frame numbers, thus improving the user's photo-taking experience.

[0034] Figure 1 This is a flowchart illustrating a photographic control method according to an exemplary embodiment, such as... Figure 1 As shown, the photographing method used in electronic devices includes the following steps.

[0035] In step S11, in response to the camera application of the electronic device receiving a photo capture request, the photo capture request carries exposure sequence information and identification information.

[0036] In this embodiment of the disclosure, the electronic device receives a photo-taking request. The received photo-taking request has different functional purposes. These different functional purposes can be marked with signs that can achieve different functional purposes. For example, the photo-taking request can be marked with signs that carry exposure sequence information and identification information.

[0037] Among them, the exposure sequence information can be understood as a set of information with different exposure values, and the identification information can be understood as a set of identification information with different identification purposes, namely, whether it is necessary to perform frame forwarding on the image frame under the current frame number or whether it is logically necessary to perform frame forwarding on the image frame under the current frame number.

[0038] The exposure sequence information carries exposure values ​​that, in accordance with the temporal order of the image frames requested in the photo-taking request, include a first number of first exposure values, a second number of second exposure values, and a third number of third exposure values, wherein the first exposure value is greater than the second exposure value, and the third exposure value is greater than the first exposure value.

[0039] The first exposure level can be understood as normal exposure (ev0), the second exposure level can be understood as underexposure (ev-), and the third exposure level can be understood as overexposure (ev+).

[0040] The identifiers included in the identifier information are arranged in the order of the image frames requested by the photo-taking request, including a second number of second identifiers, a third number of second identifiers, and a first number of first identifiers. The first identifier is used to identify the image frame obtained in the buffer frame before the photo-taking request is received, and the second identifier is used to identify the image frame obtained in the buffer frame after the photo-taking request is received.

[0041] The first quantity can be understood as the number of image frames required for reverse selection, the second quantity can be understood as the number of partial image frames required for sequential selection, and the third quantity can be understood as the number of another partial image frames required for sequential selection. The first, second, and third quantities are not limited in number.

[0042] In step S12, a target image frame is selected based on the exposure sequence information and the identification information. The target image frame is the image frame used to generate a photographed image according to the exposure sequence information.

[0043] In this embodiment of the disclosure, image frames are selected based on exposure sequence information and identification information, and the selected image frames are image frames that meet the conditions for generating a photographed image.

[0044] The target image frame can be understood as an image frame that carries different exposure sequence information and different identification information, and can generate the image required for taking a picture based on the different identification information and different exposure sequence information.

[0045] In step S13, a photograph is generated based on the target image frame.

[0046] In this embodiment of the disclosure, the desired photographic image is generated based on the target image frame that meets the synthesis conditions.

[0047] In this context, a photographed image can be understood as the final image obtained by synthesizing photographed image frames generated by a sensor.

[0048] In this embodiment of the present disclosure, the photo-taking request issued by the electronic device is processed differently according to the exposure sequence information and identification information carried in the photo-taking request. Specifically, when the current frame number is clicked to take a photo, it is determined whether the required frame needs to be fetched in advance or logically fetched in backward. A target image frame that meets the conditions is selected for the exposure sequence information and identification information. The image frames that need to be fetched in advance are combined into an image frame with the same exposure value. The combined image frame is then combined with the image frame that logically needs to be fetched in backward to obtain the required image. This enables the device to autonomously perform dynamic fetching of the required frame under the corresponding conditions and ensures that the frame number of the required frame is continuous.

[0049] Figure 2 This is a flowchart illustrating the selection of a target image frame according to an exemplary embodiment. For example... Figure 2 As shown, it includes the following steps:

[0050] In step S21, in response to the first identifier, a first number of image frames are selected in reverse order from the current frame where the photo-taking request was received, and in response to the second identifier, a second number of image frames and a third number of image frames are selected sequentially from the current frame.

[0051] In this embodiment of the disclosure, image frame selection conditions are set to determine the selection method of the target image frame. The target image frame extraction method can be determined based on the capture time. For example, different identifiers are set according to the capture time, and a forward extraction behavior or a logical backward extraction behavior is set according to different identifiers. Image frames identified as forward extraction behavior are selected in reverse order, and image frames identified as backward extraction behavior are selected sequentially backward.

[0052] The first identifier can be understood as a symbol used to store the image frames selected in reverse order, that is, a symbol used to store the first number of image frames selected in reverse order from the first number of image frames under the current frame number when a photo capture request is received. The second identifier can be understood as a symbol used to store the image frames selected sequentially from the current frame, that is, a symbol used to store the second and third number of image frames under the current frame number.

[0053] In step S22, a target image frame is obtained based on a first number of image frames, a second number of image frames, and a third number of image frames. The first number of image frames in the target image frame have a first exposure, the second number of image frames have a second exposure, and the third number of image frames have a third exposure.

[0054] In this embodiment of the disclosure, the exposure information of the image is determined according to the first number, the second number, and the third number of image frames, and the target image frame is determined according to the first number, the second number, and the third number carrying different exposure information.

[0055] The first exposure level can be understood as the state of normal exposure (ev0) of an image under normal conditions, the second exposure level can be understood as the state of underexposure (ev-) of an image under normal conditions, and the third exposure level can be understood as the state of overexposure (ev+) of an image under normal conditions.

[0056] In this embodiment, image frame selection conditions are set, and the photo-taking requests are divided into request frames with different exposure sequence information and identification information. Based on the different information carried by the obtained request frames, target image frames that meet the conditions are selected. The obtained image frames facilitate subsequent acquisition operations.

[0057] Figure 3 This is a flowchart illustrating an embodiment of acquiring a target image frame. For example... Figure 3 As shown, it includes the following steps:

[0058] In step S31, starting from the current frame where the photo-taking request is received, a first number of image frames with an exposure of the first exposure are selected in reverse order.

[0059] In this embodiment of the present disclosure, upon receiving a photo capture request for the current image frame, a first number of image frames are selected in reverse order.

[0060] In this embodiment of the disclosure, a first number of image frames with a first exposure are selected in reverse order, with the aim of combining the selected first number of image frames with a first exposure into a single image frame with a first exposure.

[0061] In step S32, a second number of image frames with a second exposure and a third number of image frames with a third exposure are selected sequentially from the current frame.

[0062] In this embodiment of the present disclosure, starting from the current frame after receiving the photo-taking request, a second number of image frames and a third number of image frames are selected sequentially, and the exposure of the second number of image frames is modified to a second exposure, and the exposure of the third number of image frames is modified to a third exposure.

[0063] In this embodiment of the disclosure, a second number of second exposure image frames and a third number of third exposure image frames are obtained, with the aim of combining the obtained second exposure image frames and third exposure image frames with the first exposure image frames.

[0064] In step S33, the target image frame is obtained based on the first number of image frames, the second number of image frames, and the third number of image frames.

[0065] In this embodiment of the present disclosure, a first number of first exposure image frames, a second number of second exposure image frames, and a third number of third exposure image frames are determined sequentially according to the timing of the image frames requested in the photo-taking request to obtain the target image frame.

[0066] The obtained image frame can be understood as follows: synthesizing a first number of first exposure image frames into a first exposure image frame, and then combining the synthesized first exposure image frame with the second exposure image frame and the third exposure image frame to obtain the target image frame.

[0067] In this embodiment of the disclosure, the selected target image frame is acquired, a first number of first exposure image frames are synthesized into a first exposure image frame, the obtained first exposure image frame is synthesized with the remaining exposure image frames, and finally the target frame is obtained.

[0068] In this embodiment of the disclosure, the storage location of the acquired target image frame is set. The acquired target image frame can be stored in a queue. For example, a cache queue is set up, and the target image frame is stored in the cache queue. The cache queue is a queue containing a first number of first exposure information. A second number of second exposure image frames and a third number of third exposure image frames are added to the cache queue. The second identification information of the second number of second exposure image frames and the third number of third exposure image frames added to the cache queue is modified to the first identification information.

[0069] The cache queue can be understood as the first exposure queue, which is cached to avoid the inability to perform the previous frame fetching operation due to the queue being cleared, and the second exposure queue and the third exposure queue, which are cached when the current frame of the photo-taking request is received.

[0070] In this embodiment of the disclosure, the second identification information of the second number of second exposure image frames and the third number of third exposure image frames added to the cache queue is modified to the first identification information. The purpose is to set the frame number of the second-identified image frame in the request sent by the electronic device to the frame number of the first-identified image frame, so as to ensure that the underlying layer of the electronic device can successfully store the second number of second exposure image frames and the third number of third exposure.

[0071] In this embodiment of the disclosure, before selecting a target image based on exposure sequence information and identification information, it is determined whether the selected target image meets the conditions for generating a photograph. For example, a first condition is set, and the image frames before the received photographing request are stored in a queue, and it is ensured that the queue will not be automatically cleared when the photographing request is sent.

[0072] The first condition can be understood as the electronic device being able to obtain image frames from the cached frames before receiving the photo-taking request in order to generate a photo. That is, the electronic device browses the obtained image frames before receiving the photo-taking request and stores the browsed image frames in a cache queue. This cache queue can contain two queues: a consumer queue and a producer queue. The consumer queue is used to store processed image frames, and the producer queue is used to store unprocessed image frames. Frames are taken from the producer queue in reverse order to obtain 5 frames from the producer queue and 3 frames from the consumer queue, thereby obtaining the 8 image frames required for multi-frame synthesis.

[0073] In this embodiment of the disclosure, it is determined whether the frame acquired by the electronic device meets the synthesis conditions and ensures that the frame acquired by the electronic device can be prefetched, thereby synthesizing the image frame that can be prefetched with the image frame that is logically postfetched.

[0074] In this embodiment of the disclosure, the selected image frame is determined to be an image frame that satisfies the requirement of generating a photographed image. For example, a second condition is set to ensure that the frame numbers of the first number of image frames, the second number of image frames, and the third number of image frames are consecutive, and the frame-by-frame sensitivity difference ratio is less than a threshold.

[0075] Here, sensitivity can be understood as the exposure sensitivity of the acquired target image frame, the sensitivity frame difference ratio can be understood as the average sensitivity of the target image frame, and the threshold can be understood as a set value, such as 10%.

[0076] In this embodiment of the disclosure, before determining whether the frames acquired by the electronic device meet the synthesis criteria, it is also necessary to ensure that the first number of frames with the first exposure acquired by the electronic device can be synthesized with the second number of frames with the second exposure and the third number of frames with the third exposure.

[0077] In this embodiment of the disclosure, taking the electronic device sending ten requests as an example for HDSR photography, as shown in Table 1, the operation of dynamically capturing frames and taking pictures in the electronic device is specifically described.

[0078] In Table 1, Tag1 is the first identifier and Tag0 is the second identifier. Request is the request sent by the application layer. 100ev- is the first request to take a picture with underexposure, and 101ev+ is the second request to take a picture with overexposure. 100ev- and 101ev+ are also image frames that logically need to be captured later.

[0079]

[0080]

[0081] Table 1

[0082] In this embodiment, the application layer fills all 10 requests with identifiers that enable dynamic forward fetching, namely the first identifier and the second identifier, so that the ev values ​​carried by the requests are in the order of 8 ev0, 1 ev- and 1 ev+ exposure tables. Among them, the identifiers of the underexposed and overexposed image frames that logically require backward fetching, as well as the first two in the request list, are set to the second identifier. The remaining 8 image frames are used for SR compositing, which normally enables forward fetching, and the identifiers of these 8 frames are set to the first identifier. The application layer processes the 10 requests separately according to the corresponding HDSR photography standard and sends them down to the underlying framework, layer by layer, to the underlying multi-frame photography queue, so that they are sent to the sensor.

[0083] In this embodiment of the disclosure, when the first request with exposure value (ev) and identifier reaches the processing layer, it is determined whether the current queue state can support dynamic frame fetching behavior. If dynamic frame fetching can be supported, the previous frame fetching operation is performed; otherwise, the subsequent frame fetching operation is performed.

[0084] In this embodiment of the disclosure, the dynamic frame-fetching pre-frame-fetching operation requires determining whether eight image frames carrying a first identifier can be pre-fetched. After the sensor receives the request, it determines whether the exposure values ​​of these eight frames meet the requirements by fetching them in reverse order in the queue. If they do meet the requirements, the exposure values ​​of frames 100 and 101 in Table 1 are modified to underexposure and overexposure, respectively, and then sent to the underlying sensor.

[0085] In this embodiment of the disclosure, the underlying sensor generates two exposure value image frames that meet the requirements of HDSR synthesis based on the modified 100th and 101st frames. At this time, since the application layer sends 10 requests, and HDSR synthesis only requires the first and second requests in this group, if the next photo is taken, it is necessary to start taking frames from the third request and perform SR synthesis operation with normal exposure values.

[0086] In this embodiment of the present disclosure, when the processing layer receives requests for underexposed and overexposed image frames, it refuses to clear the cache queue and continues to save the eight image frames carrying the first identifier in the cache queue.

[0087] In this embodiment of the disclosure, two exposure value image frames generated by the underlying sensor that meet the requirements for HDSR synthesis are manually added to frames 108 and 109 (i.e., two request frames with a second identifier).

[0088] In this embodiment of the disclosure, under the set of requests sent when clicking to take a picture, the image frames carried by the original request frame are actually the eight previously captured image frames with normal exposure values, one first request for clicking to take a picture with underexposure, and one second request for clicking to take a picture with overexposure.

[0089] Figure 4 This is a flowchart illustrating a photographic control method according to an exemplary embodiment. For example... Figure 4 As shown, the specific steps are as follows:

[0090] In step S41, turn on the camera shooting function.

[0091] In an exemplary embodiment of this disclosure, an electronic device for taking pictures, such as a camera, is turned on to perform a picture-taking operation.

[0092] In step S42, enter the SR scene and trigger High Dynamic Range (HDR).

[0093] In an exemplary embodiment of this disclosure, in a scenario where frame fetching is possible, conditions are triggered for the camera to capture a composite image, such as triggering High Dynamic Range (HDR).

[0094] Among them, SR (SuperResolution) can be understood as a technology that can dynamically capture frames from the front.

[0095] In step S43, click to take a picture, and the electronic device sends a request.

[0096] In an exemplary embodiment of this disclosure, based on the click to take a picture, the electronic device sends a request carrying exposure information and identification information.

[0097] The requests issued by the electronic device can be understood as including a certain number of queues with different flag values. For example, referring to Table 1, there are 8 requests with a flag value of 1 and 2 requests with a flag value of 0. In Table 1, "request" can be understood as the requests issued by the electronic device. Assuming that the electronic device issues 10 requests in frame 100, the electronic device fills all 10 requests with flags that allow dynamic forward fetching (i.e., request frames with a tag value of 1 and a tag value of 0 that logically need to be fetched later), so that the request frames carry information with different exposure levels.

[0098] In step S44, the dynamic frame-fetching logic is determined.

[0099] In an exemplary embodiment of this disclosure, dynamic frame-fetching logic is determined based on a flag value.

[0100] The dynamic frame-fetching logic can be understood as the selected target image frames meeting certain conditions, such as consecutive frame numbers and exposure sensitivity difference ratios less than a threshold, e.g., less than 10%.

[0101] In step S45, the bottom layer drawing is generated.

[0102] In an exemplary embodiment of this disclosure, the underlying sensor generates diagrams according to requests issued by the electronic device.

[0103] In this context, bottom-layer image output can be understood as the process by which the bottom layer outputs image frames carrying different exposure values ​​(ev-, ev0, ev+) and tag values ​​(Tag0, Tag1) based on requests issued by electronic devices. For example, referring to Table 1, an image frame carrying an exposure value of ev0 is assigned to one request, while image frames carrying exposure values ​​of ev- and ev+ are assigned to another request. Thus, after image output, the bottom layer assigns the image frames to different requests.

[0104] In step S46, the corresponding frame number information is obtained from the producer queue and the consumer queue to determine whether it meets the multi-frame synthesis standard.

[0105] In an exemplary embodiment of this disclosure, to determine whether the obtained frame conforms to the standard for multi-frame synthesis, the obtained frame can be placed in a queue, such as a cache queue, and the cache queue can be divided into different frame retrieval queues, such as a producer queue and a consumer queue.

[0106] The producer queue can be understood as storing unprocessed image frames returned by the underlying layer, while the consumer queue can be understood as storing processed image frames returned by the underlying layer. Referring to Table 1, frames with numbers 92 to 99 are stored within frames with numbers 100 to 107 in the request frames.

[0107] In step S47, the EV values ​​of the first and second frames are modified to ev- and ev+, and sent to the underlying sensor for reception.

[0108] In an exemplary embodiment of this disclosure, an image frame that is a preceding frame but logically a following frame is sent to and received by the underlying sensor.

[0109] In this context, the first frame can be understood as the first image frame captured sequentially after the electronic device receives the photo capture request during the photo capture operation. The second frame can be understood as the second image frame after the first image frame captured sequentially after the electronic device receives the photo capture request during the photo capture operation. Referring to Table 1, the first frame can be understood as the 100th frame in the request sent by the electronic device that carries the ev-exposure value, and the second frame can be understood as the 101st frame in the request sent by the electronic device that carries the ev+exposure value. The underlying sensor can be understood as a receiving device that receives image frames with different exposure levels.

[0110] In step S48, the frame selection judgment for multi-frame synthesis is completed normally.

[0111] In this embodiment of the disclosure, the obtained frames are set to determine the frame extraction judgment for the normal completion of multi-frame synthesis.

[0112] Multi-frame synthesis can be understood as synthesizing the received frames in different ways. For example, multiple frames can be classified and synthesized. According to Table 1, frames with the same exposure value are synthesized and then synthesized with frames of different exposure values.

[0113] In step S49, the frame numbers are consecutive and the exposure sensitivity is consistent.

[0114] In this embodiment of the disclosure, a determination condition is set to determine whether the obtained frame meets the condition for being able to be fetched and whether it can be synthesized.

[0115] Among them, continuous frame number can be understood as the frame number of the frame returned by the underlying layer being continuous with the frame number of the logically subsequent frame, and consistent exposure sensitivity can be understood as the average exposure sensitivity of the obtained frames being less than a threshold, such as 10%.

[0116] In step S410, frames 108 and 109 are manually added to the zero shutter speed queue and locked.

[0117] In this embodiment of the disclosure, the last two frames of the request sent by the electronic device are manually added to the zero shutter queue and locked.

[0118] In Table 1, the last two frames in the request sent by the electronic device are numbered 108 and 109. The purpose of adding the two obtained frames to the zero shutter queue and locking them can be understood as setting the last two frames to accept the frame information returned by the underlying layer, and ensuring that the last two frames in the request will not be released in advance, so that the frame taking and shooting can be completed smoothly.

[0119] In step S411, the frame fetching is completed, and the first frame number information and the second frame number information are output.

[0120] In this embodiment of the disclosure, the frame number information is output.

[0121] The first and second identification information can be understood as the second number of frames with the second exposure and the third number of frames with the third exposure returned by the underlying layer. Outputting the first and second identification information can be understood as enabling the second number of frames with the second exposure and the third number of frames with the third exposure obtained by the underlying layer to be placed in the last two frames of the request sent by the electronic device, ensuring that the last two frames can be combined.

[0122] In step S412, data processing is completed to generate a YUV image.

[0123] In this embodiment of the disclosure, the processing of the frames obtained for image synthesis is completed, and the obtained frames are converted from the original file data that has not been processed by the camera into YUV data images.

[0124] The data processing can be understood as follows: combining Table 1, the data transmission of the 8 frames of normal exposure values ​​is processed into multi-frame composite, and a high-resolution normal exposure value image is output. This image is then fed into the high dynamic range algorithm along with the subsequently obtained 100ev- / 101ev+ images. After high dynamic range processing, the image format is converted. YUV images can be understood as an image format.

[0125] In step S413, the processed image is saved to the album.

[0126] In this embodiment of the disclosure, the synthesized image is saved to the photo album.

[0127] In step S414, the camera shooting function is turned off.

[0128] In this embodiment of the disclosure, the camera shooting function is turned off, and the function of dynamically capturing frames during photography is terminated.

[0129] In this embodiment of the disclosure, frame taking is divided into pre-frame taking and logical post-frame taking based on dynamic frame taking. This solves the problem that in the scenario of taking frames to synthesize photos, the requirement of continuous frame numbers cannot be met based on pre-frame taking, which leads to the inability to take pre-frames. This further results in slow performance response in the scenario of dynamic frame taking, and the shooting and imaging time cannot be actively optimized, which seriously delays the shooting and frame taking time. The overall processing time is infinitely extended, affecting the user's shooting experience.

[0130] Based on the same concept, this disclosure also provides a photographing device.

[0131] It is understood that the photographing device provided in this disclosure includes hardware structures and / or software modules corresponding to each function in order to achieve the above-mentioned functions. In conjunction with the units and algorithm steps of the various examples disclosed in this disclosure, this disclosure can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed by hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the technical solutions of this disclosure.

[0132] Figure 5 This is a block diagram illustrating a photographing device according to an exemplary embodiment. (Refer to...) Figure 5 The device 100 includes a receiving unit 101, a selection unit 102, and an imaging unit 103.

[0133] The receiving unit 101 is configured to respond to a camera application of an electronic device receiving a photo-taking request, and to carry exposure sequence information and identification information in the photo-taking request. The exposure sequence information includes, in sequence, a first number of first exposures, a second number of second exposures, and a third number of third exposures, according to the time sequence of the image frames requested in the photo-taking request, wherein the first exposure is greater than the second exposure, and the third exposure is greater than the first exposure. The identification information includes, in sequence, a second number of second identifiers, a third number of second identifiers, and a first number of first identifiers, according to the time sequence of the image frames requested in the photo-taking request. The first identifier is used to identify image frames acquired in buffered frames before the photo-taking request is received, and the second identifier is used to identify image frames acquired in buffered frames after the photo-taking request is received. The selection unit 102 is configured to select a target image frame based on the exposure sequence information and the identification information, wherein the target image frame is the image frame used to generate a photographed image. The imaging unit 103 is configured to generate a photographed image based on the target image frame.

[0134] In one embodiment, the selection unit 102 selects a target image frame based on exposure sequence information and identification information in the following manner: in response to a first identifier, it selects a first number of image frames in reverse order from the current frame where the photo-taking request is received, and in response to a second identifier, it selects a second number of image frames and a third number of image frames in sequential order from the current frame; based on the first number of image frames, the second number of image frames, and the third number of image frames, a target image frame is obtained, wherein the first number of image frames in the target image frame have a first exposure, the second number of image frames have a second exposure, and the third number of image frames have a third exposure.

[0135] In one embodiment, the photographing device is further configured to add a second number of second exposure image frames and a third number of third exposure image frames from the image frames requested in the photographing request to a cached frame queue, and modify the identifiers of the second number of second exposure image frames and the third number of third exposure image frames to a first identifier.

[0136] In one embodiment, the selection unit 102 is further configured to: determine that a first condition is met before selecting a target image frame based on exposure sequence information and identification information, wherein meeting the first condition includes enabling the acquisition of image frames from cached frames before receiving the photo-taking request to generate a photo.

[0137] In one embodiment, the selection unit 102 is further configured to determine, before obtaining the target image frame based on the first number of image frames, the second number of image frames, and the third number of image frames, that a second condition is satisfied. The second condition includes that the frame numbers of the first number of image frames, the second number of image frames, and the third number of image frames are consecutive, and that the frame-by-frame sensitivity difference ratio is less than a threshold.

[0138] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0139] Figure 6 This is a block diagram illustrating a device 200 for taking pictures according to an exemplary embodiment. For example, device 200 may be a mobile phone, computer, digital broadcast electronic device, messaging transceiver, game console, tablet device, medical device, fitness equipment, personal digital assistant, etc.

[0140] Reference Figure 6 The device 200 may include one or more of the following components: processing component 202, memory 204, power component 206, multimedia component 208, audio component 210, input / output (I / O) interface 212, sensor component 214, and communication component 216.

[0141] Processing component 202 typically controls the overall operation of device 200, such as operations associated with display, telephone calls, data communication, camera operation, and recording. Processing component 202 may include one or more processors 220 to execute instructions to perform all or part of the steps of the methods described above. Furthermore, processing component 202 may include one or more modules to facilitate interaction between processing component 202 and other components. For example, processing component 202 may include a multimedia module to facilitate interaction between multimedia component 208 and processing component 202.

[0142] Memory 204 is configured to store various types of data to support the operation of device 200. Examples of such data include instructions for any application or method operating on device 200, contact data, phonebook data, messages, pictures, videos, etc. Memory 204 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0143] The power supply component 206 provides power to the various components of the device 200. The power supply component 206 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power to the device 200.

[0144] Multimedia component 208 includes a screen that provides an output interface between the device 200 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of the touch or swipe action but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 208 includes a front-facing camera and / or a rear-facing camera. When the device 200 is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or the rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

[0145] Audio component 210 is configured to output and / or input audio signals. For example, audio component 210 includes a microphone (MIC) configured to receive external audio signals when device 200 is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 204 or transmitted via communication component 216. In some embodiments, audio component 210 also includes a speaker for outputting audio signals.

[0146] I / O interface 212 provides an interface between processing component 202 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.

[0147] Sensor assembly 214 includes one or more sensors for providing status assessments of various aspects of device 200. For example, sensor assembly 214 may detect the on / off state of device 200, the relative positioning of components such as the display and keypad of device 200, changes in the position of device 200 or a component of device 200, the presence or absence of user contact with device 200, the orientation or acceleration / deceleration of device 200, and temperature changes of device 200. Sensor assembly 214 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 214 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 214 may also include an accelerometer, a gyroscope, a magnetometer, a pressure sensor, or a temperature sensor.

[0148] Communication component 216 is configured to facilitate wired or wireless communication between device 200 and other devices. Device 200 can access wireless networks based on communication standards, such as WiFi, 2G, or 3G, or combinations thereof. In one exemplary embodiment, communication component 216 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 216 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0149] In an exemplary embodiment, the apparatus 200 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the methods described above.

[0150] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 204 including instructions, which can be executed by a processor 220 of the device 200 to perform the above-described method. For example, the non-transitory computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.

[0151] It is understood that in this disclosure, "multiple" refers to two or more, and other quantifiers are similar. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, and B alone. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. The singular forms "a," "the," and "the" are also intended to include the plural forms unless the context clearly indicates otherwise.

[0152] It is further understood that the terms "first," "second," etc., are used to describe various types of information, but this information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another, and do not indicate a specific order or degree of importance. In fact, the expressions "first," "second," etc., are completely interchangeable. For example, without departing from the scope of this disclosure, first information can also be referred to as second information, and similarly, second information can also be referred to as first information.

[0153] It is further understood that the terms “center,” “longitudinal,” “lateral,” “front,” “rear,” “up,” “down,” “left,” “right,” “vertical,” “horizontal,” “top,” “bottom,” “inner,” and “outer,” etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are only for the convenience of describing this embodiment and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation.

[0154] It can be further understood that, unless otherwise specified, "connection" includes both direct connections where no other components exist between the two parties and indirect connections where other components exist between them.

[0155] It is further understood that although operations are described in a specific order in the accompanying drawings in the embodiments of this disclosure, this should not be construed as requiring these operations to be performed in the specific order or serial order shown, or requiring all of the shown operations to be performed to obtain the desired result. In certain environments, multitasking and parallel processing may be advantageous.

[0156] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein.

[0157] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. A photographing control method, characterized by, The method comprises: in response to a camera application of an electronic device receiving a photographing request, carrying exposure sequence information and identification information in the photographing request; the exposure sequence information carries exposure in sequence according to the time sequence of the image frame requested by the photographing request, including a first number of first exposure, a second number of second exposure and a third number of third exposure, wherein the first exposure is greater than the second exposure, and the third exposure is greater than the first exposure; the identification included in the identification information includes a second number of second identification, a third number of second identification and a first number of first identification in sequence according to the time sequence of the image frame requested by the photographing request, the first identification is used to identify the image frame obtained in the cache frame before receiving the photographing request, and the second identification is used to identify the image frame obtained in the cache frame after receiving the photographing request; based on the exposure sequence information and the identification information, selecting a target image frame, the target image frame is an image frame used to generate a photographing picture according to the exposure sequence information; based on the target image frame, generating a photographing picture.

2. The method of claim 1, wherein, The method further comprises: in response to the first identification, selecting the first number of image frames in reverse order from the current frame receiving the photographing request, and in response to the second identification, selecting the second number of image frames and the third number of image frames in sequence from the current frame; based on the first number of image frames, the second number of image frames and the third number of image frames, obtaining a target image frame, the first number of image frames in the target image frame has the first exposure, the second number of image frames has the second exposure, and the third number of image frames has the third exposure.

3. The method of claim 2, wherein, The method further comprises: in response to the first identification, selecting the first number of image frames in reverse order from the current frame receiving the photographing request, and in response to the second identification, selecting the second number of image frames and the third number of image frames in sequence from the current frame; based on the first number of image frames, the second number of image frames and the third number of image frames, obtaining a target image frame, the first number of image frames in the target image frame has the first exposure, the second number of image frames has the second exposure, and the third number of image frames has the third exposure. The method further comprises: in response to the first identification, selecting the first number of image frames in reverse order from the current frame receiving the photographing request, and in response to the second identification, selecting the second number of image frames and the third number of image frames in sequence from the current frame; based on the first number of image frames, the second number of image frames and the third number of image frames, obtaining a target image frame, the first number of image frames in the target image frame has the first exposure, the second number of image frames has the second exposure, and the third number of image frames has the third exposure. The method further comprises:

4. The method according to any one of claims 1 to 3, characterized in that, in response to the first identification, selecting the first number of image frames in reverse order from the current frame receiving the photographing request, and in response to the second identification, selecting the second number of image frames and the third number of image frames in sequence from the current frame; based on the first number of image frames, the second number of image frames and the third number of image frames, obtaining a target image frame, the first number of image frames in the target image frame has the first exposure, the second number of image frames has the second exposure, and the third number of image frames has the third exposure. The method further comprises: add the image frames of the second number of the second exposure and the image frames of the third number of the third exposure in the image frame requested by the photographing request to the cache frame queue, and modify the identification of the image frames of the second number of the second exposure and the image frames of the third number of the third exposure to the first identification.

5. The method of claim 1, wherein, Before selecting the target image frame based on the exposure sequence information and the identification information, the method further includes: determining that a first condition is met, and the first condition includes enabling the image frames in the cache frame before the photographing request is received to be obtained to generate the photographing photo.

6. The method according to claim 2 or 3, characterized in that, Before the target image frame is obtained based on the first number of image frames, the second number of image frames and the third number of image frames, the method further includes: determining that a second condition is met, and the second condition includes that the frame numbers of the first number of image frames, the second number of image frames and the third number of image frames are continuous, and the frame-to-frame sensitivity difference ratio is less than a threshold.

7. A photographing apparatus characterized by comprising: includes: a receiving unit, in response to a photographing request being received by a camera application of an electronic device, the photographing request carrying exposure sequence information and identification information; the exposure sequence information carries exposure in sequence according to the time sequence of the image frame requested by the photographing request, including a first number of first exposure, a second number of second exposure and a third number of third exposure, wherein the first exposure is greater than the second exposure, and the third exposure is greater than the first exposure; the identification information includes identification in sequence according to the time sequence of the image frame requested by the photographing request, including a second number of second identification, a third number of second identification and a first number of first identification, the first identification is used to identify the image frames obtained in the cache frame before the photographing request is received, and the second identification is used to identify the image frames obtained in the cache frame after the photographing request is received; a selecting unit, configured to select a target image frame based on the exposure sequence information and the identification information, the target image frame being an image frame used to generate a photographing picture; an imaging unit, configured to generate a photographing picture based on the target image frame.

8. The photographing apparatus according to claim 7, wherein The selecting unit selects the target image frame based on the exposure sequence information and the identification information in the following manner: in response to the first identification, the first number of image frames are selected in reverse order from the current frame at which the photographing request is received, and in response to the second identification, the second number of image frames and the third number of image frames are selected in forward order from the current frame; obtain a target image frame based on the first number of image frames, the second number of image frames and the third number of image frames, the first number of image frames in the target image frame having the first exposure, the second number of image frames having the second exposure, and the third number of image frames having the third exposure.

9. The photographing apparatus according to claim 8, wherein The selecting unit selects the first number of image frames in reverse order from the current frame at which the photographing request is received in the following manner: the first number of image frames with the first exposure are selected in reverse order from the current frame at which the photographing request is received; The selecting the second number of image frames and the third number of image frames in sequence backward from the current frame includes: modifying the exposure of the second number of image frames to the second exposure, and modifying the exposure of the third number of image frames to the third exposure; selecting the second number of image frames with the second exposure and the third number of image frames with the third exposure in sequence backward from the current frame; The target image frame is obtained based on the first number of image frames, the second number of image frames and the third number of image frames, including: determining the first number of first exposure image frames, the second number of second exposure image frames and the third number of third exposure image frames in sequence according to the time sequence of the image frame requested by the photographing request, and obtaining the target image frame.

10. The photographing apparatus according to any one of claims 7 to 9, wherein The photographing device is also used for: adding the second number of second exposure image frames and the third number of third exposure image frames in the image frame requested by the photographing request to the cache frame queue, and modifying the identification of the second number of second exposure image frames and the third number of third exposure image frames to the first identification.

11. The photographing apparatus according to claim 7, wherein The selecting unit is also used for selecting the target image frame before: determining that the first condition is met, and the first condition includes enabling the image frame in the cache frame before receiving the photographing request to be obtained to generate a photographing photo.

12. The photographing apparatus according to claim 8 or 9, characterized by, The selecting unit is also used for obtaining the target image frame based on the first number of image frames, the second number of image frames and the third number of image frames before: determining that the second condition is met, and the second condition includes that the frame numbers of the first number of image frames, the second number of image frames and the third number of image frames are continuous, and the frame-to-frame sensitivity difference is less than a threshold.

13. A photographing apparatus, characterized by comprising: including: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to execute the method of any one of claims 1-6.

14. A storage medium, characterized by The storage medium has instructions stored therein, and when the instructions in the storage medium are executed by the processor of the electronic device, the electronic device can execute the method of any one of claims 1-6.

Images