Equipment control method and device, storage medium and electronic equipment

Abstract

The invention provides an equipment control method and device, a storage medium and electronic equipment, and the method comprises the steps: responding to a detected target operation, and starting a plurality of lenses in a lens assembly of the equipment; the plurality of lenses are lenses with different focal segments, and the lenses with different focal segments are used for collecting images with different view fields; and acquiring to-be-displayed images acquired by the plurality of lenses. The method provided by the embodiment of the invention is beneficial to improving the use experience of the user.

Description

Technical Field

[0001] The technical solution of the present disclosure relates to the field of device control technology, and particularly to a device control method, apparatus, storage medium, and electronic device. Background Art

[0002] Nowadays, there are many lenses with different optical characteristics available in the market, such as wide-angle lenses, telephoto lenses, and macro lenses, etc. Different types of lenses can capture different field-of-view ranges due to their unique optical designs and focal lengths. For example, images taken by short focal length lenses (such as wide-angle lenses) usually have a wide field-of-view range, but due to their optical characteristics, they may not be suitable for showing high-precision details. On the contrary, telephoto lenses often present a smaller field-of-view range when taking images, but can present details more precisely.

[0003] To meet the shooting needs of different users, many shooting devices (such as the rear cameras of mobile phones) are usually equipped with multiple lenses and can switch different lenses for shooting according to the needs of users. For example, when it is necessary to capture objects at different distances, the short focal length lens and the telephoto lens can be switched.

[0004] However, this way of switching lenses for shooting is prone to problems such as inconsistent viewing angles and significant decline in image clarity. Summary of the Invention

[0005] In view of this, the present disclosure provides a device control method, apparatus, storage medium, and electronic device to coordinately control multiple lenses in the device for shooting.

[0006] According to the first aspect of the embodiments of the present disclosure, a device control method is provided, and the method includes:

[0007] In response to detecting a target operation, start multiple lenses in the lens assembly of the device; the multiple lenses are lenses with different focal lengths, and the lenses with different focal lengths are used to collect images with different field-of-view ranges;

[0008] Obtain the to-be-displayed images collected by the multiple lenses.

[0009] According to the second aspect of the embodiments of the present disclosure, a device control apparatus is provided, and the apparatus includes:

[0010] A start module, configured to start multiple lenses in the lens assembly of the device in response to detecting a target operation; the multiple lenses are lenses with different focal lengths, and the lenses with different focal lengths are used to collect images with different field-of-view ranges;

[0011] An obtain module, configured to obtain the to-be-displayed images collected by the multiple lenses.

[0012] According to a third aspect of the embodiments of the present disclosure, an electronic device is provided, including:

[0013] A processor;

[0014] A memory for storing instructions executable by the processor;

[0015] Wherein, the processor is configured to implement the steps of any of the device control methods in the first aspect by running the executable instructions.

[0016] According to a fourth aspect of the embodiments of the present disclosure, a non-transitory computer-readable storage medium is provided, on which a computer program is stored, and when the program is executed by a processor, the steps of any of the device control methods in the first aspect are implemented.

[0017] The technical solutions provided by the embodiments of the present disclosure may include the following beneficial effects:

[0018] After detecting a target operation, multiple lenses in the lens assembly are activated. Since the focal lengths of the multiple lenses are different, the field of view and image accuracy presented by the images captured by the lenses with different focal lengths are different.

[0019] Therefore, for the part of the image to be displayed that needs to improve the image accuracy (for example, to clearly capture distant text), it can be captured by a lens with a longer focal length (smaller field of view); for the part that needs to expand the field of view, it can be captured by a lens with a shorter focal length (larger field of view). In this way, a balance can be achieved between image acquisition accuracy and image field of view, which helps to avoid problems such as a decrease in image accuracy or poor field of view during the switching process of multiple lenses, and can improve the user experience.

[0020] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The accompanying drawings herein are incorporated into the specification and constitute a part of the specification, showing embodiments consistent with the present disclosure, and are used together with the specification to explain the principles of the present disclosure.

[0022] Figure 1 is a flowchart of a device control method shown according to an exemplary embodiment of the present disclosure;

[0023] Figure 2 is a schematic diagram of a device control method shown according to an exemplary embodiment of the present disclosure;

[0024] Figure 3Schematic diagram of another device control method shown according to an exemplary embodiment of the present disclosure;

[0025] Figure 4 Schematic diagram of another device control method shown according to an exemplary embodiment of the present disclosure;

[0026] Figure 5 Schematic diagram of another device control method shown according to an exemplary embodiment of the present disclosure;

[0027] Figure 6 Flowchart of another device control method shown according to an exemplary embodiment of the present disclosure;

[0028] Figure 7 Schematic diagram of another device control method shown according to an exemplary embodiment of the present disclosure;

[0029] Figure 8a Schematic diagram of another device control method shown according to an exemplary embodiment of the present disclosure;

[0030] Figure 8b Schematic diagram of another device control method shown according to an exemplary embodiment of the present disclosure;

[0031] Figure 8c Schematic diagram of another device control method shown according to an exemplary embodiment of the present disclosure;

[0032] Figure 8d Schematic diagram of another device control method shown according to an exemplary embodiment of the present disclosure;

[0033] Figure 9a Schematic diagram of another device control method shown according to an exemplary embodiment of the present disclosure;

[0034] Figure 9b Schematic diagram of another device control method shown according to an exemplary embodiment of the present disclosure;

[0035] Figure 10 Schematic diagram of the structure of a device control device shown according to an exemplary embodiment of the present disclosure;

[0036] Figure 11 Schematic diagram of the structure of an electronic device shown according to an exemplary embodiment of the present disclosure. Detailed implementation manners

[0037] Exemplary embodiments will be described in detail herein, and examples thereof are shown in the accompanying drawings. When the following description refers to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. On the contrary, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0038] The terms used in the present disclosure are for the purpose of describing particular embodiments only and are not intended to limit the present disclosure. The singular forms "a", "the", and "said" used in the present disclosure and the appended claims are also intended to include the plural forms unless the context clearly dictates otherwise. It should also be understood that the term "and / or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.

[0039] It should be understood that although the terms first, second, third, etc. may be used in the present disclosure to describe various information, such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of the present disclosure, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein may be interpreted as "when" or "while" or "in response to determining".

[0040] The device of the present disclosure refers to a photographing device, and exemplarily, it can be a mobile phone, a tablet computer, a camera, etc. For the sake of easy understanding, hereinafter, it is described by taking the device as a mobile phone as an example.

[0041] Generally speaking, a mobile phone is provided with multiple lenses with different optical parameters. For example, a rear camera assembly arranged on the back of the mobile phone is used to set multiple rear cameras, which usually include: a main camera (generally a standard lens, whose focal length is between that of a wide-angle lens and a telephoto lens to balance the field of view and magnification ability), an ultra-wide-angle lens, a telephoto lens, a macro lens, etc.

[0042] After the user opens the shooting interface, the main camera is usually activated to capture images. The real-time image captured by the main camera will be displayed on the shooting interface so that the user can adjust the appropriate shooting angle and shooting parameters. After finding the ideal composition and settings, the user presses the shooting button to obtain the final photo.

[0043] When the user takes a photo, the following problems often occur:

[0044] If the main camera is used for shooting, the details of distant images cannot be captured, resulting in insufficient image accuracy; if the telephoto lens is used for shooting, a relatively wide field of view cannot be captured, resulting in an incomplete composition. In this case, whether the lens is switched from the main camera to the telephoto lens or from the telephoto lens to the main camera, some requirements cannot be met.

[0045] Based on this, the present disclosure provides a device control method that can activate multiple lenses in a lens assembly. Since the multiple lenses are lenses with different field of view parameters, for parts that require improved image accuracy (such as distant text), they can be captured by a lens with a longer focal length (smaller field of view); for parts that require an expanded field of view, they can be captured by a lens with a shorter focal length (larger field of view). In this way, a balance can be achieved between image acquisition accuracy and image field of view, which helps to avoid problems such as a decrease in image accuracy or poor field of view during the switching of multiple lenses, and can improve the user experience.

[0046] The following is a detailed introduction:

[0047] Figure 1 is a flowchart of a device control method shown according to an exemplary embodiment of the present disclosure. As Figure 1 shown, it includes the following steps:

[0048] Step 101, in response to detecting a target operation, activate multiple lenses in the lens assembly of the device; the multiple lenses are lenses with different focal lengths, and the lenses with different focal lengths are used to capture images with different field of view ranges.

[0049] First, introduce the focal length. The focal length is a parameter that describes the focal length range of a lens and is usually used for zoom lenses. For example, a lens with a focal length of 18 - 55mm means that the lens can be adjusted within the focal length range of 18mm to 55mm. The focal length represents the focal length range that the lens can cover, so it can be understood as a set or generalization of focal lengths.

[0050] Here, the concept of the field of view needs to be introduced. The field of view (abbreviated as FOV) is an important parameter in photography and optics, which describes the maximum angular range of the scene that a lens or optical system can capture. The relationship between the field of view and the focal length is closely reflected in the focal length: the shorter the focal length, the larger the viewing angle of the lens, meaning a wider scene range can be seen; on the contrary, the longer the focal length, the smaller the viewing angle, and the field of view will become narrower. For a zoom lens, adjusting the focal length changes the focal length, which directly affects the field of view range that the lens can capture. For example, when you use a 18 - 55mm lens and switch from the 18mm end to the 55mm end, you will observe the change in the field of view - the originally wide viewing angle will gradually shrink, making the picture become narrower.

[0051] The "Visual Field" refers to the spatial range that the human eye or other visual perception systems can see, which is a concept in medicine and physiology. The "field of view" and the "visual field" can be used interchangeably in some contexts. For the sake of easy understanding, the "field of view" of the lens in this disclosure is also described as the "visual field".

[0052] The lens assembly itself includes several lenses. After detecting a target operation, multiple lenses (more than 2) can be determined from the several lenses. The orientations of the lenses in the same lens assembly can be the same or different. In this disclosure, the scenario where the lens assemblies have the same orientation is mainly introduced. The target operation here can be a lens startup operation, a shooting interface trigger operation, an interface zoom-in or zoom-out operation on the shooting interface, a shooting operation, etc.

[0053] For example, in the rear camera assembly of a mobile phone, multiple lenses may be vertically arranged from top to bottom or horizontally arranged from left to right. In this way, when the user uses the mobile phone to take a picture towards a certain position, these different lenses can capture images at almost the same position. This design helps to achieve the collaborative work between multiple lenses and improve the shooting effect and user experience.

[0054] Figure 2 is a schematic diagram of a device control method shown according to an exemplary embodiment of this disclosure. As Figure 2 shown, the image displayed on the device is captured by one of the lenses (such as lens one) in the lens assembly and its corresponding sensor (such as an image sensor). Figure 3 is a schematic diagram of another device control method shown according to an exemplary embodiment of this disclosure. As Figure 3 shown, the image displayed on the device is captured by another lens (such as lens two) in the lens assembly and its corresponding sensor. The focal length of lens one is different from that of lens two. Therefore, from Figure 2 and Figure 3 it can be seen that the visual field range of lens one is larger than that of lens two, so that Figure 2 the captured image can present a larger visual field range compared with Figure 3 ; however, lens two can capture the details on the distant trees, so that Figure 3 the captured image can provide higher image accuracy compared with Figure 2 .

[0055] Step 102, obtain the to-be-displayed images captured by the multiple lenses.

[0056] After starting lens one and lens two, the visual field range in Figure 2 can be obtained simultaneously, and theFigure 3 Details therein are obtained to acquire the images to be displayed captured by multiple lenses (lens one and lens two). The images to be displayed are as shown in Figure 4 . Among them, the images to be displayed can be obtained by fusing the images captured by multiple lenses, or can be obtained by stitching at least partial images (or image data) captured by multiple lenses respectively.

[0057] In this way, a balance can be achieved between the image acquisition accuracy and the image field of view, which helps to avoid problems such as a decrease in image accuracy or a poor field of view during the switching process of multiple lenses, and can improve the user experience.

[0058] Optionally, when performing step 102 to obtain the images to be displayed captured by the multiple lenses, the following steps are included:

[0059] Stitch at least partial images captured by each lens to obtain the images to be displayed; the difference between the field of view range presented by the images to be displayed and the field of view range of the target lens among the multiple lenses is less than or equal to the first difference, and the target lens is the lens with the smallest focal length among the multiple lenses.

[0060] By determining the target lens with the smallest focal length among the multiple lenses, the field of view range of the images to be displayed can be determined through the field of view range of this target lens, so as to ensure that the field of view range of the images to be displayed is large enough. The first difference is preset, and the smaller the first difference is set, the closer the field of view range of the target lens is to the field of view range presented by the images to be displayed.

[0061] Still using the above example, the field of view range captured by lens one is larger than that captured by lens two. Therefore, the field of view range of lens one is the field of view range of the images to be displayed. Figure 2 The field of view range captured by lens one is larger than that captured by lens two. Therefore, the field of view range of lens one is the field of view range of the images to be displayed. Figure 3 So that images within the field of view range as shown in

[0062] can be acquired, rather than images with a smaller field of view range as shown in Figure 4 . Figure 3 The field of view range of the images to be displayed can be determined through the field of view range of this target lens, so as to ensure that the field of view range of the images to be displayed is large enough. The first difference is preset, and the smaller the first difference is set, the closer the field of view range of the target lens is to the field of view range presented by the images to be displayed.

[0063] Exemplarily, the images to be displayed can be obtained according to the following two methods:

[0064] Method one: Control each lens to separately capture complete images, and then intercept at least partial images from the complete images captured by each lens and stitch them into the images to be displayed.

[0065] Method two: After each lens separately transmits the captured light to the corresponding sensor, obtain the images of the corresponding pixel points from the sensor to obtain a complete image to be displayed. The following is a detailed introduction to method two:

[0066] Figure 5 is a schematic diagram of another device control method shown according to an exemplary embodiment of the present disclosure. As Figure 5 shown, the data of each pixel point in area 501 can be directly obtained from the sensor corresponding to lens two; in the non-overlapping part of area 502 and area 501, the data of each pixel point can be directly obtained from the sensor corresponding to lens one. In this way, it is not necessary to obtain the data of the pixel points in the overlapping part of area 502 and area 501 from the sensor corresponding to lens one, which can greatly reduce the computing amount of the system.

[0067] In this case, Figure 6 is a flowchart of another device control method shown according to an exemplary embodiment of the present disclosure. As Figure 6 shown, method two can be implemented through the following steps:

[0068] Step 601, sort the multiple lenses in descending order of focal length to obtain a first sequence.

[0069] Among them, since the field of view of a lens is inversely proportional to the focal length of the lens, the shorter the focal length of the lens, the larger the field of view. And the focal length of each lens is fixed. In this case, the focal length range can be determined according to the focal length of the lens, and then the field of view can be determined according to the focal length range (here, it may need to be jointly determined in combination with the size of the sensor set for the lens in the device, etc.).

[0070] Therefore, after sorting the lenses in descending order of focal length to obtain the first sequence, the lenses in the first sequence are actually sorted in ascending order of field of view.

[0071] Exemplarily, still taking lens one and lens two in the above example as an example for illustration, the focal length of lens one is less than that of lens two, so that lens two can capture images of distant objects through a larger focal length. According to Figures 2 - 3 it can also be seen that the field of view of lens one is larger than that of lens two. Therefore, the first sequence obtained at this time is:

[0072] Lens two, lens one.

[0073] Step 602, use the image captured by the first lens in the first sequence as the central image.

[0074] At this time, the first lens (lens two) in the first sequence is also the lens with the smallest field of view in the first sequence, and the image captured by the first lens (central image) is also the image in area 501 as shown in Figure 5 . At this time, it is not necessary to crop the image captured by the first lens because:

[0075] The field of view of the first shot is narrower than that of each of the remaining shots in the first sequence (e.g., shot one), and theoretically, the accuracy of each of the remaining shots (e.g., shot one) for the object photographed in area 501 is lower than that of the first shot (at this time, if the image in area 501 is replaced with an image collected by other shots, the accuracy of the image to be displayed will be reduced).

[0076] Therefore, the image captured by the first lens (lens two) can be directly used as the central image, and then the data collected by other lenses (lens one in the first sequence) is used to fill the edge of this central image to expand the field of view of the central image, that is, as Figure 5 shown in the non-overlapping part of area 502 and area 501, and the filling method is executed according to step 603.

[0077] Step 603: For every two adjacent lenses in the first sequence, obtain the edge image collected by the latter lens of the two adjacent lenses; the edge image is the image collected between the field of view of the former lens and the field of view of the latter lens among the two adjacent lenses.

[0078] At this time, the two adjacent lenses in the first sequence are: lens two and lens one.

[0079] Then, the method for determining the edge image is: the image collected from the non-overlapping part of the fields of view of lens one and lens two is used as the edge image (that is, Figure 5 the non-overlapping part of area 501 and area 502 shown).

[0080] At this time, the image of the non-overlapping part of the fields of view of lens one and lens two is directly obtained from the sensor corresponding to the latter lens (lens one) of the two adjacent lenses.

[0081] Step 604: Stitch the central image and the edge image to obtain the image to be displayed.

[0082] After stitching the central image and the edge image, the Figure 5 shown image to be displayed is obtained. In this way, it is not necessary to obtain the data located in area 501 from the sensor of lens one, which can greatly reduce the amount of calculation.

[0083] It should be noted that if the first sequence includes other lenses in addition to lens two and lens one, for example, the first sequence is:

[0084] Lens two, lens one, lens three.

[0085] Figure 7 is a schematic diagram of another device control method shown by the present disclosure according to an exemplary embodiment, asFigure 7 As shown, the viewing range of area 703 is larger, and lens three can capture all the images within area 703. At this time, the edge image further includes: the image of the non-overlapping part of the viewing fields of lens one and lens three obtained from the sensor corresponding to lens three (i.e., the non-overlapping part of area 703 and area 502).

[0086] Optionally, the method further includes the following steps:

[0087] Determine the shooting interface currently displayed on the device based on the target operation; determine the focal length corresponding to the target viewing range based on the target viewing range currently presented on the shooting interface; use the viewing parameter as a preset viewing parameter requirement; at least one of the multiple lenses includes a lens that meets the preset viewing parameter requirement.

[0088] Exemplarily, the shooting interface can be implemented through the following steps:

[0089] In response to detecting an interface trigger operation, display the shooting interface on the device; and / or, in response to an operation instruction for the shooting interface displayed on the device, display the adjusted shooting interface in the shooting interface, where the operation instruction is used to adjust the shooting accuracy and / or the viewing range in the shooting interface.

[0090] It can be seen that the target operation can be an interface trigger operation for the shooting interface. For example, when the user clicks the "Camera" function on the mobile phone, the shooting interface will be automatically entered. At this time, the shooting interface will be displayed on the display interface of the mobile phone. Usually, the shooting interface at this time is the default shooting interface or the shooting interface storing the user's previous personalized settings.

[0091] Usually, the viewing range of the default shooting interface is preset. For example, it is the viewing range of the main camera, and the viewing range of the main camera is simply referred to as the 1x viewing range, where x is the focal length of the main camera.

[0092] After entering the default shooting interface, the user may zoom in or out the current viewing range of the shooting interface according to the shooting requirements, or adjust the shooting accuracy of the shooting interface. There is the following relationship between the shooting accuracy and the shooting viewing range: reducing the field of view (i.e., reducing the viewing angle) can improve the detail resolution and accuracy of the image because the real-world area represented by each pixel becomes smaller, and more details can be captured. This approach is very useful when high-precision identification or measurement of specific targets is required. On the contrary, if the field of view is to be expanded to observe a larger scene or capture multiple targets simultaneously, then the real-world area represented by a single pixel will increase, thereby reducing the detail resolution and accuracy of the image. This is because the same number of pixels need to cover a wider area, and the amount of information contained in each pixel decreases accordingly.

[0093] The following introduces two solutions for adjusting the field of view and / or shooting accuracy of the shooting interface:

[0094] I. Adjust the field of view:

[0095] Figure 8a It is a schematic diagram of another device control method shown according to an exemplary embodiment of the present disclosure. As Figure 8a shown, by adjusting the current 1x field of view (moving two fingers along the two arrows), an enlarged image can be obtained.

[0096] Figure 8b It is a schematic diagram of another device control method shown according to an exemplary embodiment of the present disclosure. The enlarged image is as Figure 8b shown. Assuming that it is a 2x field of view at this time, it should be noted that the range of the 1x field of view is larger than that of the 2x field of view). Among them, 2 is the multiple and x is the focal length, that is, adjusting the 1x focal length to 2x focal length, the field of view is reduced. In fact, the user also puts forward requirements for the image accuracy at this time, and the requirements for the image accuracy become higher.

[0097] The user can also adjust the focal length by double-clicking, single-clicking on the shooting interface, etc., or input the desired focal length through an interactive box, a voice interaction assistant, etc., such as 1.7x.

[0098] At this time, take the enlarged field of view presented by the adjusted shooting interface as the target field of view range, and determine its corresponding focal length range, and take it as the preset parameter requirement.

[0099] At this time, when starting multiple lenses in the lens assembly, at least one lens capable of meeting the preset parameter requirements should be included in the multiple lenses.

[0100] For example, the preset parameter requirement is: a lens (main camera) that meets the 1x field of view. Then the multiple lenses can be: the main camera and a telephoto lens (the focal length range is greater than that of the main camera). In this way, while meeting the field of view of the main camera desired by the user, partial images with richer details (central images) can also be captured through the telephoto lens. Taking Figure 5 as an example, the field of view of the image shown in area 502 is the field of view of the main camera desired by the user, and part of area 501 is captured by the telephoto lens, so a central image with richer details can be obtained.

[0101] II. Adjust the shooting accuracy:

[0102] Assume that the shooting accuracy can be achieved by a telephoto lens (whose field of view is 2x the field of view). At this time, the preset parameter requirement is the focal length of this telephoto lens. At this time, the multiple cameras can be: a wide-angle lens (with a focal length less than that of the telephoto lens), and a telephoto lens. In this way, while meeting the user's requirements for shooting accuracy, the wide-angle lens can supplement the edges of the pictures taken by the telephoto lens, thereby expanding the field of view of the images captured by the telephoto lens.

[0103] The beneficial effects of the above solution are introduced through an exemplary scenario:

[0104] When a user uses a photographing device to photograph a distant landscape, the user usually magnifies the scene through the lens to see it more clearly. At this time, the magnified image will also be synchronously displayed in the viewfinder, which makes the field of view presented in the viewfinder relatively small. A small movement will cause the subject to deviate from the center of the frame. Therefore, the user may need to more precisely align the target to be photographed. In other words, even if the position of the lens is only slightly moved, the position of the taken photo may have an obvious change. Therefore, it is relatively difficult for the user to find and maintain the position of the shooting object in the viewfinder.

[0105] In the present disclosure, when the user adjusts the shooting accuracy, the field of view in the entire picture will not become smaller as the field of view of the lens becomes smaller. The following is an exemplary illustration through Figure 8c and Figure 8d :

[0106] Figure 8c is a schematic diagram of another device control method shown according to an exemplary embodiment of the present disclosure. As Figure 8c shown, when the user touches a tree on the shooting interface, it can be considered that the user wants to improve the shooting accuracy of the data.

[0107] Figure 8d is a schematic diagram of another device control method shown according to an exemplary embodiment of the present disclosure. As Figure 8d shown, since the field of view of the telephoto lens can capture area 801, higher-precision images in area 801 can be obtained through the telephoto lens. In this way, there is no need to magnify in the way of Figures 8a - 8b resulting in a reduction in the field of view in the shooting interface, thus avoiding the problem that a small shake of the mobile phone by the user will cause the tree to be photographed to deviate from the center of the frame. The solution of the present disclosure helps to improve the user's shooting experience.

[0108] At this time, when performing step 101 to start multiple lenses in the lens assembly of the device, the following steps are included:

[0109] Sort the lenses in the lens assembly in ascending order of focal length to obtain a second sequence; determine a first lens in the second sequence that meets the preset parameter requirements; determine at least one second lens adjacent to the first lens in the second sequence; activate the first lens and the second lens in the lens assembly.

[0110] Among them, by sorting the lenses in the lens assembly according to the focal length, a second sequence can be obtained. It can be sorted in ascending order of focal length or in descending order.

[0111] For example, the lens assembly includes three lenses: an ultra-wide-angle lens (e.g., 8mm, 10mm, 14mm, 16mm), a telephoto lens (e.g., 200mm, 300mm, 400mm), and a standard lens (the main camera of the mobile phone, e.g., 45mm, 50mm).

[0112] At this time, the second sequence obtained by sorting in ascending order of focal length is:

[0113] Ultra-wide-angle lens, standard lens, telephoto lens.

[0114] Assume that the lens that meets the preset parameter requirements is the ultra-wide-angle lens. Then the selected first lens is: the ultra-wide-angle lens. The second lens is at least one lens adjacent to the ultra-wide-angle lens, such as: the standard lens.

[0115] At this time, the multiple lenses selected in the lens assembly are: the first lens (ultra-wide-angle lens), the second lens (standard lens).

[0116] Optionally, the method further includes the following steps:

[0117] In response to an operation instruction on the shooting interface displayed on the device, display the adjusted shooting interface in the shooting interface, where the operation instruction is used to adjust the field of view in the shooting interface. When it is determined that the difference between the field of view of the adjusted shooting interface and the field of view of the first lens is less than or equal to a second difference, determine at least one third lens adjacent to the second lens in the second sequence, and the third lens is different from the first lens.

[0118] Exemplarily, assume that the field of view of the ultra-wide-angle lens is 0.5x field of view. After the user operates, the focal length is expanded to 0.7x. At this time, the difference between the 0.7x field of view and the 1x field of view of the standard lens is 0.3x. Assume that the preset second difference is 0.5x (x is the focal length of the main camera, that is, the standard lens). Then since 0.3x is less than 0.5x, other lenses need to be additionally activated. That is: determine at least one third lens adjacent to the second lens.

[0119] At this time, the telephoto lens in the second sequence can be determined as the third lens.

[0120] When starting multiple lenses in the lens assembly of the device in step 101, the following steps are further included: starting the third lens in the lens assembly.

[0121] Through the above method: when the user reduces the field of view from 0.5x to 0.7x, the field of view in the shooting interface will be reduced accordingly. Since the field of view difference between 0.7x and 1x is not large, further enabling the third lens can further improve the image accuracy.

[0122] Optionally, the method further includes the following steps:

[0123] Display the image to be displayed on the display interface of the device; if the images in multiple regions of the image to be displayed are from different lenses, display an identifier for distinguishing different sources in each region.

[0124] Figure 9a It is a schematic diagram of another device control method shown by the present disclosure according to an exemplary embodiment. As Figure 9a shown, the images of 1x and 2x fields of view are from different lenses. Therefore, "1x" and "2x" can be regarded as identifiers for distinguishing different sources. Exemplarily, "1x" can also be replaced with "Lens One", and "2x" can be replaced with "Lens Two".

[0125] Optionally, the method further includes the following steps:

[0126] In response to detecting a trigger operation on any one of the regions, determine the target field of view range of the region; control at least one of the multiple lenses to take a picture to obtain a first image; the total range formed by the field of view ranges of the at least one lens is the same as the target field of view range, and the field of view range of each of the at least one lens is less than or equal to the target field of view range.

[0127] Exemplarily, if the user touches area 801 (such as double-clicking), it can be considered that only the area within the field of view of area 801 is desired to be photographed. At this time, only the lens two corresponding to "2x" can be controlled to take a picture.

[0128] For another example, if the user touches area 901, it can be considered that the user wants to take a picture within the field of view of area 901. At this time, control the lens one and lens two corresponding to "1x" and "2x" to take pictures synchronously to obtain Figure 9a the image to be displayed shown.

[0129] Optionally, the method further includes the following steps:

[0130] In response to detecting a trigger operation on the shooting control, control the multiple lenses to perform shooting to obtain at least one second image; each of the second images is captured by any one or more lenses. In response to determining that the size of the display interface of the device is greater than a specified size, display each of the second images on the display interface; or, in response to determining that the size of the display interface is less than or equal to the specified size, display any one of the second images on the display interface.

[0131] When the user presses the shooting control (which can be a control displayed on the screen or a physical button on the device), shooting can be performed. Since multiple lenses are activated, at this time, at least one second image can be captured by one or more lenses.

[0132] For example, the multiple lenses are 0.5x, 1x, and 2x lenses.

[0133] The second image at least includes: images captured by the 0.5x lens, 1x lens, and 2x lens; it may also include: images captured by the 1x lens and 2x lens, and images captured separately by the 2x lens.

[0134] Among them, the above-mentioned way of obtaining the second image can be obtained by referring to steps 601 - 604.

[0135] Alternatively, the second image may also include: images separately captured by the 0.5x lens, 1x lens, and 2x lens. At this time, the images captured by the 0.5x lens, 1x lens, and 2x lens can be obtained by stitching the lenses that capture images separately for each lens. It should be noted that the way of obtaining these images is different from the way of obtaining images in steps 601 - 604.

[0136] At this time, if the size of the display interface of the device is greater than the specified size (a preset value), each second image can be displayed on the display interface. Especially when there are multiple second images, one of the second images can be displayed on one side of the display interface, and the remaining multiple second images can be displayed on the other side. For example, when the device is a large-screen mobile phone or a foldable mobile phone, when the size of the display interface on the mobile phone screen is greater than the specified size, it can be displayed according to Figure 9b the shown display method for multiple second images.

[0137] If the size of the display interface of the device is less than or equal to the specified size, any one of the second images can be displayed, and then according to the user's operation, the currently displayed second image can be switched.

[0138] For the foregoing method embodiments, for the sake of simple description, they are all expressed as a series of action combinations. However, those skilled in the art should be aware that the present disclosure is not limited by the described action sequence, because according to the present disclosure, certain steps can be performed in other sequences or simultaneously.

[0139] Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily essential to the present disclosure.

[0140] Corresponding to the foregoing method embodiments for implementing application functions, the present disclosure also provides an embodiment of a device control device and a corresponding terminal.

[0141] Figure 10 is a schematic structural diagram of a device control device shown according to an exemplary embodiment of the present disclosure, as Figure 10 shown, the device control device may include:

[0142] A start module 1001, configured to start a plurality of lenses in a lens assembly of a device in response to detecting a target operation; the plurality of lenses are lenses with different focal lengths, and the lenses with different focal lengths are used to collect images with different field of view ranges.

[0143] An acquisition module 1002, configured to acquire a to-be-displayed image collected by the plurality of lenses.

[0144] Optionally, when the acquisition module 1002 is used to acquire a to-be-displayed image collected by the plurality of lenses, it is configured to:

[0145] Stitch at least part of the images collected by each lens to obtain a to-be-displayed image; the difference between the field of view range presented by the to-be-displayed image and the field of view range of a target lens among the plurality of lenses is less than or equal to a first difference, and the target lens is the lens with the smallest focal length among the plurality of lenses.

[0146] Optionally, when the acquisition module 1002 is used to stitch at least part of the images collected by each lens to obtain a to-be-displayed image, it is configured to:

[0147] Sort the plurality of lenses in descending order of focal length to obtain a first sequence.

[0148] Take the image collected by the first lens in the first sequence as the central image.

[0149] For each two adjacent lenses in the first sequence, acquire an edge image collected by the latter lens of the two adjacent lenses; the edge image is an image collected between the field of view range of the former lens and the field of view range of the latter lens among the two adjacent lenses.

[0150] Stitch the central image and the edge image to obtain the image to be displayed.

[0151] Optionally, the device further includes:

[0152] A first determination module, configured to determine the shooting interface currently displayed by the device based on the target operation.

[0153] A second determination module, configured to determine a focal length corresponding to the target field of view range based on the target field of view range currently presented by the shooting interface;

[0154] A parameter setting module, configured to use the focal length as a preset parameter requirement; at least one of the multiple lenses includes a lens that meets the preset parameter requirement.

[0155] Optionally, when the first determination module is used to determine the shooting interface currently displayed by the device based on the target operation, it is configured to:

[0156] In response to detecting an interface trigger operation, display a shooting interface on the device.

[0157] And / or, in response to an operation instruction for the shooting interface displayed by the device, display an adjusted shooting interface in the shooting interface, where the operation instruction is used to adjust the shooting accuracy and / or the field of view range in the shooting interface.

[0158] Optionally, when the startup module 1001 is used to start multiple lenses in the lens assembly of the device, it is configured to:

[0159] Sort the lenses in the lens assembly in ascending order of focal length to obtain a second sequence.

[0160] Determine a first lens in the second sequence that meets the preset parameter requirement.

[0161] Determine at least one second lens adjacent to the first lens in the second sequence.

[0162] Start the first lens and the second lens in the lens assembly.

[0163] Optionally, the device further includes:

[0164] A first response module, configured to, in response to an operation instruction for the shooting interface displayed by the device, display an adjusted shooting interface in the shooting interface, where the operation instruction is used to adjust the field of view range in the shooting interface.

[0165] A third determination module, configured to determine at least one third lens adjacent to the second lens in the second sequence when it is determined that the difference between the field of view of the adjusted shooting interface and the field of view of the first lens is less than or equal to a second difference, where the third lens and the first lens are different lenses;

[0166] When the startup module 1001 is used to start multiple lenses in the lens assembly of the device, it is further used for:

[0167] Start the third lens in the lens assembly.

[0168] Optionally, the device further includes:

[0169] A display module, configured to display the image to be displayed on the display interface of the device.

[0170] An identification module, configured to, if images of multiple regions in the image to be displayed are from different lenses, display an identifier for distinguishing different sources in each region.

[0171] Optionally, the device further includes:

[0172] A second response module, configured to determine the target field of view of the region in response to detecting a trigger operation on any one of the regions.

[0173] A control module, configured to control at least one of the multiple lenses to take a picture to obtain a first image; the total range formed by the fields of view of the at least one lens is the same as the target field of view, and the field of view of each of the at least one lens is less than or equal to the target field of view.

[0174] Optionally, the device further includes:

[0175] A third response module, configured to control the multiple lenses to take pictures to obtain at least one second image in response to detecting a trigger operation on a shooting control; each of the second images is taken by any one or more lenses.

[0176] A fourth response module, configured to display each of the second images on the display interface in response to determining that the size of the display interface of the device is greater than a specified size; or, display any one of the second images on the display interface in response to determining that the size of the display interface is less than or equal to the specified size.

[0177] For the apparatus embodiments, since they basically correspond to the method embodiments, the relevant parts can be referred to the descriptions of the method embodiments. The apparatus embodiments described above are merely illustrative. The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of the present disclosure. A person of ordinary skill in the art can understand and implement it without creative work.

[0178] Correspondingly, embodiments of the present disclosure provide an electronic device, including: a processor; a memory for storing executable instructions of the processor; wherein, the processor is configured to implement the steps of any one of the above device control methods by running the executable instructions.

[0179] Figure 11 FIG. is a schematic structural diagram of an electronic device according to an exemplary embodiment of the present disclosure. For example, the electronic device 1100 may be a user device, and may specifically be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, a wearable device such as a smart watch, smart glasses, a smart bracelet, smart running shoes, etc.

[0180] Refer to Figure 11 , the electronic device 1100 may include one or more of the following components: a processing component 1102, a memory 1104, a power supply component 1106, a multimedia component 1108, an audio component 1110, an input / output (I / O) interface 1112, a sensor component 1114, and a communication component 1116.

[0181] The processing component 1102 generally controls the overall operation of the electronic device 1100, such as operations associated with display, telephone call, data communication, camera operation, and recording operation. The processing component 1102 may include one or more processors 1120 to execute instructions to complete all or part of the steps of the above method. In addition, the processing component 1102 may include one or more modules to facilitate the interaction between the processing component 1102 and other components. For example, the processing component 1102 may include a multimedia module to facilitate the interaction between the multimedia component 1108 and the processing component 1102.

[0182] The memory 1104 is configured to store various types of data to support the operation of the device 1100. Examples of such data include instructions for any application or method operating on the electronic device 1100, contact data, phone book data, messages, pictures, videos, and the like. The memory 1104 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, a magnetic disk, or an optical disk.

[0183] The power supply component 1106 provides power to various components of the electronic device 1100. The power supply component 1106 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the electronic device 1100.

[0184] The multimedia component 1108 includes a screen that provides an output interface between the above-mentioned electronic device 1100 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The above-mentioned touch sensors can not only sense the boundaries of touch or swipe actions but also detect the duration and pressure associated with the above-mentioned touch or swipe operations. In some embodiments, the multimedia component 1108 includes a front camera and / or a rear camera. When the electronic device 1100 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each of the front camera and the rear camera can be a fixed optical lens system or have a focal length and optical zoom capabilities.

[0185] The audio component 1110 is configured to output and / or input audio signals. For example, the audio component 1110 includes a microphone (MIC) that is configured to receive external audio signals when the electronic device 1100 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals can be further stored in the memory 1104 or transmitted via the communication component 1116. In some embodiments, the audio component 1110 further includes a speaker for outputting audio signals.

[0186] The I / O interface 1112 provides an interface between the processing component 1102 and a peripheral interface module, and the above-mentioned peripheral interface module can be a keyboard, a click wheel, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.

[0187] The sensor assembly 1114 includes one or more sensors for providing a status assessment of various aspects for the electronic device 1100. For example, the sensor assembly 1114 can detect the on / off state of the electronic device 1100, the relative positioning of components, such as the display and keypad of the electronic device 1100 mentioned above. The sensor assembly 1114 can also detect a change in the position of the electronic device 1100 or a component of the electronic device 1100, the presence or absence of user contact with the electronic device 1100, the orientation or acceleration / deceleration of the electronic device 1100, and the temperature change of the electronic device 1100. The sensor assembly 1114 can include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 1114 can also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 1114 can also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0188] The communication component 1116 is configured to facilitate communication between the electronic device 1100 and other devices in a wired or wireless manner. The electronic device 1100 can access a wireless network based on communication standards, such as WiFi, 4G or 5G, 4G LTE, 5G NR, or a combination thereof. In an exemplary embodiment, the communication component 1116 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 1116 further includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0189] In an exemplary embodiment, the electronic device 1100 can be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components for performing the above methods.

[0190] In an exemplary embodiment, a non-transitory computer-readable storage medium is also provided, such as a memory 1104 including instructions, which when executed by a processor 1120 of the electronic device 1100, enables the electronic device 1100 to execute a device control method, which is any of the methods described above.

[0191] The non-transitory computer-readable storage medium may be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0192] Those skilled in the art will readily conceive of other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include known common knowledge or conventional technical means in the art not disclosed in the present disclosure. The specification and examples are only to be considered as exemplary, and the true scope and spirit of the present disclosure are pointed out by the following claims.

[0193] It should be understood that the present disclosure is not limited to the exact structures described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present disclosure is only limited by the appended claims.

Claims

1. A device control method, characterized in that, The method includes: In response to detecting a target operation, starting multiple lenses in the lens assembly of the device; the multiple lenses are lenses with different focal lengths, and the lenses with different focal lengths are used to capture images with different field of view ranges; Obtaining a to-be-displayed image captured by the multiple lenses.

2. The method according to claim 1, wherein The obtaining the to-be-displayed image captured by the multiple lenses includes: Stitching at least partial images captured by each lens to obtain the to-be-displayed image; the difference between the field of view range presented by the to-be-displayed image and the field of view range of a target lens among the multiple lenses is less than or equal to a first difference, and the target lens is the lens with the smallest focal length among the multiple lenses.

3. The method according to claim 2, wherein The stitching at least partial images captured by each lens to obtain the to-be-displayed image includes: Sequentially sorting the multiple lenses in descending order of focal length to obtain a first sequence; Taking the image captured by the first lens in the first sequence as a central image; For each two adjacent lenses in the first sequence, obtaining an edge image captured by the latter lens of the two adjacent lenses; the edge image is an image captured between the field of view range of the former lens and the field of view range of the latter lens among the two adjacent lenses; Stitching the central image and the edge image to obtain the to-be-displayed image.

4. The method according to claim 1, wherein The method further includes: Determining the shooting interface currently displayed on the device based on the target operation; Determining a focal length corresponding to the target field of view range based on the target field of view range currently presented on the shooting interface; Taking the focal length as a preset parameter requirement; at least one of the multiple lenses meets the preset parameter requirement.

5. The method according to claim 4, characterized in that, The determining the shooting interface currently displayed on the device based on the target operation includes: In response to detecting an interface trigger operation, displaying a shooting interface on the device; And / or, in response to an operation instruction for the shooting interface displayed on the device, displaying an adjusted shooting interface in the shooting interface, where the operation instruction is used to adjust the shooting accuracy and / or the field of view range in the shooting interface.

6. The method according to claim 4, wherein The starting multiple lenses provided in the lens assembly of the device includes: Sequentially sorting the lenses in the lens assembly in ascending order of focal length to obtain a second sequence; Determining a first lens in the second sequence that meets the preset parameter requirement; Determining at least one second lens adjacent to the first lens in the second sequence; Starting the first lens and the second lens in the lens assembly.

7. The method according to claim 6, characterized in that, The method further includes: In response to an operation instruction for the shooting interface displayed on the device, displaying an adjusted shooting interface in the shooting interface, where the operation instruction is used to adjust the field of view range in the shooting interface; When determining that the difference between the field of view range of the adjusted shooting interface and the field of view range of the first lens is less than or equal to a second difference, determining at least one third lens adjacent to the second lens in the second sequence, and the third lens is different from the first lens; The starting multiple lenses provided in the lens assembly of the device further includes: Starting the third lens in the lens assembly.

8. The method according to any one of claims 1-3, characterized in that, The method further includes: Display the image to be displayed on the display interface of the device; If the images in multiple regions of the image to be displayed are from different lenses, display an identifier for distinguishing different sources in each region.

9. The method according to claim 8, wherein The method further includes: In response to detecting a trigger operation on any one of the regions, determine the target field of view range of the region; Control at least one of the multiple lenses to take a picture to obtain a first image; the total range formed by the field of view ranges of the at least one lens is the same as the target field of view range, and the field of view range of each of the at least one lens is less than or equal to the target field of view range.

10. The method according to claim 8, characterized in that, The method further includes: In response to detecting a trigger operation on a shooting control, control the multiple lenses to take pictures to obtain at least one second image; each of the second images is taken by any one or more lenses; In response to determining that the size of the display interface of the device is greater than a specified size, display each of the second images on the display interface; Alternatively, in response to determining that the size of the display interface is less than or equal to the specified size, display any one of the second images on the display interface.

11. A device control apparatus, characterized in that, The device includes: A startup module, configured to start multiple lenses in a lens assembly of a device in response to detecting a target operation; the multiple lenses are lenses with different focal lengths, and the lenses with different focal lengths are used to collect images with different field of view ranges; An acquisition module, configured to acquire an image to be displayed collected by the multiple lenses.

12. An electronic device, characterized in that, Includes: A processor; A memory for storing instructions executable by the processor; Wherein, the processor is configured to implement the steps of any one of the methods according to claims 1 to 10 by running the executable instructions.

13. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the steps of any one of the methods according to claims 1 to 10.

Images