Viewing frame display method and device for forming viewing frame

Abstract

The invention provides a viewing frame display method and a device for forming a viewing frame, and belongs to the technical field of photography. The viewing frame display method comprises the following steps that S1, a first shooting module obtains a first image; s2, a second shooting module obtains a second image; s3, acquiring a current focusing position corresponding to the first shooting module; s4, acquiring a current viewing frame position corresponding to the first shooting module according to the mapping relation and the current focusing position; and S5, loading or updating the current viewing frame at the corresponding position of the second image. According to the mapping relation between the position of the viewing frame and the focusing position corresponding to the first shooting module and the current focusing position, the current position of the viewing frame corresponding to the first shooting module is obtained, the current viewing frame is loaded on the second image, and the viewing position of the picture of the first shooting module in the picture of the second shooting module can be obtained in real time.

Description

Technical Field

[0001] The present invention relates to the field of photographic technology, and in particular to a method for displaying a framing frame and a device for forming a framing frame. Background Art

[0002] With the development of electronic technology, telephoto cameras are increasingly integrated into electronic devices. However, due to the small imaging field of view of telephoto cameras, it is difficult for users to perceive the current position of the subject when using them, and it is also difficult to know in what direction and distance the device should be moved to move the subject of interest into the imaging field of view of the telephoto, resulting in a time-consuming and laborious process of using the device and a very poor user experience. Summary of the invention

[0003] In order to solve the above problems, the embodiments of the present application provide a method for displaying a framing frame and a device for forming a framing frame.

[0004] In a first aspect, the present application provides a method for displaying a view frame, comprising the following steps: S1: A first shooting module acquires a first image; S2: The second shooting module acquires a second image, and the field of view of the second image covers the field of view of the first image; S3: Obtaining a current focus position corresponding to the first shooting module; S4: Acquire a mapping relationship between a view frame position and a focus position corresponding to the first shooting module, and acquire a current view frame position corresponding to the first shooting module according to the mapping relationship and the current focus position; S5: Load or update the current view frame at the corresponding position of the second image.

[0005] Preferably, an optical axis when the first shooting module acquires the first image and an optical axis when the second shooting module acquires the second image are arranged in parallel.

[0006] Preferably, the optical axis of the first shooting module and the optical axis of the second shooting module are both fixed; or at least one of the optical axis of the first shooting module and the optical axis of the second shooting module is rotatable.

[0007] Preferably, step S3 specifically includes: obtaining a current focus position corresponding to the first shooting module when the first image is clear.

[0008] Preferably, between steps S1 and S3, it also includes: judging the clarity of the first image; if the clarity of the first image is judged to be blurred, the first shooting module focuses, the first shooting module reacquires the first image, and judges the clarity of the reacquired first image until the clarity of the first image is judged to be clear; if the clarity of the first image is judged to be clear, executing subsequent steps in sequence.

[0009] Preferably, determining the clarity of the first image includes: determining the clarity of the first image based on a trained neural network model.

[0010] Preferably, determining the clarity of the first image further comprises: determining the clarity of the first image at first preset time intervals.

[0011] Preferably, judging the clarity of the first image based on the trained neural network model specifically includes: obtaining a detection image from the first image, wherein the detection image is the first image or a local image on the first image; inputting the detection image into the trained neural network model and obtaining a corresponding output value; if the output value does not satisfy a first preset condition, determining that the clarity of the detection image is blurred; if the output value satisfies the first preset condition, determining that the clarity of the detection image is clear; if the clarity of the detection image is determined to be blurred, determining that the clarity of the first image is blurred; if the clarity of the detection image is determined to be clear, determining that the clarity of the first image is clear.

[0012] Preferably, the geometric center of the detection image is the same as the geometric center of the first image.

[0013] Preferably, before step S3, the method further includes: the first shooting module performs autofocus at least once.

[0014] Preferably, the focus position corresponding to the first shooting module is a focus motor position corresponding to the first shooting module.

[0015] Preferably, the current viewfinder position is a pixel position of an image of an overlapping field of view area of ​​the first image and the second image in the second image, and the image of an overlapping field of view area of ​​the first image and the second image is displayed in the current viewfinder.

[0016] Preferably, the current viewfinder position is a pixel position in the second image of a pixel at any preset position in an image of an overlapping field of view area of ​​the first image and the second image.

[0017] In a second aspect, an embodiment of the present application provides a device for forming a viewfinder, comprising a first shooting module, a second shooting module, a focus position acquisition module, a storage module, and a calculation module; The first shooting module is used to acquire a first image; The second shooting module is used to acquire a second image, and the field of view of the second image covers the field of view of the first image; The focus position acquisition module is used to acquire the current focus position corresponding to the first shooting module; The storage module is used to store a mapping relationship between the view frame position and the focus position corresponding to the first shooting module; The calculation module is used to obtain a mapping relationship between a view frame position and a focus position corresponding to the first shooting module from the storage module, and obtain a current view frame position corresponding to the first shooting module according to the mapping relationship and the current focus position; The second image is displayed on a display module and the current view frame is loaded or updated at a position corresponding to the second image.

[0018] Preferably, an optical axis when the first shooting module acquires the first image and an optical axis when the second shooting module acquires the second image are arranged in parallel.

[0019] Preferably, the optical axis of the first shooting module and the optical axis of the second shooting module are both fixed; or at least one of the optical axis of the first shooting module and the optical axis of the second shooting module is rotatable.

[0020] Preferably, the focus position acquisition module is used to acquire the current focus position corresponding to the first shooting module when the first image is clear.

[0021] Preferably, it also includes a discrimination module; The determination module is used to determine the clarity of the first image; The first shooting module is used to adjust the focus and reacquire the first image when the discrimination module determines that the clarity of the first image is blurred; The determination module is used to determine the clarity of the reacquired first image.

[0022] Preferably, the discrimination module discriminates the clarity of the first image based on a trained neural network model.

[0023] Preferably, the determination module determines the clarity of the first image at first preset time intervals.

[0024] Preferably, the discrimination module includes an image acquisition unit, a model processing unit, and an image determination unit; The image acquisition unit is used to acquire a detection image from the first image, where the detection image is the first image or a local image on the first image; The model processing unit is used to input the detection image into the trained neural network model and obtain the corresponding output value; The image determination unit is used to determine that the clarity of the detection image is blurred if the output value does not meet the first preset condition, determine that the clarity of the detection image is clear if the output value meets the first preset condition, if the clarity of the detection image is determined to be blurred, determine that the clarity of the first image is blurred, and if the clarity of the detection image is determined to be clear, determine that the clarity of the first image is clear.

[0025] Preferably, the geometric center of the detection image is the same as the geometric center of the first image.

[0026] Preferably, the first shooting module performs at least one automatic focusing before the focus position acquisition module acquires the current focus position corresponding to the first shooting module.

[0027] Preferably, the focus position corresponding to the first shooting module is a focus motor position corresponding to the first shooting module.

[0028] Preferably, the current viewfinder position is a pixel position of an image of an overlapping field of view area of ​​the first image and the second image in the second image, and the image of an overlapping field of view area of ​​the first image and the second image is displayed in the current viewfinder.

[0029] Preferably, the current viewfinder position is a pixel position in the second image of a pixel at any preset position in an image of an overlapping field of view area of ​​the first image and the second image.

[0030] Preferably, the display module also displays the first image.

[0031] In a third aspect, an embodiment of the present application provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the steps of the method provided in the first aspect or any possible implementation of the first aspect are implemented.

[0032] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the method provided in the first aspect or any possible implementation of the first aspect.

[0033] The beneficial effects of the present invention are: 1. According to the mapping relationship between the view frame position and the focus position corresponding to the first shooting module and the current focus position, the current view frame position corresponding to the first shooting module is obtained, and the current view frame is loaded on the second image, so that the view frame position of the first shooting module image in the second shooting module image can be obtained in real time; 2. It is convenient for users to timely perceive the scene position corresponding to the current first shooting module screen, and can guide users to control the device to quickly move the shooting target of interest into the field of view of the first shooting module. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0035] Figure 1 A schematic diagram of a flow chart of a method for displaying a view frame provided in an embodiment of the present application; Figure 2 A schematic diagram of the structure of a device for forming a framing frame provided in an embodiment of the present application; Figure 3 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application; Figure 4 A schematic diagram of loading a viewfinder in a second image provided by an embodiment of the present application; Figure 5 A schematic diagram of an interface of a display module in a device for forming a viewfinder provided in an embodiment of the present application. DETAILED DESCRIPTION

[0036] The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.

[0037] In the following introduction, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance. The following introduction provides multiple embodiments of the present application, and different embodiments can be replaced or combined, so the present application can also be considered to include all possible combinations of the same and / or different embodiments recorded. Therefore, if one embodiment includes features A, B, and C, and another embodiment includes features B and D, then the present application should also be considered to include embodiments containing one or more of all other possible combinations of A, B, C, and D, although the embodiment may not be clearly recorded in the following text.

[0038] The following description provides examples and does not limit the scope, applicability or examples set forth in the claims. Changes may be made to the functions and arrangements of the elements described without departing from the scope of the present application. Various processes or components may be appropriately omitted, substituted or added to each example. For example, the described method may be performed in an order different from the order described, and various steps may be added, omitted or combined. In addition, features described in some examples may be combined in other examples.

[0039] See also Figure 1 , 4 . Figure 1 is a flow chart of a method for displaying a view frame provided in an embodiment of the present application. Figure 4 A schematic diagram of loading a view frame in a second image provided in an embodiment of the present application. In an embodiment of the present application, the method includes the following steps: S1: A first shooting module acquires a first image; S2: The second shooting module acquires a second image, and the field of view of the second image covers the field of view of the first image; S3: Obtaining a current focus position corresponding to the first shooting module; S4: Acquire a mapping relationship between a view frame position and a focus position corresponding to the first shooting module, and acquire a current view frame position corresponding to the first shooting module according to the mapping relationship and the current focus position; S5: Load or update the current view frame at the corresponding position of the second image.

[0040] In an embodiment of the present application, the current position of the first shooting module screen can be displayed in real time on the second shooting module screen to guide the user to move the electronic device so as to quickly move the object of interest into the imaging field of view of the first shooting module, thereby improving the user experience.

[0041] In the embodiment of the present application, no matter whether the first image acquired by the first shooting module is clear or not, the viewfinder position and the current focus position are mapped in real time.

[0042] In one possible implementation, the optical axis of the first shooting module when acquiring the first image and the optical axis of the second shooting module when acquiring the second image are arranged in parallel.

[0043] In the embodiment of the present application, the image resolution of the first image and the second image may both be 1920 x 1080.

[0044] In the embodiment of the present application, the first shooting module may be a first camera, and the second shooting module may be a second camera. The first shooting module may be a telephoto camera, and the second shooting module may be a wide-angle camera.

[0045] In the embodiment of the present application, the first camera and the second camera are integrated in the same product, and the second camera screen displays the current position of the first camera screen in real time. The product can be a camera with dual cameras, or a telescope with dual cameras, etc. The method is executed by the first camera and the second camera, or it can also be executed by a control unit in the product.

[0046] In one possible implementation, the optical axis of the first shooting module and the optical axis of the second shooting module are both fixed; or at least one of the optical axis of the first shooting module and the optical axis of the second shooting module is rotatable.

[0047] In the embodiment of the present application, the optical axis of the first camera module and the optical axis of the second camera module can be fixed, and the optical axis of the first camera module and the optical axis of the second camera module can be arranged in parallel. At least one of the optical axis of the first camera module and the optical axis of the second camera module can be rotated, and when the first camera module shoots the first image and the second camera module shoots the second image, the optical axis of the first camera module and the optical axis of the second camera module can be adjusted to be arranged in parallel.

[0048] In one possible implementation, step S3 specifically includes: acquiring a current focus position corresponding to the first shooting module when the first image is clear.

[0049] In the embodiment of the present application, the viewfinder is refreshed to a new position only when the first image acquired by the first shooting module is clear.

[0050] In one possible implementation, steps S1 and S3 also include: determining the clarity of the first image; if the clarity of the first image is determined to be blurred, the first shooting module focuses, the first shooting module reacquires the first image, and determines the clarity of the reacquired first image until the clarity of the first image is determined to be clear; if the clarity of the first image is determined to be clear, executing subsequent steps in sequence.

[0051] In an embodiment of the present application, this step can be set between steps S1 and S2, and this step is executed after executing step S1. If the clarity of the first image is judged to be clear, the subsequent steps are executed in sequence, that is, after the clarity of the first image is judged to be clear, steps S2, S3, S4, and S5 are executed in sequence; this step can also be set between steps S2 and S3, and this step is executed after executing steps S1 and S2 in sequence. If the clarity of the first image is judged to be clear, the subsequent steps are executed in sequence, that is, after the clarity of the first image is judged to be clear, steps S3, S4, and S5 are executed in sequence. If the clarity of the first image is determined to be blurred, the first shooting module performs a focusing action, the first shooting module reacquires a first image, and determines the clarity of the reacquired first image. If the clarity of the reacquired first image is determined to be clear, the subsequent steps are performed in sequence. If the clarity of the reacquired first image is determined to be blurred, the first shooting module performs a focusing action again, the first shooting module reacquires another first image, and determines the clarity of the reacquired another first image until the clarity of the first image is determined to be clear. The focusing of the first shooting module can be manual focusing or automatic focusing.

[0052] In one possible implementation, determining the clarity of the first image includes: determining the clarity of the first image based on a trained neural network model.

[0053] In an embodiment of the present application, before determining the clarity of the first image, the neural network model is trained to help improve the efficiency and accuracy of the neural network model in determining the clarity of the first image.

[0054] In one possible implementation, determining the clarity of the first image further includes: determining the clarity of the first image at first preset time intervals.

[0055] In the embodiment of the present application, the clarity of the first image is determined and the view frame is updated at every first preset time interval, which can ensure that the view frame position during the use of the device is consistent with the shooting scene of the first shooting module. The first preset time can be 1 second, and the determination module determines the clarity of the first image every 1 second.

[0056] In one possible implementation, determining the clarity of the first image based on a trained neural network model specifically includes: obtaining a detection image from the first image, wherein the detection image is the first image or a local image on the first image; inputting the detection image into the trained neural network model and obtaining a corresponding output value; if the output value does not satisfy a first preset condition, determining that the clarity of the detection image is blurred; if the output value satisfies the first preset condition, determining that the clarity of the detection image is clear; if the clarity of the detection image is determined to be blurred, determining that the clarity of the first image is blurred; if the clarity of the detection image is determined to be clear, determining that the clarity of the first image is clear.

[0057] In an embodiment of the present application, if the output value does not satisfy the first preset condition, the clarity of the detection image is determined to be blurred. If the output value satisfies the first preset condition, the clarity of the detection image is determined to be clear, which can include two situations: Situation 1, if the output value is less than the first preset value, the clarity of the detection image is determined to be blurred. If the output value is not less than the first preset value, the clarity of the detection image is determined to be clear; Situation 2, if the output value is greater than the first preset value, the clarity of the detection image is determined to be blurred. If the output value is not greater than the first preset value, the clarity of the detection image is determined to be clear.

[0058] In an embodiment of the present application, the image resolution of the first image may be 1920 x 1080, and the detection image may be a local image at the center of the first image with an image resolution of 512 x 512. The first preset value may be 1, and when the output value is less than 1, the clarity of the detection image is determined to be blurred, and when the output value is not less than 1, the clarity of the detection image is determined to be clear. The neural network model may be a convolutional neural network model, and the detection image is input into a trained convolutional neural network model, and the output is 0 or 1. When the output value is 0, the clarity of the detection image is determined to be blurred, and when the output value is 1, the clarity of the detection image is determined to be clear.

[0059] In one possible implementation, the geometric center of the detection image is the same as the geometric center of the first image.

[0060] In one possible implementation, before step S3, the method further includes: the first shooting module performs autofocus at least once.

[0061] In the embodiment of the present application, performing autofocus at least once can ensure that the position of the viewfinder is consistent with the current shooting picture of the first shooting module.

[0062] In one possible implementation, the focus position corresponding to the first shooting module is a focus motor position corresponding to the first shooting module.

[0063] In an embodiment of the present application, the present application first acquires a first image and a second image, then reads the focus motor position corresponding to the first shooting module when the first image is clear, and then maps the focus motor position corresponding to the first shooting module to the viewfinder position on the second image, and then displays the viewfinder on the second image. When the first shooting module moves, it is necessary to re-read the focus motor position of the first shooting module when the first image is clear, re-acquire the viewfinder position, and then update the viewfinder position on the second image. Here, it is known that the field of view range of the second image covers the field of view range of the first image, and the field of view range of the second image covers the field of view range of the first image, which can deduce that the overlapping field of view area of ​​the first image and the second image corresponds to the complete first image.

[0064] In one possible implementation, the current viewfinder position is a pixel position of an overlapping field of view area image of the first image and the second image in the second image, and the overlapping field of view area image of the first image and the second image is displayed in the current viewfinder.

[0065] In the embodiment of the present application, the field of view of the second image covers the field of view of the first image, which means that the scene corresponding to the image of the overlapping field of view area of ​​the second image and the first image is completely consistent with the scene corresponding to the first image. The view frame position refers to the view frame position of the entire first image in the second image. The overlapping field of view area image corresponds to the entire first image.

[0066] In the embodiment of the present application, the viewfinder does not necessarily correspond to the overlapping field of view area image of the first image and the second image, that is, the viewfinder may completely overlap with the overlapping field of view area image of the first image and the second image, may partially overlap, or may not overlap at all.

[0067] In one possible implementation, the current view frame position is a pixel position in the second image of a pixel at any position in an image of an overlapping field of view area of ​​the first image and the second image.

[0068] In the embodiment of the present application, the current viewfinder position may be the pixel coordinates of the upper left corner of the overlapping field of view image of the first image and the second image in the second image; of course, the viewfinder position may also be other positions.

[0069] The method of the present application may also include an embodiment In step S110, a first image is acquired using a first camera; In step S120, a second image is acquired using a second camera, wherein the field of view of the second image covers the field of view of the first image; In this embodiment, in step S110 and step S120, the optical axes of the first camera and the second camera are parallel, and the first image and the second image both have an image resolution of 1920 x 1080; In step S130, the focus motor position corresponding to the first camera when the first image is clear is read; In this embodiment, a trained neural network is used to determine whether the first image is clear; the neural network is a convolutional neural network, whose input is a local image with an image resolution of 512 x 512 at the center of the first image (the geometric center of the local image is consistent with the geometric center of the first image), and its output is 0 or 1, where 0 indicates that the image is blurred and 1 indicates that the image is clear; In step S140, the view frame position is obtained by using the focus motor position corresponding to the first camera obtained in step S140 and the mapping relationship between the focus motor position corresponding to the first camera and the view frame position stored in the memory; In step S150, a viewfinder is loaded on the second image, wherein the viewfinder displays an image of an overlapping field of view area between the first image and the second image; In this embodiment, the view frame position is the pixel coordinates of the top left corner of the image where the first image and the second image overlap in the field of view in the second image; Figure 4 What is shown is a schematic diagram of the second image and the position of the viewfinder loaded in the second image. The position of the viewfinder 203 stored in the memory is the pixel coordinate of its upper left corner vertex 205 in the second image 201.

[0070] The following will be combined with the attached Figure 2 , 4 5, a device for forming a view frame provided in an embodiment of the present application is described in detail. It should be noted that the attached Figure 2 A device for forming a viewfinder is shown, which is used to implement the present application Figure 1 For the convenience of explanation, only the part related to the embodiment of the present application is shown. For the specific technical details not disclosed, please refer to the present application. Figure 1 The embodiment shown.

[0071] See also Figure 2 , 4 , 5, Figure 2 is a schematic diagram of the structure of a device for forming a viewfinder provided in an embodiment of the present application, Figure 4 A schematic diagram of loading a view frame in a second image provided in an embodiment of the present application, Figure 5 This is a schematic diagram of an interface of a display module in a device for forming a view frame provided by an embodiment of the present application. Figure 2 , 4As shown in , 5, the device includes a first shooting module 501, a second shooting module 502, a focus position acquisition module 503, a storage module 504, and a calculation module 505; The first shooting module 501 is used to acquire a first image; The second shooting module 502 is used to obtain a second image, and the field of view of the second image covers the field of view of the first image; The focus position acquisition module 503 is used to acquire the current focus position corresponding to the first shooting module; The storage module 504 is used to store the mapping relationship between the view frame position and the focus position corresponding to the first shooting module; The calculation module 505 is used to obtain a mapping relationship between a view frame position and a focus position corresponding to the first shooting module from the storage module, and obtain a current view frame position corresponding to the first shooting module according to the mapping relationship and the current focus position, wherein the current view frame position is a pixel position of an image of an overlapping field of view area of ​​the first image and the second image in the second image; The second image is displayed on a display module and the current view frame is loaded or updated at a position corresponding to the second image.

[0072] In the embodiment of the present application, the first shooting module 501 may be a first camera, the second shooting module 502 may be a second camera, the storage module 504 may be a memory, and the display module may be a display.

[0073] In the embodiment of the present application, no matter whether the first image acquired by the first shooting module is clear or not, the viewfinder position and the current focus position are mapped in real time.

[0074] In the embodiment of the present application, the field of view of the second image covers the field of view of the first image, which means that the scene corresponding to the image of the overlapping field of view area of ​​the second image and the first image is completely consistent with the scene corresponding to the first image. The view frame position refers to the view frame position of the entire first image in the second image. The overlapping field of view area image corresponds to the entire first image.

[0075] In one possible implementation, the optical axis of the first shooting module 501 when acquiring the first image and the optical axis of the second shooting module 502 when acquiring the second image are arranged in parallel.

[0076] In an embodiment of the present application, the first shooting module 501 may be a telephoto camera, and the second shooting module 502 may be a wide-angle camera. The present application may obtain the framing position of the telephoto camera image in the wide-angle image in real time, so that the user may timely perceive the scene position corresponding to the current telephoto camera image, and may guide the user to control the device to quickly move the shooting target of interest into the telephoto field of view.

[0077] In one possible implementation, the optical axis of the first shooting module 501 and the optical axis of the second shooting module 502 are both fixed; or at least one of the optical axis of the first shooting module 501 and the optical axis of the second shooting module 502 is rotatable.

[0078] In the embodiment of the present application, the optical axis of the first shooting module 501 and the optical axis of the second shooting module 502 can be fixed, and the optical axis of the first shooting module 501 and the optical axis of the second shooting module 502 are ensured to be arranged in parallel. At least one of the optical axis of the first shooting module 501 and the optical axis of the second shooting module 502 can be rotated, and when the first shooting module 501 shoots the first image and the second shooting module 502 shoots the second image, the optical axis of the first shooting module 501 and the optical axis of the second shooting module 502 can be adjusted to be arranged in parallel.

[0079] In one possible implementation, the focus position acquisition module 503 is used to acquire the current focus position corresponding to the first shooting module 501 when the first image is clear.

[0080] In the embodiment of the present application, the viewfinder is refreshed to a new position only when the first image acquired by the first shooting module is clear.

[0081] In one possible implementation, it further includes a determination module 506; The determination module 506 is used to determine the clarity of the first image; The first shooting module 501 is used to adjust the focus and re-acquire the first image when the determination module 506 determines that the clarity of the first image is blurred; The determination module 506 is used to determine the clarity of the re-acquired first image.

[0082] In the embodiment of the present application, if the clarity of the first image is determined to be blurred, the first shooting module 501 performs a focusing action, the first shooting module 501 reacquires a first image, and the discrimination module 506 discriminates the clarity of the reacquired first image. If the clarity of the reacquired first image is determined to be clear, the focus position acquisition module 503 obtains the current focus position corresponding to the first shooting module 501. If the clarity of the reacquired first image is determined to be blurred, the first shooting module 501 performs a focusing action again, the first shooting module 501 reacquires another first image, and the discrimination module 506 discriminates the clarity of the reacquired another first image until the clarity of the first image is determined to be clear. The focusing of the first shooting module 501 can be manual focusing or automatic focusing.

[0083] In one embodiment, the determination module 506 determines the clarity of the first image based on a trained neural network model.

[0084] In an embodiment of the present application, before determining the clarity of the first image, the neural network model is trained to help improve the efficiency and accuracy of the neural network model in determining the clarity of the first image.

[0085] In one possible implementation, the determination module 506 determines the clarity of the first image at first preset time intervals.

[0086] In the embodiment of the present application, whether the first image is clear is determined and the view frame is updated at every first preset time interval, which can ensure that the position of the view frame during use of the device is consistent with the shooting scene of the first shooting module 501.

[0087] In the embodiment of the present application, the first preset time may be 1 second, and the determination module 506 determines the clarity of the first image every 1 second. When the first image is determined to be clear, the focus position acquisition module 503 acquires the current focus position corresponding to the first shooting module 501, and the calculation module 505 acquires the mapping relationship between the viewfinder position and the focus position corresponding to the first shooting module 501 from the storage module 504, and acquires the current viewfinder position corresponding to the first shooting module 501 based on the mapping relationship and the current focus position; at the same time, the display module loads the viewfinder on the second image based on the viewfinder position updated in real time.

[0088] In one possible implementation, the identification module 506 includes an image acquisition unit, a model processing unit, and an image determination unit; The image acquisition unit is used to acquire a detection image from the first image, where the detection image is the first image or a local image on the first image; The model processing unit is used to input the detection image into the trained neural network model and obtain the corresponding output value; The image determination unit is used to determine that the clarity of the detection image is blurred if the output value does not meet the first preset condition, determine that the clarity of the detection image is clear if the output value meets the first preset condition, if the clarity of the detection image is determined to be blurred, determine that the clarity of the first image is blurred, and if the clarity of the detection image is determined to be clear, determine that the clarity of the first image is clear.

[0089] In an embodiment of the present application, if the output value does not satisfy the first preset condition, the clarity of the detection image is determined to be blurred. If the output value satisfies the first preset condition, the clarity of the detection image is determined to be clear, which can include two situations: Situation 1, if the output value is less than the first preset value, the clarity of the detection image is determined to be blurred. If the output value is not less than the first preset value, the clarity of the detection image is determined to be clear; Situation 2, if the output value is greater than the first preset value, the clarity of the detection image is determined to be blurred. If the output value is not greater than the first preset value, the clarity of the detection image is determined to be clear.

[0090] In an embodiment of the present application, the image resolution of the first image may be 1920 x 1080, and the detection image may be a local image at the center of the first image with an image resolution of 512 x 512. The first preset value may be 1, and when the output value is less than 1, the image determination unit determines that the clarity of the detection image is blurred, and when the output value is not less than 1, the image determination unit determines that the clarity of the detection image is clear. The neural network model may be a convolutional neural network model, and the model processing unit inputs the detection image into a trained convolutional neural network model, and the output is 0 or 1. When the output value is 0, the image determination unit determines that the clarity of the detection image is blurred, and when the output value is 1, the image determination unit determines that the clarity of the detection image is clear.

[0091] In one possible implementation, the geometric center of the detection image is the same as the geometric center of the first image.

[0092] In one possible implementation, the first shooting module 501 performs at least one automatic focusing before the focus position acquisition module 503 acquires the current focus position corresponding to the first shooting module 501 .

[0093] In the embodiment of the present application, before the focus position acquisition module 503 acquires the current focus position corresponding to the first shooting module 501, the first shooting module 501 performs at least one auto focus to ensure that the view frame position is consistent with the current shooting picture of the first shooting module.

[0094] In one possible implementation, the focus position corresponding to the first shooting module 501 is a focus motor position corresponding to the first shooting module 501 .

[0095] In one possible implementation, the current viewfinder position is a pixel position of an overlapping field of view area image of the first image and the second image in the second image, and the overlapping field of view area image of the first image and the second image is displayed in the current viewfinder.

[0096] In the embodiment of the present application, the viewfinder does not necessarily correspond to the overlapping field of view area image of the first image and the second image, that is, the viewfinder may completely overlap with the overlapping field of view area image of the first image and the second image, may partially overlap, or may not overlap at all.

[0097] In one possible implementation, the current view frame position is a pixel position in the second image of a pixel at any position in an image of an overlapping field of view area of ​​the first image and the second image.

[0098] In the embodiment of the present application, the current viewfinder position may be the pixel coordinates of the upper left corner of the overlapping field of view image of the first image and the second image in the second image; of course, the viewfinder position may also be other positions.

[0099] In one possible implementation, the display module further displays a first image.

[0100] In the embodiment of the present application, the display module displays the first image and the second image, and loads the current view frame in the second image, and displays the overlapping field of view area image between the first image and the second image in the view frame.

[0101] In the embodiments of the present application, Figure 5 The interface schematic diagram of the display module in this embodiment is shown, the first image is displayed on the interface 405 of the display module, the upper left local area 403 of the interface of the display module displays the second image, 401 is a viewfinder loaded in the second image, and the viewfinder displays the overlapping field of view area image of the first image and the second image. Since the field of view range of the second image covers the field of view range of the first image, the image displayed in the viewfinder corresponds to the same scene as the first image. Here, 403 and 405 are image display areas, which do not represent the actual image size and position. In actual applications, the first camera module 501 can be a telephoto camera, and the second camera module 502 can be a wide-angle camera, and the field of view range of the wide-angle camera covers the field of view range of the telephoto camera. 401 shows the first image after a certain ratio of scaling. The viewfinder can display the current shooting scene of the first shooting module 501 in real time.

[0102] Those skilled in the art can clearly understand that the technical solutions of the embodiments of the present application can be implemented with the help of software and / or hardware. The "unit", "module" and "part" in this specification refer to software and / or hardware that can independently complete or cooperate with other components to complete specific functions, where the hardware can be, for example, a field programmable gate array (FPGA), an integrated circuit (IC), etc.

[0103] Each processing unit and / or module of the embodiments of the present application may be implemented by an analog circuit that implements the functions described in the embodiments of the present application, or may be implemented by software that executes the functions described in the embodiments of the present application.

[0104] See also Figure 3 , which shows a schematic diagram of the structure of an electronic device involved in an embodiment of the present application, the electronic device can be used to implement Figure 1 The method in the embodiment shown. Figure 3 As shown, the electronic device 300 may include: at least one central processor 301 , at least one network interface 304 , a user interface 303 , a memory 305 , and at least one communication bus 302 .

[0105] The communication bus 302 is used to realize the connection and communication between these components.

[0106] The user interface 303 may include a display screen (Display) and a camera (Camera). Optionally, the user interface 303 may also include a standard wired interface and a wireless interface.

[0107] The network interface 304 may optionally include a standard wired interface or a wireless interface (such as a WI-FI interface).

[0108] Among them, the central processing unit 301 may include one or more processing cores. The central processing unit 301 uses various interfaces and lines to connect various parts of the entire electronic device 300, and executes various functions and processes data of the terminal 300 by running or executing instructions, programs, code sets or instruction sets stored in the memory 305, and calling data stored in the memory 305. Optionally, the central processing unit 301 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). The central processing unit 301 can integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU) and a modem. Among them, the CPU mainly processes the operating system, user interface and application programs; the GPU is responsible for rendering and drawing the content to be displayed on the display screen; and the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the central processing unit 301, but implemented separately through a chip.

[0109] Among them, the memory 305 may include a random access memory (Random Access Memory, RAM) and may also include a read-only memory (Read-Only Memory). Optionally, the memory 305 includes a non-transitory computer-readable storage medium. The memory 305 can be used to store instructions, programs, codes, code sets or instruction sets. The memory 305 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc.; the data storage area may store data involved in the above-mentioned various method embodiments, etc. The memory 305 may optionally be at least one storage device located away from the aforementioned central processor 301. As Figure 3 As shown, the memory 305 as a computer storage medium may include an operating system, a network communication module, a user interface module, and program instructions.

[0110] exist Figure 3 In the electronic device 300 shown, the user interface 303 is mainly used to provide an input interface for the user and obtain data input by the user; and the central processor 301 can be used to call an application program of a view frame display method stored in the memory 305, and specifically perform the following operations: S1: A first shooting module acquires a first image; S2: The second shooting module acquires a second image, and the field of view of the second image covers the field of view of the first image; S3: when the clarity of the first image is clear, obtaining a current focus position corresponding to the first shooting module; S4: Acquire a mapping relationship between a view frame position and a focus position corresponding to the first shooting module, and acquire a current view frame position corresponding to the first shooting module according to the mapping relationship and the current focus position, wherein the current view frame position is a pixel position of an image of an overlapping field of view area of ​​the first image and the second image in the second image; S5: Loading a current viewfinder on the second image, wherein the current viewfinder displays an image of an overlapping field of view area of ​​the first image and the second image.

[0111] The present application also provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the steps of the above method are implemented. The computer-readable storage medium may include, but is not limited to, any type of disk, including a floppy disk, an optical disk, a DVD, a CD-ROM, a micro drive, and a magneto-optical disk, a ROM, a RAM, an EPROM, an EEPROM, a DRAM, a VRAM, a flash memory device, a magnetic card or an optical card, a nanosystem (including a molecular memory IC), or any type of medium or device suitable for storing instructions and / or data.

[0112] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described order of actions, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

[0113] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0114] In the several embodiments provided in the present application, it should be understood that the disclosed devices can be implemented in other ways. For example, the device embodiments described above are only schematic, such as the division of the modules or units, which is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some service interfaces, and the indirect coupling or communication connection of the devices or units can be electrical or other forms.

[0115] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0116] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0117] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable memory. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a memory, including a number of instructions to enable a computer device (which can be a personal computer, server or network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned memory includes: U disk, read-only memory (ROM), random access memory (RAM), mobile hard disk, disk or optical disk and other media that can store program codes.

[0118] A person skilled in the art may understand that all or part of the steps in the various methods of the above embodiments may be completed by entering a program to instruct related hardware. The program may be stored in a computer-readable memory, and the memory may include: a flash drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0119] The above is only an exemplary embodiment of the present disclosure, and the scope of the present disclosure cannot be limited thereto. That is, any equivalent changes and modifications made according to the teachings of the present disclosure are still within the scope of the present disclosure. After considering the specification and practicing the disclosure here, those skilled in the art will easily think of the implementation scheme of the present disclosure. This application is intended to cover any modification, use or adaptation of the present disclosure, which follows the general principles of the present disclosure and includes common knowledge or customary technical means in the technical field not recorded in the present disclosure. The description and examples are regarded as exemplary only, and the scope and spirit of the present disclosure are defined by the claims.

Claims

1. A method for displaying a view frame, characterized in that: The steps include: S1: A first shooting module acquires a first image; S2: The second shooting module acquires a second image, and the field of view of the second image covers the field of view of the first image; S3: Obtaining a current focus position corresponding to the first shooting module; S4: Acquire a mapping relationship between a view frame position and a focus position corresponding to the first shooting module, and acquire a current view frame position corresponding to the first shooting module according to the mapping relationship and the current focus position; S5: Load or update the current view frame at the corresponding position of the second image.

2. A method for displaying a view frame according to claim 1, characterized in that: The optical axis of the first shooting module when acquiring the first image and the optical axis of the second shooting module when acquiring the second image are arranged in parallel.

3. A method for displaying a view frame according to claim 2, characterized in that: The optical axis of the first shooting module and the optical axis of the second shooting module are both fixed; or at least one of the optical axis of the first shooting module and the optical axis of the second shooting module is rotatable.

4. A method for displaying a view frame as claimed in claim 1, 2 or 3, characterized in that: Step S3 specifically includes: obtaining a current focus position corresponding to the first shooting module when the first image is clear.

5. A method for displaying a view frame as claimed in claim 4, characterized in that: Between steps S1 and S3, it also includes: judging the clarity of the first image; if the clarity of the first image is judged to be blurred, the first shooting module focuses, the first shooting module reacquires the first image, and judges the clarity of the reacquired first image until the clarity of the first image is judged to be clear; if the clarity of the first image is judged to be clear, executing subsequent steps in sequence.

6. A method for displaying a view frame as claimed in claim 5, characterized in that: Determining the clarity of the first image includes: determining the clarity of the first image based on a trained neural network model.

7. A method for displaying a view frame as claimed in claim 5, characterized in that: Determining the clarity of the first image further includes: determining the clarity of the first image at first preset time intervals.

8. A method for displaying a view frame as claimed in claim 6, characterized in that: Judging the clarity of the first image based on the trained neural network model specifically includes: obtaining a detection image from the first image, wherein the detection image is the first image or a local image on the first image; inputting the detection image into the trained neural network model and obtaining a corresponding output value; if the output value does not meet the first preset condition, judging that the clarity of the detection image is blurred; if the output value meets the first preset condition, judging that the clarity of the detection image is clear; if the clarity of the detection image is judged to be blurred, judging that the clarity of the first image is blurred; if the clarity of the detection image is judged to be clear, judging that the clarity of the first image is clear.

9. A method for displaying a view frame as claimed in claim 8, characterized in that: The geometric center of the detection image is the same as the geometric center of the first image.

10. A method for displaying a view frame as claimed in claim 1, 2 or 3, characterized in that: Before step S3, the method also includes: the first shooting module performs autofocus at least once.

11. A method for displaying a view frame according to claim 1, 2 or 3, characterized in that: The focus position corresponding to the first shooting module is the focus motor position corresponding to the first shooting module.

12. A method for displaying a view frame as claimed in claim 1, 2 or 3, characterized in that: The current viewfinder position is the pixel position of the overlapping field of view area image of the first image and the second image in the second image, and the overlapping field of view area image of the first image and the second image is displayed in the current viewfinder.

13. A method for displaying a view frame according to claim 12, characterized in that: The current viewfinder position is the pixel position of a pixel at any position in the overlapping field of view area image of the first image and the second image in the second image.

14. A device for forming a view frame, characterized in that: It includes a first shooting module, a second shooting module, a focus position acquisition module, a storage module, and a calculation module; The first shooting module is used to acquire a first image; The second shooting module is used to acquire a second image, and the field of view of the second image covers the field of view of the first image; The focus position acquisition module is used to acquire the current focus position corresponding to the first shooting module; The storage module is used to store a mapping relationship between the view frame position and the focus position corresponding to the first shooting module; The calculation module is used to obtain a mapping relationship between a view frame position and a focus position corresponding to the first shooting module from the storage module, and obtain a current view frame position corresponding to the first shooting module according to the mapping relationship and the current focus position; The second image is displayed on a display module and the current view frame is loaded or updated at a position corresponding to the second image.

15. The device for forming a view frame according to claim 14, characterized in that: The optical axis of the first shooting module when acquiring the first image and the optical axis of the second shooting module when acquiring the second image are arranged in parallel.

16. The device for forming a view frame according to claim 14, characterized in that: The optical axis of the first shooting module and the optical axis of the second shooting module are both fixed; or at least one of the optical axis of the first shooting module and the optical axis of the second shooting module is rotatable.

17. A device for forming a view frame as claimed in claim 14, 15 or 16, characterized in that: The focus position acquisition module is used to acquire the current focus position corresponding to the first shooting module when the first image is clear.

18. The device for forming a view frame according to claim 17, characterized in that: It also includes a discrimination module; The determination module is used to determine the clarity of the first image; The first shooting module is used to adjust the focus and reacquire the first image when the discrimination module determines that the clarity of the first image is blurred; The determination module is used to determine the clarity of the reacquired first image.

19. The device for forming a view frame according to claim 18, characterized in that: The discrimination module discriminates the clarity of the first image based on a trained neural network model.

20. The device for forming a view frame according to claim 18, characterized in that: The determination module determines the clarity of the first image at a first preset time interval.

21. The device for forming a view frame according to claim 18, characterized in that: The discrimination module includes an image acquisition unit, a model processing unit, and an image determination unit; The image acquisition unit is used to acquire a detection image from the first image, where the detection image is the first image or a local image on the first image; The model processing unit is used to input the detection image into the trained neural network model and obtain the corresponding output value; The image determination unit is used to determine that the clarity of the detection image is blurred if the output value does not meet the first preset condition, determine that the clarity of the detection image is clear if the output value meets the first preset condition, if the clarity of the detection image is determined to be blurred, determine that the clarity of the first image is blurred, and if the clarity of the detection image is determined to be clear, determine that the clarity of the first image is clear.

22. The device for forming a view frame according to claim 21, characterized in that: The geometric center of the detection image is the same as the geometric center of the first image.

23. The device for forming a view frame according to claim 14, 15 or 16, characterized in that: The first shooting module performs at least one automatic focusing before the focus position acquisition module acquires the current focus position corresponding to the first shooting module.

24. The device for forming a view frame according to claim 14, 15 or 16, characterized in that: The focus position corresponding to the first shooting module is the focus motor position corresponding to the first shooting module.

25. The device for forming a view frame according to claim 14, 15 or 16, characterized in that: The current viewfinder position is the pixel position of the overlapping field of view area image of the first image and the second image in the second image, and the overlapping field of view area image of the first image and the second image is displayed in the current viewfinder.

26. The device for forming a view frame according to claim 25, characterized in that: The current viewfinder position is the pixel position of a pixel at any position in the overlapping field of view area image of the first image and the second image in the second image.

27. A device for forming a view frame as claimed in claim 14, 15 or 16, characterized in that: The display module also displays a first image.

28. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 13 are implemented.

29. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 13 are implemented.

Images